Text Generation - HuggingFace

This is a supervised text generation algorithm which supports many pre-trained models available in Hugging Face. The following sample notebook demonstrates how to use the Sagemaker Python SDK for Text Generation for using these algorithms.

For detailed documentation please refer Use Built-in Algorithms with Pre-trained Models in SageMaker Python SDK

Available Models

Model ID

Fine Tunable?

Latest Version

Min SDK Version

Source

huggingface-textgeneration-bloom-1b1

False

2.1.0

2.189.0

HuggingFace

huggingface-textgeneration-bloom-1b7

False

2.1.0

2.189.0

HuggingFace

huggingface-textgeneration-bloom-560m

False

2.1.0

2.189.0

HuggingFace

huggingface-textgeneration-bloomz-1b1

False

2.1.0

2.189.0

HuggingFace

huggingface-textgeneration-bloomz-1b7

False

2.1.0

2.189.0

HuggingFace

huggingface-textgeneration-bloomz-560m

False

2.1.0

2.189.0

HuggingFace

huggingface-textgeneration-distilgpt2

False

2.1.0

2.189.0

HuggingFace

huggingface-textgeneration-dolly-v2-12b-bf16

False

2.1.0

2.189.0

HuggingFace

huggingface-textgeneration-dolly-v2-3b-bf16

False

2.1.0

2.189.0

HuggingFace

huggingface-textgeneration-dolly-v2-7b-bf16

False

2.1.0

2.189.0

HuggingFace

huggingface-textgeneration-falcon-40b-bf16

False

1.0.0

2.144.0

HuggingFace

huggingface-textgeneration-falcon-40b-instruct-bf16

False

1.0.0

2.144.0

HuggingFace

huggingface-textgeneration-falcon-7b-bf16

False

1.0.0

2.144.0

HuggingFace

huggingface-textgeneration-falcon-7b-instruct-bf16

False

1.0.0

2.144.0

HuggingFace

huggingface-textgeneration-gpt2

False

2.1.0

2.189.0

HuggingFace

huggingface-textgeneration-models

False

1.3.0

2.144.0

HuggingFace

huggingface-textgeneration-open-llama

False

3.1.0

2.189.0

HuggingFace