############################################
Text Generation - HuggingFace
############################################

This is a supervised text generation algorithm which supports many pre-trained models available in Hugging Face. The following
`sample notebook <https://github.com/aws/amazon-sagemaker-examples/blob/main/introduction_to_amazon_algorithms/jumpstart_text_generation/Amazon_JumpStart_Text_Generation.ipynb>`__
demonstrates how to use the Sagemaker Python SDK for Text Generation for using these algorithms.

For detailed documentation please refer :ref:`Use Built-in Algorithms with Pre-trained Models in SageMaker Python SDK <built-in-algos>`

.. list-table:: Available Models
   :widths: 50 20 20 20 20
   :header-rows: 1
   :class: datatable

   * - Model ID
     - Fine Tunable?
     - Latest Version
     - Min SDK Version
     - Source
   * - huggingface-textgeneration-bloom-1b1
     - False
     - 2.4.2
     - 2.189.0
     - `HuggingFace <https://huggingface.co/bigscience/bloom-1b1>`__
   * - huggingface-textgeneration-bloom-1b7
     - False
     - 2.4.1
     - 2.189.0
     - `HuggingFace <https://huggingface.co/bigscience/bloom-1b7>`__
   * - huggingface-textgeneration-bloom-560m
     - False
     - 2.3.14
     - 2.189.0
     - `HuggingFace <https://huggingface.co/bigscience/bloom-560m>`__
   * - huggingface-textgeneration-bloomz-1b1
     - False
     - 2.4.1
     - 2.189.0
     - `HuggingFace <https://huggingface.co/bigscience/bloomz-1b1>`__
   * - huggingface-textgeneration-bloomz-1b7
     - False
     - 2.4.2
     - 2.189.0
     - `HuggingFace <https://huggingface.co/bigscience/bloomz-1b7>`__
   * - huggingface-textgeneration-bloomz-560m
     - False
     - 2.3.1
     - 2.189.0
     - `HuggingFace <https://huggingface.co/bigscience/bloomz-560m>`__
   * - huggingface-textgeneration-distilgpt2
     - False
     - 3.0.14
     - 2.189.0
     - `HuggingFace <https://huggingface.co/distilbert/distilgpt2>`__
   * - huggingface-textgeneration-dolly-v2-12b-bf16
     - False
     - 2.3.3
     - 2.189.0
     - `HuggingFace <https://huggingface.co/databricks/dolly-v2-12b>`__
   * - huggingface-textgeneration-dolly-v2-3b-bf16
     - False
     - 2.4.2
     - 2.189.0
     - `HuggingFace <https://huggingface.co/databricks/dolly-v2-3b>`__
   * - huggingface-textgeneration-dolly-v2-7b-bf16
     - False
     - 2.2.19
     - 2.189.0
     - `HuggingFace <https://huggingface.co/databricks/dolly-v2-7b>`__
   * - huggingface-textgeneration-falcon-40b-bf16
     - False
     - 1.1.10
     - 2.189.0
     - `HuggingFace <https://huggingface.co/tiiuae/falcon-40b>`__
   * - huggingface-textgeneration-falcon-40b-instruct-bf16
     - False
     - 1.1.10
     - 2.189.0
     - `HuggingFace <https://huggingface.co/tiiuae/falcon-40b-instruct>`__
   * - huggingface-textgeneration-falcon-7b-bf16
     - False
     - 1.1.10
     - 2.189.0
     - `HuggingFace <https://huggingface.co/tiiuae/falcon-7b>`__
   * - huggingface-textgeneration-falcon-7b-instruct-bf16
     - False
     - 1.1.10
     - 2.189.0
     - `HuggingFace <https://huggingface.co/tiiuae/falcon-7b-instruct>`__
   * - huggingface-textgeneration-gpt2
     - False
     - 3.1.2
     - 2.189.0
     - `HuggingFace <https://huggingface.co/openai-community/gpt2>`__
   * - huggingface-textgeneration-gpt2-large
     - False
     - 1.0.13
     - 2.189.0
     - `HuggingFace <https://huggingface.co/openai-community/gpt2-large>`__
   * - huggingface-textgeneration-gpt2-medium
     - False
     - 1.0.13
     - 2.189.0
     - `HuggingFace <https://huggingface.co/openai-community/gpt2-medium>`__
   * - huggingface-textgeneration-models
     - False
     - 1.4.10
     - 2.189.0
     - `HuggingFace <https://huggingface.co/models?pipeline_tag=text-generation&sort=downloads>`__
   * - huggingface-textgeneration-olmo-3-7b-instruct
     - False
     - 1.0.2
     - 2.237.1
     - `HuggingFace <https://huggingface.co/allenai/Olmo-3-7B-Instruct>`__
   * - huggingface-textgeneration-open-llama
     - False
     - 3.3.1
     - 2.189.0
     - `HuggingFace <https://huggingface.co/openlm-research/open_llama_7b>`__
   * - huggingface-textgeneration-openai-gpt
     - False
     - 1.0.13
     - 2.189.0
     - `HuggingFace <https://huggingface.co/openai-community/openai-gpt>`__
   * - meta-textgeneration-llama-2-7b
     - True
     - 5.1.0
     - 2.237.1
     - `HuggingFace <https://huggingface.co/meta-llama/Llama-2-7b-hf>`__
   * - meta-textgeneration-llama-3-1-70b-instruct
     - True
     - 3.1.0
     - 2.237.1
     - `HuggingFace <https://huggingface.co/meta-llama/Llama-3.1-70B-Instruct>`__
   * - meta-textgeneration-llama-3-1-8b-instruct
     - True
     - 3.10.0
     - 2.237.1
     - `HuggingFace <https://huggingface.co/meta-llama/Llama-3.1-8B-Instruct>`__
   * - meta-textgeneration-llama-3-2-1b
     - True
     - 2.0.0
     - 2.237.1
     - `HuggingFace <https://huggingface.co/meta-llama/Llama-3.2-1B>`__
   * - meta-textgeneration-llama-3-2-1b-instruct
     - True
     - 2.9.0
     - 2.237.1
     - `HuggingFace <https://huggingface.co/meta-llama/Llama-3.2-1B-Instruct>`__
   * - meta-textgeneration-llama-3-2-3b
     - True
     - 2.0.0
     - 2.237.1
     - `HuggingFace <https://huggingface.co/meta-llama/Llama-3.2-3B>`__
   * - meta-textgeneration-llama-3-2-3b-instruct
     - True
     - 2.9.0
     - 2.237.1
     - `HuggingFace <https://huggingface.co/meta-llama/Llama-3.2-3B-Instruct>`__
   * - meta-textgeneration-llama-3-8b
     - True
     - 3.1.0
     - 2.237.1
     - `HuggingFace <https://huggingface.co/meta-llama/Meta-Llama-3-8B>`__
   * - meta-textgeneration-llama-guard-3-1b
     - False
     - 2.2.0
     - 2.237.1
     - `HuggingFace <https://huggingface.co/meta-llama/Llama-Guard-3-1B>`__
   * - meta-textgeneration-llama-guard-3-8b
     - False
     - 2.2.0
     - 2.237.1
     - `HuggingFace <https://huggingface.co/meta-llama/Llama-Guard-3-8B>`__