Text generation

Family-owned implementations of the text generation task interface.

See the related Hugging Face task page for the ecosystem-level task definition.

Model families

Model family	Declared recipes	Exact checkpoint examples	Runtime CLI
`bart`	2	`facebook/bart-base`	`trtmc run`
`bloom`	2	`bigscience/bloom-560m`	`trtmc run`
`codegen`	2	`Salesforce/codegen-350M-mono`	`trtmc run`
`deepseek_v2`	4	`deepseek-ai/DeepSeek-V2-Lite` `katuni4ka/tiny-random-deepseek-v3`	`trtmc run`
`elf_flow`	3	`embedded-language-flows/ELF-B-de-en` `embedded-language-flows/ELF-B-owt` `embedded-language-flows/ELF-B-xsum`	`trtmc run`
`falcon`	2	`tiiuae/falcon-rw-1b`	`trtmc run`
`gemma`	7	`google/gemma-2-2b-it` `google/gemma-3-12b-it` `google/gemma-3-1b-it` `google/gemma-3-270m-it` `google/gemma-3-27b-it` `google/gemma-3-4b-it`	`trtmc run`
`glm`	3	`THUDM/glm-4-9b-hf`	`trtmc run`
`gpt_neo`	2	`EleutherAI/gpt-neo-125m`	`trtmc run`
`gpt_neox`	2	`EleutherAI/pythia-70m`	`trtmc run`
`gpt_oss`	3	`openai/gpt-oss-20b`	`trtmc run`
`gpt2`	3	`distilbert/distilgpt2` `openai-community/gpt2`	`trtmc run`
`granite`	2	`ibm-granite/granite-3.1-2b-base`	`trtmc run`
`hunyuan`	3	`tencent/HY-MT1.5-7B` `tencent/Hy-MT2-1.8B` `tencent/Hy-MT2-7B`	`trtmc run`
`internlm`	2	`internlm/internlm2-math-plus-1_8b`	`trtmc run`
`k2_horizon`	1	`IFM/K2-Horizon-7B`	`trtmc run`
`k2_horizon_uno`	1	`IFM/K2-Horizon-7B-Uno`	`trtmc run`
`lfm2`	5	`LiquidAI/LFM2-1.2B` `LiquidAI/LFM2-2.6B` `LiquidAI/LFM2-350M` `LiquidAI/LFM2-700M`	`trtmc run`
`lfm3`	2	`LiquidAI/LFM3-1.7B`	`trtmc run`
`llama`	10	`TinyLlama/TinyLlama-1.1B-Chat-v1.0` `nvidia/Llama-3.1-8B-Instruct-FP8` `nvidia/Llama-3.1-8B-Instruct-NVFP4` `nvidia/Llama-3.1-Minitron-4B-Depth-Base` `nvidia/Llama-3.1-Minitron-4B-Width-Base` `nvidia/Llama-3.1-Nemotron-Nano-4B-v1.1` `openbmb/MiniCPM5-2B` `tiiuae/Falcon3-1B-Base`	`trtmc run`
`m2m_100`	1	`facebook/nllb-200-distilled-600M`	`trtmc run`
`mamba`	2	`state-spaces/mamba-130m-hf`	`trtmc run`
`marian`	2	`Helsinki-NLP/opus-mt-en-ru`	`trtmc run`
`mistral`	3	`mistralai/Mistral-7B-Instruct-v0.1` `nvidia/Riva-Translate-4B-Instruct-v1.1`	`trtmc run`
`mixtral`	2	`ggml-org/stories15M_MOE`	`trtmc run`
`muse_glimmer`	1	`RadixArk/Muse-Glimmer-NVFP4`	`trtmc run`
`nemotron`	2	`nvidia/Nemotron-4-Mini-Hindi-4B-Base` `nvidia/Nemotron-Mini-4B-Instruct`	`trtmc run`
`nemotron_h`	4	`nvidia/NVIDIA-Nemotron-Nano-9B-v2` `nvidia/NVIDIA-Nemotron-Nano-9B-v2-FP8` `nvidia/NVIDIA-Nemotron-Nano-9B-v2-NVFP4`	`trtmc run`
`nemotron_labs_diffusion`	3	`nvidia/Nemotron-Labs-Diffusion-8B`	`trtmc run`
`olmo`	2	`allenai/OLMo-1B-hf`	`trtmc run`
`olmo2`	2	`allenai/OLMo-2-0425-1B`	`trtmc run`
`opt`	2	`facebook/opt-125m`	`trtmc run`
`phi`	2	`microsoft/Phi-3-mini-4k-instruct`	`trtmc run`
`phi_moe`	3	`microsoft/Phi-tiny-MoE-instruct`	`trtmc run`
`qwen`	11	`Qwen/Qwen3-0.6B` `Qwen/Qwen3-4B-Instruct-2507` `superwhisper/s1-mini`	`trtmc run`
`qwen_moe`	3	`Qwen/Qwen3-30B-A3B` `amd-quark/tiny-random-qwen3_moe`	`trtmc run`
`qwen3_5`	6	`AxionML/Qwen3.5-9B-NVFP4` `Qwen/Qwen3.5-0.8B` `Qwen/Qwen3.5-2B` `Qwen/Qwen3.5-4B` `Qwen/Qwen3.5-9B`	`trtmc run`
`qwen3_8`	4	`Qwen/Qwen3.6-27B` `Qwen/Qwen3.8-27B` `nvidia/Qwen3.8-27B-NVFP4`	`trtmc run`
`qwen3_omni`	1	`Qwen/Qwen3-Omni-30B-A3B-Instruct`	`trtmc run`
`rwkv`	2	`RWKV/rwkv-4-169m-pile`	`trtmc run`
`smollm3`	1	`HuggingFaceTB/SmolLM3-3B`	`trtmc run`
`stablelm`	2	`stabilityai/stablelm-2-1_6b`	`trtmc run`
`starcoder2`	2	`bigcode/starcoder2-3b`	`trtmc run`
`t5`	2	`google-t5/t5-small`	`trtmc run`
`xglm`	2	`facebook/xglm-564M`	`trtmc run`