Supported Models
Support is defined by files that live inside one self-contained
families/<family>/ directory. Each row below points to that family's own
E2E manifest; there is no central model registry or duplicated support matrix.
- 99 self-contained family modules under
families/. - 238 family-owned E2E manifests under
families/*/tests/manifests/. - Every runtime DSO implements an abstract task interface directly.
Declared recipes
An entry means the repository contains a builder, a native runtime DSO that implements an abstract Task API, and a family-owned test recipe for that exact checkpoint. It is not a promise that an unlisted fine-tune is compatible.
A manifest with hf_id names its Hugging Face source. A manifest without
hf_id intentionally represents a family-owned prepared local checkpoint; the
inventory labels it as such instead of inventing Hugging Face metadata.
| Checkpoint | Family | Task interface | Build | Owned manifest |
|---|---|---|---|---|
suno/bark | bark | audio_generation | fp32; Single device | families/bark/tests/manifests/bark-large.json |
suno/bark | bark | audio_generation | fp32; TP4 | families/bark/tests/manifests/bark-large-tp4.json |
suno/bark-small | bark | audio_generation | fp16; Single device | families/bark/tests/manifests/bark-small.json |
suno/bark-small | bark | audio_generation | fp32; Single device | families/bark/tests/manifests/bark-small-fp32-l0.json |
suno/bark-small | bark | audio_generation | fp32; TP4 | families/bark/tests/manifests/bark-small-tp4.json |
nvidia/magpie_tts_multilingual_357m | magpie_tts | audio_generation | fp32; Single device | families/magpie_tts/tests/manifests/magpie-tts-357m.json |
nvidia/magpie_tts_multilingual_357m | magpie_tts | audio_generation | fp32; TP4 | families/magpie_tts/tests/manifests/magpie-tts-357m-tp4.json |
timm/densenet121.ra_in1k | timm_densenet | classification | fp16; Single device | families/timm_densenet/tests/manifests/densenet121-ra-in1k.json |
timm/efficientnet_b0.ra_in1k | timm_efficientnet | classification | fp16; Single device | families/timm_efficientnet/tests/manifests/efficientnet-b0-ra-in1k.json |
timm/inception_v3.tv_in1k | timm_inception | classification | fp16; Single device | families/timm_inception/tests/manifests/inception-v3-tv-in1k.json |
timm/mnasnet_100.rmsp_in1k | timm_mnasnet | classification | fp16; Single device | families/timm_mnasnet/tests/manifests/mnasnet-100-rmsp-in1k.json |
timm/mobilenetv2_100.ra_in1k | timm_mobilenetv2 | classification | fp16; Single device | families/timm_mobilenetv2/tests/manifests/mobilenetv2-100-ra-in1k.json |
timm/mobilenetv3_large_100.ra_in1k | timm_mobilenetv3 | classification | fp16; Single device | families/timm_mobilenetv3/tests/manifests/mobilenetv3-large-100-ra-in1k.json |
timm/repvgg_a2.rvgg_in1k | timm_repvgg | classification | fp16; Single device | families/timm_repvgg/tests/manifests/repvgg-a2-rvgg-in1k.json |
timm/resnet50.a1_in1k | timm_resnet | classification | fp16; Single device | families/timm_resnet/tests/manifests/resnet50-a1-in1k.json |
timm/vgg16.tv_in1k | timm_vgg | classification | fp16; Single device | families/timm_vgg/tests/manifests/vgg16-tv-in1k.json |
timm/vit_base_patch16_224.augreg_in21k_ft_in1k | timm_vit | classification | fp16; Single device | families/timm_vit/tests/manifests/timm-vit-base-p16-224-augreg-in21k-ft-in1k.json |
timm/vit_base_patch16_224.augreg_in21k_ft_in1k | timm_vit | classification | fp32; TP4 | families/timm_vit/tests/manifests/timm-vit-base-p16-224-augreg-in21k-ft-in1k-tp4.json |
sentence-transformers/all-MiniLM-L6-v2 | bert | embedding | fp16; Single device | families/bert/tests/manifests/all-minilm-l6-v2.json |
intfloat/multilingual-e5-small | bert | embedding | fp16; Single device | families/bert/tests/manifests/multilingual-e5-small.json |
nvidia/llama-nemotron-embed-vl-1b-v2 | eagle_vlm | embedding | fp16; Single device | families/eagle_vlm/tests/manifests/nemotron-embed-vl-1b-v2.json |
nvidia/llama-nemotron-embed-vl-1b-v2 | eagle_vlm | embedding | fp32; TP4 | families/eagle_vlm/tests/manifests/nemotron-embed-vl-1b-v2-tp4.json |
albert/albert-base-v2 | albert | encoding | fp16; Single device | families/albert/tests/manifests/albert-base.json |
albert/albert-base-v2 | albert | encoding | fp32; TP4 | families/albert/tests/manifests/albert-base-tp4.json |
google-bert/bert-base-uncased | bert | encoding | fp16; Single device | families/bert/tests/manifests/bert-base-uncased.json |
google-bert/bert-base-uncased | bert | encoding | fp32; TP4 | families/bert/tests/manifests/bert-base-uncased-tp4.json |
BAAI/bge-small-en-v1.5 | bert | encoding | fp16; Single device | families/bert/tests/manifests/bge-small-en-v1.5.json |
sentence-transformers/paraphrase-multilingual-MiniLM-L12-v2 | bert | encoding | fp16; Single device | families/bert/tests/manifests/paraphrase-multilingual-minilm-l12-v2.json |
YituTech/conv-bert-base | convbert | encoding | fp16; Single device | families/convbert/tests/manifests/convbert-base.json |
YituTech/conv-bert-base | convbert | encoding | fp32; TP2 | families/convbert/tests/manifests/convbert-base-tp2.json |
microsoft/deberta-base | deberta | encoding | fp16; Single device | families/deberta/tests/manifests/deberta-base.json |
microsoft/deberta-base | deberta | encoding | fp32; TP4 | families/deberta/tests/manifests/deberta-base-tp4.json |
distilbert/distilbert-base-uncased | distilbert | encoding | fp16; Single device | families/distilbert/tests/manifests/distilbert-base-uncased.json |
distilbert/distilbert-base-uncased | distilbert | encoding | fp32; TP4 | families/distilbert/tests/manifests/distilbert-base-uncased-tp4.json |
facebook/dpr-ctx_encoder-single-nq-base | dpr | encoding | fp16; Single device | families/dpr/tests/manifests/dpr-ctx-encoder.json |
facebook/dpr-ctx_encoder-single-nq-base | dpr | encoding | fp32; TP4 | families/dpr/tests/manifests/dpr-ctx-encoder-tp4.json |
google/electra-base-discriminator | electra | encoding | fp16; Single device | families/electra/tests/manifests/electra-base-discriminator.json |
google/electra-base-discriminator | electra | encoding | fp32; TP4 | families/electra/tests/manifests/electra-base-discriminator-tp4.json |
google/fnet-base | fnet | encoding | fp16; Single device | families/fnet/tests/manifests/fnet-base.json |
google/fnet-base | fnet | encoding | fp32; TP4 | families/fnet/tests/manifests/fnet-base-tp4.json |
answerdotai/ModernBERT-base | modernbert | encoding | fp32; Single device | families/modernbert/tests/manifests/modernbert-base.json |
answerdotai/ModernBERT-base | modernbert | encoding | fp32; TP4 | families/modernbert/tests/manifests/modernbert-base-tp4.json |
sentence-transformers/all-mpnet-base-v2 | mpnet | encoding | fp16; Single device | families/mpnet/tests/manifests/all-mpnet-base-v2.json |
sentence-transformers/all-mpnet-base-v2 | mpnet | encoding | fp32; TP4 | families/mpnet/tests/manifests/all-mpnet-base-v2-tp4.json |
almanach/camembert-base | roberta | encoding | fp16; Single device | families/roberta/tests/manifests/camembert-base.json |
almanach/camembert-base | roberta | encoding | fp32; TP4 | families/roberta/tests/manifests/camembert-base-tp4.json |
FacebookAI/roberta-base | roberta | encoding | fp16; Single device | families/roberta/tests/manifests/roberta-base.json |
FacebookAI/roberta-base | roberta | encoding | fp32; TP4 | families/roberta/tests/manifests/roberta-base-tp4.json |
FacebookAI/roberta-large | roberta | encoding | fp16; Single device | families/roberta/tests/manifests/roberta-large.json |
FacebookAI/roberta-large | roberta | encoding | fp32; TP4 | families/roberta/tests/manifests/roberta-large-tp4.json |
FacebookAI/xlm-roberta-base | roberta | encoding | fp16; Single device | families/roberta/tests/manifests/xlm-roberta-base.json |
FacebookAI/xlm-roberta-base | roberta | encoding | fp32; TP4 | families/roberta/tests/manifests/xlm-roberta-base-tp4.json |
xlnet/xlnet-base-cased | xlnet | encoding | fp16; Single device | families/xlnet/tests/manifests/xlnet-base.json |
xlnet/xlnet-base-cased | xlnet | encoding | fp32; TP4 | families/xlnet/tests/manifests/xlnet-base-tp4.json |
Qwen/Qwen-Image-Edit-2511 | qwen_image | image_edit | bf16; Single device | families/qwen_image/tests/manifests/qwen-image-edit-2511.json |
facebook/dinov3-convnext-tiny-pretrain-lvd1689m | dinov3 | image_features | fp16; Single device | families/dinov3/tests/manifests/dinov3-convnext-tiny-pretrain-lvd1689m.json |
facebook/dinov3-vits16-pretrain-lvd1689m | dinov3 | image_features | fp16; Single device | families/dinov3/tests/manifests/dinov3-vits16-pretrain-lvd1689m.json |
timm/vit_small_patch16_dinov3_qkvb.lvd1689m | dinov3 | image_features | fp16; Single device | families/dinov3/tests/manifests/dinov3-vits16-timm-l0.json |
nvidia/Cosmos3-Nano | cosmos3 | image_generation | bf16; Single device | families/cosmos3/tests/manifests/cosmos3-nano-l0.json |
nvidia/Cosmos3-Nano | cosmos3 | image_generation | bf16; CP2 | families/cosmos3/tests/manifests/cosmos3-nano-l0-cp2.json |
black-forest-labs/FLUX.2-dev | flux | image_generation | bf16; Single device | families/flux/tests/manifests/flux-2-dev.json |
black-forest-labs/FLUX.2-dev | flux | image_generation | fp16; Single device | families/flux/tests/manifests/flux-2-dev-fp8.json |
black-forest-labs/FLUX.2-dev | flux | image_generation | fp16; Single device | families/flux/tests/manifests/flux-2-dev-fp8-l0.json |
black-forest-labs/FLUX.2-dev | flux | image_generation | fp16; TP4 | families/flux/tests/manifests/flux-2-dev-fp8-l0-tp4.json |
black-forest-labs/FLUX.2-dev | flux | image_generation | bf16; Single device | families/flux/tests/manifests/flux-2-dev-l0.json |
black-forest-labs/FLUX.2-dev | flux | image_generation | fp16; TP4 | families/flux/tests/manifests/flux-2-dev-l0-tp4.json |
black-forest-labs/FLUX.1-schnell | flux | image_generation | fp16; Single device | families/flux/tests/manifests/flux-schnell.json |
black-forest-labs/FLUX.1-schnell | flux | image_generation | fp16; Single device | families/flux/tests/manifests/flux-schnell-l0.json |
black-forest-labs/FLUX.1-schnell | flux | image_generation | fp32; CP4 | families/flux/tests/manifests/flux-schnell-l0-cp4.json |
black-forest-labs/FLUX.1-schnell | flux | image_generation | fp32; TP4 | families/flux/tests/manifests/flux-schnell-l0-tp4.json |
Lightricks/LTX-Video | ltx_video | image_generation | fp16; Single device | families/ltx_video/tests/manifests/ltx-video-l0.json |
MiniMaxAI/MiniMax-H3 | minimax_h3 | image_generation | bf16; Single device | families/minimax_h3/tests/manifests/minimax-h3-768p.json |
PixArt-alpha/PixArt-Sigma-XL-2-1024-MS | pixart | image_generation | fp16; Single device | families/pixart/tests/manifests/pixart-sigma-1024.json |
PixArt-alpha/PixArt-Sigma-XL-2-1024-MS | pixart | image_generation | fp16; Single device | families/pixart/tests/manifests/pixart-sigma-1024-l0.json |
PixArt-alpha/PixArt-Sigma-XL-2-1024-MS | pixart | image_generation | fp32; TP4 | families/pixart/tests/manifests/pixart-sigma-1024-tp4.json |
Qwen/Qwen-Image | qwen_image | image_generation | bf16; Single device | families/qwen_image/tests/manifests/qwen-image.json |
Qwen/Qwen-Image-2512 | qwen_image | image_generation | bf16; Single device | families/qwen_image/tests/manifests/qwen-image-2512.json |
Qwen/Qwen-Image | qwen_image | image_generation | bf16; Single device | families/qwen_image/tests/manifests/qwen-image-l0.json |
Wan-AI/Wan2.1-T2V-1.3B-Diffusers | wan_t2v | image_generation | fp16; Single device | families/wan_t2v/tests/manifests/wan21-t2v-1.3b.json |
Wan-AI/Wan2.1-T2V-1.3B-Diffusers | wan_t2v | image_generation | fp16; Single device | families/wan_t2v/tests/manifests/wan21-t2v-1.3b-l0.json |
Wan-AI/Wan2.1-T2V-1.3B-Diffusers | wan_t2v | image_generation | fp16; CP4 | families/wan_t2v/tests/manifests/wan21-t2v-1.3b-l0-cp4.json |
Wan-AI/Wan2.1-T2V-1.3B-Diffusers | wan_t2v | image_generation | fp32; TP4 | families/wan_t2v/tests/manifests/wan21-t2v-1.3b-l0-tp4.json |
Wan-AI/Wan2.2-TI2V-5B | wan2_2_ti2v | image_generation | bf16; Single device | families/wan2_2_ti2v/tests/manifests/wan22-ti2v-5b.json |
Wan-AI/Wan2.2-TI2V-5B | wan2_2_ti2v | image_generation | bf16; Single device | families/wan2_2_ti2v/tests/manifests/wan22-ti2v-5b-l0.json |
Tongyi-MAI/Z-Image-Turbo | z_image | image_generation | fp16; Single device | families/z_image/tests/manifests/z-image-turbo.json |
Tongyi-MAI/Z-Image-Turbo | z_image | image_generation | fp16; Single device | families/z_image/tests/manifests/z-image-turbo-l0.json |
Tongyi-MAI/Z-Image-Turbo | z_image | image_generation | fp32; TP2 | families/z_image/tests/manifests/z-image-turbo-l0-tp2.json |
black-forest-labs/FLUX.1-schnell | flux | image_generation_batch | fp16; Single device | families/flux/tests/manifests/flux-schnell-l0-batch2.json |
Ruicheng/moge-2-vitl | moge | monocular_geometry | fp32; Single device | families/moge/tests/manifests/moge-2-vitl.json |
prepared local checkpoint | foundationpose | pose_hypothesis_refinement | fp16; Single device | families/foundationpose/tests/manifests/foundationpose-ngc-1.0.1.json |
facebook/sam-vit-base | sam | prompted_segmentation | fp16; Single device | families/sam/tests/manifests/sam-vit-base.json |
facebook/sam-vit-base | sam | prompted_segmentation | fp32; TP4 | families/sam/tests/manifests/sam-vit-base-tp4.json |
nvidia/llama-nemotron-rerank-vl-1b-v2 | eagle_vlm | reranking | fp16; Single device | families/eagle_vlm/tests/manifests/nemotron-rerank-vl-1b-v2.json |
nvidia/llama-nemotron-rerank-vl-1b-v2 | eagle_vlm | reranking | fp32; TP4 | families/eagle_vlm/tests/manifests/nemotron-rerank-vl-1b-v2-tp4.json |
lerobot/act_aloha_sim_transfer_cube_human | lerobot_act | robot_control | fp32; Single device | families/lerobot_act/tests/manifests/act-aloha-sim-transfer-cube.json |
nvidia/segformer-b0-finetuned-ade-512-512 | segformer | segmentation | fp16; Single device | families/segformer/tests/manifests/segformer-b0-ade.json |
nvidia/segformer-b0-finetuned-ade-512-512 | segformer | segmentation | fp32; TP4 | families/segformer/tests/manifests/segformer-b0-ade-tp4.json |
nvidia/NVIDIA-NemotronLabs-VoiceChat-11B | nemotron_voicechat | speech_session | fp32; Single device | families/nemotron_voicechat/tests/manifests/nemotron-voicechat-11b.json |
nvidia/personaplex-7b-v1 | personaplex | speech_to_speech | fp16; Single device | families/personaplex/tests/manifests/personaplex-7b.json |
nvidia/personaplex-7b-v1 | personaplex | speech_to_speech | fp16; Single device | families/personaplex/tests/manifests/personaplex-7b-l0.json |
nvidia/personaplex-7b-v1 | personaplex | speech_to_speech | fp32; TP4 | families/personaplex/tests/manifests/personaplex-7b-l0-tp4.json |
nvidia/c-fast-foundationstereo | fast_foundation_stereo | stereo_disparity | fp16; Single device | families/fast_foundation_stereo/tests/manifests/fast-foundation-stereo.json |
facebook/bart-base | bart | text_generation | fp16; Single device | families/bart/tests/manifests/bart-base.json |
facebook/bart-base | bart | text_generation | fp32; TP4 | families/bart/tests/manifests/bart-base-tp4.json |
bigscience/bloom-560m | bloom | text_generation | fp32; Single device | families/bloom/tests/manifests/bloom-560m.json |
bigscience/bloom-560m | bloom | text_generation | fp32; TP4 | families/bloom/tests/manifests/bloom-560m-tp4.json |
Salesforce/codegen-350M-mono | codegen | text_generation | fp16; Single device | families/codegen/tests/manifests/codegen-350m.json |
Salesforce/codegen-350M-mono | codegen | text_generation | fp32; TP4 | families/codegen/tests/manifests/codegen-350m-tp4.json |
deepseek-ai/DeepSeek-V2-Lite | deepseek_v2 | text_generation | fp16; Single device | families/deepseek_v2/tests/manifests/deepseek-v2-lite.json |
deepseek-ai/DeepSeek-V2-Lite | deepseek_v2 | text_generation | fp32; TP4 | families/deepseek_v2/tests/manifests/deepseek-v2-lite-tp4.json |
katuni4ka/tiny-random-deepseek-v3 | deepseek_v2 | text_generation | fp16; Single device | families/deepseek_v2/tests/manifests/deepseek-v2-tiny.json |
katuni4ka/tiny-random-deepseek-v3 | deepseek_v2 | text_generation | fp32; TP2 | families/deepseek_v2/tests/manifests/deepseek-v2-tiny-tp2.json |
embedded-language-flows/ELF-B-de-en | elf_flow | text_generation | fp16; Single device | families/elf_flow/tests/manifests/elf-b-de-en-l0.json |
embedded-language-flows/ELF-B-owt | elf_flow | text_generation | fp32; Single device | families/elf_flow/tests/manifests/elf-b-owt-l0.json |
embedded-language-flows/ELF-B-xsum | elf_flow | text_generation | fp16; Single device | families/elf_flow/tests/manifests/elf-b-xsum-l0.json |
tiiuae/falcon-rw-1b | falcon | text_generation | fp16; Single device | families/falcon/tests/manifests/falcon-rw-1b.json |
tiiuae/falcon-rw-1b | falcon | text_generation | fp32; TP4 | families/falcon/tests/manifests/falcon-rw-1b-tp4.json |
google/gemma-2-2b-it | gemma | text_generation | fp16; Single device | families/gemma/tests/manifests/gemma-2-2b.json |
google/gemma-2-2b-it | gemma | text_generation | fp32; TP4 | families/gemma/tests/manifests/gemma-2-2b-tp4.json |
THUDM/glm-4-9b-hf | glm | text_generation | fp16; Single device | families/glm/tests/manifests/glm-4-9b.json |
THUDM/glm-4-9b-hf | glm | text_generation | fp16; Single device | families/glm/tests/manifests/glm-4-9b-l0.json |
THUDM/glm-4-9b-hf | glm | text_generation | fp32; TP2 | families/glm/tests/manifests/glm-4-9b-l0-tp2.json |
EleutherAI/gpt-neo-125m | gpt_neo | text_generation | fp16; Single device | families/gpt_neo/tests/manifests/gpt-neo-125m.json |
EleutherAI/gpt-neo-125m | gpt_neo | text_generation | fp32; TP4 | families/gpt_neo/tests/manifests/gpt-neo-125m-tp4.json |
EleutherAI/pythia-70m | gpt_neox | text_generation | fp32; Single device | families/gpt_neox/tests/manifests/pythia-70m.json |
EleutherAI/pythia-70m | gpt_neox | text_generation | fp32; TP4 | families/gpt_neox/tests/manifests/pythia-70m-tp4.json |
openai/gpt-oss-20b | gpt_oss | text_generation | fp16; Single device | families/gpt_oss/tests/manifests/gpt-oss-20b.json |
openai/gpt-oss-20b | gpt_oss | text_generation | fp16; Single device | families/gpt_oss/tests/manifests/gpt-oss-20b-l0.json |
openai/gpt-oss-20b | gpt_oss | text_generation | fp32; TP4 | families/gpt_oss/tests/manifests/gpt-oss-20b-l0-tp4.json |
distilbert/distilgpt2 | gpt2 | text_generation | fp16; Single device | families/gpt2/tests/manifests/distilgpt2.json |
openai-community/gpt2 | gpt2 | text_generation | fp32; Single device | families/gpt2/tests/manifests/gpt2-125m.json |
openai-community/gpt2 | gpt2 | text_generation | fp32; TP4 | families/gpt2/tests/manifests/gpt2-125m-tp4.json |
ibm-granite/granite-3.1-2b-base | granite | text_generation | fp16; Single device | families/granite/tests/manifests/granite-3.1-2b.json |
ibm-granite/granite-3.1-2b-base | granite | text_generation | fp32; TP4 | families/granite/tests/manifests/granite-3.1-2b-tp4.json |
internlm/internlm2-math-plus-1_8b | internlm | text_generation | fp16; Single device | families/internlm/tests/manifests/internlm2-1.8b.json |
internlm/internlm2-math-plus-1_8b | internlm | text_generation | fp32; TP4 | families/internlm/tests/manifests/internlm2-1.8b-tp4.json |
IFM/K2-Horizon-7B | k2_horizon | text_generation | bf16; Single device | families/k2_horizon/tests/manifests/k2-horizon-7b.json |
LiquidAI/LFM2-1.2B | lfm2 | text_generation | fp16; Single device | families/lfm2/tests/manifests/lfm2-1.2b.json |
LiquidAI/LFM2-2.6B | lfm2 | text_generation | fp16; Single device | families/lfm2/tests/manifests/lfm2-2.6b.json |
LiquidAI/LFM2-350M | lfm2 | text_generation | bf16; Single device | families/lfm2/tests/manifests/lfm2-350m-bf16-model-card.json |
LiquidAI/LFM2-350M | lfm2 | text_generation | fp16; Single device | families/lfm2/tests/manifests/lfm2-350m-fp16.json |
LiquidAI/LFM2-700M | lfm2 | text_generation | fp16; Single device | families/lfm2/tests/manifests/lfm2-700m.json |
tiiuae/Falcon3-1B-Base | llama | text_generation | fp16; Single device | families/llama/tests/manifests/falcon3-1b.json |
nvidia/Llama-3.1-Minitron-4B-Depth-Base | llama | text_generation | fp16; Single device | families/llama/tests/manifests/minitron-4b-depth.json |
nvidia/Llama-3.1-Minitron-4B-Width-Base | llama | text_generation | fp16; Single device | families/llama/tests/manifests/minitron-4b-width.json |
nvidia/Llama-3.1-Minitron-4B-Width-Base | llama | text_generation | fp16; Single device | families/llama/tests/manifests/minitron-4b-width-l0.json |
nvidia/Llama-3.1-Minitron-4B-Width-Base | llama | text_generation | bf16; Single device | families/llama/tests/manifests/minitron-4b-width-regression-native-kv-chunked-prefill.json |
nvidia/Llama-3.1-Nemotron-Nano-4B-v1.1 | llama | text_generation | fp16; Single device | families/llama/tests/manifests/nemotron-nano-4b.json |
TinyLlama/TinyLlama-1.1B-Chat-v1.0 | llama | text_generation | fp16; Single device | families/llama/tests/manifests/tinyllama-1.1b.json |
facebook/nllb-200-distilled-600M | m2m_100 | text_generation | fp16; Single device | families/m2m_100/tests/manifests/nllb-200.json |
state-spaces/mamba-130m-hf | mamba | text_generation | fp32; Single device | families/mamba/tests/manifests/mamba-130m.json |
state-spaces/mamba-130m-hf | mamba | text_generation | fp32; TP4 | families/mamba/tests/manifests/mamba-130m-tp4.json |
Helsinki-NLP/opus-mt-en-ru | marian | text_generation | fp16; Single device | families/marian/tests/manifests/marian-en-ru.json |
Helsinki-NLP/opus-mt-en-ru | marian | text_generation | fp32; TP4 | families/marian/tests/manifests/marian-en-ru-tp4.json |
mistralai/Mistral-7B-Instruct-v0.1 | mistral | text_generation | fp16; Single device | families/mistral/tests/manifests/mistral-7b.json |
mistralai/Mistral-7B-Instruct-v0.1 | mistral | text_generation | fp16; Single device | families/mistral/tests/manifests/mistral-7b-l0.json |
nvidia/Riva-Translate-4B-Instruct-v1.1 | mistral | text_generation | fp16; Single device | families/mistral/tests/manifests/riva-translate-4b.json |
ggml-org/stories15M_MOE | mixtral | text_generation | fp16; Single device | families/mixtral/tests/manifests/mixtral-stories-15m.json |
ggml-org/stories15M_MOE | mixtral | text_generation | fp32; TP2 | families/mixtral/tests/manifests/mixtral-stories-15m-tp2.json |
nvidia/Nemotron-4-Mini-Hindi-4B-Base | nemotron | text_generation | bf16; Single device | families/nemotron/tests/manifests/nemotron-hindi-4b.json |
nvidia/Nemotron-Mini-4B-Instruct | nemotron | text_generation | fp16; Single device | families/nemotron/tests/manifests/nemotron-mini-4b.json |
nvidia/NVIDIA-Nemotron-Nano-9B-v2 | nemotron_h | text_generation | fp16; Single device | families/nemotron_h/tests/manifests/nemotron-h-nano-9b.json |
nvidia/NVIDIA-Nemotron-Nano-9B-v2 | nemotron_h | text_generation | fp32; TP4 | families/nemotron_h/tests/manifests/nemotron-h-nano-9b-tp4.json |
nvidia/Nemotron-Labs-Diffusion-8B | nemotron_labs_diffusion | text_generation | bf16; Single device | families/nemotron_labs_diffusion/tests/manifests/nemotron-labs-diffusion-8b.json |
nvidia/Nemotron-Labs-Diffusion-8B | nemotron_labs_diffusion | text_generation | bf16; Single device | families/nemotron_labs_diffusion/tests/manifests/nemotron-labs-diffusion-8b-l0.json |
allenai/OLMo-1B-hf | olmo | text_generation | fp16; Single device | families/olmo/tests/manifests/olmo-1b.json |
allenai/OLMo-1B-hf | olmo | text_generation | fp32; TP4 | families/olmo/tests/manifests/olmo-1b-tp4.json |
allenai/OLMo-2-0425-1B | olmo2 | text_generation | fp32; Single device | families/olmo2/tests/manifests/olmo2-1b.json |
allenai/OLMo-2-0425-1B | olmo2 | text_generation | fp32; TP4 | families/olmo2/tests/manifests/olmo2-1b-tp4.json |
facebook/opt-125m | opt | text_generation | fp16; Single device | families/opt/tests/manifests/opt-125m.json |
facebook/opt-125m | opt | text_generation | fp32; TP4 | families/opt/tests/manifests/opt-125m-tp4.json |
microsoft/Phi-3-mini-4k-instruct | phi | text_generation | fp16; Single device | families/phi/tests/manifests/phi3-mini.json |
microsoft/Phi-3-mini-4k-instruct | phi | text_generation | fp32; TP4 | families/phi/tests/manifests/phi3-mini-tp4.json |
microsoft/Phi-tiny-MoE-instruct | phi_moe | text_generation | fp16; Single device | families/phi_moe/tests/manifests/phi-moe.json |
microsoft/Phi-tiny-MoE-instruct | phi_moe | text_generation | fp16; Single device | families/phi_moe/tests/manifests/phi-moe-l0.json |
microsoft/Phi-tiny-MoE-instruct | phi_moe | text_generation | fp32; TP4 | families/phi_moe/tests/manifests/phi-moe-l0-tp4.json |
Qwen/Qwen3-0.6B | qwen | text_generation | fp16; Single device | families/qwen/tests/manifests/qwen3-0.6b-fp16.json |
Qwen/Qwen3-0.6B | qwen | text_generation | fp16; TP4 | families/qwen/tests/manifests/qwen3-0.6b-fp16-tp4.json |
Qwen/Qwen3-0.6B | qwen | text_generation | fp16; Single device | families/qwen/tests/manifests/qwen3-0.6b-fp8.json |
Qwen/Qwen3-0.6B | qwen | text_generation | bf16; TP4 | families/qwen/tests/manifests/qwen3-0.6b-fp8-tp4.json |
Qwen/Qwen3-0.6B | qwen | text_generation | bf16; Single device | families/qwen/tests/manifests/qwen3-0.6b-native-l0.json |
Qwen/Qwen3-0.6B | qwen | text_generation | bf16; Single device | families/qwen/tests/manifests/qwen3-0.6b-regression-native-kv-chunked-prefill.json |
Qwen/Qwen3-0.6B | qwen | text_generation | fp16; Single device | families/qwen/tests/manifests/qwen3-0.6b-topp.json |
Qwen/Qwen3-0.6B | qwen | text_generation | fp16; TP4 | families/qwen/tests/manifests/qwen3-0.6b-topp-tp4.json |
Qwen/Qwen3-4B-Instruct-2507 | qwen | text_generation | fp16; Single device | families/qwen/tests/manifests/qwen3-4b-instruct-2507.json |
Qwen/Qwen3-4B-Instruct-2507 | qwen | text_generation | fp16; TP4 | families/qwen/tests/manifests/qwen3-4b-instruct-2507-tp4.json |
Qwen/Qwen3-30B-A3B | qwen_moe | text_generation | fp16; Single device | families/qwen_moe/tests/manifests/qwen3-moe-30b-a3b.json |
Qwen/Qwen3-30B-A3B | qwen_moe | text_generation | fp16; TP4 | families/qwen_moe/tests/manifests/qwen3-moe-30b-a3b-tp4.json |
amd-quark/tiny-random-qwen3_moe | qwen_moe | text_generation | fp16; Single device | families/qwen_moe/tests/manifests/qwen3-moe-tiny-random.json |
Qwen/Qwen3.5-9B | qwen3_5 | text_generation | fp16; Single device | families/qwen3_5/tests/manifests/qwen35-9b.json |
Qwen/Qwen3.8-27B | qwen3_8 | text_generation | fp16; Single device | families/qwen3_8/tests/manifests/qwen38-27b.json |
Qwen/Qwen3-Omni-30B-A3B-Instruct | qwen3_omni | text_generation | bf16; Single device | families/qwen3_omni/tests/manifests/qwen3-omni-30b-a3b-instruct.json |
RWKV/rwkv-4-169m-pile | rwkv | text_generation | fp32; Single device | families/rwkv/tests/manifests/rwkv-169m.json |
RWKV/rwkv-4-169m-pile | rwkv | text_generation | fp32; TP4 | families/rwkv/tests/manifests/rwkv-169m-tp4.json |
stabilityai/stablelm-2-1_6b | stablelm | text_generation | fp16; Single device | families/stablelm/tests/manifests/stablelm2-1.6b.json |
stabilityai/stablelm-2-1_6b | stablelm | text_generation | fp32; TP4 | families/stablelm/tests/manifests/stablelm2-1.6b-tp4.json |
bigcode/starcoder2-3b | starcoder2 | text_generation | fp16; Single device | families/starcoder2/tests/manifests/starcoder2-3b.json |
bigcode/starcoder2-3b | starcoder2 | text_generation | fp32; TP2 | families/starcoder2/tests/manifests/starcoder2-3b-tp2.json |
google-t5/t5-small | t5 | text_generation | fp16; Single device | families/t5/tests/manifests/t5-small.json |
google-t5/t5-small | t5 | text_generation | fp32; TP4 | families/t5/tests/manifests/t5-small-tp4.json |
facebook/xglm-564M | xglm | text_generation | fp16; Single device | families/xglm/tests/manifests/xglm-564m.json |
facebook/xglm-564M | xglm | text_generation | fp32; TP4 | families/xglm/tests/manifests/xglm-564m-tp4.json |
facebook/sam3 | sam3 | text_prompted_segmentation | fp32; Single device | families/sam3/tests/manifests/sam3.json |
amazon/chronos-bolt-tiny | chronos_bolt | time_series_forecast | fp32; Single device | families/chronos_bolt/tests/manifests/chronos-bolt-tiny-official.json |
amazon/chronos-bolt-tiny | chronos_bolt | time_series_forecast | fp32; TP4 | families/chronos_bolt/tests/manifests/chronos-bolt-tiny-official-tp4.json |
ibm-granite/granite-timeseries-patchtsmixer | patchtsmixer | time_series_forecast | fp16; Single device | families/patchtsmixer/tests/manifests/patchtsmixer-granite-official.json |
ibm-granite/granite-timeseries-patchtsmixer | patchtsmixer | time_series_forecast | fp32; TP4 | families/patchtsmixer/tests/manifests/patchtsmixer-granite-official-tp4.json |
ibm-research/patchtst-etth1-regression-distribution | patchtst | time_series_forecast | fp16; Single device | families/patchtst/tests/manifests/patchtst-etth1-regression-distribution.json |
ibm-research/patchtst-etth1-regression-distribution | patchtst | time_series_forecast | fp32; TP4 | families/patchtst/tests/manifests/patchtst-etth1-regression-distribution-tp4.json |
ibm-granite/granite-timeseries-patchtst | patchtst | time_series_forecast | fp16; Single device | families/patchtst/tests/manifests/patchtst-granite-official.json |
google/timesfm-2.0-500m-pytorch | timesfm | time_series_forecast | fp32; Single device | families/timesfm/tests/manifests/timesfm-2.0-500m-official.json |
google/timesfm-2.0-500m-pytorch | timesfm | time_series_forecast | fp32; TP4 | families/timesfm/tests/manifests/timesfm-2.0-500m-official-tp4.json |
nvidia/canary-1b-v2 | canary | transcription | fp16; Single device | families/canary/tests/manifests/canary-1b-v2.json |
nvidia/canary-1b-v2 | canary | transcription | fp32; TP4 | families/canary/tests/manifests/canary-1b-v2-tp4.json |
openai/whisper-large-v3-turbo | whisper | transcription | fp32; Single device | families/whisper/tests/manifests/whisper-large-v3-turbo.json |
openai/whisper-large-v3-turbo | whisper | transcription | fp32; TP4 | families/whisper/tests/manifests/whisper-large-v3-turbo-tp4.json |
openai/whisper-small | whisper | transcription | fp16; Single device | families/whisper/tests/manifests/whisper-small-fp16.json |
openai/whisper-tiny | whisper | transcription | fp16; Single device | families/whisper/tests/manifests/whisper-tiny-fp16.json |
openai/whisper-tiny | whisper | transcription | fp16; TP2 | families/whisper/tests/manifests/whisper-tiny-fp16-tp2.json |
nvidia/nemotron-3.5-asr-streaming-0.6b | nemotron_speech_streaming | transcription_streaming | fp16; Single device | families/nemotron_speech_streaming/tests/manifests/nemotron-3.5-asr-streaming-0.6b.json |
nvidia/nemotron-speech-streaming-en-0.6b | nemotron_speech_streaming | transcription_streaming | fp16; Single device | families/nemotron_speech_streaming/tests/manifests/nemotron-speech-streaming-en-0.6b.json |
nvidia/nemotron-speech-streaming-en-0.6b | nemotron_speech_streaming | transcription_streaming | fp32; TP4 | families/nemotron_speech_streaming/tests/manifests/nemotron-speech-streaming-en-0.6b-tp4.json |
facebook/sam2.1-hiera-small | sam2 | video_segmentation | mixed_bf16_fp32; Single device | families/sam2/tests/manifests/sam2-public-core-l0.json |
deepseek-ai/DeepSeek-OCR-2 | deepseek_ocr | vision_language_generation | fp16; Single device | families/deepseek_ocr/tests/manifests/deepseek-ocr.json |
deepseek-ai/DeepSeek-OCR-2 | deepseek_ocr | vision_language_generation | fp16; Single device | families/deepseek_ocr/tests/manifests/deepseek-ocr-l0.json |
deepseek-ai/DeepSeek-OCR-2 | deepseek_ocr | vision_language_generation | fp32; TP2 | families/deepseek_ocr/tests/manifests/deepseek-ocr-l0-tp2.json |
OpenGVLab/InternVL3-2B-hf | internvl | vision_language_generation | fp16; Single device | families/internvl/tests/manifests/internvl3-2b.json |
OpenGVLab/InternVL3-2B-hf | internvl | vision_language_generation | fp32; TP2 | families/internvl/tests/manifests/internvl3-2b-tp2.json |
OpenGVLab/InternVL3-8B-hf | internvl | vision_language_generation | fp16; Single device | families/internvl/tests/manifests/internvl3-8b.json |
OpenGVLab/InternVL3-8B-hf | internvl | vision_language_generation | fp32; TP4 | families/internvl/tests/manifests/internvl3-8b-tp4.json |
bytedance-research/Lance | lance | vision_language_generation | bf16; Single device | families/lance/tests/manifests/lance-3b-x2t-image.json |
nvidia/LocateAnything-3B | locateanything | vision_language_generation | fp16; Single device | families/locateanything/tests/manifests/locateanything-3b.json |
microsoft/Phi-4-multimodal-instruct | phi4_multimodal | vision_language_generation | fp16; Single device | families/phi4_multimodal/tests/manifests/phi4-multimodal.json |
Qwen/Qwen2.5-VL-3B-Instruct | qwen_vl | vision_language_generation | fp32; Single device | families/qwen_vl/tests/manifests/qwen25vl-3b.json |
Qwen/Qwen2.5-VL-3B-Instruct | qwen_vl | vision_language_generation | fp32; TP2 | families/qwen_vl/tests/manifests/qwen25vl-3b-tp2.json |
Qwen/Qwen3-VL-2B-Instruct | qwen_vl | vision_language_generation | bf16; Single device | families/qwen_vl/tests/manifests/qwen3-vl-2b.json |
Qwen/Qwen3-VL-2B-Instruct | qwen_vl | vision_language_generation | fp32; TP4 | families/qwen_vl/tests/manifests/qwen3-vl-2b-tp4.json |
Efficient-Large-Model/SANA-WM_bidirectional | sana_wm | world_model_generation | bf16; Single device | families/sana_wm/tests/manifests/sana-wm-bidirectional.json |
For task-oriented navigation, see Model Recipes.