Supported Models
Support is defined by files that live inside one self-contained
families/<family>/ directory. Each row below points to that family's own
E2E manifest; there is no central model registry or duplicated support matrix.
- 128 self-contained family modules under
families/. - 287 family-owned E2E manifests under
families/*/tests/manifests/. - Every runtime DSO implements an abstract task interface directly.
Declared recipes
An entry means the repository contains a builder, a native runtime DSO that implements an abstract Task API, and a family-owned test recipe for that exact checkpoint. It is not a promise that an unlisted fine-tune is compatible.
A manifest with hf_id names its Hugging Face source. A manifest without
hf_id intentionally represents a family-owned prepared local checkpoint; the
inventory labels it as such instead of inventing Hugging Face metadata.
| Checkpoint | Family | Task interface | Build | Owned manifest |
|---|---|---|---|---|
suno/bark | bark | audio_generation | fp32; Single device | families/bark/tests/manifests/bark-large.json |
suno/bark | bark | audio_generation | fp32; TP4 | families/bark/tests/manifests/bark-large-tp4.json |
suno/bark-small | bark | audio_generation | fp16; Single device | families/bark/tests/manifests/bark-small.json |
suno/bark-small | bark | audio_generation | fp32; Single device | families/bark/tests/manifests/bark-small-fp32-l0.json |
suno/bark-small | bark | audio_generation | fp32; TP4 | families/bark/tests/manifests/bark-small-tp4.json |
nvidia/magpie_tts_multilingual_357m | magpie_tts | audio_generation | fp32; Single device | families/magpie_tts/tests/manifests/magpie-tts-357m.json |
nvidia/magpie_tts_multilingual_357m | magpie_tts | audio_generation | fp32; TP4 | families/magpie_tts/tests/manifests/magpie-tts-357m-tp4.json |
timm/crossvit_9_240.in1k | timm_crossvit | classification | fp16; Single device | families/timm_crossvit/tests/manifests/crossvit-9-240-in1k.json |
timm/dpn68b.ra_in1k | timm_dpn | classification | fp16; Single device | families/timm_dpn/tests/manifests/dpn68b-ra-in1k.json |
timm/dpn92.mx_in1k | timm_dpn | classification | fp16; Single device | families/timm_dpn/tests/manifests/dpn92-mx-in1k.json |
timm/hrnet_w18.ms_aug_in1k | timm_hrnet | classification | fp16; Single device | families/timm_hrnet/tests/manifests/hrnet-w18-ms-aug-in1k.json |
timm/mnasnet_100.rmsp_in1k | timm_mnasnet | classification | fp16; Single device | families/timm_mnasnet/tests/manifests/mnasnet-100-rmsp-in1k.json |
timm/mobilevit_s.cvnets_in1k | timm_mobilevit | classification | fp16; Single device | families/timm_mobilevit/tests/manifests/mobilevit-s-cvnets-in1k.json |
timm/mobilevit_xxs.cvnets_in1k | timm_mobilevit | classification | fp16; Single device | families/timm_mobilevit/tests/manifests/mobilevit-xxs-cvnets-in1k.json |
timm/dm_nfnet_f0.dm_in1k | timm_nfnet | classification | fp16; Single device | families/timm_nfnet/tests/manifests/dm-nfnet-f0-dm-in1k.json |
timm/dm_nfnet_f3.dm_in1k | timm_nfnet | classification | fp16; Single device | families/timm_nfnet/tests/manifests/dm-nfnet-f3-dm-in1k.json |
timm/repvgg_a2.rvgg_in1k | timm_repvgg | classification | fp16; Single device | families/timm_repvgg/tests/manifests/repvgg-a2-rvgg-in1k.json |
timm/res2net50_26w_4s.in1k | timm_res2net | classification | fp16; Single device | families/timm_res2net/tests/manifests/res2net50-26w-4s-in1k.json |
timm/res2net50d.in1k | timm_res2net | classification | fp16; Single device | families/timm_res2net/tests/manifests/res2net50d-in1k.json |
timm/res2next50.in1k | timm_res2net | classification | fp16; Single device | families/timm_res2net/tests/manifests/res2next50-in1k.json |
timm/senet154.gluon_in1k | timm_senet | classification | fp16; Single device | families/timm_senet/tests/manifests/senet154-gluon-in1k.json |
timm/seresnet50.a1_in1k | timm_seresnet | classification | fp16; Single device | families/timm_seresnet/tests/manifests/seresnet50-a1-in1k.json |
timm/vgg16.tv_in1k | timm_vgg | classification | fp16; Single device | families/timm_vgg/tests/manifests/vgg16-tv-in1k.json |
timm/xception41.tf_in1k | timm_xception | classification | fp16; Single device | families/timm_xception/tests/manifests/xception41-tf-in1k.json |
sentence-transformers/all-MiniLM-L6-v2 | bert | embedding | fp16; Single device | families/bert/tests/manifests/all-minilm-l6-v2.json |
intfloat/multilingual-e5-small | bert | embedding | fp16; Single device | families/bert/tests/manifests/multilingual-e5-small.json |
nvidia/llama-nemotron-embed-vl-1b-v2 | eagle_vlm | embedding | fp16; Single device | families/eagle_vlm/tests/manifests/nemotron-embed-vl-1b-v2.json |
nvidia/llama-nemotron-embed-vl-1b-v2 | eagle_vlm | embedding | fp32; TP4 | families/eagle_vlm/tests/manifests/nemotron-embed-vl-1b-v2-tp4.json |
albert/albert-base-v2 | albert | encoding | fp16; Single device | families/albert/tests/manifests/albert-base.json |
albert/albert-base-v2 | albert | encoding | fp32; TP4 | families/albert/tests/manifests/albert-base-tp4.json |
google-bert/bert-base-uncased | bert | encoding | fp16; Single device | families/bert/tests/manifests/bert-base-uncased.json |
google-bert/bert-base-uncased | bert | encoding | fp32; TP4 | families/bert/tests/manifests/bert-base-uncased-tp4.json |
BAAI/bge-small-en-v1.5 | bert | encoding | fp16; Single device | families/bert/tests/manifests/bge-small-en-v1.5.json |
sentence-transformers/paraphrase-multilingual-MiniLM-L12-v2 | bert | encoding | fp16; Single device | families/bert/tests/manifests/paraphrase-multilingual-minilm-l12-v2.json |
YituTech/conv-bert-base | convbert | encoding | fp16; Single device | families/convbert/tests/manifests/convbert-base.json |
YituTech/conv-bert-base | convbert | encoding | fp32; TP2 | families/convbert/tests/manifests/convbert-base-tp2.json |
microsoft/deberta-base | deberta | encoding | fp16; Single device | families/deberta/tests/manifests/deberta-base.json |
microsoft/deberta-base | deberta | encoding | fp32; TP4 | families/deberta/tests/manifests/deberta-base-tp4.json |
distilbert/distilbert-base-uncased | distilbert | encoding | fp16; Single device | families/distilbert/tests/manifests/distilbert-base-uncased.json |
distilbert/distilbert-base-uncased | distilbert | encoding | fp32; TP4 | families/distilbert/tests/manifests/distilbert-base-uncased-tp4.json |
facebook/dpr-ctx_encoder-single-nq-base | dpr | encoding | fp16; Single device | families/dpr/tests/manifests/dpr-ctx-encoder.json |
facebook/dpr-ctx_encoder-single-nq-base | dpr | encoding | fp32; TP4 | families/dpr/tests/manifests/dpr-ctx-encoder-tp4.json |
google/electra-base-discriminator | electra | encoding | fp16; Single device | families/electra/tests/manifests/electra-base-discriminator.json |
google/electra-base-discriminator | electra | encoding | fp32; TP4 | families/electra/tests/manifests/electra-base-discriminator-tp4.json |
google/fnet-base | fnet | encoding | fp16; Single device | families/fnet/tests/manifests/fnet-base.json |
google/fnet-base | fnet | encoding | fp32; TP4 | families/fnet/tests/manifests/fnet-base-tp4.json |
answerdotai/ModernBERT-base | modernbert | encoding | fp32; Single device | families/modernbert/tests/manifests/modernbert-base.json |
answerdotai/ModernBERT-base | modernbert | encoding | fp32; TP4 | families/modernbert/tests/manifests/modernbert-base-tp4.json |
sentence-transformers/all-mpnet-base-v2 | mpnet | encoding | fp16; Single device | families/mpnet/tests/manifests/all-mpnet-base-v2.json |
sentence-transformers/all-mpnet-base-v2 | mpnet | encoding | fp32; TP4 | families/mpnet/tests/manifests/all-mpnet-base-v2-tp4.json |
almanach/camembert-base | roberta | encoding | fp16; Single device | families/roberta/tests/manifests/camembert-base.json |
almanach/camembert-base | roberta | encoding | fp32; TP4 | families/roberta/tests/manifests/camembert-base-tp4.json |
FacebookAI/roberta-base | roberta | encoding | fp16; Single device | families/roberta/tests/manifests/roberta-base.json |
FacebookAI/roberta-base | roberta | encoding | fp32; TP4 | families/roberta/tests/manifests/roberta-base-tp4.json |
FacebookAI/roberta-large | roberta | encoding | fp16; Single device | families/roberta/tests/manifests/roberta-large.json |
FacebookAI/roberta-large | roberta | encoding | fp32; TP4 | families/roberta/tests/manifests/roberta-large-tp4.json |
FacebookAI/xlm-roberta-base | roberta | encoding | fp16; Single device | families/roberta/tests/manifests/xlm-roberta-base.json |
FacebookAI/xlm-roberta-base | roberta | encoding | fp32; TP4 | families/roberta/tests/manifests/xlm-roberta-base-tp4.json |
xlnet/xlnet-base-cased | xlnet | encoding | fp16; Single device | families/xlnet/tests/manifests/xlnet-base.json |
xlnet/xlnet-base-cased | xlnet | encoding | fp32; TP4 | families/xlnet/tests/manifests/xlnet-base-tp4.json |
Qwen/Qwen-Image-Edit-2511 | qwen_image | image_edit | bf16; Single device | families/qwen_image/tests/manifests/qwen-image-edit-2511.json |
facebook/dinov3-convnext-tiny-pretrain-lvd1689m | dinov3 | image_features | fp16; Single device | families/dinov3/tests/manifests/dinov3-convnext-tiny-pretrain-lvd1689m.json |
facebook/dinov3-vits16-pretrain-lvd1689m | dinov3 | image_features | fp16; Single device | families/dinov3/tests/manifests/dinov3-vits16-pretrain-lvd1689m.json |
timm/vit_small_patch16_dinov3_qkvb.lvd1689m | dinov3 | image_features | fp16; Single device | families/dinov3/tests/manifests/dinov3-vits16-timm-l0.json |
nvidia/Cosmos3-Nano | cosmos3 | image_generation | bf16; Single device | families/cosmos3/tests/manifests/cosmos3-nano-l0.json |
nvidia/Cosmos3-Nano | cosmos3 | image_generation | bf16; CP2 | families/cosmos3/tests/manifests/cosmos3-nano-l0-cp2.json |
black-forest-labs/FLUX.2-dev | flux | image_generation | bf16; Single device | families/flux/tests/manifests/flux-2-dev.json |
black-forest-labs/FLUX.2-dev | flux | image_generation | fp16; Single device | families/flux/tests/manifests/flux-2-dev-fp8.json |
black-forest-labs/FLUX.2-dev | flux | image_generation | fp16; Single device | families/flux/tests/manifests/flux-2-dev-fp8-l0.json |
black-forest-labs/FLUX.2-dev | flux | image_generation | fp16; TP4 | families/flux/tests/manifests/flux-2-dev-fp8-l0-tp4.json |
black-forest-labs/FLUX.2-dev | flux | image_generation | bf16; Single device | families/flux/tests/manifests/flux-2-dev-l0.json |
black-forest-labs/FLUX.2-dev | flux | image_generation | fp16; TP4 | families/flux/tests/manifests/flux-2-dev-l0-tp4.json |
black-forest-labs/FLUX.1-schnell | flux | image_generation | fp16; Single device | families/flux/tests/manifests/flux-schnell.json |
black-forest-labs/FLUX.1-schnell | flux | image_generation | fp16; Single device | families/flux/tests/manifests/flux-schnell-l0.json |
black-forest-labs/FLUX.1-schnell | flux | image_generation | fp32; CP4 | families/flux/tests/manifests/flux-schnell-l0-cp4.json |
black-forest-labs/FLUX.1-schnell | flux | image_generation | fp32; TP4 | families/flux/tests/manifests/flux-schnell-l0-tp4.json |
Lightricks/LTX-Video | ltx_video | image_generation | fp16; Single device | families/ltx_video/tests/manifests/ltx-video-l0.json |
MiniMaxAI/MiniMax-H3 | minimax_h3 | image_generation | bf16; Single device | families/minimax_h3/tests/manifests/minimax-h3-768p.json |
PixArt-alpha/PixArt-Sigma-XL-2-1024-MS | pixart | image_generation | fp16; Single device | families/pixart/tests/manifests/pixart-sigma-1024.json |
PixArt-alpha/PixArt-Sigma-XL-2-1024-MS | pixart | image_generation | fp16; Single device | families/pixart/tests/manifests/pixart-sigma-1024-l0.json |
PixArt-alpha/PixArt-Sigma-XL-2-1024-MS | pixart | image_generation | fp32; TP4 | families/pixart/tests/manifests/pixart-sigma-1024-tp4.json |
Qwen/Qwen-Image | qwen_image | image_generation | bf16; Single device | families/qwen_image/tests/manifests/qwen-image.json |
Qwen/Qwen-Image-2512 | qwen_image | image_generation | bf16; Single device | families/qwen_image/tests/manifests/qwen-image-2512.json |
Qwen/Qwen-Image | qwen_image | image_generation | bf16; Single device | families/qwen_image/tests/manifests/qwen-image-l0.json |
Wan-AI/Wan2.1-T2V-1.3B-Diffusers | wan_t2v | image_generation | fp16; Single device | families/wan_t2v/tests/manifests/wan21-t2v-1.3b.json |
Wan-AI/Wan2.1-T2V-1.3B-Diffusers | wan_t2v | image_generation | fp16; Single device | families/wan_t2v/tests/manifests/wan21-t2v-1.3b-l0.json |
Wan-AI/Wan2.1-T2V-1.3B-Diffusers | wan_t2v | image_generation | fp16; CP4 | families/wan_t2v/tests/manifests/wan21-t2v-1.3b-l0-cp4.json |
Wan-AI/Wan2.1-T2V-1.3B-Diffusers | wan_t2v | image_generation | fp32; TP4 | families/wan_t2v/tests/manifests/wan21-t2v-1.3b-l0-tp4.json |
Wan-AI/Wan2.2-TI2V-5B | wan2_2_ti2v | image_generation | bf16; Single device | families/wan2_2_ti2v/tests/manifests/wan22-ti2v-5b.json |
Wan-AI/Wan2.2-TI2V-5B | wan2_2_ti2v | image_generation | bf16; Single device | families/wan2_2_ti2v/tests/manifests/wan22-ti2v-5b-l0.json |
Tongyi-MAI/Z-Image-Turbo | z_image | image_generation | fp16; Single device | families/z_image/tests/manifests/z-image-turbo.json |
Tongyi-MAI/Z-Image-Turbo | z_image | image_generation | fp16; Single device | families/z_image/tests/manifests/z-image-turbo-l0.json |
Tongyi-MAI/Z-Image-Turbo | z_image | image_generation | fp32; TP2 | families/z_image/tests/manifests/z-image-turbo-l0-tp2.json |
black-forest-labs/FLUX.1-schnell | flux | image_generation_batch | fp16; Single device | families/flux/tests/manifests/flux-schnell-l0-batch2.json |
timm/convnext_tiny.in12k_ft_in1k | timm_convnext | image_to_class_scores | fp16; Single device | families/timm_convnext/tests/manifests/convnext-tiny-in12k-ft-in1k.json |
timm/densenet121.ra_in1k | timm_densenet | image_to_class_scores | fp16; Single device | families/timm_densenet/tests/manifests/densenet121-ra-in1k.json |
timm/efficientnet_b0.ra_in1k | timm_efficientnet | image_to_class_scores | fp16; Single device | families/timm_efficientnet/tests/manifests/efficientnet-b0-ra-in1k.json |
timm/ghostnet_100.in1k | timm_ghostnet | image_to_class_scores | fp16; Single device | families/timm_ghostnet/tests/manifests/ghostnet-100-in1k.json |
timm/inception_v3.tv_in1k | timm_inception | image_to_class_scores | fp16; Single device | families/timm_inception/tests/manifests/inception-v3-tv-in1k.json |
timm/inception_resnet_v2.tf_in1k | timm_inception_resnet | image_to_class_scores | fp16; Single device | families/timm_inception_resnet/tests/manifests/inception-resnet-v2-tf-in1k.json |
timm/inception_v4.tf_in1k | timm_inception_v4 | image_to_class_scores | fp16; Single device | families/timm_inception_v4/tests/manifests/inception-v4-tf-in1k.json |
timm/mobilenetv2_100.ra_in1k | timm_mobilenetv2 | image_to_class_scores | fp16; Single device | families/timm_mobilenetv2/tests/manifests/mobilenetv2-100-ra-in1k.json |
timm/mobilenetv3_large_100.ra_in1k | timm_mobilenetv3 | image_to_class_scores | fp16; Single device | families/timm_mobilenetv3/tests/manifests/mobilenetv3-large-100-ra-in1k.json |
timm/mobilenetv4_conv_large.e500_r256_in1k | timm_mobilenetv4 | image_to_class_scores | fp16; Single device | families/timm_mobilenetv4/tests/manifests/mobilenetv4-conv-large.json |
timm/mobilenetv4_conv_medium.e500_r256_in1k | timm_mobilenetv4 | image_to_class_scores | fp16; Single device | families/timm_mobilenetv4/tests/manifests/mobilenetv4-conv-medium.json |
timm/mobilenetv4_conv_small.e2400_r224_in1k | timm_mobilenetv4 | image_to_class_scores | fp16; Single device | families/timm_mobilenetv4/tests/manifests/mobilenetv4-conv-small.json |
timm/mobilenetv4_conv_small_050.e3000_r224_in1k | timm_mobilenetv4 | image_to_class_scores | fp16; Single device | families/timm_mobilenetv4/tests/manifests/mobilenetv4-conv-small-050.json |
timm/regnety_040.ra3_in1k | timm_regnet | image_to_class_scores | fp16; Single device | families/timm_regnet/tests/manifests/regnety-040-ra3-in1k.json |
timm/resnest50d.in1k | timm_resnest | image_to_class_scores | fp16; Single device | families/timm_resnest/tests/manifests/resnest50d-in1k.json |
timm/resnet50.a1_in1k | timm_resnet | image_to_class_scores | fp16; Single device | families/timm_resnet/tests/manifests/resnet50-a1-in1k.json |
timm/swin_tiny_patch4_window7_224.ms_in1k | timm_swin | image_to_class_scores | fp16; Single device | families/timm_swin/tests/manifests/swin-tiny-patch4-window7-224-ms-in1k.json |
timm/vit_base_patch16_224.augreg_in21k_ft_in1k | timm_vit | image_to_class_scores | fp16; Single device | families/timm_vit/tests/manifests/timm-vit-base-p16-224-augreg-in21k-ft-in1k.json |
timm/vit_base_patch16_224.augreg_in21k_ft_in1k | timm_vit | image_to_class_scores | fp32; TP4 | families/timm_vit/tests/manifests/timm-vit-base-p16-224-augreg-in21k-ft-in1k-tp4.json |
timm/xcit_nano_12_p16_224.fb_in1k | timm_xcit | image_to_class_scores | fp16; Single device | families/timm_xcit/tests/manifests/xcit-nano-12-p16-224-fb-in1k.json |
timm/xcit_tiny_12_p16_224.fb_in1k | timm_xcit | image_to_class_scores | fp16; Single device | families/timm_xcit/tests/manifests/xcit-tiny-12-p16-224-fb-in1k.json |
Ruicheng/moge-2-vitl | moge | monocular_geometry | fp32; Single device | families/moge/tests/manifests/moge-2-vitl.json |
facebook/detr-resnet-50 | detr | object_detection | fp16; Single device | families/detr/tests/manifests/detr-resnet-50.json |
Ultralytics/YOLO11 | yolo11 | object_detection | fp16; Single device | families/yolo11/tests/manifests/yolo11n.json |
jameslahm/yolov10n | yolov10 | object_detection | fp16; Single device | families/yolov10/tests/manifests/yolov10n.json |
jameslahm/yolov10s | yolov10 | object_detection | fp16; Single device | families/yolov10/tests/manifests/yolov10s.json |
jameslahm/yolov10x | yolov10 | object_detection | fp16; Single device | families/yolov10/tests/manifests/yolov10x.json |
Ultralytics/YOLOv5 | yolov5 | object_detection | fp16; Single device | families/yolov5/tests/manifests/yolov5n.json |
Ultralytics/YOLOv8 | yolov8 | object_detection | fp16; Single device | families/yolov8/tests/manifests/yolov8n.json |
prepared local checkpoint | foundationpose | pose_hypothesis_refinement | fp16; Single device | families/foundationpose/tests/manifests/foundationpose-ngc-1.0.1.json |
facebook/sam-vit-base | sam | prompted_segmentation | fp16; Single device | families/sam/tests/manifests/sam-vit-base.json |
facebook/sam-vit-base | sam | prompted_segmentation | fp32; TP4 | families/sam/tests/manifests/sam-vit-base-tp4.json |
nvidia/llama-nemotron-rerank-vl-1b-v2 | eagle_vlm | reranking | fp16; Single device | families/eagle_vlm/tests/manifests/nemotron-rerank-vl-1b-v2.json |
nvidia/llama-nemotron-rerank-vl-1b-v2 | eagle_vlm | reranking | fp32; TP4 | families/eagle_vlm/tests/manifests/nemotron-rerank-vl-1b-v2-tp4.json |
lerobot/act_aloha_sim_transfer_cube_human | lerobot_act | robot_control | fp32; Single device | families/lerobot_act/tests/manifests/act-aloha-sim-transfer-cube.json |
nvidia/segformer-b0-finetuned-ade-512-512 | segformer | segmentation | fp16; Single device | families/segformer/tests/manifests/segformer-b0-ade.json |
nvidia/segformer-b0-finetuned-ade-512-512 | segformer | segmentation | fp32; TP4 | families/segformer/tests/manifests/segformer-b0-ade-tp4.json |
nvidia/NVIDIA-NemotronLabs-VoiceChat-11B | nemotron_voicechat | speech_session | fp32; Single device | families/nemotron_voicechat/tests/manifests/nemotron-voicechat-11b.json |
nvidia/personaplex-7b-v1 | personaplex | speech_to_speech | fp16; Single device | families/personaplex/tests/manifests/personaplex-7b.json |
nvidia/personaplex-7b-v1 | personaplex | speech_to_speech | fp16; Single device | families/personaplex/tests/manifests/personaplex-7b-l0.json |
nvidia/personaplex-7b-v1 | personaplex | speech_to_speech | fp32; TP4 | families/personaplex/tests/manifests/personaplex-7b-l0-tp4.json |
nvidia/c-fast-foundationstereo | fast_foundation_stereo | stereo_disparity | fp16; Single device | families/fast_foundation_stereo/tests/manifests/fast-foundation-stereo.json |
boltz-community/boltz-2 | boltz2 | structure_prediction | bf16; Single device | families/boltz2/tests/manifests/boltz2-protein-monomer.json |
prepared local checkpoint | openfold3 | structure_prediction | fp16; Single device | families/openfold3/tests/manifests/openfold3-ubiquitin-fp16-l0.json |
facebook/bart-base | bart | text_generation | fp16; Single device | families/bart/tests/manifests/bart-base.json |
facebook/bart-base | bart | text_generation | fp32; TP4 | families/bart/tests/manifests/bart-base-tp4.json |
bigscience/bloom-560m | bloom | text_generation | fp32; Single device | families/bloom/tests/manifests/bloom-560m.json |
bigscience/bloom-560m | bloom | text_generation | fp32; TP4 | families/bloom/tests/manifests/bloom-560m-tp4.json |
Salesforce/codegen-350M-mono | codegen | text_generation | fp16; Single device | families/codegen/tests/manifests/codegen-350m.json |
Salesforce/codegen-350M-mono | codegen | text_generation | fp32; TP4 | families/codegen/tests/manifests/codegen-350m-tp4.json |
deepseek-ai/DeepSeek-V2-Lite | deepseek_v2 | text_generation | fp16; Single device | families/deepseek_v2/tests/manifests/deepseek-v2-lite.json |
deepseek-ai/DeepSeek-V2-Lite | deepseek_v2 | text_generation | fp32; TP4 | families/deepseek_v2/tests/manifests/deepseek-v2-lite-tp4.json |
katuni4ka/tiny-random-deepseek-v3 | deepseek_v2 | text_generation | fp16; Single device | families/deepseek_v2/tests/manifests/deepseek-v2-tiny.json |
katuni4ka/tiny-random-deepseek-v3 | deepseek_v2 | text_generation | fp32; TP2 | families/deepseek_v2/tests/manifests/deepseek-v2-tiny-tp2.json |
embedded-language-flows/ELF-B-de-en | elf_flow | text_generation | fp16; Single device | families/elf_flow/tests/manifests/elf-b-de-en-l0.json |
embedded-language-flows/ELF-B-owt | elf_flow | text_generation | fp32; Single device | families/elf_flow/tests/manifests/elf-b-owt-l0.json |
embedded-language-flows/ELF-B-xsum | elf_flow | text_generation | fp16; Single device | families/elf_flow/tests/manifests/elf-b-xsum-l0.json |
tiiuae/falcon-rw-1b | falcon | text_generation | fp16; Single device | families/falcon/tests/manifests/falcon-rw-1b.json |
tiiuae/falcon-rw-1b | falcon | text_generation | fp32; TP4 | families/falcon/tests/manifests/falcon-rw-1b-tp4.json |
google/gemma-2-2b-it | gemma | text_generation | fp16; Single device | families/gemma/tests/manifests/gemma-2-2b.json |
google/gemma-2-2b-it | gemma | text_generation | fp32; TP4 | families/gemma/tests/manifests/gemma-2-2b-tp4.json |
google/gemma-3-12b-it | gemma | text_generation | bf16; Single device | families/gemma/tests/manifests/gemma-3-12b.json |
google/gemma-3-1b-it | gemma | text_generation | bf16; Single device | families/gemma/tests/manifests/gemma-3-1b.json |
google/gemma-3-270m-it | gemma | text_generation | bf16; Single device | families/gemma/tests/manifests/gemma-3-270m.json |
google/gemma-3-4b-it | gemma | text_generation | bf16; Single device | families/gemma/tests/manifests/gemma-3-4b.json |
THUDM/glm-4-9b-hf | glm | text_generation | fp16; Single device | families/glm/tests/manifests/glm-4-9b.json |
THUDM/glm-4-9b-hf | glm | text_generation | fp16; Single device | families/glm/tests/manifests/glm-4-9b-l0.json |
THUDM/glm-4-9b-hf | glm | text_generation | fp32; TP2 | families/glm/tests/manifests/glm-4-9b-l0-tp2.json |
EleutherAI/gpt-neo-125m | gpt_neo | text_generation | fp16; Single device | families/gpt_neo/tests/manifests/gpt-neo-125m.json |
EleutherAI/gpt-neo-125m | gpt_neo | text_generation | fp32; TP4 | families/gpt_neo/tests/manifests/gpt-neo-125m-tp4.json |
EleutherAI/pythia-70m | gpt_neox | text_generation | fp32; Single device | families/gpt_neox/tests/manifests/pythia-70m.json |
EleutherAI/pythia-70m | gpt_neox | text_generation | fp32; TP4 | families/gpt_neox/tests/manifests/pythia-70m-tp4.json |
openai/gpt-oss-20b | gpt_oss | text_generation | fp16; Single device | families/gpt_oss/tests/manifests/gpt-oss-20b.json |
openai/gpt-oss-20b | gpt_oss | text_generation | fp16; Single device | families/gpt_oss/tests/manifests/gpt-oss-20b-l0.json |
openai/gpt-oss-20b | gpt_oss | text_generation | fp32; TP4 | families/gpt_oss/tests/manifests/gpt-oss-20b-l0-tp4.json |
distilbert/distilgpt2 | gpt2 | text_generation | fp16; Single device | families/gpt2/tests/manifests/distilgpt2.json |
openai-community/gpt2 | gpt2 | text_generation | fp32; Single device | families/gpt2/tests/manifests/gpt2-125m.json |
openai-community/gpt2 | gpt2 | text_generation | fp32; TP4 | families/gpt2/tests/manifests/gpt2-125m-tp4.json |
ibm-granite/granite-3.1-2b-base | granite | text_generation | fp16; Single device | families/granite/tests/manifests/granite-3.1-2b.json |
ibm-granite/granite-3.1-2b-base | granite | text_generation | fp32; TP4 | families/granite/tests/manifests/granite-3.1-2b-tp4.json |
internlm/internlm2-math-plus-1_8b | internlm | text_generation | fp16; Single device | families/internlm/tests/manifests/internlm2-1.8b.json |
internlm/internlm2-math-plus-1_8b | internlm | text_generation | fp32; TP4 | families/internlm/tests/manifests/internlm2-1.8b-tp4.json |
IFM/K2-Horizon-7B | k2_horizon | text_generation | bf16; Single device | families/k2_horizon/tests/manifests/k2-horizon-7b.json |
IFM/K2-Horizon-7B-Uno | k2_horizon_uno | text_generation | bf16; Single device | families/k2_horizon_uno/tests/manifests/k2-horizon-7b-uno.json |
LiquidAI/LFM2-1.2B | lfm2 | text_generation | bf16; Single device | families/lfm2/tests/manifests/lfm2-1.2b.json |
LiquidAI/LFM2-2.6B | lfm2 | text_generation | fp16; Single device | families/lfm2/tests/manifests/lfm2-2.6b.json |
LiquidAI/LFM2-350M | lfm2 | text_generation | bf16; Single device | families/lfm2/tests/manifests/lfm2-350m-bf16-model-card.json |
LiquidAI/LFM2-350M | lfm2 | text_generation | fp16; Single device | families/lfm2/tests/manifests/lfm2-350m-fp16.json |
LiquidAI/LFM2-700M | lfm2 | text_generation | fp16; Single device | families/lfm2/tests/manifests/lfm2-700m.json |
tiiuae/Falcon3-1B-Base | llama | text_generation | fp16; Single device | families/llama/tests/manifests/falcon3-1b.json |
openbmb/MiniCPM5-2B | llama | text_generation | fp16; Single device | families/llama/tests/manifests/minicpm5-2b.json |
nvidia/Llama-3.1-Minitron-4B-Depth-Base | llama | text_generation | fp16; Single device | families/llama/tests/manifests/minitron-4b-depth.json |
nvidia/Llama-3.1-Minitron-4B-Width-Base | llama | text_generation | fp16; Single device | families/llama/tests/manifests/minitron-4b-width.json |
nvidia/Llama-3.1-Minitron-4B-Width-Base | llama | text_generation | fp16; Single device | families/llama/tests/manifests/minitron-4b-width-l0.json |
nvidia/Llama-3.1-Minitron-4B-Width-Base | llama | text_generation | bf16; Single device | families/llama/tests/manifests/minitron-4b-width-regression-native-kv-chunked-prefill.json |
nvidia/Llama-3.1-Nemotron-Nano-4B-v1.1 | llama | text_generation | fp16; Single device | families/llama/tests/manifests/nemotron-nano-4b.json |
TinyLlama/TinyLlama-1.1B-Chat-v1.0 | llama | text_generation | fp16; Single device | families/llama/tests/manifests/tinyllama-1.1b.json |
facebook/nllb-200-distilled-600M | m2m_100 | text_generation | fp16; Single device | families/m2m_100/tests/manifests/nllb-200.json |
state-spaces/mamba-130m-hf | mamba | text_generation | fp32; Single device | families/mamba/tests/manifests/mamba-130m.json |
state-spaces/mamba-130m-hf | mamba | text_generation | fp32; TP4 | families/mamba/tests/manifests/mamba-130m-tp4.json |
Helsinki-NLP/opus-mt-en-ru | marian | text_generation | fp16; Single device | families/marian/tests/manifests/marian-en-ru.json |
Helsinki-NLP/opus-mt-en-ru | marian | text_generation | fp32; TP4 | families/marian/tests/manifests/marian-en-ru-tp4.json |
mistralai/Mistral-7B-Instruct-v0.1 | mistral | text_generation | fp16; Single device | families/mistral/tests/manifests/mistral-7b.json |
mistralai/Mistral-7B-Instruct-v0.1 | mistral | text_generation | fp16; Single device | families/mistral/tests/manifests/mistral-7b-l0.json |
nvidia/Riva-Translate-4B-Instruct-v1.1 | mistral | text_generation | fp16; Single device | families/mistral/tests/manifests/riva-translate-4b.json |
ggml-org/stories15M_MOE | mixtral | text_generation | fp16; Single device | families/mixtral/tests/manifests/mixtral-stories-15m.json |
ggml-org/stories15M_MOE | mixtral | text_generation | fp32; TP2 | families/mixtral/tests/manifests/mixtral-stories-15m-tp2.json |
nvidia/Nemotron-4-Mini-Hindi-4B-Base | nemotron | text_generation | bf16; Single device | families/nemotron/tests/manifests/nemotron-hindi-4b.json |
nvidia/Nemotron-Mini-4B-Instruct | nemotron | text_generation | fp16; Single device | families/nemotron/tests/manifests/nemotron-mini-4b.json |
nvidia/NVIDIA-Nemotron-Nano-9B-v2 | nemotron_h | text_generation | fp16; Single device | families/nemotron_h/tests/manifests/nemotron-h-nano-9b.json |
nvidia/NVIDIA-Nemotron-Nano-9B-v2 | nemotron_h | text_generation | fp32; TP4 | families/nemotron_h/tests/manifests/nemotron-h-nano-9b-tp4.json |
nvidia/Nemotron-Labs-Diffusion-8B | nemotron_labs_diffusion | text_generation | bf16; Single device | families/nemotron_labs_diffusion/tests/manifests/nemotron-labs-diffusion-8b.json |
nvidia/Nemotron-Labs-Diffusion-8B | nemotron_labs_diffusion | text_generation | bf16; Single device | families/nemotron_labs_diffusion/tests/manifests/nemotron-labs-diffusion-8b-l0.json |
allenai/OLMo-1B-hf | olmo | text_generation | fp16; Single device | families/olmo/tests/manifests/olmo-1b.json |
allenai/OLMo-1B-hf | olmo | text_generation | fp32; TP4 | families/olmo/tests/manifests/olmo-1b-tp4.json |
allenai/OLMo-2-0425-1B | olmo2 | text_generation | fp32; Single device | families/olmo2/tests/manifests/olmo2-1b.json |
allenai/OLMo-2-0425-1B | olmo2 | text_generation | fp32; TP4 | families/olmo2/tests/manifests/olmo2-1b-tp4.json |
facebook/opt-125m | opt | text_generation | fp16; Single device | families/opt/tests/manifests/opt-125m.json |
facebook/opt-125m | opt | text_generation | fp32; TP4 | families/opt/tests/manifests/opt-125m-tp4.json |
microsoft/Phi-3-mini-4k-instruct | phi | text_generation | fp16; Single device | families/phi/tests/manifests/phi3-mini.json |
microsoft/Phi-3-mini-4k-instruct | phi | text_generation | fp32; TP4 | families/phi/tests/manifests/phi3-mini-tp4.json |
microsoft/Phi-tiny-MoE-instruct | phi_moe | text_generation | fp16; Single device | families/phi_moe/tests/manifests/phi-moe.json |
microsoft/Phi-tiny-MoE-instruct | phi_moe | text_generation | fp16; Single device | families/phi_moe/tests/manifests/phi-moe-l0.json |
microsoft/Phi-tiny-MoE-instruct | phi_moe | text_generation | fp32; TP4 | families/phi_moe/tests/manifests/phi-moe-l0-tp4.json |
Qwen/Qwen3-0.6B | qwen | text_generation | fp16; Single device | families/qwen/tests/manifests/qwen3-0.6b-fp16.json |
Qwen/Qwen3-0.6B | qwen | text_generation | fp16; TP4 | families/qwen/tests/manifests/qwen3-0.6b-fp16-tp4.json |
Qwen/Qwen3-0.6B | qwen | text_generation | fp16; Single device | families/qwen/tests/manifests/qwen3-0.6b-fp8.json |
Qwen/Qwen3-0.6B | qwen | text_generation | bf16; TP4 | families/qwen/tests/manifests/qwen3-0.6b-fp8-tp4.json |
Qwen/Qwen3-0.6B | qwen | text_generation | bf16; Single device | families/qwen/tests/manifests/qwen3-0.6b-native-l0.json |
Qwen/Qwen3-0.6B | qwen | text_generation | bf16; Single device | families/qwen/tests/manifests/qwen3-0.6b-regression-native-kv-chunked-prefill.json |
Qwen/Qwen3-0.6B | qwen | text_generation | fp16; Single device | families/qwen/tests/manifests/qwen3-0.6b-topp.json |
Qwen/Qwen3-0.6B | qwen | text_generation | fp16; TP4 | families/qwen/tests/manifests/qwen3-0.6b-topp-tp4.json |
Qwen/Qwen3-4B-Instruct-2507 | qwen | text_generation | fp16; Single device | families/qwen/tests/manifests/qwen3-4b-instruct-2507.json |
Qwen/Qwen3-4B-Instruct-2507 | qwen | text_generation | fp16; TP4 | families/qwen/tests/manifests/qwen3-4b-instruct-2507-tp4.json |
Qwen/Qwen3-30B-A3B | qwen_moe | text_generation | fp16; Single device | families/qwen_moe/tests/manifests/qwen3-moe-30b-a3b.json |
Qwen/Qwen3-30B-A3B | qwen_moe | text_generation | fp16; TP4 | families/qwen_moe/tests/manifests/qwen3-moe-30b-a3b-tp4.json |
amd-quark/tiny-random-qwen3_moe | qwen_moe | text_generation | fp16; Single device | families/qwen_moe/tests/manifests/qwen3-moe-tiny-random.json |
Qwen/Qwen3.5-0.8B | qwen3_5 | text_generation | fp16; Single device | families/qwen3_5/tests/manifests/qwen35-0.8b.json |
Qwen/Qwen3.5-2B | qwen3_5 | text_generation | fp16; Single device | families/qwen3_5/tests/manifests/qwen35-2b.json |
Qwen/Qwen3.5-4B | qwen3_5 | text_generation | fp16; Single device | families/qwen3_5/tests/manifests/qwen35-4b.json |
Qwen/Qwen3.5-9B | qwen3_5 | text_generation | fp16; Single device | families/qwen3_5/tests/manifests/qwen35-9b.json |
Qwen/Qwen3.6-27B | qwen3_8 | text_generation | fp16; Single device | families/qwen3_8/tests/manifests/qwen36-27b.json |
Qwen/Qwen3.8-27B | qwen3_8 | text_generation | fp16; Single device | families/qwen3_8/tests/manifests/qwen38-27b.json |
Qwen/Qwen3-Omni-30B-A3B-Instruct | qwen3_omni | text_generation | bf16; Single device | families/qwen3_omni/tests/manifests/qwen3-omni-30b-a3b-instruct.json |
RWKV/rwkv-4-169m-pile | rwkv | text_generation | fp32; Single device | families/rwkv/tests/manifests/rwkv-169m.json |
RWKV/rwkv-4-169m-pile | rwkv | text_generation | fp32; TP4 | families/rwkv/tests/manifests/rwkv-169m-tp4.json |
superwhisper/s1-mini | s1_mini | text_generation | fp16; Single device | families/s1_mini/tests/manifests/s1-mini-fp16.json |
HuggingFaceTB/SmolLM3-3B | smollm3 | text_generation | bf16; Single device | families/smollm3/tests/manifests/smollm3-3b-l0.json |
stabilityai/stablelm-2-1_6b | stablelm | text_generation | fp16; Single device | families/stablelm/tests/manifests/stablelm2-1.6b.json |
stabilityai/stablelm-2-1_6b | stablelm | text_generation | fp32; TP4 | families/stablelm/tests/manifests/stablelm2-1.6b-tp4.json |
bigcode/starcoder2-3b | starcoder2 | text_generation | fp16; Single device | families/starcoder2/tests/manifests/starcoder2-3b.json |
bigcode/starcoder2-3b | starcoder2 | text_generation | fp32; TP2 | families/starcoder2/tests/manifests/starcoder2-3b-tp2.json |
google-t5/t5-small | t5 | text_generation | fp16; Single device | families/t5/tests/manifests/t5-small.json |
google-t5/t5-small | t5 | text_generation | fp32; TP4 | families/t5/tests/manifests/t5-small-tp4.json |
facebook/xglm-564M | xglm | text_generation | fp16; Single device | families/xglm/tests/manifests/xglm-564m.json |
facebook/xglm-564M | xglm | text_generation | fp32; TP4 | families/xglm/tests/manifests/xglm-564m-tp4.json |
facebook/sam3 | sam3 | text_prompted_segmentation | fp32; Single device | families/sam3/tests/manifests/sam3.json |
amazon/chronos-bolt-tiny | chronos_bolt | time_series_forecast | fp32; Single device | families/chronos_bolt/tests/manifests/chronos-bolt-tiny-official.json |
amazon/chronos-bolt-tiny | chronos_bolt | time_series_forecast | fp32; TP4 | families/chronos_bolt/tests/manifests/chronos-bolt-tiny-official-tp4.json |
ibm-granite/granite-timeseries-patchtsmixer | patchtsmixer | time_series_forecast | fp16; Single device | families/patchtsmixer/tests/manifests/patchtsmixer-granite-official.json |
ibm-granite/granite-timeseries-patchtsmixer | patchtsmixer | time_series_forecast | fp32; TP4 | families/patchtsmixer/tests/manifests/patchtsmixer-granite-official-tp4.json |
ibm-research/patchtst-etth1-regression-distribution | patchtst | time_series_forecast | fp16; Single device | families/patchtst/tests/manifests/patchtst-etth1-regression-distribution.json |
ibm-research/patchtst-etth1-regression-distribution | patchtst | time_series_forecast | fp32; TP4 | families/patchtst/tests/manifests/patchtst-etth1-regression-distribution-tp4.json |
ibm-granite/granite-timeseries-patchtst | patchtst | time_series_forecast | fp16; Single device | families/patchtst/tests/manifests/patchtst-granite-official.json |
google/timesfm-2.0-500m-pytorch | timesfm | time_series_forecast | fp32; Single device | families/timesfm/tests/manifests/timesfm-2.0-500m-official.json |
google/timesfm-2.0-500m-pytorch | timesfm | time_series_forecast | fp32; TP4 | families/timesfm/tests/manifests/timesfm-2.0-500m-official-tp4.json |
nvidia/canary-1b-v2 | canary | transcription | fp16; Single device | families/canary/tests/manifests/canary-1b-v2.json |
nvidia/canary-1b-v2 | canary | transcription | fp32; TP4 | families/canary/tests/manifests/canary-1b-v2-tp4.json |
zai-org/GLM-ASR-Nano-2512 | glmasr | transcription | fp16; Single device | families/glmasr/tests/manifests/glmasr-nano-fp16.json |
openai/whisper-large-v3-turbo | whisper | transcription | fp32; Single device | families/whisper/tests/manifests/whisper-large-v3-turbo.json |
openai/whisper-large-v3-turbo | whisper | transcription | fp32; TP4 | families/whisper/tests/manifests/whisper-large-v3-turbo-tp4.json |
openai/whisper-small | whisper | transcription | fp16; Single device | families/whisper/tests/manifests/whisper-small-fp16.json |
openai/whisper-tiny | whisper | transcription | fp16; Single device | families/whisper/tests/manifests/whisper-tiny-fp16.json |
openai/whisper-tiny | whisper | transcription | fp16; TP2 | families/whisper/tests/manifests/whisper-tiny-fp16-tp2.json |
nvidia/nemotron-3.5-asr-streaming-0.6b | nemotron_speech_streaming | transcription_streaming | fp16; Single device | families/nemotron_speech_streaming/tests/manifests/nemotron-3.5-asr-streaming-0.6b.json |
nvidia/nemotron-speech-streaming-en-0.6b | nemotron_speech_streaming | transcription_streaming | fp16; Single device | families/nemotron_speech_streaming/tests/manifests/nemotron-speech-streaming-en-0.6b.json |
nvidia/nemotron-speech-streaming-en-0.6b | nemotron_speech_streaming | transcription_streaming | fp32; TP4 | families/nemotron_speech_streaming/tests/manifests/nemotron-speech-streaming-en-0.6b-tp4.json |
facebook/sam2.1-hiera-small | sam2 | video_segmentation | mixed_bf16_fp32; Single device | families/sam2/tests/manifests/sam2-public-core-l0.json |
deepseek-ai/DeepSeek-OCR-2 | deepseek_ocr | vision_language_generation | fp16; Single device | families/deepseek_ocr/tests/manifests/deepseek-ocr.json |
deepseek-ai/DeepSeek-OCR-2 | deepseek_ocr | vision_language_generation | fp16; Single device | families/deepseek_ocr/tests/manifests/deepseek-ocr-l0.json |
deepseek-ai/DeepSeek-OCR-2 | deepseek_ocr | vision_language_generation | fp32; TP2 | families/deepseek_ocr/tests/manifests/deepseek-ocr-l0-tp2.json |
OpenGVLab/InternVL3-2B-hf | internvl | vision_language_generation | fp16; Single device | families/internvl/tests/manifests/internvl3-2b.json |
OpenGVLab/InternVL3-2B-hf | internvl | vision_language_generation | fp32; TP2 | families/internvl/tests/manifests/internvl3-2b-tp2.json |
OpenGVLab/InternVL3-8B-hf | internvl | vision_language_generation | fp16; Single device | families/internvl/tests/manifests/internvl3-8b.json |
OpenGVLab/InternVL3-8B-hf | internvl | vision_language_generation | fp32; TP4 | families/internvl/tests/manifests/internvl3-8b-tp4.json |
bytedance-research/Lance | lance | vision_language_generation | bf16; Single device | families/lance/tests/manifests/lance-3b-x2t-image.json |
nvidia/LocateAnything-3B | locateanything | vision_language_generation | fp16; Single device | families/locateanything/tests/manifests/locateanything-3b.json |
microsoft/Phi-4-multimodal-instruct | phi4_multimodal | vision_language_generation | fp16; Single device | families/phi4_multimodal/tests/manifests/phi4-multimodal.json |
Qwen/Qwen2.5-VL-3B-Instruct | qwen_vl | vision_language_generation | fp32; Single device | families/qwen_vl/tests/manifests/qwen25vl-3b.json |
Qwen/Qwen2.5-VL-3B-Instruct | qwen_vl | vision_language_generation | fp32; TP2 | families/qwen_vl/tests/manifests/qwen25vl-3b-tp2.json |
Qwen/Qwen3-VL-2B-Instruct | qwen_vl | vision_language_generation | bf16; Single device | families/qwen_vl/tests/manifests/qwen3-vl-2b.json |
Qwen/Qwen3-VL-2B-Instruct | qwen_vl | vision_language_generation | fp32; TP4 | families/qwen_vl/tests/manifests/qwen3-vl-2b-tp4.json |
Efficient-Large-Model/SANA-WM_bidirectional | sana_wm | world_model_generation | bf16; Single device | families/sana_wm/tests/manifests/sana-wm-bidirectional.json |
For task-oriented navigation, see Model Recipes.