Supported Models
Support is defined by files that live inside one self-contained
families/<family>/ directory. Each row below points to that family's own
E2E manifest; there is no central model registry or duplicated support matrix.
- 159 self-contained family modules under
families/. - 378 family-owned E2E manifests under
families/*/tests/manifests/. - Every runtime DSO implements an abstract task interface directly.
Declared recipes
An entry means the repository contains a builder, a native runtime DSO that implements an abstract Task API, and a family-owned test recipe for that exact checkpoint. It is not a promise that an unlisted fine-tune is compatible.
A manifest with hf_id names its Hugging Face source. A manifest without
hf_id intentionally represents a family-owned prepared local checkpoint; the
inventory labels it as such instead of inventing Hugging Face metadata.
| Checkpoint | Family | Task interface | Build | Owned manifest |
|---|---|---|---|---|
nvidia/magpie_tts_multilingual_357m | magpie_tts | audio_generation | fp32; Single device | families/magpie_tts/tests/manifests/magpie-tts-357m.json |
nvidia/magpie_tts_multilingual_357m | magpie_tts | audio_generation | fp32; TP4 | families/magpie_tts/tests/manifests/magpie-tts-357m-tp4.json |
MiniMaxAI/MiniMax-Music3 | minimax_music3 | audio_generation | bf16; Single device | families/minimax_music3/tests/manifests/minimax-music3-l0.json |
MIT/ast-finetuned-audioset-10-10-0.4593 | ast | audio_to_class_scores | fp32; Single device | families/ast/tests/manifests/ast-finetuned-audioset-10-10-0.4593.json |
nvidia/Nemotron-3-Nano-Omni-30B-A3B-Reasoning-NVFP4 | nemotron_omni | audio_video_text_to_text | fp16; Single device | families/nemotron_omni/tests/manifests/nemotron-omni-nvfp4-native.json |
timm/dpn68b.ra_in1k | timm_dpn | classification | fp16; Single device | families/timm_dpn/tests/manifests/dpn68b-ra-in1k.json |
timm/dpn92.mx_in1k | timm_dpn | classification | fp16; Single device | families/timm_dpn/tests/manifests/dpn92-mx-in1k.json |
timm/hrnet_w18.ms_aug_in1k | timm_hrnet | classification | fp16; Single device | families/timm_hrnet/tests/manifests/hrnet-w18-ms-aug-in1k.json |
timm/mnasnet_100.rmsp_in1k | timm_mnasnet | classification | fp16; Single device | families/timm_mnasnet/tests/manifests/mnasnet-100-rmsp-in1k.json |
timm/dm_nfnet_f0.dm_in1k | timm_nfnet | classification | fp16; Single device | families/timm_nfnet/tests/manifests/dm-nfnet-f0-dm-in1k.json |
timm/dm_nfnet_f3.dm_in1k | timm_nfnet | classification | fp16; Single device | families/timm_nfnet/tests/manifests/dm-nfnet-f3-dm-in1k.json |
timm/repvgg_a2.rvgg_in1k | timm_repvgg | classification | fp16; Single device | families/timm_repvgg/tests/manifests/repvgg-a2-rvgg-in1k.json |
timm/res2net50_26w_4s.in1k | timm_res2net | classification | fp16; Single device | families/timm_res2net/tests/manifests/res2net50-26w-4s-in1k.json |
timm/res2net50d.in1k | timm_res2net | classification | fp16; Single device | families/timm_res2net/tests/manifests/res2net50d-in1k.json |
timm/res2next50.in1k | timm_res2net | classification | fp16; Single device | families/timm_res2net/tests/manifests/res2next50-in1k.json |
timm/senet154.gluon_in1k | timm_senet | classification | fp16; Single device | families/timm_senet/tests/manifests/senet154-gluon-in1k.json |
timm/seresnet50.a1_in1k | timm_seresnet | classification | fp16; Single device | families/timm_seresnet/tests/manifests/seresnet50-a1-in1k.json |
timm/vgg16.tv_in1k | timm_vgg | classification | fp16; Single device | families/timm_vgg/tests/manifests/vgg16-tv-in1k.json |
timm/xception41.tf_in1k | timm_xception | classification | fp16; Single device | families/timm_xception/tests/manifests/xception41-tf-in1k.json |
sentence-transformers/all-MiniLM-L6-v2 | bert | embedding | fp16; Single device | families/bert/tests/manifests/all-minilm-l6-v2.json |
intfloat/multilingual-e5-small | bert | embedding | fp16; Single device | families/bert/tests/manifests/multilingual-e5-small.json |
google/embeddinggemma-2 | embeddinggemma2 | embedding | bf16; Single device | families/embeddinggemma2/tests/manifests/embeddinggemma2-text-bf16.json |
google/embeddinggemma-2 | embeddinggemma2 | embedding | fp32; Single device | families/embeddinggemma2/tests/manifests/embeddinggemma2-text-fp32.json |
Qwen/Qwen3-Embedding-0.6B | qwen | embedding | bf16; Single device | families/qwen/tests/manifests/qwen3-embedding-0.6b.json |
google-bert/bert-base-uncased | bert | encoding | fp16; Single device | families/bert/tests/manifests/bert-base-uncased.json |
google-bert/bert-base-uncased | bert | encoding | fp32; TP4 | families/bert/tests/manifests/bert-base-uncased-tp4.json |
BAAI/bge-small-en-v1.5 | bert | encoding | fp16; Single device | families/bert/tests/manifests/bge-small-en-v1.5.json |
sentence-transformers/paraphrase-multilingual-MiniLM-L12-v2 | bert | encoding | fp16; Single device | families/bert/tests/manifests/paraphrase-multilingual-minilm-l12-v2.json |
YituTech/conv-bert-base | convbert | encoding | fp16; Single device | families/convbert/tests/manifests/convbert-base.json |
YituTech/conv-bert-base | convbert | encoding | fp32; TP2 | families/convbert/tests/manifests/convbert-base-tp2.json |
almanach/camembert-base | roberta | encoding | fp16; Single device | families/roberta/tests/manifests/camembert-base.json |
almanach/camembert-base | roberta | encoding | fp32; TP4 | families/roberta/tests/manifests/camembert-base-tp4.json |
FacebookAI/roberta-base | roberta | encoding | fp16; Single device | families/roberta/tests/manifests/roberta-base.json |
FacebookAI/roberta-base | roberta | encoding | fp16; Single device | families/roberta/tests/manifests/roberta-base-fp8.json |
FacebookAI/roberta-base | roberta | encoding | fp32; TP4 | families/roberta/tests/manifests/roberta-base-tp4.json |
FacebookAI/roberta-large | roberta | encoding | fp16; Single device | families/roberta/tests/manifests/roberta-large.json |
FacebookAI/roberta-large | roberta | encoding | fp32; TP4 | families/roberta/tests/manifests/roberta-large-tp4.json |
FacebookAI/xlm-roberta-base | roberta | encoding | fp16; Single device | families/roberta/tests/manifests/xlm-roberta-base.json |
FacebookAI/xlm-roberta-base | roberta | encoding | fp32; TP4 | families/roberta/tests/manifests/xlm-roberta-base-tp4.json |
Qwen/Qwen-Image-Edit-2511 | qwen_image | image_edit | bf16; Single device | families/qwen_image/tests/manifests/qwen-image-edit-2511.json |
facebook/dinov3-convnext-tiny-pretrain-lvd1689m | dinov3 | image_features | fp16; Single device | families/dinov3/tests/manifests/dinov3-convnext-tiny-pretrain-lvd1689m.json |
facebook/dinov3-convnext-tiny-pretrain-lvd1689m | dinov3 | image_features | fp16; Single device | families/dinov3/tests/manifests/dinov3-convnext-tiny-pretrain-lvd1689m-fp8.json |
facebook/dinov3-vits16-pretrain-lvd1689m | dinov3 | image_features | fp16; Single device | families/dinov3/tests/manifests/dinov3-vits16-pretrain-lvd1689m.json |
facebook/dinov3-vits16-pretrain-lvd1689m | dinov3 | image_features | fp16; Single device | families/dinov3/tests/manifests/dinov3-vits16-pretrain-lvd1689m-fp8.json |
timm/vit_small_patch16_dinov3_qkvb.lvd1689m | dinov3 | image_features | fp16; Single device | families/dinov3/tests/manifests/dinov3-vits16-timm-l0.json |
nvidia/Cosmos3-Nano | cosmos3 | image_generation | bf16; Single device | families/cosmos3/tests/manifests/cosmos3-nano-l0.json |
nvidia/Cosmos3-Nano | cosmos3 | image_generation | bf16; CP2 | families/cosmos3/tests/manifests/cosmos3-nano-l0-cp2.json |
black-forest-labs/FLUX.2-dev | flux | image_generation | bf16; Single device | families/flux/tests/manifests/flux-2-dev.json |
black-forest-labs/FLUX.2-dev | flux | image_generation | fp16; Single device | families/flux/tests/manifests/flux-2-dev-fp8.json |
black-forest-labs/FLUX.2-dev | flux | image_generation | fp16; Single device | families/flux/tests/manifests/flux-2-dev-fp8-l0.json |
black-forest-labs/FLUX.2-dev | flux | image_generation | fp16; TP4 | families/flux/tests/manifests/flux-2-dev-fp8-l0-tp4.json |
black-forest-labs/FLUX.2-dev | flux | image_generation | bf16; Single device | families/flux/tests/manifests/flux-2-dev-l0.json |
black-forest-labs/FLUX.2-dev | flux | image_generation | fp16; TP4 | families/flux/tests/manifests/flux-2-dev-l0-tp4.json |
black-forest-labs/FLUX.1-schnell | flux | image_generation | fp16; Single device | families/flux/tests/manifests/flux-schnell.json |
black-forest-labs/FLUX.1-schnell | flux | image_generation | fp16; Single device | families/flux/tests/manifests/flux-schnell-l0.json |
black-forest-labs/FLUX.1-schnell | flux | image_generation | fp32; CP4 | families/flux/tests/manifests/flux-schnell-l0-cp4.json |
black-forest-labs/FLUX.1-schnell | flux | image_generation | fp32; TP4 | families/flux/tests/manifests/flux-schnell-l0-tp4.json |
Lightricks/LTX-Video | ltx_video | image_generation | fp16; Single device | families/ltx_video/tests/manifests/ltx-video-fp8-l0.json |
Lightricks/LTX-Video | ltx_video | image_generation | fp16; Single device | families/ltx_video/tests/manifests/ltx-video-l0.json |
MiniMaxAI/MiniMax-H3 | minimax_h3 | image_generation | bf16; Single device | families/minimax_h3/tests/manifests/minimax-h3-768p.json |
PixArt-alpha/PixArt-Sigma-XL-2-1024-MS | pixart | image_generation | fp16; Single device | families/pixart/tests/manifests/pixart-sigma-1024.json |
PixArt-alpha/PixArt-Sigma-XL-2-1024-MS | pixart | image_generation | fp16; Single device | families/pixart/tests/manifests/pixart-sigma-1024-l0.json |
PixArt-alpha/PixArt-Sigma-XL-2-1024-MS | pixart | image_generation | fp32; TP4 | families/pixart/tests/manifests/pixart-sigma-1024-tp4.json |
Qwen/Qwen-Image | qwen_image | image_generation | bf16; Single device | families/qwen_image/tests/manifests/qwen-image.json |
Qwen/Qwen-Image-2512 | qwen_image | image_generation | bf16; Single device | families/qwen_image/tests/manifests/qwen-image-2512.json |
Qwen/Qwen-Image-2512 | qwen_image | image_generation | bf16; Single device | families/qwen_image/tests/manifests/qwen-image-2512-fp8-l0.json |
Qwen/Qwen-Image | qwen_image | image_generation | bf16; Single device | families/qwen_image/tests/manifests/qwen-image-l0.json |
stabilityai/sdxl-turbo | stable_diffusion | image_generation | fp16; Single device | families/stable_diffusion/tests/manifests/sdxl-turbo.json |
stable-diffusion-v1-5/stable-diffusion-v1-5 | stable_diffusion | image_generation | fp16; Single device | families/stable_diffusion/tests/manifests/stable-diffusion-v1-5.json |
Wan-AI/Wan2.1-T2V-1.3B-Diffusers | wan_t2v | image_generation | fp16; Single device | families/wan_t2v/tests/manifests/wan21-t2v-1.3b.json |
Wan-AI/Wan2.1-T2V-1.3B-Diffusers | wan_t2v | image_generation | fp16; Single device | families/wan_t2v/tests/manifests/wan21-t2v-1.3b-fp8-l0.json |
Wan-AI/Wan2.1-T2V-1.3B-Diffusers | wan_t2v | image_generation | fp16; Single device | families/wan_t2v/tests/manifests/wan21-t2v-1.3b-l0.json |
Wan-AI/Wan2.1-T2V-1.3B-Diffusers | wan_t2v | image_generation | fp16; CP4 | families/wan_t2v/tests/manifests/wan21-t2v-1.3b-l0-cp4.json |
Wan-AI/Wan2.1-T2V-1.3B-Diffusers | wan_t2v | image_generation | fp32; TP4 | families/wan_t2v/tests/manifests/wan21-t2v-1.3b-l0-tp4.json |
Wan-AI/Wan2.2-TI2V-5B | wan2_2_ti2v | image_generation | bf16; Single device | families/wan2_2_ti2v/tests/manifests/wan22-ti2v-5b.json |
Wan-AI/Wan2.2-TI2V-5B | wan2_2_ti2v | image_generation | bf16; Single device | families/wan2_2_ti2v/tests/manifests/wan22-ti2v-5b-fp8.json |
Wan-AI/Wan2.2-TI2V-5B | wan2_2_ti2v | image_generation | bf16; Single device | families/wan2_2_ti2v/tests/manifests/wan22-ti2v-5b-l0.json |
Tongyi-MAI/Z-Image-Turbo | z_image | image_generation | fp16; Single device | families/z_image/tests/manifests/z-image-turbo.json |
Tongyi-MAI/Z-Image-Turbo | z_image | image_generation | fp16; Single device | families/z_image/tests/manifests/z-image-turbo-fp8-l0.json |
Tongyi-MAI/Z-Image-Turbo | z_image | image_generation | fp16; Single device | families/z_image/tests/manifests/z-image-turbo-l0.json |
Tongyi-MAI/Z-Image-Turbo | z_image | image_generation | fp32; TP2 | families/z_image/tests/manifests/z-image-turbo-l0-tp2.json |
black-forest-labs/FLUX.1-schnell | flux | image_generation_batch | fp16; Single device | families/flux/tests/manifests/flux-schnell-l0-batch2.json |
lerobot/act_aloha_sim_transfer_cube_human | lerobot_act | image_state_to_action_chunk | fp32; Single device | families/lerobot_act/tests/manifests/act-aloha-sim-transfer-cube.json |
lerobot/act_aloha_sim_transfer_cube_human | lerobot_act | image_state_to_action_chunk | fp16; Single device | families/lerobot_act/tests/manifests/act-aloha-sim-transfer-cube-fp16.json |
IDEA-Research/grounding-dino-tiny | grounding_dino | image_text_to_boxes | fp16; Single device | families/grounding_dino/tests/manifests/grounding-dino-tiny.json |
google/owlv2-base-patch16-ensemble | owlv2 | image_text_to_boxes | fp16; Single device | families/owlv2/tests/manifests/owlv2-base-patch16-ensemble.json |
jameslahm/yolov10n | yolov10 | image_to_boxes | fp16; Single device | families/yolov10/tests/manifests/yolov10n.json |
jameslahm/yolov10s | yolov10 | image_to_boxes | fp16; Single device | families/yolov10/tests/manifests/yolov10s.json |
jameslahm/yolov10x | yolov10 | image_to_boxes | fp16; Single device | families/yolov10/tests/manifests/yolov10x.json |
Ultralytics/YOLOv5 | yolov5 | image_to_boxes | fp16; Single device | families/yolov5/tests/manifests/yolov5n.json |
Ultralytics/YOLOv8 | yolov8 | image_to_boxes | fp16; Single device | families/yolov8/tests/manifests/yolov8n.json |
timm/convnext_tiny.in12k_ft_in1k | timm_convnext | image_to_class_scores | fp16; Single device | families/timm_convnext/tests/manifests/convnext-tiny-in12k-ft-in1k.json |
timm/crossvit_9_240.in1k | timm_crossvit | image_to_class_scores | fp16; Single device | families/timm_crossvit/tests/manifests/crossvit-9-240-in1k.json |
timm/densenet121.ra_in1k | timm_densenet | image_to_class_scores | fp16; Single device | families/timm_densenet/tests/manifests/densenet121-ra-in1k.json |
timm/efficientnet_b0.ra_in1k | timm_efficientnet | image_to_class_scores | fp16; Single device | families/timm_efficientnet/tests/manifests/efficientnet-b0-ra-in1k.json |
timm/ghostnet_100.in1k | timm_ghostnet | image_to_class_scores | fp16; Single device | families/timm_ghostnet/tests/manifests/ghostnet-100-in1k.json |
timm/inception_v3.tv_in1k | timm_inception | image_to_class_scores | fp16; Single device | families/timm_inception/tests/manifests/inception-v3-tv-in1k.json |
timm/inception_resnet_v2.tf_in1k | timm_inception_resnet | image_to_class_scores | fp16; Single device | families/timm_inception_resnet/tests/manifests/inception-resnet-v2-tf-in1k.json |
timm/inception_v4.tf_in1k | timm_inception_v4 | image_to_class_scores | fp16; Single device | families/timm_inception_v4/tests/manifests/inception-v4-tf-in1k.json |
timm/mobilenetv2_100.ra_in1k | timm_mobilenetv2 | image_to_class_scores | fp16; Single device | families/timm_mobilenetv2/tests/manifests/mobilenetv2-100-ra-in1k.json |
timm/mobilenetv3_large_100.ra_in1k | timm_mobilenetv3 | image_to_class_scores | fp16; Single device | families/timm_mobilenetv3/tests/manifests/mobilenetv3-large-100-ra-in1k.json |
timm/mobilenetv4_conv_large.e500_r256_in1k | timm_mobilenetv4 | image_to_class_scores | fp16; Single device | families/timm_mobilenetv4/tests/manifests/mobilenetv4-conv-large.json |
timm/mobilenetv4_conv_medium.e500_r256_in1k | timm_mobilenetv4 | image_to_class_scores | fp16; Single device | families/timm_mobilenetv4/tests/manifests/mobilenetv4-conv-medium.json |
timm/mobilenetv4_conv_small.e2400_r224_in1k | timm_mobilenetv4 | image_to_class_scores | fp16; Single device | families/timm_mobilenetv4/tests/manifests/mobilenetv4-conv-small.json |
timm/mobilenetv4_conv_small_050.e3000_r224_in1k | timm_mobilenetv4 | image_to_class_scores | fp16; Single device | families/timm_mobilenetv4/tests/manifests/mobilenetv4-conv-small-050.json |
timm/mobilevit_s.cvnets_in1k | timm_mobilevit | image_to_class_scores | fp16; Single device | families/timm_mobilevit/tests/manifests/mobilevit-s-cvnets-in1k.json |
timm/mobilevit_xxs.cvnets_in1k | timm_mobilevit | image_to_class_scores | fp16; Single device | families/timm_mobilevit/tests/manifests/mobilevit-xxs-cvnets-in1k.json |
timm/regnety_040.ra3_in1k | timm_regnet | image_to_class_scores | fp16; Single device | families/timm_regnet/tests/manifests/regnety-040-ra3-in1k.json |
timm/resnest50d.in1k | timm_resnest | image_to_class_scores | fp16; Single device | families/timm_resnest/tests/manifests/resnest50d-in1k.json |
timm/resnet50.a1_in1k | timm_resnet | image_to_class_scores | fp16; Single device | families/timm_resnet/tests/manifests/resnet50-a1-in1k.json |
timm/swin_tiny_patch4_window7_224.ms_in1k | timm_swin | image_to_class_scores | fp16; Single device | families/timm_swin/tests/manifests/swin-tiny-patch4-window7-224-ms-in1k.json |
timm/vit_base_patch16_224.augreg_in21k_ft_in1k | timm_vit | image_to_class_scores | fp16; Single device | families/timm_vit/tests/manifests/timm-vit-base-p16-224-augreg-in21k-ft-in1k.json |
timm/vit_base_patch16_224.augreg_in21k_ft_in1k | timm_vit | image_to_class_scores | fp32; TP4 | families/timm_vit/tests/manifests/timm-vit-base-p16-224-augreg-in21k-ft-in1k-tp4.json |
timm/xcit_nano_12_p16_224.fb_in1k | timm_xcit | image_to_class_scores | fp16; Single device | families/timm_xcit/tests/manifests/xcit-nano-12-p16-224-fb-in1k.json |
timm/xcit_tiny_12_p16_224.fb_in1k | timm_xcit | image_to_class_scores | fp16; Single device | families/timm_xcit/tests/manifests/xcit-tiny-12-p16-224-fb-in1k.json |
google/vit-base-patch16-224 | vit | image_to_class_scores | fp32; Single device | families/vit/tests/manifests/vit-base-patch16-224.json |
google/vit-base-patch16-224 | vit | image_to_class_scores | fp16; Single device | families/vit/tests/manifests/vit-base-patch16-224-fp16.json |
google/vit-base-patch16-224 | vit | image_to_class_scores | fp16; Single device | families/vit/tests/manifests/vit-base-patch16-224-fp8.json |
facebook/dinov2-base | dinov2 | image_to_token_and_pooled_features | fp32; Single device | families/dinov2/tests/manifests/dinov2-base.json |
nvidia/Cosmos3-Edge | cosmos3_edge | image_video_text_to_text | fp16; Single device | families/cosmos3_edge/tests/manifests/cosmos3-edge-fp16.json |
nvidia/Cosmos3-Edge | cosmos3_edge | image_video_text_to_text | fp32; Single device | families/cosmos3_edge/tests/manifests/cosmos3-edge-fp32.json |
nvidia/gr00t17-lerobot-libero_spatial-640 | lerobot_groot | images_state_text_to_action_chunk | bf16; Single device | families/lerobot_groot/tests/manifests/groot-n17-libero-spatial-bf16.json |
nvidia/gr00t17-lerobot-libero_spatial-640 | lerobot_groot | images_state_text_to_action_chunk | fp32; Single device | families/lerobot_groot/tests/manifests/groot-n17-libero-spatial-fp32.json |
lerobot/pi05_libero_base | lerobot_pi05 | images_state_text_to_action_chunk | bf16; Single device | families/lerobot_pi05/tests/manifests/pi05-libero-base-bf16.json |
lerobot/pi05_libero_base | lerobot_pi05 | images_state_text_to_action_chunk | fp32; Single device | families/lerobot_pi05/tests/manifests/pi05-libero-base-fp32.json |
facebook/esm2_t33_650M_UR50D | esm | masked_text_to_token_scores | fp32; Single device | families/esm/tests/manifests/esm2-t33-650m-ur50d.json |
facebook/esm2_t33_650M_UR50D | esm | masked_text_to_token_scores | fp16; Single device | families/esm/tests/manifests/esm2-t33-650m-ur50d-fp16.json |
depth-anything/Depth-Anything-V2-Small-hf | depth_anything | monocular_depth | fp16; Single device | families/depth_anything/tests/manifests/depth-anything-v2-small.json |
Ruicheng/moge-2-vitl | moge | monocular_geometry | fp32; Single device | families/moge/tests/manifests/moge-2-vitl.json |
SenseTime/deformable-detr | deformable_detr | object_detection | fp16; Single device | families/deformable_detr/tests/manifests/deformable-detr-r50.json |
facebook/detr-resnet-50 | detr | object_detection | fp16; Single device | families/detr/tests/manifests/detr-resnet-50.json |
PekingU/rtdetr_v2_r18vd | rt_detr_v2 | object_detection | fp16; Single device | families/rt_detr_v2/tests/manifests/rtdetr-v2-r18.json |
Ultralytics/YOLO11 | yolo11 | object_detection | fp16; Single device | families/yolo11/tests/manifests/yolo11n.json |
hustvl/yolos-small | yolos | object_detection | fp16; Single device | families/yolos/tests/manifests/yolos-small.json |
prepared local checkpoint | pointnet | points_to_semantic_segmentation | fp16; Single device | families/pointnet/tests/manifests/pointnet-s3dis.json |
prepared local checkpoint | foundationpose | pose_hypothesis_refinement | fp16; Single device | families/foundationpose/tests/manifests/foundationpose-ngc-1.0.1.json |
facebook/sam-vit-base | sam | prompted_segmentation | fp16; Single device | families/sam/tests/manifests/sam-vit-base.json |
facebook/sam-vit-base | sam | prompted_segmentation | fp32; TP4 | families/sam/tests/manifests/sam-vit-base-tp4.json |
ZhengPeng7/BiRefNet_lite | birefnet | segmentation | fp16; Single device | families/birefnet/tests/manifests/birefnet-lite.json |
nvidia/segformer-b0-finetuned-ade-512-512 | segformer | segmentation | fp16; Single device | families/segformer/tests/manifests/segformer-b0-ade.json |
nvidia/segformer-b0-finetuned-ade-512-512 | segformer | segmentation | fp32; TP4 | families/segformer/tests/manifests/segformer-b0-ade-tp4.json |
nvidia/NVIDIA-NemotronLabs-VoiceChat-11B | nemotron_voicechat | speech_session | fp32; Single device | families/nemotron_voicechat/tests/manifests/nemotron-voicechat-11b.json |
nvidia/personaplex-7b-v1 | personaplex | speech_to_speech | fp16; Single device | families/personaplex/tests/manifests/personaplex-7b.json |
nvidia/personaplex-7b-v1 | personaplex | speech_to_speech | fp16; Single device | families/personaplex/tests/manifests/personaplex-7b-fp8.json |
nvidia/personaplex-7b-v1 | personaplex | speech_to_speech | fp16; Single device | families/personaplex/tests/manifests/personaplex-7b-l0.json |
nvidia/personaplex-7b-v1 | personaplex | speech_to_speech | fp32; TP4 | families/personaplex/tests/manifests/personaplex-7b-l0-tp4.json |
nvidia/parakeet-tdt-0.6b-v3 | parakeet_tdt | speech_transcription | fp16; Single device | families/parakeet_tdt/tests/manifests/parakeet-tdt-0.6b-v3.json |
facebook/wav2vec2-base-960h | wav2vec2 | speech_transcription | fp32; Single device | families/wav2vec2/tests/manifests/wav2vec2-base-960h.json |
jonatasgrosman/wav2vec2-large-xlsr-53-japanese | wav2vec2 | speech_transcription | fp32; Single device | families/wav2vec2/tests/manifests/wav2vec2-xlsr-53-japanese.json |
nvidia/c-fast-foundationstereo | fast_foundation_stereo | stereo_disparity | fp16; Single device | families/fast_foundation_stereo/tests/manifests/fast-foundation-stereo.json |
boltz-community/boltz-2 | boltz2 | structure_prediction | bf16; Single device | families/boltz2/tests/manifests/boltz2-protein-monomer.json |
prepared local checkpoint | openfold3 | structure_prediction | fp16; Single device | families/openfold3/tests/manifests/openfold3-ubiquitin-fp16-l0.json |
Cloudflare/clef | clef | structured_decision | bf16; Single device | families/clef/tests/manifests/clef.json |
Cloudflare/clef-flash | clef | structured_decision | bf16; Single device | families/clef/tests/manifests/clef-flash.json |
convaiinnovations/laya | laya | structured_decision | bf16; Single device | families/laya/tests/manifests/laya.json |
convaiinnovations/laya | laya | structured_decision | bf16; Single device | families/laya/tests/manifests/laya-multilingual.json |
convaiinnovations/laya | laya | structured_decision | bf16; Single device | families/laya/tests/manifests/laya-router.json |
convaiinnovations/laya | laya | structured_decision | bf16; Single device | families/laya/tests/manifests/laya-typed-decisions.json |
facebook/bart-base | bart | text_generation | fp16; Single device | families/bart/tests/manifests/bart-base.json |
facebook/bart-base | bart | text_generation | fp32; TP4 | families/bart/tests/manifests/bart-base-tp4.json |
bigscience/bloom-560m | bloom | text_generation | fp32; Single device | families/bloom/tests/manifests/bloom-560m.json |
bigscience/bloom-560m | bloom | text_generation | fp32; TP4 | families/bloom/tests/manifests/bloom-560m-tp4.json |
Salesforce/codegen-350M-mono | codegen | text_generation | fp16; Single device | families/codegen/tests/manifests/codegen-350m.json |
Salesforce/codegen-350M-mono | codegen | text_generation | fp32; TP4 | families/codegen/tests/manifests/codegen-350m-tp4.json |
deepseek-ai/DeepSeek-V2-Lite | deepseek_v2 | text_generation | fp16; Single device | families/deepseek_v2/tests/manifests/deepseek-v2-lite.json |
deepseek-ai/DeepSeek-V2-Lite | deepseek_v2 | text_generation | fp32; TP4 | families/deepseek_v2/tests/manifests/deepseek-v2-lite-tp4.json |
katuni4ka/tiny-random-deepseek-v3 | deepseek_v2 | text_generation | fp16; Single device | families/deepseek_v2/tests/manifests/deepseek-v2-tiny.json |
katuni4ka/tiny-random-deepseek-v3 | deepseek_v2 | text_generation | fp32; TP2 | families/deepseek_v2/tests/manifests/deepseek-v2-tiny-tp2.json |
embedded-language-flows/ELF-B-de-en | elf_flow | text_generation | fp16; Single device | families/elf_flow/tests/manifests/elf-b-de-en-l0.json |
embedded-language-flows/ELF-B-owt | elf_flow | text_generation | fp32; Single device | families/elf_flow/tests/manifests/elf-b-owt-l0.json |
embedded-language-flows/ELF-B-xsum | elf_flow | text_generation | fp16; Single device | families/elf_flow/tests/manifests/elf-b-xsum-l0.json |
tiiuae/falcon-rw-1b | falcon | text_generation | fp16; Single device | families/falcon/tests/manifests/falcon-rw-1b.json |
tiiuae/falcon-rw-1b | falcon | text_generation | fp32; TP4 | families/falcon/tests/manifests/falcon-rw-1b-tp4.json |
google/gemma-2-2b-it | gemma | text_generation | fp16; Single device | families/gemma/tests/manifests/gemma-2-2b.json |
google/gemma-2-2b-it | gemma | text_generation | fp32; TP4 | families/gemma/tests/manifests/gemma-2-2b-tp4.json |
google/gemma-3-12b-it | gemma | text_generation | bf16; Single device | families/gemma/tests/manifests/gemma-3-12b.json |
google/gemma-3-1b-it | gemma | text_generation | bf16; Single device | families/gemma/tests/manifests/gemma-3-1b.json |
google/gemma-3-270m-it | gemma | text_generation | bf16; Single device | families/gemma/tests/manifests/gemma-3-270m.json |
google/gemma-3-27b-it | gemma | text_generation | bf16; Single device | families/gemma/tests/manifests/gemma-3-27b.json |
google/gemma-3-4b-it | gemma | text_generation | bf16; Single device | families/gemma/tests/manifests/gemma-3-4b.json |
THUDM/glm-4-9b-hf | glm | text_generation | fp16; Single device | families/glm/tests/manifests/glm-4-9b.json |
THUDM/glm-4-9b-hf | glm | text_generation | fp16; Single device | families/glm/tests/manifests/glm-4-9b-l0.json |
THUDM/glm-4-9b-hf | glm | text_generation | fp32; TP2 | families/glm/tests/manifests/glm-4-9b-l0-tp2.json |
EleutherAI/gpt-neo-125m | gpt_neo | text_generation | fp16; Single device | families/gpt_neo/tests/manifests/gpt-neo-125m.json |
EleutherAI/gpt-neo-125m | gpt_neo | text_generation | fp32; TP4 | families/gpt_neo/tests/manifests/gpt-neo-125m-tp4.json |
EleutherAI/pythia-70m | gpt_neox | text_generation | fp32; Single device | families/gpt_neox/tests/manifests/pythia-70m.json |
EleutherAI/pythia-70m | gpt_neox | text_generation | fp32; TP4 | families/gpt_neox/tests/manifests/pythia-70m-tp4.json |
openai/gpt-oss-20b | gpt_oss | text_generation | fp16; Single device | families/gpt_oss/tests/manifests/gpt-oss-20b.json |
openai/gpt-oss-20b | gpt_oss | text_generation | fp16; Single device | families/gpt_oss/tests/manifests/gpt-oss-20b-l0.json |
openai/gpt-oss-20b | gpt_oss | text_generation | fp32; TP4 | families/gpt_oss/tests/manifests/gpt-oss-20b-l0-tp4.json |
distilbert/distilgpt2 | gpt2 | text_generation | fp16; Single device | families/gpt2/tests/manifests/distilgpt2.json |
openai-community/gpt2 | gpt2 | text_generation | fp32; Single device | families/gpt2/tests/manifests/gpt2-125m.json |
openai-community/gpt2 | gpt2 | text_generation | fp32; TP4 | families/gpt2/tests/manifests/gpt2-125m-tp4.json |
ibm-granite/granite-3.1-2b-base | granite | text_generation | fp16; Single device | families/granite/tests/manifests/granite-3.1-2b.json |
ibm-granite/granite-3.1-2b-base | granite | text_generation | fp32; TP4 | families/granite/tests/manifests/granite-3.1-2b-tp4.json |
tencent/HY-MT1.5-7B | hunyuan | text_generation | fp16; Single device | families/hunyuan/tests/manifests/hy-mt1.5-7b.json |
tencent/Hy-MT2-1.8B | hunyuan | text_generation | fp16; Single device | families/hunyuan/tests/manifests/hy-mt2-1.8b.json |
tencent/Hy-MT2-7B | hunyuan | text_generation | fp16; Single device | families/hunyuan/tests/manifests/hy-mt2-7b.json |
internlm/internlm2-math-plus-1_8b | internlm | text_generation | fp16; Single device | families/internlm/tests/manifests/internlm2-1.8b.json |
internlm/internlm2-math-plus-1_8b | internlm | text_generation | fp32; TP4 | families/internlm/tests/manifests/internlm2-1.8b-tp4.json |
IFM/K2-Horizon-7B | k2_horizon | text_generation | bf16; Single device | families/k2_horizon/tests/manifests/k2-horizon-7b.json |
IFM/K2-Horizon-7B-Uno | k2_horizon_uno | text_generation | bf16; Single device | families/k2_horizon_uno/tests/manifests/k2-horizon-7b-uno.json |
LiquidAI/LFM2-1.2B | lfm2 | text_generation | bf16; Single device | families/lfm2/tests/manifests/lfm2-1.2b.json |
LiquidAI/LFM2-2.6B | lfm2 | text_generation | fp16; Single device | families/lfm2/tests/manifests/lfm2-2.6b.json |
LiquidAI/LFM2-350M | lfm2 | text_generation | bf16; Single device | families/lfm2/tests/manifests/lfm2-350m-bf16-model-card.json |
LiquidAI/LFM2-350M | lfm2 | text_generation | fp16; Single device | families/lfm2/tests/manifests/lfm2-350m-fp16.json |
LiquidAI/LFM2-700M | lfm2 | text_generation | fp16; Single device | families/lfm2/tests/manifests/lfm2-700m.json |
LiquidAI/LFM3-1.7B | lfm3 | text_generation | bf16; Single device | families/lfm3/tests/manifests/lfm3-1.7b-bf16.json |
LiquidAI/LFM3-1.7B | lfm3 | text_generation | fp16; Single device | families/lfm3/tests/manifests/lfm3-1.7b-fp16.json |
tiiuae/Falcon3-1B-Base | llama | text_generation | fp16; Single device | families/llama/tests/manifests/falcon3-1b.json |
nvidia/Llama-3.1-8B-Instruct-FP8 | llama | text_generation | bf16; Single device | families/llama/tests/manifests/llama-3.1-8b-fp8.json |
nvidia/Llama-3.1-8B-Instruct-NVFP4 | llama | text_generation | bf16; Single device | families/llama/tests/manifests/llama-3.1-8b-nvfp4.json |
openbmb/MiniCPM5-2B | llama | text_generation | fp16; Single device | families/llama/tests/manifests/minicpm5-2b.json |
nvidia/Llama-3.1-Minitron-4B-Depth-Base | llama | text_generation | fp16; Single device | families/llama/tests/manifests/minitron-4b-depth.json |
nvidia/Llama-3.1-Minitron-4B-Width-Base | llama | text_generation | fp16; Single device | families/llama/tests/manifests/minitron-4b-width.json |
nvidia/Llama-3.1-Minitron-4B-Width-Base | llama | text_generation | fp16; Single device | families/llama/tests/manifests/minitron-4b-width-l0.json |
nvidia/Llama-3.1-Minitron-4B-Width-Base | llama | text_generation | bf16; Single device | families/llama/tests/manifests/minitron-4b-width-regression-native-kv-chunked-prefill.json |
nvidia/Llama-3.1-Nemotron-Nano-4B-v1.1 | llama | text_generation | fp16; Single device | families/llama/tests/manifests/nemotron-nano-4b.json |
TinyLlama/TinyLlama-1.1B-Chat-v1.0 | llama | text_generation | fp16; Single device | families/llama/tests/manifests/tinyllama-1.1b.json |
facebook/nllb-200-distilled-600M | m2m_100 | text_generation | fp16; Single device | families/m2m_100/tests/manifests/nllb-200.json |
state-spaces/mamba-130m-hf | mamba | text_generation | fp32; Single device | families/mamba/tests/manifests/mamba-130m.json |
state-spaces/mamba-130m-hf | mamba | text_generation | fp32; TP4 | families/mamba/tests/manifests/mamba-130m-tp4.json |
Helsinki-NLP/opus-mt-en-ru | marian | text_generation | fp16; Single device | families/marian/tests/manifests/marian-en-ru.json |
Helsinki-NLP/opus-mt-en-ru | marian | text_generation | fp32; TP4 | families/marian/tests/manifests/marian-en-ru-tp4.json |
mistralai/Mistral-7B-Instruct-v0.1 | mistral | text_generation | fp16; Single device | families/mistral/tests/manifests/mistral-7b.json |
mistralai/Mistral-7B-Instruct-v0.1 | mistral | text_generation | fp16; Single device | families/mistral/tests/manifests/mistral-7b-l0.json |
nvidia/Riva-Translate-4B-Instruct-v1.1 | mistral | text_generation | fp16; Single device | families/mistral/tests/manifests/riva-translate-4b.json |
ggml-org/stories15M_MOE | mixtral | text_generation | fp16; Single device | families/mixtral/tests/manifests/mixtral-stories-15m.json |
ggml-org/stories15M_MOE | mixtral | text_generation | fp32; TP2 | families/mixtral/tests/manifests/mixtral-stories-15m-tp2.json |
RadixArk/Muse-Glimmer-NVFP4 | muse_glimmer | text_generation | fp16; Single device | families/muse_glimmer/tests/manifests/muse-glimmer-nvfp4.json |
nvidia/Nemotron-4-Mini-Hindi-4B-Base | nemotron | text_generation | bf16; Single device | families/nemotron/tests/manifests/nemotron-hindi-4b.json |
nvidia/Nemotron-Mini-4B-Instruct | nemotron | text_generation | fp16; Single device | families/nemotron/tests/manifests/nemotron-mini-4b.json |
nvidia/NVIDIA-Nemotron-Nano-9B-v2 | nemotron_h | text_generation | fp16; Single device | families/nemotron_h/tests/manifests/nemotron-h-nano-9b.json |
nvidia/NVIDIA-Nemotron-Nano-9B-v2-FP8 | nemotron_h | text_generation | fp16; Single device | families/nemotron_h/tests/manifests/nemotron-h-nano-9b-fp8.json |
nvidia/NVIDIA-Nemotron-Nano-9B-v2-NVFP4 | nemotron_h | text_generation | fp16; Single device | families/nemotron_h/tests/manifests/nemotron-h-nano-9b-nvfp4.json |
nvidia/NVIDIA-Nemotron-Nano-9B-v2 | nemotron_h | text_generation | fp32; TP4 | families/nemotron_h/tests/manifests/nemotron-h-nano-9b-tp4.json |
nvidia/Nemotron-Labs-Diffusion-8B | nemotron_labs_diffusion | text_generation | bf16; Single device | families/nemotron_labs_diffusion/tests/manifests/nemotron-labs-diffusion-8b.json |
nvidia/Nemotron-Labs-Diffusion-8B | nemotron_labs_diffusion | text_generation | bf16; Single device | families/nemotron_labs_diffusion/tests/manifests/nemotron-labs-diffusion-8b-fp8-l0.json |
nvidia/Nemotron-Labs-Diffusion-8B | nemotron_labs_diffusion | text_generation | bf16; Single device | families/nemotron_labs_diffusion/tests/manifests/nemotron-labs-diffusion-8b-l0.json |
allenai/OLMo-1B-hf | olmo | text_generation | fp16; Single device | families/olmo/tests/manifests/olmo-1b.json |
allenai/OLMo-1B-hf | olmo | text_generation | fp32; TP4 | families/olmo/tests/manifests/olmo-1b-tp4.json |
allenai/OLMo-2-0425-1B | olmo2 | text_generation | fp32; Single device | families/olmo2/tests/manifests/olmo2-1b.json |
allenai/OLMo-2-0425-1B | olmo2 | text_generation | fp32; TP4 | families/olmo2/tests/manifests/olmo2-1b-tp4.json |
facebook/opt-125m | opt | text_generation | fp16; Single device | families/opt/tests/manifests/opt-125m.json |
facebook/opt-125m | opt | text_generation | fp32; TP4 | families/opt/tests/manifests/opt-125m-tp4.json |
microsoft/Phi-3-mini-4k-instruct | phi | text_generation | fp16; Single device | families/phi/tests/manifests/phi3-mini.json |
microsoft/Phi-3-mini-4k-instruct | phi | text_generation | fp32; TP4 | families/phi/tests/manifests/phi3-mini-tp4.json |
microsoft/Phi-tiny-MoE-instruct | phi_moe | text_generation | fp16; Single device | families/phi_moe/tests/manifests/phi-moe.json |
microsoft/Phi-tiny-MoE-instruct | phi_moe | text_generation | fp16; Single device | families/phi_moe/tests/manifests/phi-moe-l0.json |
microsoft/Phi-tiny-MoE-instruct | phi_moe | text_generation | fp32; TP4 | families/phi_moe/tests/manifests/phi-moe-l0-tp4.json |
Qwen/Qwen3-0.6B | qwen | text_generation | fp16; Single device | families/qwen/tests/manifests/qwen3-0.6b-fp16.json |
Qwen/Qwen3-0.6B | qwen | text_generation | fp16; TP4 | families/qwen/tests/manifests/qwen3-0.6b-fp16-tp4.json |
Qwen/Qwen3-0.6B | qwen | text_generation | fp16; Single device | families/qwen/tests/manifests/qwen3-0.6b-fp8.json |
Qwen/Qwen3-0.6B | qwen | text_generation | bf16; TP4 | families/qwen/tests/manifests/qwen3-0.6b-fp8-tp4.json |
Qwen/Qwen3-0.6B | qwen | text_generation | bf16; Single device | families/qwen/tests/manifests/qwen3-0.6b-native-l0.json |
Qwen/Qwen3-0.6B | qwen | text_generation | bf16; Single device | families/qwen/tests/manifests/qwen3-0.6b-regression-native-kv-chunked-prefill.json |
Qwen/Qwen3-0.6B | qwen | text_generation | fp16; Single device | families/qwen/tests/manifests/qwen3-0.6b-topp.json |
Qwen/Qwen3-0.6B | qwen | text_generation | fp16; TP4 | families/qwen/tests/manifests/qwen3-0.6b-topp-tp4.json |
Qwen/Qwen3-4B-Instruct-2507 | qwen | text_generation | fp16; Single device | families/qwen/tests/manifests/qwen3-4b-instruct-2507.json |
Qwen/Qwen3-4B-Instruct-2507 | qwen | text_generation | fp16; TP4 | families/qwen/tests/manifests/qwen3-4b-instruct-2507-tp4.json |
superwhisper/s1-mini | qwen | text_generation | fp16; Single device | families/qwen/tests/manifests/s1-mini-fp16.json |
Qwen/Qwen3-30B-A3B | qwen_moe | text_generation | fp16; Single device | families/qwen_moe/tests/manifests/qwen3-moe-30b-a3b.json |
Qwen/Qwen3-30B-A3B | qwen_moe | text_generation | fp16; TP4 | families/qwen_moe/tests/manifests/qwen3-moe-30b-a3b-tp4.json |
amd-quark/tiny-random-qwen3_moe | qwen_moe | text_generation | fp16; Single device | families/qwen_moe/tests/manifests/qwen3-moe-tiny-random.json |
Qwen/Qwen3.5-0.8B | qwen3_5 | text_generation | fp16; Single device | families/qwen3_5/tests/manifests/qwen35-0.8b.json |
Qwen/Qwen3.5-2B | qwen3_5 | text_generation | fp16; Single device | families/qwen3_5/tests/manifests/qwen35-2b.json |
Qwen/Qwen3.5-4B | qwen3_5 | text_generation | fp16; Single device | families/qwen3_5/tests/manifests/qwen35-4b.json |
Qwen/Qwen3.5-9B | qwen3_5 | text_generation | fp16; Single device | families/qwen3_5/tests/manifests/qwen35-9b.json |
Qwen/Qwen3.5-9B | qwen3_5 | text_generation | fp16; Single device | families/qwen3_5/tests/manifests/qwen35-9b-fp8.json |
AxionML/Qwen3.5-9B-NVFP4 | qwen3_5 | text_generation | fp16; Single device | families/qwen3_5/tests/manifests/qwen35-9b-nvfp4.json |
Qwen/Qwen3.6-27B | qwen3_8 | text_generation | fp16; Single device | families/qwen3_8/tests/manifests/qwen36-27b.json |
Qwen/Qwen3.8-27B | qwen3_8 | text_generation | fp16; Single device | families/qwen3_8/tests/manifests/qwen38-27b.json |
Qwen/Qwen3.8-27B | qwen3_8 | text_generation | fp16; Single device | families/qwen3_8/tests/manifests/qwen38-27b-fp8.json |
nvidia/Qwen3.8-27B-NVFP4 | qwen3_8 | text_generation | fp16; Single device | families/qwen3_8/tests/manifests/qwen38-27b-nvfp4.json |
Qwen/Qwen3-Omni-30B-A3B-Instruct | qwen3_omni | text_generation | bf16; Single device | families/qwen3_omni/tests/manifests/qwen3-omni-30b-a3b-instruct.json |
RWKV/rwkv-4-169m-pile | rwkv | text_generation | fp32; Single device | families/rwkv/tests/manifests/rwkv-169m.json |
RWKV/rwkv-4-169m-pile | rwkv | text_generation | fp32; TP4 | families/rwkv/tests/manifests/rwkv-169m-tp4.json |
HuggingFaceTB/SmolLM3-3B | smollm3 | text_generation | bf16; Single device | families/smollm3/tests/manifests/smollm3-3b-l0.json |
stabilityai/stablelm-2-1_6b | stablelm | text_generation | fp16; Single device | families/stablelm/tests/manifests/stablelm2-1.6b.json |
stabilityai/stablelm-2-1_6b | stablelm | text_generation | fp32; TP4 | families/stablelm/tests/manifests/stablelm2-1.6b-tp4.json |
bigcode/starcoder2-3b | starcoder2 | text_generation | fp16; Single device | families/starcoder2/tests/manifests/starcoder2-3b.json |
bigcode/starcoder2-3b | starcoder2 | text_generation | fp32; TP2 | families/starcoder2/tests/manifests/starcoder2-3b-tp2.json |
google-t5/t5-small | t5 | text_generation | fp16; Single device | families/t5/tests/manifests/t5-small.json |
google-t5/t5-small | t5 | text_generation | fp32; TP4 | families/t5/tests/manifests/t5-small-tp4.json |
facebook/xglm-564M | xglm | text_generation | fp16; Single device | families/xglm/tests/manifests/xglm-564m.json |
facebook/xglm-564M | xglm | text_generation | fp32; TP4 | families/xglm/tests/manifests/xglm-564m-tp4.json |
openai/clip-vit-base-patch32 | clip | text_image_to_relevance | fp16; Single device | families/clip/tests/manifests/clip-vit-base-patch32.json |
google/siglip-base-patch16-224 | siglip | text_image_to_relevance | fp32; Single device | families/siglip/tests/manifests/siglip-base-patch16-224.json |
google/siglip-base-patch16-224 | siglip | text_image_to_relevance | fp32; Single device | families/siglip/tests/manifests/siglip-base-patch16-224-fp8.json |
facebook/sam3 | sam3 | text_prompted_segmentation | fp32; Single device | families/sam3/tests/manifests/sam3.json |
nvidia/llama-nemotron-rerank-vl-1b-v2 | eagle_vlm | text_query_documents_to_relevance | fp16; Single device | families/eagle_vlm/tests/manifests/nemotron-rerank-vl-1b-v2.json |
nvidia/llama-nemotron-rerank-vl-1b-v2-fp8 | eagle_vlm | text_query_documents_to_relevance | fp16; Single device | families/eagle_vlm/tests/manifests/nemotron-rerank-vl-1b-v2-fp8.json |
nvidia/llama-nemotron-rerank-vl-1b-v2 | eagle_vlm | text_query_documents_to_relevance | fp32; TP4 | families/eagle_vlm/tests/manifests/nemotron-rerank-vl-1b-v2-tp4.json |
suno/bark | bark | text_to_audio | fp32; Single device | families/bark/tests/manifests/bark-large.json |
suno/bark | bark | text_to_audio | fp32; TP4 | families/bark/tests/manifests/bark-large-tp4.json |
suno/bark-small | bark | text_to_audio | fp16; Single device | families/bark/tests/manifests/bark-small.json |
suno/bark-small | bark | text_to_audio | fp32; Single device | families/bark/tests/manifests/bark-small-fp32-l0.json |
suno/bark-small | bark | text_to_audio | fp32; TP4 | families/bark/tests/manifests/bark-small-tp4.json |
nvidia/llama-nemotron-embed-vl-1b-v2 | eagle_vlm | text_to_embedding | fp16; Single device | families/eagle_vlm/tests/manifests/nemotron-embed-vl-1b-v2.json |
nvidia/llama-nemotron-embed-vl-1b-v2-fp8 | eagle_vlm | text_to_embedding | fp16; Single device | families/eagle_vlm/tests/manifests/nemotron-embed-vl-1b-v2-fp8.json |
nvidia/llama-nemotron-embed-vl-1b-v2 | eagle_vlm | text_to_embedding | fp32; TP4 | families/eagle_vlm/tests/manifests/nemotron-embed-vl-1b-v2-tp4.json |
Alibaba-NLP/gte-base-en-v1.5 | gte | text_to_embedding | fp32; Single device | families/gte/tests/manifests/gte-base-en-v1_5.json |
Alibaba-NLP/gte-base-en-v1.5 | gte | text_to_embedding | fp16; Single device | families/gte/tests/manifests/gte-base-en-v1_5-fp16.json |
nomic-ai/nomic-embed-text-v1.5 | nomic_bert | text_to_embedding | fp32; Single device | families/nomic_bert/tests/manifests/nomic-embed-text-v1_5.json |
albert/albert-base-v2 | albert | text_to_pooled_features | fp16; Single device | families/albert/tests/manifests/albert-base.json |
albert/albert-base-v2 | albert | text_to_pooled_features | fp32; TP4 | families/albert/tests/manifests/albert-base-tp4.json |
microsoft/deberta-base | deberta | text_to_pooled_features | fp16; Single device | families/deberta/tests/manifests/deberta-base.json |
microsoft/deberta-base | deberta | text_to_pooled_features | fp16; Single device | families/deberta/tests/manifests/deberta-base-fp8.json |
microsoft/deberta-base | deberta | text_to_pooled_features | fp32; TP4 | families/deberta/tests/manifests/deberta-base-tp4.json |
distilbert/distilbert-base-uncased | distilbert | text_to_pooled_features | fp16; Single device | families/distilbert/tests/manifests/distilbert-base-uncased.json |
distilbert/distilbert-base-uncased | distilbert | text_to_pooled_features | fp32; TP4 | families/distilbert/tests/manifests/distilbert-base-uncased-tp4.json |
facebook/dpr-ctx_encoder-single-nq-base | dpr | text_to_pooled_features | fp16; Single device | families/dpr/tests/manifests/dpr-ctx-encoder.json |
facebook/dpr-ctx_encoder-single-nq-base | dpr | text_to_pooled_features | fp32; TP4 | families/dpr/tests/manifests/dpr-ctx-encoder-tp4.json |
google/electra-base-discriminator | electra | text_to_pooled_features | fp16; Single device | families/electra/tests/manifests/electra-base-discriminator.json |
google/electra-base-discriminator | electra | text_to_pooled_features | fp32; TP4 | families/electra/tests/manifests/electra-base-discriminator-tp4.json |
google/fnet-base | fnet | text_to_pooled_features | fp16; Single device | families/fnet/tests/manifests/fnet-base.json |
google/fnet-base | fnet | text_to_pooled_features | fp32; TP4 | families/fnet/tests/manifests/fnet-base-tp4.json |
ibm-granite/granite-embedding-small-english-r2 | modernbert | text_to_pooled_features | fp32; Single device | families/modernbert/tests/manifests/granite-embedding-small-english-r2.json |
answerdotai/ModernBERT-base | modernbert | text_to_pooled_features | fp32; Single device | families/modernbert/tests/manifests/modernbert-base.json |
answerdotai/ModernBERT-base | modernbert | text_to_pooled_features | fp32; TP4 | families/modernbert/tests/manifests/modernbert-base-tp4.json |
sentence-transformers/all-mpnet-base-v2 | mpnet | text_to_pooled_features | fp16; Single device | families/mpnet/tests/manifests/all-mpnet-base-v2.json |
sentence-transformers/all-mpnet-base-v2 | mpnet | text_to_pooled_features | fp32; TP4 | families/mpnet/tests/manifests/all-mpnet-base-v2-tp4.json |
xlnet/xlnet-base-cased | xlnet | text_to_pooled_features | fp16; Single device | families/xlnet/tests/manifests/xlnet-base.json |
xlnet/xlnet-base-cased | xlnet | text_to_pooled_features | fp32; TP4 | families/xlnet/tests/manifests/xlnet-base-tp4.json |
albert/albert-base-v2 | albert | text_to_token_features | fp16; Single device | families/albert/tests/manifests/albert-base-token-features.json |
microsoft/deberta-v3-base | deberta_v2 | text_to_token_features | fp32; Single device | families/deberta_v2/tests/manifests/deberta-v3-base.json |
microsoft/deberta-v3-base | deberta_v2 | text_to_token_features | fp16; Single device | families/deberta_v2/tests/manifests/deberta-v3-base-fp16.json |
amazon/chronos-bolt-tiny | chronos_bolt | time_series_forecast | fp32; Single device | families/chronos_bolt/tests/manifests/chronos-bolt-tiny-official.json |
amazon/chronos-bolt-tiny | chronos_bolt | time_series_forecast | fp16; Single device | families/chronos_bolt/tests/manifests/chronos-bolt-tiny-official-fp16.json |
amazon/chronos-bolt-tiny | chronos_bolt | time_series_forecast | fp32; TP4 | families/chronos_bolt/tests/manifests/chronos-bolt-tiny-official-tp4.json |
ibm-granite/granite-timeseries-patchtsmixer | patchtsmixer | time_series_forecast | fp16; Single device | families/patchtsmixer/tests/manifests/patchtsmixer-granite-official.json |
ibm-granite/granite-timeseries-patchtsmixer | patchtsmixer | time_series_forecast | fp32; TP4 | families/patchtsmixer/tests/manifests/patchtsmixer-granite-official-tp4.json |
ibm-research/patchtst-etth1-regression-distribution | patchtst | time_series_forecast | fp16; Single device | families/patchtst/tests/manifests/patchtst-etth1-regression-distribution.json |
ibm-research/patchtst-etth1-regression-distribution | patchtst | time_series_forecast | fp32; TP4 | families/patchtst/tests/manifests/patchtst-etth1-regression-distribution-tp4.json |
ibm-granite/granite-timeseries-patchtst | patchtst | time_series_forecast | fp16; Single device | families/patchtst/tests/manifests/patchtst-granite-official.json |
google/timesfm-2.0-500m-pytorch | timesfm | time_series_forecast | fp32; Single device | families/timesfm/tests/manifests/timesfm-2.0-500m-official.json |
google/timesfm-2.0-500m-pytorch | timesfm | time_series_forecast | fp32; TP4 | families/timesfm/tests/manifests/timesfm-2.0-500m-official-tp4.json |
nvidia/canary-1b-v2 | canary | transcription | fp16; Single device | families/canary/tests/manifests/canary-1b-v2.json |
nvidia/canary-1b-v2 | canary | transcription | fp16; Single device | families/canary/tests/manifests/canary-1b-v2-fp8.json |
nvidia/canary-1b-v2 | canary | transcription | fp32; TP4 | families/canary/tests/manifests/canary-1b-v2-tp4.json |
zai-org/GLM-ASR-Nano-2512 | glmasr | transcription | fp16; Single device | families/glmasr/tests/manifests/glmasr-nano-fp16.json |
zai-org/GLM-ASR-Nano-2512 | glmasr | transcription | fp16; Single device | families/glmasr/tests/manifests/glmasr-nano-fp8.json |
openai/whisper-large-v3-turbo | whisper | transcription | fp32; Single device | families/whisper/tests/manifests/whisper-large-v3-turbo.json |
openai/whisper-large-v3-turbo | whisper | transcription | fp32; TP4 | families/whisper/tests/manifests/whisper-large-v3-turbo-tp4.json |
openai/whisper-small | whisper | transcription | fp16; Single device | families/whisper/tests/manifests/whisper-small-fp16.json |
openai/whisper-small | whisper | transcription | fp16; Single device | families/whisper/tests/manifests/whisper-small-fp8.json |
openai/whisper-tiny | whisper | transcription | fp16; Single device | families/whisper/tests/manifests/whisper-tiny-fp16.json |
openai/whisper-tiny | whisper | transcription | fp16; TP2 | families/whisper/tests/manifests/whisper-tiny-fp16-tp2.json |
nvidia/nemotron-3.5-asr-streaming-0.6b | nemotron_speech_streaming | transcription_streaming | fp16; Single device | families/nemotron_speech_streaming/tests/manifests/nemotron-3.5-asr-streaming-0.6b.json |
nvidia/nemotron-speech-streaming-en-0.6b | nemotron_speech_streaming | transcription_streaming | fp16; Single device | families/nemotron_speech_streaming/tests/manifests/nemotron-speech-streaming-en-0.6b.json |
nvidia/nemotron-speech-streaming-en-0.6b | nemotron_speech_streaming | transcription_streaming | fp16; Single device | families/nemotron_speech_streaming/tests/manifests/nemotron-speech-streaming-en-0.6b-fp8.json |
nvidia/nemotron-speech-streaming-en-0.6b | nemotron_speech_streaming | transcription_streaming | fp32; TP4 | families/nemotron_speech_streaming/tests/manifests/nemotron-speech-streaming-en-0.6b-tp4.json |
facebook/sam2.1-hiera-small | sam2 | video_segmentation | mixed_bf16_fp32; Single device | families/sam2/tests/manifests/sam2-public-core-l0.json |
deepseek-ai/DeepSeek-OCR-2 | deepseek_ocr | vision_language_generation | fp16; Single device | families/deepseek_ocr/tests/manifests/deepseek-ocr.json |
deepseek-ai/DeepSeek-OCR-2 | deepseek_ocr | vision_language_generation | fp16; Single device | families/deepseek_ocr/tests/manifests/deepseek-ocr-fp8.json |
deepseek-ai/DeepSeek-OCR-2 | deepseek_ocr | vision_language_generation | fp16; Single device | families/deepseek_ocr/tests/manifests/deepseek-ocr-l0.json |
deepseek-ai/DeepSeek-OCR-2 | deepseek_ocr | vision_language_generation | fp32; TP2 | families/deepseek_ocr/tests/manifests/deepseek-ocr-l0-tp2.json |
OpenGVLab/InternVL3-2B-hf | internvl | vision_language_generation | fp16; Single device | families/internvl/tests/manifests/internvl3-2b.json |
OpenGVLab/InternVL3-2B-hf | internvl | vision_language_generation | fp16; Single device | families/internvl/tests/manifests/internvl3-2b-fp8.json |
OpenGVLab/InternVL3-2B-hf | internvl | vision_language_generation | fp32; TP2 | families/internvl/tests/manifests/internvl3-2b-tp2.json |
OpenGVLab/InternVL3-8B-hf | internvl | vision_language_generation | fp16; Single device | families/internvl/tests/manifests/internvl3-8b.json |
OpenGVLab/InternVL3-8B-hf | internvl | vision_language_generation | fp32; TP4 | families/internvl/tests/manifests/internvl3-8b-tp4.json |
bytedance-research/Lance | lance | vision_language_generation | bf16; Single device | families/lance/tests/manifests/lance-3b-x2t-image.json |
nvidia/LocateAnything-3B | locateanything | vision_language_generation | fp16; Single device | families/locateanything/tests/manifests/locateanything-3b.json |
nvidia/LocateAnything-3B | locateanything | vision_language_generation | fp16; Single device | families/locateanything/tests/manifests/locateanything-3b-fp8.json |
nvidia/Nemotron-3-Nano-Omni-30B-A3B-Reasoning-NVFP4 | nemotron_omni | vision_language_generation | fp16; Single device | families/nemotron_omni/tests/manifests/nemotron-omni-nvfp4-text-image.json |
microsoft/Phi-4-multimodal-instruct | phi4_multimodal | vision_language_generation | fp16; Single device | families/phi4_multimodal/tests/manifests/phi4-multimodal.json |
Qwen/Qwen2.5-VL-3B-Instruct | qwen_vl | vision_language_generation | fp32; Single device | families/qwen_vl/tests/manifests/qwen25vl-3b.json |
Qwen/Qwen2.5-VL-3B-Instruct | qwen_vl | vision_language_generation | fp32; TP2 | families/qwen_vl/tests/manifests/qwen25vl-3b-tp2.json |
nvidia/Qwen2.5-VL-7B-Instruct-FP8 | qwen_vl | vision_language_generation | fp16; Single device | families/qwen_vl/tests/manifests/qwen25vl-7b-fp8.json |
nvidia/Qwen2.5-VL-7B-Instruct-NVFP4 | qwen_vl | vision_language_generation | fp16; Single device | families/qwen_vl/tests/manifests/qwen25vl-7b-nvfp4.json |
Qwen/Qwen3-VL-2B-Instruct | qwen_vl | vision_language_generation | bf16; Single device | families/qwen_vl/tests/manifests/qwen3-vl-2b.json |
Qwen/Qwen3-VL-2B-Instruct | qwen_vl | vision_language_generation | fp32; TP4 | families/qwen_vl/tests/manifests/qwen3-vl-2b-tp4.json |
Qwen/Qwen3-VL-8B-Instruct | qwen_vl | vision_language_generation | bf16; Single device | families/qwen_vl/tests/manifests/qwen3-vl-8b.json |
Qwen/Qwen3.5-27B | qwen3_5 | vision_language_generation | fp16; TP2 | families/qwen3_5/tests/manifests/qwen35-27b-edge-image-tp2.json |
Qwen/Qwen3.5-2B | qwen3_5 | vision_language_generation | fp16; Single device | families/qwen3_5/tests/manifests/qwen35-2b-edge-image-tp1.json |
Qwen/Qwen3.5-35B-A3B-GPTQ-Int4 | qwen3_5_moe | vision_language_generation | fp16; Single device | families/qwen3_5_moe/tests/manifests/qwen35-moe-gptq-edge.json |
Efficient-Large-Model/SANA-WM_bidirectional | sana_wm | world_model_generation | bf16; Single device | families/sana_wm/tests/manifests/sana-wm-bidirectional.json |
For task-oriented navigation, see Model Recipes.