llama
This directory owns its Python builder, native runtime DSO, bundle section semantics, and tests. It has no source dependency on another family.
Task interfaces
Owned recipes
| Recipe | Checkpoint | Task interfaces (primary first) | Build | Manifest |
|---|---|---|---|---|
falcon3-1b | tiiuae/Falcon3-1B-Base | text_generation | fp16; single device | families/llama/tests/manifests/falcon3-1b.json |
minicpm5-2b | openbmb/MiniCPM5-2B | text_generation | fp16; single device | families/llama/tests/manifests/minicpm5-2b.json |
minitron-4b-depth | nvidia/Llama-3.1-Minitron-4B-Depth-Base | text_generation | fp16; single device | families/llama/tests/manifests/minitron-4b-depth.json |
minitron-4b-width | nvidia/Llama-3.1-Minitron-4B-Width-Base | text_generation | fp16; single device | families/llama/tests/manifests/minitron-4b-width.json |
minitron-4b-width-l0 | nvidia/Llama-3.1-Minitron-4B-Width-Base | text_generation | fp16; single device | families/llama/tests/manifests/minitron-4b-width-l0.json |
minitron-4b-width-regression-native-kv-chunked-prefill | nvidia/Llama-3.1-Minitron-4B-Width-Base | text_generation | bf16; single device | families/llama/tests/manifests/minitron-4b-width-regression-native-kv-chunked-prefill.json |
nemotron-nano-4b | nvidia/Llama-3.1-Nemotron-Nano-4B-v1.1 | text_generation | fp16; single device | families/llama/tests/manifests/nemotron-nano-4b.json |
tinyllama-1.1b | TinyLlama/TinyLlama-1.1B-Chat-v1.0 | text_generation | fp16; single device | families/llama/tests/manifests/tinyllama-1.1b.json |