Skip to main content

← All model recipe tasks

llama

This directory owns its Python builder, native runtime DSO, bundle section semantics, and tests. It has no source dependency on another family.

Task interfaces

Owned recipes

RecipeCheckpointAbstract taskBuildManifest
falcon3-1btiiuae/Falcon3-1B-Basetext_generationfp16; single devicefamilies/llama/tests/manifests/falcon3-1b.json
minitron-4b-depthnvidia/Llama-3.1-Minitron-4B-Depth-Basetext_generationfp16; single devicefamilies/llama/tests/manifests/minitron-4b-depth.json
minitron-4b-widthnvidia/Llama-3.1-Minitron-4B-Width-Basetext_generationfp16; single devicefamilies/llama/tests/manifests/minitron-4b-width.json
minitron-4b-width-l0nvidia/Llama-3.1-Minitron-4B-Width-Basetext_generationfp16; single devicefamilies/llama/tests/manifests/minitron-4b-width-l0.json
minitron-4b-width-regression-native-kv-chunked-prefillnvidia/Llama-3.1-Minitron-4B-Width-Basetext_generationbf16; single devicefamilies/llama/tests/manifests/minitron-4b-width-regression-native-kv-chunked-prefill.json
nemotron-nano-4bnvidia/Llama-3.1-Nemotron-Nano-4B-v1.1text_generationfp16; single devicefamilies/llama/tests/manifests/nemotron-nano-4b.json
tinyllama-1.1bTinyLlama/TinyLlama-1.1B-Chat-v1.0text_generationfp16; single devicefamilies/llama/tests/manifests/tinyllama-1.1b.json