mixtral
This directory owns its Python builder, native runtime DSO, bundle section semantics, and tests. It has no source dependency on another family.
Task interfaces
Owned recipes
| Recipe | Checkpoint | Abstract task | Build | Manifest |
|---|---|---|---|---|
mixtral-stories-15m | ggml-org/stories15M_MOE | text_generation | fp16; single device | families/mixtral/tests/manifests/mixtral-stories-15m.json |
mixtral-stories-15m-tp2 | ggml-org/stories15M_MOE | text_generation | fp32; TP2 | families/mixtral/tests/manifests/mixtral-stories-15m-tp2.json |