granite
This directory owns its Python builder, native runtime DSO, bundle section semantics, and tests. It has no source dependency on another family.
Task interfaces
Owned recipes
| Recipe | Checkpoint | Abstract task | Build | Manifest |
|---|---|---|---|---|
granite-3.1-2b | ibm-granite/granite-3.1-2b-base | text_generation | fp16; single device | families/granite/tests/manifests/granite-3.1-2b.json |
granite-3.1-2b-tp4 | ibm-granite/granite-3.1-2b-base | text_generation | fp32; TP4 | families/granite/tests/manifests/granite-3.1-2b-tp4.json |