starcoder2
This directory owns its Python builder, native runtime DSO, bundle section semantics, and tests. It has no source dependency on another family.
Task interfaces
Owned recipes
| Recipe | Checkpoint | Abstract task | Build | Manifest |
|---|---|---|---|---|
starcoder2-3b | bigcode/starcoder2-3b | text_generation | fp16; single device | families/starcoder2/tests/manifests/starcoder2-3b.json |
starcoder2-3b-tp2 | bigcode/starcoder2-3b | text_generation | fp32; TP2 | families/starcoder2/tests/manifests/starcoder2-3b-tp2.json |