distillation
Modules
Real Puzzle-KD text dataset adapter for native AutoModel global KD. |
|
Exact memory-bounded CE and KLD from hidden states and LM heads. |
|
Small Puzzletron extensions to NeMo AutoModel's native KD recipes. |
|
Small deterministic image/text dataset for global-KD integration runs. |
|
Exact-LM finalist selection and sequential native global KD. |
Global distillation stage interfaces.