distill

Modules

modelopt.torch.distill.config	Configurations for distillation modes.
modelopt.torch.distill.distillation	API for converting a model into a modelopt.torch.distill.DistillationModel to be used directly in training.
modelopt.torch.distill.distillation_model	Meta-model wrapper to support knowledge-distillation learning.
modelopt.torch.distill.loss_balancers	Basic loss balancers for Distillation task.
modelopt.torch.distill.losses	Different types of distillation losses.
modelopt.torch.distill.mode	Module implementing and describing modes that can be used during the NAS convert process.
modelopt.torch.distill.plugins	Handles distillation plugins for third-party modules.
modelopt.torch.distill.registry	A dynamic module registry that holds information about available DynamicModules for Distillation-related purposes.

Distillation API subpackage for torch.