kd_model
Knowledge distillation loss functions.
Provides normalized_mse_loss and cosine_embedding_loss_batched for comparing model outputs. Used by validation.py.
Functions
- cosine_embedding_loss_batched(input, target)
- Parameters:
input (Tensor)
target (Tensor)
- Return type:
Tensor
- normalized_mse_loss(input, target, reduction='mean', epsilon=1e-06)
- Parameters:
input (Tensor)
target (Tensor)
reduction (Literal['none', 'mean', 'sum'])
epsilon (float)
- Return type:
Tensor