eagle_model

Eagle model to support eagle decoding.

Classes

EagleModel

Base Eagle Model.

class EagleModel

Bases: DynamicModule

Base Eagle Model.

modify(eagle_offline, eagle_hidden_state_distillation, eagle_self_logit_distillation, eagle_freeze_base_model, eagle_report_acc, eagle_reuse_base_decoder, eagle_loss_decay_factor, eagle_architecture_config)

Base Eagle Model modify function. Child class should implement the details.