eagle_model

Eagle model to support eagle decoding.

Classes

EagleModel

Base Eagle Model.

class EagleModel

Bases: DynamicModule

Base Eagle Model.

modify(eagle_num_layers, use_input_layernorm_in_first_layer, use_last_layernorm, eagle_hidden_state_distillation, use_aux_hidden_state, eagle_aux_hidden_state_layer_ids, eagle_disable_moe, draft_vocab_size, use_mtp_layernorm)

Base Eagle Model modify function. Child class should implement the details.