eagle_model

Eagle model to support eagle decoding.

Classes

EagleModel

Base Eagle Model.

class EagleModel

Bases: DynamicModule

Base Eagle Model.

modify(eagle_num_layers, use_input_layernorm_in_first_layer, use_last_layernorm)

Base Eagle Model modify function. Child class should implement the details.