mtp_model

MTP model to support mtp decoding.

Classes

MTPModel

Base MTP Model.

class MTPModel

Bases: DynamicModule

Base MTP Model.

modify(mtp_num_layers, mtp_num_module, mtp_freeze_list, use_last_layernorm)

Base MTP Model modify function. Child class should implement the details.