mode

This module contains the mode descriptor for the quantization mode.

Classes

MedusaModeDescriptor

Class to describe the "medusa" mode.

class MedusaModeDescriptor

Bases: _ModeDescriptor

Class to describe the "medusa" mode.

The properties of this mode can be inspected via the source code.

property config_class: Type[ModeloptBaseConfig]

Specifies the config class for the mode.

property convert: Callable[[Module, ModeloptBaseConfig], Tuple[Module, Dict[str, Any]]]

The mode’s entrypoint for converting a model.

property name: str

Returns the value (str representation) of the mode.

property restore: Callable[[Module, ModeloptBaseConfig, Dict[str, Any]], Module]

The mode’s entrypoint for restoring a model.