library

Replacement library for loading models with layer replacements (AnyModel / sharded HF checkpoints).

Classes

ReplacementLibrary

class ReplacementLibrary

Bases: object

__init__(replacement_library_path, descriptor, model_config_overrides=None)

Parameters:

• replacement_library_path (str | Path)

• model_config_overrides (dict | None)

create_index_file_from_weights(weight_paths)

Parameters:

weight_paths (List[str])

create_model_config(layer_replacements)

Parameters:

layer_replacements (list[dict])

get_arbitrary_checkpoint_dir()

Return type:

Path

load_model(layer_replacements)

Load model using AnyModel approach with temporary checkpoint directory.

Parameters:

layer_replacements (list[dict])

Return type:

PreTrainedModel

property model_config: PreTrainedConfig

prepare_tmp_checkpoint_dir(tmpdir, model_config, layer_replacements)

Parameters:

• tmpdir (Path)

• model_config (PreTrainedConfig)

• layer_replacements (List[dict])