library

Replacement library for loading models with layer replacements (AnyModel / sharded HF checkpoints).

Classes

ReplacementLibrary

class ReplacementLibrary

Bases: object

__init__(replacement_library_path, descriptor, model_config_overrides=None)
Parameters:

  • replacement_library_path (str | Path)

  • model_config_overrides (dict | None)

create_index_file_from_weights(weight_paths)
Parameters:

weight_paths (List[str])

create_model_config(layer_replacements)
Parameters:

layer_replacements (list[dict])

get_arbitrary_checkpoint_dir()
Return type:

Path

load_model(layer_replacements)

Load model using AnyModel approach with temporary checkpoint directory.

Parameters:

layer_replacements (list[dict])

Return type:

PreTrainedModel

property model_config: PreTrainedConfig
prepare_tmp_checkpoint_dir(tmpdir, model_config, layer_replacements)
Parameters:

  • tmpdir (Path)

  • model_config (PreTrainedConfig)

  • layer_replacements (List[dict])