runtime_candidate
Shared reversible application of one complete typed block candidate.
Classes
Own hooks and entered contexts for one live candidate application. |
Functions
Apply Mamba/MoE/no-op typed semantics without resizing parameters. |
- class RemovableCandidateHandle
Bases:
objectOwn hooks and entered contexts for one live candidate application.
- __init__(handles, contexts)
- Parameters:
handles (list[Any])
contexts (list[AbstractContextManager])
- remove()
- Return type:
None
- apply_runtime_candidate(layer, parent_block_config, child_block_config, *, expert_keep_ids=None)
Apply Mamba/MoE/no-op typed semantics without resizing parameters.
The low-level hook construction remains colocated with the AutoModel solution recipe for now; this API is the single lifecycle boundary used by both replace-one-block scoring and elastic bypass.
- Return type: