vllm

Functions

prepare_vllm_config	Mutate a copied HF config into the vLLM AnyModel deploy shape.
prepare_vllm_deploy_copy	Create an immutable-ish deploy copy and rewrite only that copy for vLLM.

prepare_vllm_config(config, *, descriptor_name=None)

Mutate a copied HF config into the vLLM AnyModel deploy shape.

Parameters:

• config (Any)

• descriptor_name (str | None)

Return type:

bool

prepare_vllm_deploy_copy(checkpoint_dir, deploy_root, *, trust_remote_code=False, descriptor_name=None)

Create an immutable-ish deploy copy and rewrite only that copy for vLLM.

The canonical checkpoint remains in Puzzletron format with typed block_configs. The returned directory is safe for vLLM benchmarking or serving and may be discarded by the caller.

Parameters:

• checkpoint_dir (str | Path)

• deploy_root (str | Path)

• trust_remote_code (bool)

• descriptor_name (str | None)

Return type:

Path