scoring

Validates and scores model compression solutions by evaluating puzzle solution candidates.

Functions

launch_scoring

resolve_scoring_output_dir

Output dir where solution_*.json are written — must match the writer's resolution.

resolve_scoring_paths

Resolve input/output paths for block or atomic subblock scoring.
launch_scoring(cfg, num_nodes=1, node_index=0)
Parameters:

  • cfg (DictConfig)

  • num_nodes (int)

  • node_index (int)

resolve_scoring_output_dir(cfg)

Output dir where solution_*.json are written — must match the writer’s resolution.

The AutoModel writer falls back to <solutions_path stem>--validation when scoring.output_dir is unset; resume detection has to use the same path.

Parameters:

cfg (DictConfig)

Return type:

str

resolve_scoring_paths(cfg)

Resolve input/output paths for block or atomic subblock scoring.

Parameters:

cfg (DictConfig)

Return type:

tuple[Path, Path]