score_pruning_activations

Functions

launch_score_activations

Score pruning activations.

launch_score_activations(cfg, num_nodes=1, node_index=0)

Score pruning activations.

num_nodes/node_index mirror the bypass/scoring stages and allow splitting the work across nodes. Activation scoring is handled by the AutoModel backend (pruning.backend: automodel).

When pruning.activation_passes is set, runs one scoring pass per entry (FFN + attention) into subdirs of activations_log_dir — see _run_activation_passes().

Parameters:
  • cfg (DictConfig)

  • num_nodes (int)

  • node_index (int)