subblock_stats

Modules

modelopt.torch.puzzletron.subblock_stats.calc_runtime_stats

Runtime statistics calculation for NAS subblock benchmarking via vLLM.

modelopt.torch.puzzletron.subblock_stats.calc_subblock_params_and_memory

Calculate memory usage and parameter counts for neural network subblocks.

modelopt.torch.puzzletron.subblock_stats.calc_subblock_stats

Calc subblock stats to compute memory and runtime statistics for subblocks.

modelopt.torch.puzzletron.subblock_stats.runtime_utils

Utilities for runtime benchmarking and model saving in ModelOpt NAS.

modelopt.torch.puzzletron.subblock_stats.runtime_vllm

vLLM Runtime Benchmark Integration for ModelOpt NAS Subblocks.

Subblock statistics collection for Puzzletron.