subblock_stats
Modules
Runtime statistics calculation for NAS subblock benchmarking via vLLM. |
|
|
Calculate memory usage and parameter counts for neural network subblocks. |
|
Calc subblock stats to compute memory and runtime statistics for subblocks. |
Runtime application helpers for named vLLM measurement contracts. |
|
Layout and arithmetic primitives for repeated-candidate runtime estimates. |
|
Utilities for runtime benchmarking and model saving in Puzzletron. |
|
vLLM Runtime Benchmark Integration for ModelOpt NAS Subblocks. |
|
Explicit distributed topology for vLLM runtime measurements. |
Subblock statistics collection for Puzzletron.