quant_format#
The quantization and KV-cache format names shared by every export backend.
Backend-specific names live with their backend: the TensorRT-LLM checkpoint layout
constants, for example, are in modelopt.torch.export.trtllm.model_config.
The quantization and KV-cache format names shared by every export backend.
Backend-specific names live with their backend: the TensorRT-LLM checkpoint layout
constants, for example, are in modelopt.torch.export.trtllm.model_config.