attention

Modules

modelopt.torch.kernels.quantization.attention.bmm2_qdq

NVFP4 operand helpers for the attention BMM matmuls.

modelopt.torch.kernels.quantization.attention.mla

MLA attention kernels with fused fake quantization (prefill and decode).

Quantization-specific attention kernel pieces.

bmm2_qdq.py holds the operand-specific NVFP4 helpers for the attention P @ V matmul and the V-cache finalization kernel. This package initializer does not import that module, so importing the package alone does not require Triton.