Kernels Module#
API documentation for the kernels module.
- Nv Fp4 Mo E Utils
- Apply Rope Write KV
- Argmax Kernel
- Attention Scale Utils
- Audio Fbank Kernels
- Batch Evict Kernels
- Build Layout
- Causal Conv1d
- Checkpoint Source Batch
- Common
- Compact Phase Support
- Conversion
- Cp Spec Kernels
- Ctm Decode Attention Runner
- Cute Dsl Causal Conv1d Runner
- Cute Dsl Dual GEMM Runner
- Cute Dsl F16 Moe Runner
- Cute Dsl FMHA Runner
- Cute Dsl Fmhav2 Runner
- Cute Dsl FMHA Params
- Cute Dsl FMHA Types
- Cute Dsl Gdn Runner
- Cute Dsl GEMM Nv Fp4 Runner
- Cute Dsl GEMM Runner
- Cute Dsl Layer Norm Runner
- Cute Dsl Module Loader
- Cute Dsl Nvfp4 Dual GEMM Runner
- Cute Dsl Nvfp4 Moe Runner
- Cute Dsl Nvfp4 Moe Sm110 Runner
- Cute Dsl Qsa Sparse Runner
- Cute Dsl Rms Norm Runner
- Cute Dsl Ssd Runner
- Cute Dsl Tensor Descriptors
- Cute Dsl W2 A16 GEMM Runner
- Cute Dsl W2 A16 Moe Runner
- Dart Gather Kernels
- Dart Selector Kernels
- Ddtree Kernels
- Decoder XQA Jit Compiler
- Decoder XQA Runner
- Dequant
- Dequantize
- Dflash2 Candidate Selector
- Dflash2 Grouped Dynamic Conv
- Dflash Runtime Kernels
- Domino Rollout Kernels
- Dspark Kernels
- Embedding Kernels
- F16 Moe Support Kernels
- Fnv1a Hash Kernel
- Force Acceptance Kernels
- Fp16 Layout Convert
- Fp16 Moe Assemble
- Fp4 Quantize
- Gdn Kernel Utils
- Gdn Pdl Config
- Gdn Tree Chunk Kernels
- Gemma4 Audio Attention
- Gemma4 Mtp Runtime Kernels
- Gptq Activation Permutation
- Gptq Marlin Repack
- Grouped Lora GEMM
- Image Util Kernels
- Initialize Cos Sin Cache
- Int4 Cute Dsl Repack
- Int4 Groupwise GEMM
- Int4 Moe Scale Repack
- Int4 Plugin V1 Repack
- Int4 Qkv Scale Concat
- Int4 Source Accessors
- Iq2 Xxs Repack
- Kernel
- Kernel Selector
- KV Cache Utils Kernels
- Lilicorr Chain Walk
- Low Rank Candidate Head Kernels
- Marlin
- Marlin Repack Index
- Marlin Dtypes
- Marlin Mma
- Marlin Template
- Minimax H3 Kernels
- Moe Activation Kernels
- Moe Align Sum Kernels
- Moe Marlin
- Moe Marlin Indices Kernels
- Moe Per Expert Scale Kernels
- Moe Sigmoid Group Topk Kernels
- Moe Topk Softmax Kernels
- Mtp State Scatter Kernels
- Nvfp4 A16 Blackwell GEMM Runner
- Nvfp4 A16 Blackwell Gemv Jit Compiler
- Nvfp4 A16 Blackwell Gemv Jit Runner
- Nvfp4 A16 Blackwell Moe Dispatch Policy
- Nvfp4 A16 Blackwell Moe Jit Compiler
- Nvfp4 A16 Blackwell Moe Jit Runner
- Nvfp4 A16 Blackwell Moe Runner
- Nvfp4 A16 Blackwell Support
- Nvfp4 Moe Layout
- Nvfp4 Moe Normalize
- Nvfp4 Moe Pdl Config
- Nvfp4 Moe Plugin Geforce Transform
- Nvfp4 Moe Plugin Transform
- Nvfp4 Moe Scale Transform
- Nvfp4 Moe Types
- Nvfp4 Moe Weight Transform
- Nvfp4 W4 A16 Marlin Repack
- Nvfp4 Dequant
- Nvfp4 Scale
- Nvfp4 Tensor
- Ple Gather
- Ple Scatter
- Plugin Jit Blob
- Plugin Jit Compile Cache
- Plugin Jit Compiler
- Plugin Jit Cubin
- Plugin Jit Digest
- Plugin Jit Embedded Sources
- Plugin Jit Key
- Plugin Jit Module Registry
- Q8 0 Kernels
- Q8 0 Linear
- Qsa Indexer Jit Compiler
- Qsa Indexer Kernels
- Qsa Indexer Runner
- Request Stable Rng Kernels
- Scale Convert
- Selective State Update
- Sliding Window Utils
- Speculative Kernels
- Speculative Kernels Utils
- Speculative Sampling
- Speculative Sampling Kernels
- Ssd Varlen Metadata
- Talker Mlp Kernels
- Util Kernels
- Vectorized Types
- Video Sparse Attention Runner
- W2a16 Small M GEMM
- W2a16 Small M Moe
- XQA Kernel Support
- XQA Kernel Types
- XQA Launch Config