C++ API Reference#
This section provides documentation for the TensorRT Edge-LLM C++ API.
- Builder Module
- Common Module
- Kernels Module
- Apply Rope Write KV
- Batch Evict Kernels
- Causal Conv1d
- Common
- Context FMHA Runner
- Conversion
- Cute Dsl FMHA Runner
- Decoder XQA Runner
- Dequant
- Dequantize
- EAGLE Accept Kernels
- EAGLE Util Kernels
- Embedding Kernels
- FMHA Params V2
- Image Util Kernels
- Initialize Cos Sin Cache
- Int4 Groupwise GEMM
- Kernel
- Kernel Selector
- KV Cache Utils Kernels
- Marlin
- Marlin Dtypes
- Marlin Mma
- Marlin Template
- Moe Activation Kernels
- Moe Align Sum Kernels
- Moe Marlin
- Moe Marlin Indices Kernels
- Moe Topk Softmax Kernels
- Selective State Update
- Talker Mlp Kernels
- Util Kernels
- Vectorized Types
- Multimodal Module
- Plugins Module
- Profiling Module
- Runtime Module
- Sampler Module
- Tokenizer Module