Key Features

This document lists key features supported in TensorRT-LLM.

• Quantization

• Inflight Batching

• Chunked Context

• LoRA

• KV Cache Reuse

• Speculative Sampling