Supported Hardware#
TensorRT LLM supports the full spectrum of NVIDIA GPU architectures:
NVIDIA Blackwell: B200, GB200, B300, GB300, DGX Spark
NVIDIA Hopper: H100, H200, GH200
NVIDIA Ada Lovelace: L20, L40/L40S
NVIDIA Ampere: A100
TensorRT LLM supports the full spectrum of NVIDIA GPU architectures:
NVIDIA Blackwell: B200, GB200, B300, GB300, DGX Spark
NVIDIA Hopper: H100, H200, GH200
NVIDIA Ada Lovelace: L20, L40/L40S
NVIDIA Ampere: A100