Supported Hardware#

TensorRT LLM supports the full spectrum of NVIDIA GPU architectures:

  • NVIDIA Blackwell: B200, GB200, B300, GB300, DGX Spark

  • NVIDIA Hopper: H100, H200, GH200

  • NVIDIA Ada Lovelace: L20, L40/L40S

  • NVIDIA Ampere: A100