Installation

There are multiple ways to install and run TensorRT LLM. For most users, the options below should be ordered from simple to complex. The approaches are equivalent in terms of the supported features.

Note: This project will download and install additional third-party open source software projects. Review the license terms of these open source projects before use.

1. Pre-built release container images on NGC

2. Pre-built release wheels on PyPI (see Installing on Linux via pip)

3. Building from Source Code on Linux