TensorRT Model Optimizer

0.13.0

Getting Started

Overview
Installation
Quick Start: Quantization
Quick Start: Sparsity

Optimization Guides

Quantization
Sparsity

Deployment

TensorRT-LLM Deployment

Examples

All ModelOpt Examples

Reference

Changelog
modelopt API
- deploy
  - llm
- onnx
- torch

Support

Contact us
FAQs

TensorRT Model Optimizer

modelopt API
deploy
View page source

deploy

Modules

modelopt.deploy.llm

LLM deployment package with tensorrt_llm.

Model Optimizer’s deployment package.

Previous Next

© Copyright 2023-2024, NVIDIA Corporation.

Built with Sphinx using a theme provided by Read the Docs.