TensorRT Model Optimizer

Getting Started

  • Overview
  • Installation
  • Quick Start: Quantization
  • Quick Start: Quantization (Windows)
  • Quick Start: Pruning
  • Quick Start: Distillation
  • Quick Start: Sparsity

Guides

  • Quantization
  • Pruning
  • NAS
  • Distillation
  • Sparsity
  • Saving & Restoring
  • Speculative Decoding

Deployment

  • TensorRT-LLM Deployment
  • DirectML Deployment

Examples

  • All GitHub Examples
  • ResNet20 on CIFAR-10: Pruning
  • HF BERT: Prune, Distill & Quantize

Reference

  • Changelog
  • modelopt API

Support

  • Contact us
  • FAQs
TensorRT Model Optimizer
  • Search

© Copyright 2023-2024, NVIDIA Corporation.

Built with Sphinx using a theme provided by Read the Docs.