Welcome to Model Optimizer (ModelOpt) documentation!

Getting Started

• Overview
• Installation
• Quick Start: Quantization
• Quick Start: Quantization (Windows)
• Quick Start: Pruning
• Quick Start: Distillation
• Quick Start: Sparsity

Guides

• Support Matrix
• Quantization
• Pruning
• NAS
• Distillation
• Sparsity
• Saving & Restoring
• Speculative Decoding

Deployment

• TensorRT-LLM
• DirectML
• Unified HuggingFace Checkpoint

Examples

• All GitHub Examples

Reference

• Changelog
• modelopt API

Support

• Contact us
• FAQs