Model Optimizer

Getting Started

Overview
Installation
Quick Start: PTQ - PyTorch
Quick Start: PTQ - ONNX
Quick Start: PTQ - PyTorch to ONNX
Quick Start: PTQ - Windows
Quick Start: QAT
Quick Start: Pruning
Quick Start: Distillation
Quick Start: Speculative Decoding
Quick Start: Sparsity

Guides

Support Matrix
Recipes
ModelOpt Config System
Quantization
Saving & Restoring
Pruning
Distillation
Speculative Decoding
Sparsity
NAS
AutoCast (ONNX)
Autotune (ONNX)

Deployment

TensorRT-LLM
Onnxruntime
Unified HuggingFace Checkpoint

Examples

All GitHub Examples

Reference

Changelog
modelopt API
- deploy
- models
  - arctic
  - dbrx
  - deepseek
  - gemma
  - gemma4
  - gpt_oss
  - llama
  - mixtral
  - nemotron
  - nemotron_h
  - qwen2_moe
  - qwen3
  - qwen3_5_moe
  - qwen3_moe
  - qwen3_next
  - registry
  - specs
- onnx
- torch

Support

Contact us
FAQs

Model Optimizer

modelopt API
models
llama
View page source

llama

Llama specs (HF model type llama).

Previous Next

© Copyright 2023-2025, NVIDIA Corporation.

Built with Sphinx using a theme provided by Read the Docs.