Model Optimizer

Announcements

Announcements

Getting Started

Overview
Installation
Quick Start: PTQ - PyTorch
Quick Start: PTQ - ONNX
Quick Start: PTQ - PyTorch to ONNX
Quick Start: PTQ - Windows
Quick Start: QAT
Quick Start: Pruning
Quick Start: Distillation
Quick Start: Speculative Decoding
Quick Start: Sparsity

Guides

Support Matrix
Recipes
ModelOpt Config System
Quantization
Saving & Restoring
Pruning
Distillation
Speculative Decoding
Sparsity
NAS
AutoCast (ONNX)
Autotune (ONNX)

Deployment

TensorRT-LLM
Onnxruntime
Unified HuggingFace Checkpoint

Examples

All GitHub Examples

Reference

Changelog
modelopt API
- deploy
- onnx
- torch
  - distill
  - export
  - fastgen
  - kernels
  - nas
  - opt
  - peft
  - prune
  - puzzletron
  - quantization
  - sparsity
  - speculative
    - config
    - dflash
    - eagle
    - medusa
    - mode
    - plugins
    - speculative_decoding
    - utils
  - trace
  - utils

Support

Contact us
FAQs

Model Optimizer

modelopt API
torch
speculative
eagle
default_config
View page source

default_config

Default EAGLE architecture config.

Previous Next

© Copyright 2023-2025, NVIDIA Corporation.

Built with Sphinx using a theme provided by Read the Docs.