torch

Modules

modelopt.torch.distill

Distillation API subpackage for torch.

modelopt.torch.export

Export package.

modelopt.torch.nas

Main module for NAS/Pruning-based model design and optimization.

modelopt.torch.opt

Module for general-purpose model optimization infrastructure.

modelopt.torch.prune

A simplified API for modelopt.torch.nas for pruning algorithms.

modelopt.torch.quantization

Quantization package.

modelopt.torch.sparsity

API for sparsification algorithms.

modelopt.torch.speculative

Speculative Decoding Optimizations.

modelopt.torch.trace

Tracing module for layer-wise dependency analysis.

modelopt.torch.utils

Utility functions.

Model optimization and deployment subpackage for torch.