nas

Modules

modelopt.torch.nas.algorithms

High-level search and model design algorithms to help you optimize your model.

modelopt.torch.nas.autonas

Entrypoints for AutoNAS mode.

modelopt.torch.nas.conversion

Main APIs+entrypoints for model pruning.

modelopt.torch.nas.hparams

Module containing implementations for various types of hyperparameters.

modelopt.torch.nas.modules

The dynamic equivalents for torch.nn modules.

modelopt.torch.nas.patch

Patch manager for NAS.

modelopt.torch.nas.plugins

Handles nas plugins for third-party modules.

modelopt.torch.nas.registry

A dynamic module registry that holds information about available DynamicModules for NAS.

modelopt.torch.nas.search_space

An extension of the DynamicSpace to handle searchable units and related utilities.

modelopt.torch.nas.traced_hp

Module to specify the basic hyperparameter with tracing capabilities.

modelopt.torch.nas.utils

Utility functions for prune-related and search-space related tasks.

Main module for NAS/Pruning-based model design and optimization.