nas

Modules

modelopt.torch.nas.algorithms

High-level search and model design algorithms to help you optimize your model.

modelopt.torch.nas.autonas

Entrypoints for AutoNAS mode.

modelopt.torch.nas.config

Default configurations for NAS modes.

modelopt.torch.nas.conversion

Main APIs+entrypoints for model pruning.

modelopt.torch.nas.hparams

Module containing implementations for various types of hyperparameters.

modelopt.torch.nas.mode

Module implementing and describing modes that can be used during the NAS convert process.

modelopt.torch.nas.modules

The dynamic equivalents for torch.nn modules.

modelopt.torch.nas.plugins

Handles nas plugins for third-party modules.

modelopt.torch.nas.registry

A dynamic module registry that holds information about available DynamicModules for NAS.

modelopt.torch.nas.search_space

An extension of the DynamicSpace to handle searchable units and related utilities.

modelopt.torch.nas.traced_hp

Module to specify the basic hyperparameter with tracing capabilities.

modelopt.torch.nas.utils

Utility functions for prune-related and search-space related tasks.

Main module for NAS/Pruning-based model design and optimization.