sparsity

Modules

modelopt.torch.sparsity.config

Default configurations for sparsity modes.

modelopt.torch.sparsity.magnitude

Magnitude-base sparsity inspired by NVIDIA ASP (Automatic SParsity).

modelopt.torch.sparsity.mode

Sparsity mode descriptor.

modelopt.torch.sparsity.module

Dynamic class for all sparse modules.

modelopt.torch.sparsity.plugins

Handles sparsity plugins for third-party modules.

modelopt.torch.sparsity.searcher

Searcher interface for sparsity algorithms.

modelopt.torch.sparsity.sparsegpt

Utility functions of SparseGPT.

modelopt.torch.sparsity.sparsification

High-level API to automatically sparsify your model with various algorithms.

API for sparsification algorithms.