sparsity

Modules

modelopt.torch.sparsity.attention_sparsity	Extensible sparse attention optimization for transformer models.
modelopt.torch.sparsity.sparsification	High-level API to sparsify the weights and the attention of a model.
modelopt.torch.sparsity.weight_sparsity	API for weight sparsification algorithms.

API for sparsification algorithms.

This module provides access to both weight sparsity and attention sparsity algorithms through sparsify.