plugins

Modules

Handles quantization plugins to correctly quantize third-party modules.

Please check out the source code of this module for examples of how plugins work and how you can write your own one. Currently, we support plugins for

  • apex

  • diffusers

  • huggingface

  • megatron

  • nemo

  • fairscale

  • peft