export#
Modules
Convert modelopt quantization export config to align with llm-compressor config format. |
|
Code that export quantized Hugging Face models for deployment. |
|
Built-in module handlers for unified Hugging Face export. |
|
Module-shape predicates and MoE quantizer helpers shared by every export backend. |
|
Write each decoder layer's quantized checkpoint shard as soon as it is calibrated. |
|
Utility functions for model type detection and classification. |
|
Utilities for Mixture-of-Experts (MoE) model export. |
|
Export package plugin. |
|
Quantization-aware reverse weight conversion for unified HF export. |
|
The quantization and KV-cache format names shared by every export backend. |
|
Utils for quantization including scaling factors adjustments. |
|
Registries dispatching per-module logic for the unified HF export path. |
|
Shared primitives for streaming checkpoint casts and export. |
|
Convert the Model Optimizer quantized model to the transformer_engine. |
|
Checkpoint export logic for the TensorRT-LLM specific format. |
|
Code that export quantized Hugging Face models for deployment. |
|
Streaming HF checkpoint export for disk/CPU-offloaded models. |
|
Code that export quantized Megatron Core models for deployment. |
Export package for Hugging Face and Megatron-based models.