megatron-energon

Introduction

General
Installation

Basic Usage

Quickstart
Data Preparation
Data Decoding
Data Flow
Task Encoder
Metadataset
Save and Restore
Glossary

Advanced Usage

Remote Dataset
Crude Datasets and Auxiliary Data
Custom Sample Loader
Reproducible Scaling
Packing
Grouping
Joining Datasets
Epochized Blending
Customized Blending
Parallelism

API

Packages and Modules
Command-Line Interface

Internals

Contribution Guidelines
Code Structure

megatron-energon

Python Module Index

Python Module Index

m


	m
	`megatron`
	`megatron.energon`
	`megatron.energon.av`
	`megatron.energon.task_encoder.cooking`

© Copyright 2025 NVIDIA Corporation.

Built with Sphinx using a theme provided by Read the Docs.