Packages and Modules
- megatron.energon
AugmentTaskEncoderBaseCoreDatasetFactoryBaseWebdatasetFactoryBatchBatchDatasetBlendDatasetCachePoolCaptioningSampleCaptioningWebdatasetConcatDatasetCookerCrudeSampleCrudeWebdatasetDatasetLoaderDatasetLoaderInterfaceDecodeFileStoreDefaultDecoderWebdatasetFactoryDefaultGenericWebdatasetFactoryDefaultTaskEncoderDirectLazyEpochizeDatasetFileCacheLazyFileStoreFileStoreCachePoolFileStoreDecoderFilterDatasetGcDatasetGroupBatchDatasetImageClassificationSampleImageClassificationWebdatasetImageSampleImageWebdatasetInterleavedSampleInterleavedWebdatasetIterMapDatasetJoinedWebdatasetFactoryLazyLimitDatasetLogSampleDatasetMapDatasetMetadatasetMetadatasetV2MixBatchDatasetMockLazyMultiChoiceVQASampleMultiChoiceVQAWebdatasetNoCachePoolOCRSampleOCRWebdatasetPackingDatasetRepeatDatasetSampleSampleDecoderSavableDataLoaderSavableDatasetShuffleBufferDatasetSimilarityInterleavedSampleSimilarityInterleavedWebdatasetSkipSampleSourceInfoStandardWebdatasetFactorySystemFileStoreTaskEncoderTextSampleTextWebdatasetVQAOCRWebdatasetVQASampleVQAWebdatasetVidQASampleVidQAWebdatasetWorkerConfigbasic_sample_keys()batch_list()batch_pad_stack()batch_stack()concat_pad()cooker()generic_batch()generic_concat()get_loader()get_savable_loader()get_train_dataset()get_val_dataset()get_val_datasets()homogeneous_concat_mix()load_dataset()prepare_metadataset()stateless()Cookerbasic_sample_keys()cooker()get_cooker_need_cache()get_cooker_need_primary()
- megatron.energon.av