Packages and Modules
- megatron.energon
AugmentTaskEncoderBaseCoreDatasetFactoryBaseWebdatasetFactoryBatchBatchDatasetBlendDatasetCaptioningSampleCaptioningWebdatasetConcatDatasetCookerCrudeSampleCrudeWebdatasetDatasetLoaderDatasetLoaderInterfaceDefaultDecoderWebdatasetFactoryDefaultGenericWebdatasetFactoryDefaultTaskEncoderEpochizeDatasetFilterDatasetGcDatasetGroupBatchDatasetImageClassificationSampleImageClassificationWebdatasetImageSampleImageWebdatasetInterleavedSampleInterleavedWebdatasetIterMapDatasetJoinedWebdatasetFactoryLimitDatasetLogSampleDatasetMapDatasetMetadatasetMetadatasetV2MixBatchDatasetMultiChoiceVQASampleMultiChoiceVQAWebdatasetOCRSampleOCRWebdatasetPackingDatasetRepeatDatasetSampleSavableDataLoaderSavableDatasetShuffleBufferDatasetSimilarityInterleavedSampleSimilarityInterleavedWebdatasetSkipSampleStandardWebdatasetFactoryTaskEncoderTextSampleTextWebdatasetVQAOCRWebdatasetVQASampleVQAWebdatasetVidQASampleVidQAWebdatasetWorkerConfigbasic_sample_keys()batch_list()batch_pad_stack()batch_stack()concat_pad()generic_batch()generic_concat()get_loader()get_savable_loader()get_train_dataset()get_val_dataset()get_val_datasets()homogeneous_concat_mix()load_dataset()prepare_metadataset()stateless()Cookerbasic_sample_keys()