dataset\_utils
==============

.. List the submodules





.. Autodoc anything defined in the module itself

   TODO: WE DON'T USE THIS OPTION RIGHT NOW BUT WE CAN REACTIVATE IF WANTED
   We use :ignore-module-all: so sphinx does not document the same module twice, even if it is reimported
   For reimports that should be documented somewhere other than where they are defined, the re-imports
   __module__ should be manually overridden -- i.e. in the ``__init__.py`` which contains ``from xxx import YYY``,
   add in ``YYY.__module__ = __name__``.

.. automodule:: modelopt.torch.utils.dataset_utils
   :members:
   :undoc-members:

   .. Also show members without docstrings. Only members from __all__ are considered as per conf.py
   .. Ideally we should add docstrings for these members.


   .. Overview table of available classes in the module
   
   
   


   .. Overview table of available functions in the module
   
   
   .. rubric:: Functions

   .. autosummary::
      :nosignatures:
   
      create_forward_loop
      download_hf_dataset_as_jsonl
      get_dataset_dataloader
      get_dataset_samples
      get_jsonl_text_samples
      get_max_batch_size
      get_supported_datasets