Workloads Documentation#

This section contains automatically generated documentation for all CloudAI workloads. Each workload provides specific functionality for running different types of tests and benchmarks.

Available Workloads#

Test

Slurm

Kubernetes

RunAI

Standalone

AI Dynamo

Bash Command

Chakra Replay

DDLB

DeepEP Benchmark

JaxToolbox workloads (DEPRECATED)

MegatronRun

NCCL

NeMo v1.0 aka NemoLauncher (DEPRECATED)

Nemo Run

NIXL Bench

NIXL KVBench

NIXL CTPerf

Sleep

Slurm Container

Triton Inference

UCC

Adding New Workloads#

To add documentation for a new workload:

  1. Add docstrings to your Python classes and methods

  2. Create a markdown file in doc/workloads/ (e.g., my_workload.md)

  3. Add it to the table above.

The documentation will be automatically generated during the build process!