Straggler Detection
The Straggler Detection package’s purpose is to detect slower ranks participating in a PyTorch distributed workload.
Straggler Detection is included in the nvidia_resiliency_ext.attribution.straggler
package. Integrate the detector directly into the training loop as described in
the usage guide and examples.