Shared Utilities

The Shared Utilities package provides essential infrastructure components for NVRx, including:

• NVRx Logger: A distributed logging system designed for multi-node, multi-rank training workloads

• Log Aggregation: Automatic collection and aggregation of logs from distributed processes

• Environment-driven Configuration: Flexible logging configuration through environment variables

The Shared Utilities are included in the nvidia_resiliency_ext.shared_utils package.

Contents:

• NVRx Logger Guide
  • Key Features
  • Architecture
  • Configuration
  • Basic Usage
  • Node Local Temporary Logging Setup
  • Advanced Configuration
  • Example Output Format
  • Integration with Other NVRx Components
  • Best Practices
  • Troubleshooting
• Configuration Reference
  • Environment Variables
  • Python API Parameters
  • LogManager Constructor Parameters
  • Configuration Examples
  • SLURM Integration
  • Docker Integration
  • Kubernetes Integration
  • Configuration Precedence
  • Best Practices
  • Filesystem Selection
  • Troubleshooting
  • Quick API Reference
• API Reference
  • Log Manager
  • Log Aggregator
  • Log Configuration
  • Core Classes
  • Core Functions
  • Quick Reference