Examples

End-to-end examples demonstrating PhysicsNeMo Curator pipelines for data curation workflows.

• Getting Started — core pipeline concepts: building, parallel execution, profiling, and checkpointing

• CAE — computational engineering with CFD meshes

• Earth-2 — weather and climate data with xarray DataArrays

• Alchemy — atomic and molecular simulation data

• Extending — creating custom sources, filters, and sinks

Getting Started

Core pipeline concepts — building, running, profiling, and checkpointing data curation pipelines.

Creating a Pipeline

Creating a Pipeline

Running a Pipeline in Parallel

Running a Pipeline in Parallel

Checkpointing a Pipeline

Checkpointing a Pipeline

Profiling a Pipeline

Profiling a Pipeline

CAE

Examples for computational engineering — reading, filtering, and writing CFD surface and volume meshes using the mesh domain.

Ansys Thermal Simulation ETL Pipeline

Ansys Thermal Simulation ETL Pipeline

Crash Simulation ETL Pipeline

Crash Simulation ETL Pipeline

DrivAerML End-to-End ETL Pipeline.

DrivAerML End-to-End ETL Pipeline.

External Aerodynamics ETL Pipeline

External Aerodynamics ETL Pipeline

VTK Backend Profiling: PyVista vs Rust

VTK Backend Profiling: PyVista vs Rust

Earth-2

Examples for weather and climate data — fetching, filtering, and writing gridded reanalysis data as xarray DataArrays using the da domain.

ERA5 Reanalysis ETL Pipeline

ERA5 Reanalysis ETL Pipeline

Alchemy

Examples for the atm domain — reading, filtering, and writing atomic/molecular simulation data as nvalchemi AtomicData objects.

OMol25 Atomic Data ETL Pipeline

OMol25 Atomic Data ETL Pipeline

Extending

How to create and register custom pipeline components — sources, filters, and sinks — for your own data formats and transformations.

Creating a Custom Filter

Creating a Custom Filter

Creating a Custom Sink

Creating a Custom Sink

Creating a Custom Source

Creating a Custom Source