physicsnemo_curator.core#

Core pipeline framework for PhysicsNeMo Curator.

Classes#

Filter

Abstract filter/transform that processes a stream of T items.

Param

Descriptor for a configurable parameter on a pipeline component.

Pipeline

Lazy pipeline that chains a source through filters into a sink.

Sink

Abstract sink that persists items and returns output file paths.

Source

Abstract data source that yields items of type T.

DBInfo

Metadata about a single pipeline database file.

IndexMetrics

Metrics for one __getitem__ call (one source index).

PipelineMetrics

Aggregated metrics across all processed indices.

PipelineStore

SQLite-backed store combining checkpoint tracking, metrics, provenance, and worker progress.

StageMetrics

Metrics for a single pipeline stage (source, one filter, or sink).

Registry

Global registry of submodules and their pipeline components.

SubmoduleEntry

Registry entry for a single submodule (e.g. mesh, da, atm).