sequential#

Sequential execution backend.

Processes pipeline items one at a time in a simple for-loop. This is the default when n_jobs=1.

Classes#

SequentialBackend

Execute pipeline items sequentially in a for-loop.

Module Contents#

class physicsnemo_curator.run.sequential.SequentialBackend[source]#

Bases: physicsnemo_curator.run.base.RunBackend

Execute pipeline items sequentially in a for-loop.

This backend has no dependencies and is always available. It’s the safest choice for pipelines with stateful filters that need to accumulate results across all items.

run(
pipeline: physicsnemo_curator.core.base.Pipeline[Any],
config: physicsnemo_curator.run.base.RunConfig,
) list[list[str]][source]#

Execute pipeline indices sequentially.

Parameters:
  • pipeline (Pipeline) – The pipeline to execute.

  • config (RunConfig) – Execution configuration.

Returns:

Sink outputs, one list per index.

Return type:

list[list[str]]

description: ClassVar[str] = 'Sequential for-loop execution (no parallelism)'#
name: ClassVar[str] = 'sequential'#
requires: ClassVar[tuple[str, Ellipsis]] = ()#