earth2studio.data.DataArrayPathList

class earth2studio.data.DataArrayPathList(paths, **xr_args)

A local xarray dataarray directory data source that handles multiple files.

This class provides functionality to work with multiple xarray-compatible files (e.g., netCDF) as a single data source. All input files must have consistent dimensions and variables. Under the hood, it uses xarray’s open_mfdataset which leverages Dask for parallel and memory-efficient data processing.

Parameters:

• paths (str | list[str]) – Either a string glob pattern (e.g., “path/to/files/*.nc”) or an explicit list of files. All specified files must exist and be readable.

• xr_args (Any) – Additional keyword arguments passed to xarray’s open_mfdataset method.

Raises:

• FileNotFoundError – If no files match the provided path pattern or if any specified file doesn’t exist.

• ValueError – If the files have inconsistent dimensions or variables.

• RuntimeError – If there are issues opening or processing the dataset.

Notes

• The class uses Dask arrays internally through xarray’s open_mfdataset, providing efficient parallel processing and lazy evaluation. Operations are only computed when data is actually requested through the __call__ method.

• All files must share the same coordinate system and variable structure.

• Required dimensions are: time, variable, lat, and lon.

__call__(time, variable)

Retrieve data for specified timestamps and variables.

Parameters:

• time (datetime | list[datetime] | TimeArray) – Single timestamp or list of timestamps to retrieve data for.

• variable (str | list[str] | VariableArray) – Single variable name or list of variable names to retrieve.

Returns:

Data array containing the requested time and variable selections.

Return type:

xr.DataArray

Raises:

ValueError – If requested time or variable values are not present in the dataset.