Note
Go to the end to download the full example code.
Running DLESyM Inference#
Basic deterministic inference workflow for the DLESyM model.
This example will demonstrate how to run a simple inference workflow with the DLESyM model, which differs from other prognostic models in earth2studio. DLESyM performs global earth system modeling, including atmosphere and ocean components which evolve on different timescales (different temporal resolution). Internally, the model uses a HEALPix nside=64 (approximately 1 degree) resolution grid for the physical variables of interest. The model also uses some derived input variables which are not provided by standard data sources but can be computed from the standard variables.
In this example you will learn:
How to instantiate the DLESyM model
How to use the model API to generate a forecast
How to use the output selection and regridding methods to select appropriate data
How to use the DLESyMLatLon model with earth2studio workflows
Set Up#
The first step is fetching appropriate input data for the model. The ERA5 data sources in earth2studio provide data on the lat/lon grid, so have two options:
Use the
earth2studio.models.px.DLESyMLatLonmodel. This version of DLESyM accepts inputs on the lat/lon grid and regrids them to the HEALPix grid internally, before returning the output regridded back to the lat/lon grid. This is the recommended approach for most users as it can be used directly with earth2studio data sources and workflows, since it performs regridding and pre-processing internally.Use the
earth2studio.models.px.DLESyMmodel, and handle the regridding of input lat/lon data ourselves. Since the model uses some derived variables which are not provided by the data source, we would also need to prepare these derived variables ourselves.
Let’s load both of these models and inspect the expected input coordinates for each. Also note the input and output variable set for each model.
import os
os.makedirs("outputs", exist_ok=True)
from dotenv import load_dotenv
load_dotenv() # TODO: make common example prep function
import numpy as np
import torch
from earth2studio.data import ARCO
from earth2studio.data.utils import fetch_data
from earth2studio.models.px.dlesym import DLESyM, DLESyMLatLon
device = "cpu" if not torch.cuda.is_available() else "cuda"
# Create the data source
data = ARCO()
# Load the default model package which downloads the check point from NGC
# We will instantiate both versions of the model to demonstrate usage of each.
package = DLESyMLatLon.load_default_package()
model_ll = DLESyMLatLon.load_model(package).to(device)
package = DLESyM.load_default_package()
model_hpx = DLESyM.load_model(package).to(device)
in_coords_ll = model_ll.input_coords()
in_coords_hpx = model_hpx.input_coords()
print(
"DLESyM LatLon input coord shapes: ",
[(k, v.shape) for k, v in in_coords_ll.items()],
)
print(
"DLESyM HPX input coord shapes: ", [(k, v.shape) for k, v in in_coords_hpx.items()]
)
print("Lat-lon input variable names: ", in_coords_ll["variable"])
print(
"Lat-lon output variable names: ", model_ll.output_coords(in_coords_ll)["variable"]
)
print("HEALPix input variable names: ", in_coords_hpx["variable"])
print(
"HEALPix output variable names: ",
model_hpx.output_coords(in_coords_hpx)["variable"],
)
Downloading config.yaml: 0%| | 0.00/1.36k [00:00<?, ?B/s]
Downloading config.yaml: 100%|██████████| 1.36k/1.36k [00:00<00:00, 1.06MB/s]
Downloading atmos_model_0.mdlus: 0%| | 0.00/37.6M [00:00<?, ?B/s]
Downloading atmos_model_0.mdlus: 4%|▍ | 1.51M/37.6M [00:00<00:02, 15.8MB/s]
Downloading atmos_model_0.mdlus: 22%|██▏ | 8.37M/37.6M [00:00<00:00, 48.7MB/s]
Downloading atmos_model_0.mdlus: 38%|███▊ | 14.4M/37.6M [00:00<00:00, 55.2MB/s]
Downloading atmos_model_0.mdlus: 59%|█████▉ | 22.3M/37.6M [00:00<00:00, 66.2MB/s]
Downloading atmos_model_0.mdlus: 85%|████████▍ | 31.9M/37.6M [00:00<00:00, 78.3MB/s]
Downloading atmos_model_0.mdlus: 100%|██████████| 37.6M/37.6M [00:00<00:00, 69.2MB/s]
Downloading ocean_model_0.mdlus: 0%| | 0.00/2.97M [00:00<?, ?B/s]
Downloading ocean_model_0.mdlus: 100%|██████████| 2.97M/2.97M [00:00<00:00, 123MB/s]
Warning, cannot find healpixpad module
Downloading hpx_lat.npy: 0%| | 0.00/384k [00:00<?, ?B/s]
Downloading hpx_lat.npy: 100%|██████████| 384k/384k [00:00<00:00, 5.25MB/s]
Downloading hpx_lon.npy: 0%| | 0.00/384k [00:00<?, ?B/s]
Downloading hpx_lon.npy: 100%|██████████| 384k/384k [00:00<00:00, 10.3MB/s]
Downloading land_sea_mask.npy: 0%| | 0.00/192k [00:00<?, ?B/s]
Downloading land_sea_mask.npy: 100%|██████████| 192k/192k [00:00<00:00, 72.7MB/s]
Downloading topography.npy: 0%| | 0.00/192k [00:00<?, ?B/s]
Downloading topography.npy: 100%|██████████| 192k/192k [00:00<00:00, 55.2MB/s]
DLESyM LatLon input coord shapes: [('batch', (0,)), ('time', (0,)), ('lead_time', (9,)), ('variable', (11,)), ('lat', (721,)), ('lon', (1440,))]
DLESyM HPX input coord shapes: [('batch', (0,)), ('time', (0,)), ('lead_time', (9,)), ('variable', (9,)), ('face', (12,)), ('height', (64,)), ('width', (64,))]
Lat-lon input variable names: ['z500' 'z1000' 't2m' 'tcwv' 't850' 'z250' 'sst' 'u10m' 'v10m' 'z300'
'z700']
Lat-lon output variable names: ['z500' 'tau300-700' 'z1000' 't2m' 'tcwv' 't850' 'z250' 'ws10m' 'sst']
HEALPix input variable names: ['z500' 'tau300-700' 'z1000' 't2m' 'tcwv' 't850' 'z250' 'ws10m' 'sst']
HEALPix output variable names: ['z500' 'tau300-700' 'z1000' 't2m' 'tcwv' 't850' 'z250' 'ws10m' 'sst']
Making Predictions, Regridding, and Selecting Outputs#
Let’s now pull some example data and make predictions with the model. As the
data source provides lat/lon data, we can use the earth2studio.models.px.DLESyMLatLon model.
In addition, we demonstrate how to use the regridding utilities provided by
DLESyMLatLon to regrid onto the HEALPix grid. The earth2studio.models.px.DLESyM
model can then be used directly with the HEALPix data.
Finally, a key aspect of the DLESyM model is that it makes predictions for the atmosphere and ocean components at different timesteps, because the atmosphere is faster-evolving than the ocean. The atmosphere is predicted every 6 hours, while the ocean is only predicted every 48 hours. Thus, not all output lead times are valid for the ocean component. For convenience, we can use a method that selects only the valid outputs for each of the atmosphere and ocean components.
ic_date = np.datetime64("2021-06-15")
# Fetch some example data
x, coords = fetch_data(
source=data,
time=np.array([ic_date]),
variable=np.array(in_coords_ll["variable"]),
lead_time=in_coords_ll["lead_time"],
device=device,
)
# Can call the `DLESyMLatLon` model directly with the input lat/lon data
y, y_coords = model_ll(x, coords)
# Or, we can use the pre-processing and regridding utilities to regrid the data onto
# the HEALPix grid, and then run directly with `DLESyM`, which expects HEALPix data
x_prep, coords_prep = model_ll._prepare_derived_variables(x, coords)
x_hpx, coords_hpx = model_ll.to_hpx(x_prep), model_ll.coords_to_hpx(coords_prep)
y_hpx, y_coords_hpx = model_hpx(x_hpx, coords_hpx)
# Retrieve the valid outputs for atmos/ocean components from the predictions
y_atmos, y_atmos_coords = model_ll.retrieve_valid_atmos_outputs(y, y_coords)
y_ocean, y_ocean_coords = model_ll.retrieve_valid_ocean_outputs(y, y_coords)
print(
"Atmosphere outputs (variables, lead_time [hrs]):",
y_atmos_coords["variable"],
y_atmos_coords["lead_time"].astype("timedelta64[h]"),
)
print(
"Ocean outputs (variables, lead_time [hrs]):",
y_ocean_coords["variable"],
y_ocean_coords["lead_time"].astype("timedelta64[h]"),
)
Fetching ARCO data: 0%| | 0/11 [00:00<?, ?it/s]
2025-05-15 03:26:45.619 | DEBUG | earth2studio.data.arco:fetch_array:252 - Fetching ARCO zarr array for variable: z1000 at 2021-06-13T00:00:00
Fetching ARCO data: 0%| | 0/11 [00:00<?, ?it/s]
2025-05-15 03:26:45.620 | DEBUG | earth2studio.data.arco:fetch_array:252 - Fetching ARCO zarr array for variable: v10m at 2021-06-13T00:00:00
Fetching ARCO data: 0%| | 0/11 [00:00<?, ?it/s]
2025-05-15 03:26:45.621 | DEBUG | earth2studio.data.arco:fetch_array:252 - Fetching ARCO zarr array for variable: tcwv at 2021-06-13T00:00:00
Fetching ARCO data: 0%| | 0/11 [00:00<?, ?it/s]
2025-05-15 03:26:45.622 | DEBUG | earth2studio.data.arco:fetch_array:252 - Fetching ARCO zarr array for variable: z700 at 2021-06-13T00:00:00
Fetching ARCO data: 0%| | 0/11 [00:00<?, ?it/s]
2025-05-15 03:26:45.623 | DEBUG | earth2studio.data.arco:fetch_array:252 - Fetching ARCO zarr array for variable: z250 at 2021-06-13T00:00:00
Fetching ARCO data: 0%| | 0/11 [00:00<?, ?it/s]
2025-05-15 03:26:45.624 | DEBUG | earth2studio.data.arco:fetch_array:252 - Fetching ARCO zarr array for variable: z500 at 2021-06-13T00:00:00
Fetching ARCO data: 0%| | 0/11 [00:00<?, ?it/s]
2025-05-15 03:26:45.625 | DEBUG | earth2studio.data.arco:fetch_array:252 - Fetching ARCO zarr array for variable: u10m at 2021-06-13T00:00:00
Fetching ARCO data: 0%| | 0/11 [00:00<?, ?it/s]
2025-05-15 03:26:45.626 | DEBUG | earth2studio.data.arco:fetch_array:252 - Fetching ARCO zarr array for variable: t2m at 2021-06-13T00:00:00
Fetching ARCO data: 0%| | 0/11 [00:00<?, ?it/s]
2025-05-15 03:26:45.627 | DEBUG | earth2studio.data.arco:fetch_array:252 - Fetching ARCO zarr array for variable: z300 at 2021-06-13T00:00:00
Fetching ARCO data: 0%| | 0/11 [00:00<?, ?it/s]
2025-05-15 03:26:45.628 | DEBUG | earth2studio.data.arco:fetch_array:252 - Fetching ARCO zarr array for variable: t850 at 2021-06-13T00:00:00
Fetching ARCO data: 0%| | 0/11 [00:00<?, ?it/s]
2025-05-15 03:26:45.629 | DEBUG | earth2studio.data.arco:fetch_array:252 - Fetching ARCO zarr array for variable: sst at 2021-06-13T00:00:00
Fetching ARCO data: 0%| | 0/11 [00:00<?, ?it/s]
2025-05-15 03:26:45.742 | DEBUG | earth2studio.data.utils:_make_local_details:629 - Copying /gcp-public-data-arco-era5/ar/full_37-1h-0p25deg-chunk-1.zarr-v3/total_column_water_vapour/1064592.0.0 to local cache
Fetching ARCO data: 0%| | 0/11 [00:00<?, ?it/s]
2025-05-15 03:26:45.748 | DEBUG | earth2studio.data.utils:_make_local_details:629 - Copying /gcp-public-data-arco-era5/ar/full_37-1h-0p25deg-chunk-1.zarr-v3/geopotential/1064592.0.0.0 to local cache
Fetching ARCO data: 0%| | 0/11 [00:00<?, ?it/s]
2025-05-15 03:26:45.754 | DEBUG | earth2studio.data.utils:_make_local_details:629 - Copying /gcp-public-data-arco-era5/ar/full_37-1h-0p25deg-chunk-1.zarr-v3/geopotential/1064592.0.0.0 to local cache
Fetching ARCO data: 0%| | 0/11 [00:00<?, ?it/s]
2025-05-15 03:26:45.755 | DEBUG | earth2studio.data.utils:_make_local_details:629 - Copying /gcp-public-data-arco-era5/ar/full_37-1h-0p25deg-chunk-1.zarr-v3/geopotential/1064592.0.0.0 to local cache
Fetching ARCO data: 0%| | 0/11 [00:00<?, ?it/s]
2025-05-15 03:26:45.756 | DEBUG | earth2studio.data.utils:_make_local_details:629 - Copying /gcp-public-data-arco-era5/ar/full_37-1h-0p25deg-chunk-1.zarr-v3/2m_temperature/1064592.0.0 to local cache
Fetching ARCO data: 0%| | 0/11 [00:00<?, ?it/s]
2025-05-15 03:26:45.757 | DEBUG | earth2studio.data.utils:_make_local_details:629 - Copying /gcp-public-data-arco-era5/ar/full_37-1h-0p25deg-chunk-1.zarr-v3/geopotential/1064592.0.0.0 to local cache
Fetching ARCO data: 0%| | 0/11 [00:00<?, ?it/s]
2025-05-15 03:26:45.760 | DEBUG | earth2studio.data.utils:_make_local_details:629 - Copying /gcp-public-data-arco-era5/ar/full_37-1h-0p25deg-chunk-1.zarr-v3/geopotential/1064592.0.0.0 to local cache
Fetching ARCO data: 0%| | 0/11 [00:00<?, ?it/s]
2025-05-15 03:26:45.763 | DEBUG | earth2studio.data.utils:_make_local_details:629 - Copying /gcp-public-data-arco-era5/ar/full_37-1h-0p25deg-chunk-1.zarr-v3/sea_surface_temperature/1064592.0.0 to local cache
Fetching ARCO data: 0%| | 0/11 [00:00<?, ?it/s]
2025-05-15 03:26:45.766 | DEBUG | earth2studio.data.utils:_make_local_details:629 - Copying /gcp-public-data-arco-era5/ar/full_37-1h-0p25deg-chunk-1.zarr-v3/10m_u_component_of_wind/1064592.0.0 to local cache
Fetching ARCO data: 0%| | 0/11 [00:00<?, ?it/s]
2025-05-15 03:26:45.840 | DEBUG | earth2studio.data.utils:_make_local_details:629 - Copying /gcp-public-data-arco-era5/ar/full_37-1h-0p25deg-chunk-1.zarr-v3/10m_v_component_of_wind/1064592.0.0 to local cache
Fetching ARCO data: 0%| | 0/11 [00:00<?, ?it/s]
Fetching ARCO data: 9%|▉ | 1/11 [00:00<00:02, 4.26it/s]
2025-05-15 03:26:45.998 | DEBUG | earth2studio.data.utils:_make_local_details:629 - Copying /gcp-public-data-arco-era5/ar/full_37-1h-0p25deg-chunk-1.zarr-v3/temperature/1064592.0.0.0 to local cache
Fetching ARCO data: 9%|▉ | 1/11 [00:00<00:02, 4.26it/s]
Fetching ARCO data: 18%|█▊ | 2/11 [00:00<00:01, 4.60it/s]
Fetching ARCO data: 36%|███▋ | 4/11 [00:00<00:01, 6.05it/s]
Fetching ARCO data: 45%|████▌ | 5/11 [00:00<00:00, 6.42it/s]
Fetching ARCO data: 55%|█████▍ | 6/11 [00:01<00:02, 2.21it/s]
Fetching ARCO data: 64%|██████▎ | 7/11 [00:02<00:01, 2.44it/s]
Fetching ARCO data: 73%|███████▎ | 8/11 [00:02<00:01, 2.61it/s]
Fetching ARCO data: 82%|████████▏ | 9/11 [00:02<00:00, 3.23it/s]
Fetching ARCO data: 100%|██████████| 11/11 [00:03<00:00, 3.72it/s]
Fetching ARCO data: 100%|██████████| 11/11 [00:03<00:00, 3.45it/s]
Fetching ARCO data: 0%| | 0/11 [00:00<?, ?it/s]
2025-05-15 03:26:48.807 | DEBUG | earth2studio.data.arco:fetch_array:252 - Fetching ARCO zarr array for variable: t2m at 2021-06-13T06:00:00
Fetching ARCO data: 0%| | 0/11 [00:00<?, ?it/s]
2025-05-15 03:26:48.808 | DEBUG | earth2studio.data.arco:fetch_array:252 - Fetching ARCO zarr array for variable: v10m at 2021-06-13T06:00:00
Fetching ARCO data: 0%| | 0/11 [00:00<?, ?it/s]
2025-05-15 03:26:48.808 | DEBUG | earth2studio.data.arco:fetch_array:252 - Fetching ARCO zarr array for variable: z500 at 2021-06-13T06:00:00
Fetching ARCO data: 0%| | 0/11 [00:00<?, ?it/s]
2025-05-15 03:26:48.809 | DEBUG | earth2studio.data.arco:fetch_array:252 - Fetching ARCO zarr array for variable: z700 at 2021-06-13T06:00:00
Fetching ARCO data: 0%| | 0/11 [00:00<?, ?it/s]
2025-05-15 03:26:48.810 | DEBUG | earth2studio.data.arco:fetch_array:252 - Fetching ARCO zarr array for variable: tcwv at 2021-06-13T06:00:00
Fetching ARCO data: 0%| | 0/11 [00:00<?, ?it/s]
2025-05-15 03:26:48.810 | DEBUG | earth2studio.data.arco:fetch_array:252 - Fetching ARCO zarr array for variable: t850 at 2021-06-13T06:00:00
Fetching ARCO data: 0%| | 0/11 [00:00<?, ?it/s]
2025-05-15 03:26:48.811 | DEBUG | earth2studio.data.arco:fetch_array:252 - Fetching ARCO zarr array for variable: u10m at 2021-06-13T06:00:00
Fetching ARCO data: 0%| | 0/11 [00:00<?, ?it/s]
2025-05-15 03:26:48.811 | DEBUG | earth2studio.data.arco:fetch_array:252 - Fetching ARCO zarr array for variable: z1000 at 2021-06-13T06:00:00
Fetching ARCO data: 0%| | 0/11 [00:00<?, ?it/s]
2025-05-15 03:26:48.812 | DEBUG | earth2studio.data.arco:fetch_array:252 - Fetching ARCO zarr array for variable: z300 at 2021-06-13T06:00:00
Fetching ARCO data: 0%| | 0/11 [00:00<?, ?it/s]
2025-05-15 03:26:48.812 | DEBUG | earth2studio.data.arco:fetch_array:252 - Fetching ARCO zarr array for variable: z250 at 2021-06-13T06:00:00
Fetching ARCO data: 0%| | 0/11 [00:00<?, ?it/s]
2025-05-15 03:26:48.813 | DEBUG | earth2studio.data.arco:fetch_array:252 - Fetching ARCO zarr array for variable: sst at 2021-06-13T06:00:00
Fetching ARCO data: 0%| | 0/11 [00:00<?, ?it/s]
2025-05-15 03:26:48.886 | DEBUG | earth2studio.data.utils:_make_local_details:629 - Copying /gcp-public-data-arco-era5/ar/full_37-1h-0p25deg-chunk-1.zarr-v3/geopotential/1064598.0.0.0 to local cache
Fetching ARCO data: 0%| | 0/11 [00:00<?, ?it/s]
2025-05-15 03:26:48.887 | DEBUG | earth2studio.data.utils:_make_local_details:629 - Copying /gcp-public-data-arco-era5/ar/full_37-1h-0p25deg-chunk-1.zarr-v3/geopotential/1064598.0.0.0 to local cache
Fetching ARCO data: 0%| | 0/11 [00:00<?, ?it/s]
2025-05-15 03:26:48.887 | DEBUG | earth2studio.data.utils:_make_local_details:629 - Copying /gcp-public-data-arco-era5/ar/full_37-1h-0p25deg-chunk-1.zarr-v3/sea_surface_temperature/1064598.0.0 to local cache
Fetching ARCO data: 0%| | 0/11 [00:00<?, ?it/s]
2025-05-15 03:26:48.888 | DEBUG | earth2studio.data.utils:_make_local_details:629 - Copying /gcp-public-data-arco-era5/ar/full_37-1h-0p25deg-chunk-1.zarr-v3/10m_v_component_of_wind/1064598.0.0 to local cache
Fetching ARCO data: 0%| | 0/11 [00:00<?, ?it/s]
2025-05-15 03:26:48.888 | DEBUG | earth2studio.data.utils:_make_local_details:629 - Copying /gcp-public-data-arco-era5/ar/full_37-1h-0p25deg-chunk-1.zarr-v3/temperature/1064598.0.0.0 to local cache
Fetching ARCO data: 0%| | 0/11 [00:00<?, ?it/s]
2025-05-15 03:26:48.889 | DEBUG | earth2studio.data.utils:_make_local_details:629 - Copying /gcp-public-data-arco-era5/ar/full_37-1h-0p25deg-chunk-1.zarr-v3/geopotential/1064598.0.0.0 to local cache
Fetching ARCO data: 0%| | 0/11 [00:00<?, ?it/s]
2025-05-15 03:26:48.889 | DEBUG | earth2studio.data.utils:_make_local_details:629 - Copying /gcp-public-data-arco-era5/ar/full_37-1h-0p25deg-chunk-1.zarr-v3/total_column_water_vapour/1064598.0.0 to local cache
Fetching ARCO data: 0%| | 0/11 [00:00<?, ?it/s]
2025-05-15 03:26:48.890 | DEBUG | earth2studio.data.utils:_make_local_details:629 - Copying /gcp-public-data-arco-era5/ar/full_37-1h-0p25deg-chunk-1.zarr-v3/geopotential/1064598.0.0.0 to local cache
Fetching ARCO data: 0%| | 0/11 [00:00<?, ?it/s]
2025-05-15 03:26:48.890 | DEBUG | earth2studio.data.utils:_make_local_details:629 - Copying /gcp-public-data-arco-era5/ar/full_37-1h-0p25deg-chunk-1.zarr-v3/2m_temperature/1064598.0.0 to local cache
Fetching ARCO data: 0%| | 0/11 [00:00<?, ?it/s]
2025-05-15 03:26:48.891 | DEBUG | earth2studio.data.utils:_make_local_details:629 - Copying /gcp-public-data-arco-era5/ar/full_37-1h-0p25deg-chunk-1.zarr-v3/10m_u_component_of_wind/1064598.0.0 to local cache
Fetching ARCO data: 0%| | 0/11 [00:00<?, ?it/s]
2025-05-15 03:26:48.892 | DEBUG | earth2studio.data.utils:_make_local_details:629 - Copying /gcp-public-data-arco-era5/ar/full_37-1h-0p25deg-chunk-1.zarr-v3/geopotential/1064598.0.0.0 to local cache
Fetching ARCO data: 0%| | 0/11 [00:00<?, ?it/s]
Fetching ARCO data: 9%|▉ | 1/11 [00:00<00:01, 9.24it/s]
Fetching ARCO data: 18%|█▊ | 2/11 [00:00<00:01, 4.64it/s]
Fetching ARCO data: 27%|██▋ | 3/11 [00:00<00:02, 3.64it/s]
Fetching ARCO data: 55%|█████▍ | 6/11 [00:01<00:01, 3.23it/s]
Fetching ARCO data: 64%|██████▎ | 7/11 [00:01<00:01, 3.68it/s]
Fetching ARCO data: 73%|███████▎ | 8/11 [00:02<00:00, 3.60it/s]
Fetching ARCO data: 82%|████████▏ | 9/11 [00:02<00:00, 4.06it/s]
Fetching ARCO data: 100%|██████████| 11/11 [00:02<00:00, 6.14it/s]
Fetching ARCO data: 100%|██████████| 11/11 [00:02<00:00, 4.51it/s]
Fetching ARCO data: 0%| | 0/11 [00:00<?, ?it/s]
2025-05-15 03:26:51.251 | DEBUG | earth2studio.data.arco:fetch_array:252 - Fetching ARCO zarr array for variable: z1000 at 2021-06-13T12:00:00
Fetching ARCO data: 0%| | 0/11 [00:00<?, ?it/s]
2025-05-15 03:26:51.251 | DEBUG | earth2studio.data.arco:fetch_array:252 - Fetching ARCO zarr array for variable: v10m at 2021-06-13T12:00:00
Fetching ARCO data: 0%| | 0/11 [00:00<?, ?it/s]
2025-05-15 03:26:51.252 | DEBUG | earth2studio.data.arco:fetch_array:252 - Fetching ARCO zarr array for variable: t850 at 2021-06-13T12:00:00
Fetching ARCO data: 0%| | 0/11 [00:00<?, ?it/s]
2025-05-15 03:26:51.252 | DEBUG | earth2studio.data.arco:fetch_array:252 - Fetching ARCO zarr array for variable: z700 at 2021-06-13T12:00:00
Fetching ARCO data: 0%| | 0/11 [00:00<?, ?it/s]
2025-05-15 03:26:51.253 | DEBUG | earth2studio.data.arco:fetch_array:252 - Fetching ARCO zarr array for variable: z500 at 2021-06-13T12:00:00
Fetching ARCO data: 0%| | 0/11 [00:00<?, ?it/s]
2025-05-15 03:26:51.253 | DEBUG | earth2studio.data.arco:fetch_array:252 - Fetching ARCO zarr array for variable: z250 at 2021-06-13T12:00:00
Fetching ARCO data: 0%| | 0/11 [00:00<?, ?it/s]
2025-05-15 03:26:51.254 | DEBUG | earth2studio.data.arco:fetch_array:252 - Fetching ARCO zarr array for variable: u10m at 2021-06-13T12:00:00
Fetching ARCO data: 0%| | 0/11 [00:00<?, ?it/s]
2025-05-15 03:26:51.254 | DEBUG | earth2studio.data.arco:fetch_array:252 - Fetching ARCO zarr array for variable: t2m at 2021-06-13T12:00:00
Fetching ARCO data: 0%| | 0/11 [00:00<?, ?it/s]
2025-05-15 03:26:51.255 | DEBUG | earth2studio.data.arco:fetch_array:252 - Fetching ARCO zarr array for variable: z300 at 2021-06-13T12:00:00
Fetching ARCO data: 0%| | 0/11 [00:00<?, ?it/s]
2025-05-15 03:26:51.255 | DEBUG | earth2studio.data.arco:fetch_array:252 - Fetching ARCO zarr array for variable: tcwv at 2021-06-13T12:00:00
Fetching ARCO data: 0%| | 0/11 [00:00<?, ?it/s]
2025-05-15 03:26:51.256 | DEBUG | earth2studio.data.arco:fetch_array:252 - Fetching ARCO zarr array for variable: sst at 2021-06-13T12:00:00
Fetching ARCO data: 0%| | 0/11 [00:00<?, ?it/s]
2025-05-15 03:26:51.325 | DEBUG | earth2studio.data.utils:_make_local_details:629 - Copying /gcp-public-data-arco-era5/ar/full_37-1h-0p25deg-chunk-1.zarr-v3/10m_u_component_of_wind/1064604.0.0 to local cache
Fetching ARCO data: 0%| | 0/11 [00:00<?, ?it/s]
2025-05-15 03:26:51.327 | DEBUG | earth2studio.data.utils:_make_local_details:629 - Copying /gcp-public-data-arco-era5/ar/full_37-1h-0p25deg-chunk-1.zarr-v3/geopotential/1064604.0.0.0 to local cache
Fetching ARCO data: 0%| | 0/11 [00:00<?, ?it/s]
2025-05-15 03:26:51.327 | DEBUG | earth2studio.data.utils:_make_local_details:629 - Copying /gcp-public-data-arco-era5/ar/full_37-1h-0p25deg-chunk-1.zarr-v3/2m_temperature/1064604.0.0 to local cache
Fetching ARCO data: 0%| | 0/11 [00:00<?, ?it/s]
2025-05-15 03:26:51.330 | DEBUG | earth2studio.data.utils:_make_local_details:629 - Copying /gcp-public-data-arco-era5/ar/full_37-1h-0p25deg-chunk-1.zarr-v3/geopotential/1064604.0.0.0 to local cache
Fetching ARCO data: 0%| | 0/11 [00:00<?, ?it/s]
2025-05-15 03:26:51.330 | DEBUG | earth2studio.data.utils:_make_local_details:629 - Copying /gcp-public-data-arco-era5/ar/full_37-1h-0p25deg-chunk-1.zarr-v3/temperature/1064604.0.0.0 to local cache
Fetching ARCO data: 0%| | 0/11 [00:00<?, ?it/s]
2025-05-15 03:26:51.331 | DEBUG | earth2studio.data.utils:_make_local_details:629 - Copying /gcp-public-data-arco-era5/ar/full_37-1h-0p25deg-chunk-1.zarr-v3/total_column_water_vapour/1064604.0.0 to local cache
Fetching ARCO data: 0%| | 0/11 [00:00<?, ?it/s]
2025-05-15 03:26:51.332 | DEBUG | earth2studio.data.utils:_make_local_details:629 - Copying /gcp-public-data-arco-era5/ar/full_37-1h-0p25deg-chunk-1.zarr-v3/geopotential/1064604.0.0.0 to local cache
Fetching ARCO data: 0%| | 0/11 [00:00<?, ?it/s]
2025-05-15 03:26:51.333 | DEBUG | earth2studio.data.utils:_make_local_details:629 - Copying /gcp-public-data-arco-era5/ar/full_37-1h-0p25deg-chunk-1.zarr-v3/geopotential/1064604.0.0.0 to local cache
Fetching ARCO data: 0%| | 0/11 [00:00<?, ?it/s]
2025-05-15 03:26:51.334 | DEBUG | earth2studio.data.utils:_make_local_details:629 - Copying /gcp-public-data-arco-era5/ar/full_37-1h-0p25deg-chunk-1.zarr-v3/10m_v_component_of_wind/1064604.0.0 to local cache
Fetching ARCO data: 0%| | 0/11 [00:00<?, ?it/s]
2025-05-15 03:26:51.335 | DEBUG | earth2studio.data.utils:_make_local_details:629 - Copying /gcp-public-data-arco-era5/ar/full_37-1h-0p25deg-chunk-1.zarr-v3/sea_surface_temperature/1064604.0.0 to local cache
Fetching ARCO data: 0%| | 0/11 [00:00<?, ?it/s]
2025-05-15 03:26:51.336 | DEBUG | earth2studio.data.utils:_make_local_details:629 - Copying /gcp-public-data-arco-era5/ar/full_37-1h-0p25deg-chunk-1.zarr-v3/geopotential/1064604.0.0.0 to local cache
Fetching ARCO data: 0%| | 0/11 [00:00<?, ?it/s]
Fetching ARCO data: 9%|▉ | 1/11 [00:00<00:01, 7.30it/s]
Fetching ARCO data: 45%|████▌ | 5/11 [00:00<00:00, 13.34it/s]
Fetching ARCO data: 64%|██████▎ | 7/11 [00:02<00:01, 2.31it/s]
Fetching ARCO data: 91%|█████████ | 10/11 [00:02<00:00, 3.94it/s]
Fetching ARCO data: 100%|██████████| 11/11 [00:02<00:00, 4.31it/s]
Fetching ARCO data: 0%| | 0/11 [00:00<?, ?it/s]
2025-05-15 03:26:53.809 | DEBUG | earth2studio.data.arco:fetch_array:252 - Fetching ARCO zarr array for variable: t2m at 2021-06-13T18:00:00
Fetching ARCO data: 0%| | 0/11 [00:00<?, ?it/s]
2025-05-15 03:26:53.809 | DEBUG | earth2studio.data.arco:fetch_array:252 - Fetching ARCO zarr array for variable: v10m at 2021-06-13T18:00:00
Fetching ARCO data: 0%| | 0/11 [00:00<?, ?it/s]
2025-05-15 03:26:53.810 | DEBUG | earth2studio.data.arco:fetch_array:252 - Fetching ARCO zarr array for variable: z250 at 2021-06-13T18:00:00
Fetching ARCO data: 0%| | 0/11 [00:00<?, ?it/s]
2025-05-15 03:26:53.810 | DEBUG | earth2studio.data.arco:fetch_array:252 - Fetching ARCO zarr array for variable: z700 at 2021-06-13T18:00:00
Fetching ARCO data: 0%| | 0/11 [00:00<?, ?it/s]
2025-05-15 03:26:53.811 | DEBUG | earth2studio.data.arco:fetch_array:252 - Fetching ARCO zarr array for variable: t850 at 2021-06-13T18:00:00
Fetching ARCO data: 0%| | 0/11 [00:00<?, ?it/s]
2025-05-15 03:26:53.811 | DEBUG | earth2studio.data.arco:fetch_array:252 - Fetching ARCO zarr array for variable: tcwv at 2021-06-13T18:00:00
Fetching ARCO data: 0%| | 0/11 [00:00<?, ?it/s]
2025-05-15 03:26:53.812 | DEBUG | earth2studio.data.arco:fetch_array:252 - Fetching ARCO zarr array for variable: u10m at 2021-06-13T18:00:00
Fetching ARCO data: 0%| | 0/11 [00:00<?, ?it/s]
2025-05-15 03:26:53.812 | DEBUG | earth2studio.data.arco:fetch_array:252 - Fetching ARCO zarr array for variable: z1000 at 2021-06-13T18:00:00
Fetching ARCO data: 0%| | 0/11 [00:00<?, ?it/s]
2025-05-15 03:26:53.813 | DEBUG | earth2studio.data.arco:fetch_array:252 - Fetching ARCO zarr array for variable: z300 at 2021-06-13T18:00:00
Fetching ARCO data: 0%| | 0/11 [00:00<?, ?it/s]
2025-05-15 03:26:53.814 | DEBUG | earth2studio.data.arco:fetch_array:252 - Fetching ARCO zarr array for variable: z500 at 2021-06-13T18:00:00
Fetching ARCO data: 0%| | 0/11 [00:00<?, ?it/s]
2025-05-15 03:26:53.814 | DEBUG | earth2studio.data.arco:fetch_array:252 - Fetching ARCO zarr array for variable: sst at 2021-06-13T18:00:00
Fetching ARCO data: 0%| | 0/11 [00:00<?, ?it/s]
2025-05-15 03:26:53.885 | DEBUG | earth2studio.data.utils:_make_local_details:629 - Copying /gcp-public-data-arco-era5/ar/full_37-1h-0p25deg-chunk-1.zarr-v3/2m_temperature/1064610.0.0 to local cache
Fetching ARCO data: 0%| | 0/11 [00:00<?, ?it/s]
2025-05-15 03:26:53.886 | DEBUG | earth2studio.data.utils:_make_local_details:629 - Copying /gcp-public-data-arco-era5/ar/full_37-1h-0p25deg-chunk-1.zarr-v3/geopotential/1064610.0.0.0 to local cache
Fetching ARCO data: 0%| | 0/11 [00:00<?, ?it/s]
2025-05-15 03:26:53.886 | DEBUG | earth2studio.data.utils:_make_local_details:629 - Copying /gcp-public-data-arco-era5/ar/full_37-1h-0p25deg-chunk-1.zarr-v3/temperature/1064610.0.0.0 to local cache
Fetching ARCO data: 0%| | 0/11 [00:00<?, ?it/s]
2025-05-15 03:26:53.887 | DEBUG | earth2studio.data.utils:_make_local_details:629 - Copying /gcp-public-data-arco-era5/ar/full_37-1h-0p25deg-chunk-1.zarr-v3/geopotential/1064610.0.0.0 to local cache
Fetching ARCO data: 0%| | 0/11 [00:00<?, ?it/s]
2025-05-15 03:26:53.887 | DEBUG | earth2studio.data.utils:_make_local_details:629 - Copying /gcp-public-data-arco-era5/ar/full_37-1h-0p25deg-chunk-1.zarr-v3/geopotential/1064610.0.0.0 to local cache
Fetching ARCO data: 0%| | 0/11 [00:00<?, ?it/s]
2025-05-15 03:26:53.888 | DEBUG | earth2studio.data.utils:_make_local_details:629 - Copying /gcp-public-data-arco-era5/ar/full_37-1h-0p25deg-chunk-1.zarr-v3/10m_u_component_of_wind/1064610.0.0 to local cache
Fetching ARCO data: 0%| | 0/11 [00:00<?, ?it/s]
2025-05-15 03:26:53.888 | DEBUG | earth2studio.data.utils:_make_local_details:629 - Copying /gcp-public-data-arco-era5/ar/full_37-1h-0p25deg-chunk-1.zarr-v3/sea_surface_temperature/1064610.0.0 to local cache
Fetching ARCO data: 0%| | 0/11 [00:00<?, ?it/s]
2025-05-15 03:26:53.890 | DEBUG | earth2studio.data.utils:_make_local_details:629 - Copying /gcp-public-data-arco-era5/ar/full_37-1h-0p25deg-chunk-1.zarr-v3/10m_v_component_of_wind/1064610.0.0 to local cache
Fetching ARCO data: 0%| | 0/11 [00:00<?, ?it/s]
2025-05-15 03:26:53.890 | DEBUG | earth2studio.data.utils:_make_local_details:629 - Copying /gcp-public-data-arco-era5/ar/full_37-1h-0p25deg-chunk-1.zarr-v3/geopotential/1064610.0.0.0 to local cache
Fetching ARCO data: 0%| | 0/11 [00:00<?, ?it/s]
2025-05-15 03:26:53.891 | DEBUG | earth2studio.data.utils:_make_local_details:629 - Copying /gcp-public-data-arco-era5/ar/full_37-1h-0p25deg-chunk-1.zarr-v3/geopotential/1064610.0.0.0 to local cache
Fetching ARCO data: 0%| | 0/11 [00:00<?, ?it/s]
2025-05-15 03:26:53.891 | DEBUG | earth2studio.data.utils:_make_local_details:629 - Copying /gcp-public-data-arco-era5/ar/full_37-1h-0p25deg-chunk-1.zarr-v3/total_column_water_vapour/1064610.0.0 to local cache
Fetching ARCO data: 0%| | 0/11 [00:00<?, ?it/s]
Fetching ARCO data: 9%|▉ | 1/11 [00:00<00:01, 5.08it/s]
Fetching ARCO data: 18%|█▊ | 2/11 [00:00<00:02, 3.09it/s]
Fetching ARCO data: 55%|█████▍ | 6/11 [00:01<00:01, 3.96it/s]
Fetching ARCO data: 64%|██████▎ | 7/11 [00:02<00:01, 2.67it/s]
Fetching ARCO data: 82%|████████▏ | 9/11 [00:02<00:00, 3.97it/s]
Fetching ARCO data: 100%|██████████| 11/11 [00:02<00:00, 4.94it/s]
Fetching ARCO data: 100%|██████████| 11/11 [00:02<00:00, 4.10it/s]
Fetching ARCO data: 0%| | 0/11 [00:00<?, ?it/s]
2025-05-15 03:26:56.495 | DEBUG | earth2studio.data.arco:fetch_array:252 - Fetching ARCO zarr array for variable: z1000 at 2021-06-14T00:00:00
Fetching ARCO data: 0%| | 0/11 [00:00<?, ?it/s]
2025-05-15 03:26:56.496 | DEBUG | earth2studio.data.arco:fetch_array:252 - Fetching ARCO zarr array for variable: v10m at 2021-06-14T00:00:00
Fetching ARCO data: 0%| | 0/11 [00:00<?, ?it/s]
2025-05-15 03:26:56.496 | DEBUG | earth2studio.data.arco:fetch_array:252 - Fetching ARCO zarr array for variable: tcwv at 2021-06-14T00:00:00
Fetching ARCO data: 0%| | 0/11 [00:00<?, ?it/s]
2025-05-15 03:26:56.497 | DEBUG | earth2studio.data.arco:fetch_array:252 - Fetching ARCO zarr array for variable: z700 at 2021-06-14T00:00:00
Fetching ARCO data: 0%| | 0/11 [00:00<?, ?it/s]
2025-05-15 03:26:56.497 | DEBUG | earth2studio.data.arco:fetch_array:252 - Fetching ARCO zarr array for variable: z250 at 2021-06-14T00:00:00
Fetching ARCO data: 0%| | 0/11 [00:00<?, ?it/s]
2025-05-15 03:26:56.498 | DEBUG | earth2studio.data.arco:fetch_array:252 - Fetching ARCO zarr array for variable: z500 at 2021-06-14T00:00:00
Fetching ARCO data: 0%| | 0/11 [00:00<?, ?it/s]
2025-05-15 03:26:56.498 | DEBUG | earth2studio.data.arco:fetch_array:252 - Fetching ARCO zarr array for variable: u10m at 2021-06-14T00:00:00
Fetching ARCO data: 0%| | 0/11 [00:00<?, ?it/s]
2025-05-15 03:26:56.499 | DEBUG | earth2studio.data.arco:fetch_array:252 - Fetching ARCO zarr array for variable: t2m at 2021-06-14T00:00:00
Fetching ARCO data: 0%| | 0/11 [00:00<?, ?it/s]
2025-05-15 03:26:56.499 | DEBUG | earth2studio.data.arco:fetch_array:252 - Fetching ARCO zarr array for variable: z300 at 2021-06-14T00:00:00
Fetching ARCO data: 0%| | 0/11 [00:00<?, ?it/s]
2025-05-15 03:26:56.500 | DEBUG | earth2studio.data.arco:fetch_array:252 - Fetching ARCO zarr array for variable: t850 at 2021-06-14T00:00:00
Fetching ARCO data: 0%| | 0/11 [00:00<?, ?it/s]
2025-05-15 03:26:56.500 | DEBUG | earth2studio.data.arco:fetch_array:252 - Fetching ARCO zarr array for variable: sst at 2021-06-14T00:00:00
Fetching ARCO data: 0%| | 0/11 [00:00<?, ?it/s]
2025-05-15 03:26:56.569 | DEBUG | earth2studio.data.utils:_make_local_details:629 - Copying /gcp-public-data-arco-era5/ar/full_37-1h-0p25deg-chunk-1.zarr-v3/geopotential/1064616.0.0.0 to local cache
Fetching ARCO data: 0%| | 0/11 [00:00<?, ?it/s]
2025-05-15 03:26:56.571 | DEBUG | earth2studio.data.utils:_make_local_details:629 - Copying /gcp-public-data-arco-era5/ar/full_37-1h-0p25deg-chunk-1.zarr-v3/total_column_water_vapour/1064616.0.0 to local cache
Fetching ARCO data: 0%| | 0/11 [00:00<?, ?it/s]
2025-05-15 03:26:56.571 | DEBUG | earth2studio.data.utils:_make_local_details:629 - Copying /gcp-public-data-arco-era5/ar/full_37-1h-0p25deg-chunk-1.zarr-v3/10m_u_component_of_wind/1064616.0.0 to local cache
Fetching ARCO data: 0%| | 0/11 [00:00<?, ?it/s]
2025-05-15 03:26:56.572 | DEBUG | earth2studio.data.utils:_make_local_details:629 - Copying /gcp-public-data-arco-era5/ar/full_37-1h-0p25deg-chunk-1.zarr-v3/geopotential/1064616.0.0.0 to local cache
Fetching ARCO data: 0%| | 0/11 [00:00<?, ?it/s]
2025-05-15 03:26:56.573 | DEBUG | earth2studio.data.utils:_make_local_details:629 - Copying /gcp-public-data-arco-era5/ar/full_37-1h-0p25deg-chunk-1.zarr-v3/geopotential/1064616.0.0.0 to local cache
Fetching ARCO data: 0%| | 0/11 [00:00<?, ?it/s]
2025-05-15 03:26:56.574 | DEBUG | earth2studio.data.utils:_make_local_details:629 - Copying /gcp-public-data-arco-era5/ar/full_37-1h-0p25deg-chunk-1.zarr-v3/2m_temperature/1064616.0.0 to local cache
Fetching ARCO data: 0%| | 0/11 [00:00<?, ?it/s]
2025-05-15 03:26:56.576 | DEBUG | earth2studio.data.utils:_make_local_details:629 - Copying /gcp-public-data-arco-era5/ar/full_37-1h-0p25deg-chunk-1.zarr-v3/temperature/1064616.0.0.0 to local cache
Fetching ARCO data: 0%| | 0/11 [00:00<?, ?it/s]
2025-05-15 03:26:56.578 | DEBUG | earth2studio.data.utils:_make_local_details:629 - Copying /gcp-public-data-arco-era5/ar/full_37-1h-0p25deg-chunk-1.zarr-v3/geopotential/1064616.0.0.0 to local cache
Fetching ARCO data: 0%| | 0/11 [00:00<?, ?it/s]
2025-05-15 03:26:56.579 | DEBUG | earth2studio.data.utils:_make_local_details:629 - Copying /gcp-public-data-arco-era5/ar/full_37-1h-0p25deg-chunk-1.zarr-v3/sea_surface_temperature/1064616.0.0 to local cache
Fetching ARCO data: 0%| | 0/11 [00:00<?, ?it/s]
2025-05-15 03:26:56.580 | DEBUG | earth2studio.data.utils:_make_local_details:629 - Copying /gcp-public-data-arco-era5/ar/full_37-1h-0p25deg-chunk-1.zarr-v3/10m_v_component_of_wind/1064616.0.0 to local cache
Fetching ARCO data: 0%| | 0/11 [00:00<?, ?it/s]
2025-05-15 03:26:56.581 | DEBUG | earth2studio.data.utils:_make_local_details:629 - Copying /gcp-public-data-arco-era5/ar/full_37-1h-0p25deg-chunk-1.zarr-v3/geopotential/1064616.0.0.0 to local cache
Fetching ARCO data: 0%| | 0/11 [00:00<?, ?it/s]
Fetching ARCO data: 9%|▉ | 1/11 [00:00<00:01, 7.84it/s]
Fetching ARCO data: 27%|██▋ | 3/11 [00:00<00:01, 4.75it/s]
Fetching ARCO data: 55%|█████▍ | 6/11 [00:02<00:01, 2.55it/s]
Fetching ARCO data: 73%|███████▎ | 8/11 [00:02<00:00, 3.47it/s]
Fetching ARCO data: 82%|████████▏ | 9/11 [00:02<00:00, 3.45it/s]
Fetching ARCO data: 100%|██████████| 11/11 [00:02<00:00, 4.87it/s]
Fetching ARCO data: 100%|██████████| 11/11 [00:02<00:00, 3.97it/s]
Fetching ARCO data: 0%| | 0/11 [00:00<?, ?it/s]
2025-05-15 03:26:59.269 | DEBUG | earth2studio.data.arco:fetch_array:252 - Fetching ARCO zarr array for variable: t2m at 2021-06-14T06:00:00
Fetching ARCO data: 0%| | 0/11 [00:00<?, ?it/s]
2025-05-15 03:26:59.269 | DEBUG | earth2studio.data.arco:fetch_array:252 - Fetching ARCO zarr array for variable: v10m at 2021-06-14T06:00:00
Fetching ARCO data: 0%| | 0/11 [00:00<?, ?it/s]
2025-05-15 03:26:59.270 | DEBUG | earth2studio.data.arco:fetch_array:252 - Fetching ARCO zarr array for variable: z500 at 2021-06-14T06:00:00
Fetching ARCO data: 0%| | 0/11 [00:00<?, ?it/s]
2025-05-15 03:26:59.270 | DEBUG | earth2studio.data.arco:fetch_array:252 - Fetching ARCO zarr array for variable: z700 at 2021-06-14T06:00:00
Fetching ARCO data: 0%| | 0/11 [00:00<?, ?it/s]
2025-05-15 03:26:59.271 | DEBUG | earth2studio.data.arco:fetch_array:252 - Fetching ARCO zarr array for variable: tcwv at 2021-06-14T06:00:00
Fetching ARCO data: 0%| | 0/11 [00:00<?, ?it/s]
2025-05-15 03:26:59.271 | DEBUG | earth2studio.data.arco:fetch_array:252 - Fetching ARCO zarr array for variable: t850 at 2021-06-14T06:00:00
Fetching ARCO data: 0%| | 0/11 [00:00<?, ?it/s]
2025-05-15 03:26:59.272 | DEBUG | earth2studio.data.arco:fetch_array:252 - Fetching ARCO zarr array for variable: u10m at 2021-06-14T06:00:00
Fetching ARCO data: 0%| | 0/11 [00:00<?, ?it/s]
2025-05-15 03:26:59.272 | DEBUG | earth2studio.data.arco:fetch_array:252 - Fetching ARCO zarr array for variable: z1000 at 2021-06-14T06:00:00
Fetching ARCO data: 0%| | 0/11 [00:00<?, ?it/s]
2025-05-15 03:26:59.273 | DEBUG | earth2studio.data.arco:fetch_array:252 - Fetching ARCO zarr array for variable: z300 at 2021-06-14T06:00:00
Fetching ARCO data: 0%| | 0/11 [00:00<?, ?it/s]
2025-05-15 03:26:59.273 | DEBUG | earth2studio.data.arco:fetch_array:252 - Fetching ARCO zarr array for variable: z250 at 2021-06-14T06:00:00
Fetching ARCO data: 0%| | 0/11 [00:00<?, ?it/s]
2025-05-15 03:26:59.274 | DEBUG | earth2studio.data.arco:fetch_array:252 - Fetching ARCO zarr array for variable: sst at 2021-06-14T06:00:00
Fetching ARCO data: 0%| | 0/11 [00:00<?, ?it/s]
2025-05-15 03:26:59.342 | DEBUG | earth2studio.data.utils:_make_local_details:629 - Copying /gcp-public-data-arco-era5/ar/full_37-1h-0p25deg-chunk-1.zarr-v3/10m_v_component_of_wind/1064622.0.0 to local cache
Fetching ARCO data: 0%| | 0/11 [00:00<?, ?it/s]
2025-05-15 03:26:59.343 | DEBUG | earth2studio.data.utils:_make_local_details:629 - Copying /gcp-public-data-arco-era5/ar/full_37-1h-0p25deg-chunk-1.zarr-v3/geopotential/1064622.0.0.0 to local cache
Fetching ARCO data: 0%| | 0/11 [00:00<?, ?it/s]
2025-05-15 03:26:59.344 | DEBUG | earth2studio.data.utils:_make_local_details:629 - Copying /gcp-public-data-arco-era5/ar/full_37-1h-0p25deg-chunk-1.zarr-v3/10m_u_component_of_wind/1064622.0.0 to local cache
Fetching ARCO data: 0%| | 0/11 [00:00<?, ?it/s]
2025-05-15 03:26:59.346 | DEBUG | earth2studio.data.utils:_make_local_details:629 - Copying /gcp-public-data-arco-era5/ar/full_37-1h-0p25deg-chunk-1.zarr-v3/geopotential/1064622.0.0.0 to local cache
Fetching ARCO data: 0%| | 0/11 [00:00<?, ?it/s]
2025-05-15 03:26:59.346 | DEBUG | earth2studio.data.utils:_make_local_details:629 - Copying /gcp-public-data-arco-era5/ar/full_37-1h-0p25deg-chunk-1.zarr-v3/sea_surface_temperature/1064622.0.0 to local cache
Fetching ARCO data: 0%| | 0/11 [00:00<?, ?it/s]
2025-05-15 03:26:59.347 | DEBUG | earth2studio.data.utils:_make_local_details:629 - Copying /gcp-public-data-arco-era5/ar/full_37-1h-0p25deg-chunk-1.zarr-v3/geopotential/1064622.0.0.0 to local cache
Fetching ARCO data: 0%| | 0/11 [00:00<?, ?it/s]
2025-05-15 03:26:59.347 | DEBUG | earth2studio.data.utils:_make_local_details:629 - Copying /gcp-public-data-arco-era5/ar/full_37-1h-0p25deg-chunk-1.zarr-v3/total_column_water_vapour/1064622.0.0 to local cache
Fetching ARCO data: 0%| | 0/11 [00:00<?, ?it/s]
2025-05-15 03:26:59.347 | DEBUG | earth2studio.data.utils:_make_local_details:629 - Copying /gcp-public-data-arco-era5/ar/full_37-1h-0p25deg-chunk-1.zarr-v3/geopotential/1064622.0.0.0 to local cache
Fetching ARCO data: 0%| | 0/11 [00:00<?, ?it/s]
2025-05-15 03:26:59.348 | DEBUG | earth2studio.data.utils:_make_local_details:629 - Copying /gcp-public-data-arco-era5/ar/full_37-1h-0p25deg-chunk-1.zarr-v3/2m_temperature/1064622.0.0 to local cache
Fetching ARCO data: 0%| | 0/11 [00:00<?, ?it/s]
2025-05-15 03:26:59.351 | DEBUG | earth2studio.data.utils:_make_local_details:629 - Copying /gcp-public-data-arco-era5/ar/full_37-1h-0p25deg-chunk-1.zarr-v3/temperature/1064622.0.0.0 to local cache
Fetching ARCO data: 0%| | 0/11 [00:00<?, ?it/s]
2025-05-15 03:26:59.353 | DEBUG | earth2studio.data.utils:_make_local_details:629 - Copying /gcp-public-data-arco-era5/ar/full_37-1h-0p25deg-chunk-1.zarr-v3/geopotential/1064622.0.0.0 to local cache
Fetching ARCO data: 0%| | 0/11 [00:00<?, ?it/s]
Fetching ARCO data: 9%|▉ | 1/11 [00:00<00:01, 8.40it/s]
Fetching ARCO data: 27%|██▋ | 3/11 [00:00<00:01, 4.77it/s]
Fetching ARCO data: 36%|███▋ | 4/11 [00:00<00:01, 5.40it/s]
Fetching ARCO data: 55%|█████▍ | 6/11 [00:01<00:01, 2.68it/s]
Fetching ARCO data: 64%|██████▎ | 7/11 [00:02<00:01, 2.85it/s]
Fetching ARCO data: 82%|████████▏ | 9/11 [00:02<00:00, 3.01it/s]
Fetching ARCO data: 91%|█████████ | 10/11 [00:02<00:00, 3.42it/s]
Fetching ARCO data: 100%|██████████| 11/11 [00:03<00:00, 3.63it/s]
Fetching ARCO data: 0%| | 0/11 [00:00<?, ?it/s]
2025-05-15 03:27:02.301 | DEBUG | earth2studio.data.arco:fetch_array:252 - Fetching ARCO zarr array for variable: z1000 at 2021-06-14T12:00:00
Fetching ARCO data: 0%| | 0/11 [00:00<?, ?it/s]
2025-05-15 03:27:02.302 | DEBUG | earth2studio.data.arco:fetch_array:252 - Fetching ARCO zarr array for variable: v10m at 2021-06-14T12:00:00
Fetching ARCO data: 0%| | 0/11 [00:00<?, ?it/s]
2025-05-15 03:27:02.302 | DEBUG | earth2studio.data.arco:fetch_array:252 - Fetching ARCO zarr array for variable: t850 at 2021-06-14T12:00:00
Fetching ARCO data: 0%| | 0/11 [00:00<?, ?it/s]
2025-05-15 03:27:02.303 | DEBUG | earth2studio.data.arco:fetch_array:252 - Fetching ARCO zarr array for variable: z700 at 2021-06-14T12:00:00
Fetching ARCO data: 0%| | 0/11 [00:00<?, ?it/s]
2025-05-15 03:27:02.304 | DEBUG | earth2studio.data.arco:fetch_array:252 - Fetching ARCO zarr array for variable: z500 at 2021-06-14T12:00:00
Fetching ARCO data: 0%| | 0/11 [00:00<?, ?it/s]
2025-05-15 03:27:02.304 | DEBUG | earth2studio.data.arco:fetch_array:252 - Fetching ARCO zarr array for variable: z250 at 2021-06-14T12:00:00
Fetching ARCO data: 0%| | 0/11 [00:00<?, ?it/s]
2025-05-15 03:27:02.305 | DEBUG | earth2studio.data.arco:fetch_array:252 - Fetching ARCO zarr array for variable: u10m at 2021-06-14T12:00:00
Fetching ARCO data: 0%| | 0/11 [00:00<?, ?it/s]
2025-05-15 03:27:02.305 | DEBUG | earth2studio.data.arco:fetch_array:252 - Fetching ARCO zarr array for variable: t2m at 2021-06-14T12:00:00
Fetching ARCO data: 0%| | 0/11 [00:00<?, ?it/s]
2025-05-15 03:27:02.306 | DEBUG | earth2studio.data.arco:fetch_array:252 - Fetching ARCO zarr array for variable: z300 at 2021-06-14T12:00:00
Fetching ARCO data: 0%| | 0/11 [00:00<?, ?it/s]
2025-05-15 03:27:02.306 | DEBUG | earth2studio.data.arco:fetch_array:252 - Fetching ARCO zarr array for variable: tcwv at 2021-06-14T12:00:00
Fetching ARCO data: 0%| | 0/11 [00:00<?, ?it/s]
2025-05-15 03:27:02.307 | DEBUG | earth2studio.data.arco:fetch_array:252 - Fetching ARCO zarr array for variable: sst at 2021-06-14T12:00:00
Fetching ARCO data: 0%| | 0/11 [00:00<?, ?it/s]
2025-05-15 03:27:02.376 | DEBUG | earth2studio.data.utils:_make_local_details:629 - Copying /gcp-public-data-arco-era5/ar/full_37-1h-0p25deg-chunk-1.zarr-v3/geopotential/1064628.0.0.0 to local cache
Fetching ARCO data: 0%| | 0/11 [00:00<?, ?it/s]
2025-05-15 03:27:02.378 | DEBUG | earth2studio.data.utils:_make_local_details:629 - Copying /gcp-public-data-arco-era5/ar/full_37-1h-0p25deg-chunk-1.zarr-v3/total_column_water_vapour/1064628.0.0 to local cache
Fetching ARCO data: 0%| | 0/11 [00:00<?, ?it/s]
2025-05-15 03:27:02.379 | DEBUG | earth2studio.data.utils:_make_local_details:629 - Copying /gcp-public-data-arco-era5/ar/full_37-1h-0p25deg-chunk-1.zarr-v3/10m_v_component_of_wind/1064628.0.0 to local cache
Fetching ARCO data: 0%| | 0/11 [00:00<?, ?it/s]
2025-05-15 03:27:02.380 | DEBUG | earth2studio.data.utils:_make_local_details:629 - Copying /gcp-public-data-arco-era5/ar/full_37-1h-0p25deg-chunk-1.zarr-v3/10m_u_component_of_wind/1064628.0.0 to local cache
Fetching ARCO data: 0%| | 0/11 [00:00<?, ?it/s]
2025-05-15 03:27:02.380 | DEBUG | earth2studio.data.utils:_make_local_details:629 - Copying /gcp-public-data-arco-era5/ar/full_37-1h-0p25deg-chunk-1.zarr-v3/geopotential/1064628.0.0.0 to local cache
Fetching ARCO data: 0%| | 0/11 [00:00<?, ?it/s]
2025-05-15 03:27:02.381 | DEBUG | earth2studio.data.utils:_make_local_details:629 - Copying /gcp-public-data-arco-era5/ar/full_37-1h-0p25deg-chunk-1.zarr-v3/geopotential/1064628.0.0.0 to local cache
Fetching ARCO data: 0%| | 0/11 [00:00<?, ?it/s]
2025-05-15 03:27:02.381 | DEBUG | earth2studio.data.utils:_make_local_details:629 - Copying /gcp-public-data-arco-era5/ar/full_37-1h-0p25deg-chunk-1.zarr-v3/2m_temperature/1064628.0.0 to local cache
Fetching ARCO data: 0%| | 0/11 [00:00<?, ?it/s]
2025-05-15 03:27:02.382 | DEBUG | earth2studio.data.utils:_make_local_details:629 - Copying /gcp-public-data-arco-era5/ar/full_37-1h-0p25deg-chunk-1.zarr-v3/sea_surface_temperature/1064628.0.0 to local cache
Fetching ARCO data: 0%| | 0/11 [00:00<?, ?it/s]
2025-05-15 03:27:02.383 | DEBUG | earth2studio.data.utils:_make_local_details:629 - Copying /gcp-public-data-arco-era5/ar/full_37-1h-0p25deg-chunk-1.zarr-v3/geopotential/1064628.0.0.0 to local cache
Fetching ARCO data: 0%| | 0/11 [00:00<?, ?it/s]
2025-05-15 03:27:02.384 | DEBUG | earth2studio.data.utils:_make_local_details:629 - Copying /gcp-public-data-arco-era5/ar/full_37-1h-0p25deg-chunk-1.zarr-v3/geopotential/1064628.0.0.0 to local cache
Fetching ARCO data: 0%| | 0/11 [00:00<?, ?it/s]
2025-05-15 03:27:02.390 | DEBUG | earth2studio.data.utils:_make_local_details:629 - Copying /gcp-public-data-arco-era5/ar/full_37-1h-0p25deg-chunk-1.zarr-v3/temperature/1064628.0.0.0 to local cache
Fetching ARCO data: 0%| | 0/11 [00:00<?, ?it/s]
Fetching ARCO data: 9%|▉ | 1/11 [00:00<00:01, 8.12it/s]
Fetching ARCO data: 18%|█▊ | 2/11 [00:00<00:01, 5.16it/s]
Fetching ARCO data: 27%|██▋ | 3/11 [00:00<00:02, 3.67it/s]
Fetching ARCO data: 55%|█████▍ | 6/11 [00:01<00:01, 2.89it/s]
Fetching ARCO data: 64%|██████▎ | 7/11 [00:02<00:01, 3.11it/s]
Fetching ARCO data: 73%|███████▎ | 8/11 [00:02<00:00, 3.36it/s]
Fetching ARCO data: 82%|████████▏ | 9/11 [00:02<00:00, 3.55it/s]
Fetching ARCO data: 91%|█████████ | 10/11 [00:02<00:00, 3.72it/s]
Fetching ARCO data: 100%|██████████| 11/11 [00:02<00:00, 3.78it/s]
Fetching ARCO data: 0%| | 0/11 [00:00<?, ?it/s]
2025-05-15 03:27:05.218 | DEBUG | earth2studio.data.arco:fetch_array:252 - Fetching ARCO zarr array for variable: t2m at 2021-06-14T18:00:00
Fetching ARCO data: 0%| | 0/11 [00:00<?, ?it/s]
2025-05-15 03:27:05.219 | DEBUG | earth2studio.data.arco:fetch_array:252 - Fetching ARCO zarr array for variable: v10m at 2021-06-14T18:00:00
Fetching ARCO data: 0%| | 0/11 [00:00<?, ?it/s]
2025-05-15 03:27:05.219 | DEBUG | earth2studio.data.arco:fetch_array:252 - Fetching ARCO zarr array for variable: z250 at 2021-06-14T18:00:00
Fetching ARCO data: 0%| | 0/11 [00:00<?, ?it/s]
2025-05-15 03:27:05.220 | DEBUG | earth2studio.data.arco:fetch_array:252 - Fetching ARCO zarr array for variable: z700 at 2021-06-14T18:00:00
Fetching ARCO data: 0%| | 0/11 [00:00<?, ?it/s]
2025-05-15 03:27:05.220 | DEBUG | earth2studio.data.arco:fetch_array:252 - Fetching ARCO zarr array for variable: t850 at 2021-06-14T18:00:00
Fetching ARCO data: 0%| | 0/11 [00:00<?, ?it/s]
2025-05-15 03:27:05.221 | DEBUG | earth2studio.data.arco:fetch_array:252 - Fetching ARCO zarr array for variable: tcwv at 2021-06-14T18:00:00
Fetching ARCO data: 0%| | 0/11 [00:00<?, ?it/s]
2025-05-15 03:27:05.221 | DEBUG | earth2studio.data.arco:fetch_array:252 - Fetching ARCO zarr array for variable: u10m at 2021-06-14T18:00:00
Fetching ARCO data: 0%| | 0/11 [00:00<?, ?it/s]
2025-05-15 03:27:05.222 | DEBUG | earth2studio.data.arco:fetch_array:252 - Fetching ARCO zarr array for variable: z1000 at 2021-06-14T18:00:00
Fetching ARCO data: 0%| | 0/11 [00:00<?, ?it/s]
2025-05-15 03:27:05.223 | DEBUG | earth2studio.data.arco:fetch_array:252 - Fetching ARCO zarr array for variable: z300 at 2021-06-14T18:00:00
Fetching ARCO data: 0%| | 0/11 [00:00<?, ?it/s]
2025-05-15 03:27:05.223 | DEBUG | earth2studio.data.arco:fetch_array:252 - Fetching ARCO zarr array for variable: z500 at 2021-06-14T18:00:00
Fetching ARCO data: 0%| | 0/11 [00:00<?, ?it/s]
2025-05-15 03:27:05.224 | DEBUG | earth2studio.data.arco:fetch_array:252 - Fetching ARCO zarr array for variable: sst at 2021-06-14T18:00:00
Fetching ARCO data: 0%| | 0/11 [00:00<?, ?it/s]
2025-05-15 03:27:05.293 | DEBUG | earth2studio.data.utils:_make_local_details:629 - Copying /gcp-public-data-arco-era5/ar/full_37-1h-0p25deg-chunk-1.zarr-v3/total_column_water_vapour/1064634.0.0 to local cache
Fetching ARCO data: 0%| | 0/11 [00:00<?, ?it/s]
2025-05-15 03:27:05.294 | DEBUG | earth2studio.data.utils:_make_local_details:629 - Copying /gcp-public-data-arco-era5/ar/full_37-1h-0p25deg-chunk-1.zarr-v3/10m_u_component_of_wind/1064634.0.0 to local cache
Fetching ARCO data: 0%| | 0/11 [00:00<?, ?it/s]
2025-05-15 03:27:05.298 | DEBUG | earth2studio.data.utils:_make_local_details:629 - Copying /gcp-public-data-arco-era5/ar/full_37-1h-0p25deg-chunk-1.zarr-v3/geopotential/1064634.0.0.0 to local cache
Fetching ARCO data: 0%| | 0/11 [00:00<?, ?it/s]
2025-05-15 03:27:05.299 | DEBUG | earth2studio.data.utils:_make_local_details:629 - Copying /gcp-public-data-arco-era5/ar/full_37-1h-0p25deg-chunk-1.zarr-v3/geopotential/1064634.0.0.0 to local cache
Fetching ARCO data: 0%| | 0/11 [00:00<?, ?it/s]
2025-05-15 03:27:05.299 | DEBUG | earth2studio.data.utils:_make_local_details:629 - Copying /gcp-public-data-arco-era5/ar/full_37-1h-0p25deg-chunk-1.zarr-v3/temperature/1064634.0.0.0 to local cache
Fetching ARCO data: 0%| | 0/11 [00:00<?, ?it/s]
2025-05-15 03:27:05.300 | DEBUG | earth2studio.data.utils:_make_local_details:629 - Copying /gcp-public-data-arco-era5/ar/full_37-1h-0p25deg-chunk-1.zarr-v3/10m_v_component_of_wind/1064634.0.0 to local cache
Fetching ARCO data: 0%| | 0/11 [00:00<?, ?it/s]
2025-05-15 03:27:05.300 | DEBUG | earth2studio.data.utils:_make_local_details:629 - Copying /gcp-public-data-arco-era5/ar/full_37-1h-0p25deg-chunk-1.zarr-v3/geopotential/1064634.0.0.0 to local cache
Fetching ARCO data: 0%| | 0/11 [00:00<?, ?it/s]
2025-05-15 03:27:05.301 | DEBUG | earth2studio.data.utils:_make_local_details:629 - Copying /gcp-public-data-arco-era5/ar/full_37-1h-0p25deg-chunk-1.zarr-v3/geopotential/1064634.0.0.0 to local cache
Fetching ARCO data: 0%| | 0/11 [00:00<?, ?it/s]
2025-05-15 03:27:05.301 | DEBUG | earth2studio.data.utils:_make_local_details:629 - Copying /gcp-public-data-arco-era5/ar/full_37-1h-0p25deg-chunk-1.zarr-v3/sea_surface_temperature/1064634.0.0 to local cache
Fetching ARCO data: 0%| | 0/11 [00:00<?, ?it/s]
2025-05-15 03:27:05.304 | DEBUG | earth2studio.data.utils:_make_local_details:629 - Copying /gcp-public-data-arco-era5/ar/full_37-1h-0p25deg-chunk-1.zarr-v3/geopotential/1064634.0.0.0 to local cache
Fetching ARCO data: 0%| | 0/11 [00:00<?, ?it/s]
2025-05-15 03:27:05.305 | DEBUG | earth2studio.data.utils:_make_local_details:629 - Copying /gcp-public-data-arco-era5/ar/full_37-1h-0p25deg-chunk-1.zarr-v3/2m_temperature/1064634.0.0 to local cache
Fetching ARCO data: 0%| | 0/11 [00:00<?, ?it/s]
Fetching ARCO data: 9%|▉ | 1/11 [00:00<00:01, 8.69it/s]
Fetching ARCO data: 27%|██▋ | 3/11 [00:00<00:01, 4.74it/s]
Fetching ARCO data: 45%|████▌ | 5/11 [00:00<00:00, 7.16it/s]
Fetching ARCO data: 55%|█████▍ | 6/11 [00:02<00:02, 2.14it/s]
Fetching ARCO data: 64%|██████▎ | 7/11 [00:02<00:02, 1.90it/s]
Fetching ARCO data: 73%|███████▎ | 8/11 [00:02<00:01, 2.39it/s]
Fetching ARCO data: 91%|█████████ | 10/11 [00:03<00:00, 3.90it/s]
Fetching ARCO data: 100%|██████████| 11/11 [00:03<00:00, 3.59it/s]
Fetching ARCO data: 0%| | 0/11 [00:00<?, ?it/s]
2025-05-15 03:27:08.284 | DEBUG | earth2studio.data.arco:fetch_array:252 - Fetching ARCO zarr array for variable: z1000 at 2021-06-15T00:00:00
Fetching ARCO data: 0%| | 0/11 [00:00<?, ?it/s]
2025-05-15 03:27:08.285 | DEBUG | earth2studio.data.arco:fetch_array:252 - Fetching ARCO zarr array for variable: v10m at 2021-06-15T00:00:00
Fetching ARCO data: 0%| | 0/11 [00:00<?, ?it/s]
2025-05-15 03:27:08.285 | DEBUG | earth2studio.data.arco:fetch_array:252 - Fetching ARCO zarr array for variable: tcwv at 2021-06-15T00:00:00
Fetching ARCO data: 0%| | 0/11 [00:00<?, ?it/s]
2025-05-15 03:27:08.286 | DEBUG | earth2studio.data.arco:fetch_array:252 - Fetching ARCO zarr array for variable: z700 at 2021-06-15T00:00:00
Fetching ARCO data: 0%| | 0/11 [00:00<?, ?it/s]
2025-05-15 03:27:08.286 | DEBUG | earth2studio.data.arco:fetch_array:252 - Fetching ARCO zarr array for variable: z250 at 2021-06-15T00:00:00
Fetching ARCO data: 0%| | 0/11 [00:00<?, ?it/s]
2025-05-15 03:27:08.287 | DEBUG | earth2studio.data.arco:fetch_array:252 - Fetching ARCO zarr array for variable: z500 at 2021-06-15T00:00:00
Fetching ARCO data: 0%| | 0/11 [00:00<?, ?it/s]
2025-05-15 03:27:08.287 | DEBUG | earth2studio.data.arco:fetch_array:252 - Fetching ARCO zarr array for variable: u10m at 2021-06-15T00:00:00
Fetching ARCO data: 0%| | 0/11 [00:00<?, ?it/s]
2025-05-15 03:27:08.288 | DEBUG | earth2studio.data.arco:fetch_array:252 - Fetching ARCO zarr array for variable: t2m at 2021-06-15T00:00:00
Fetching ARCO data: 0%| | 0/11 [00:00<?, ?it/s]
2025-05-15 03:27:08.288 | DEBUG | earth2studio.data.arco:fetch_array:252 - Fetching ARCO zarr array for variable: z300 at 2021-06-15T00:00:00
Fetching ARCO data: 0%| | 0/11 [00:00<?, ?it/s]
2025-05-15 03:27:08.289 | DEBUG | earth2studio.data.arco:fetch_array:252 - Fetching ARCO zarr array for variable: t850 at 2021-06-15T00:00:00
Fetching ARCO data: 0%| | 0/11 [00:00<?, ?it/s]
2025-05-15 03:27:08.289 | DEBUG | earth2studio.data.arco:fetch_array:252 - Fetching ARCO zarr array for variable: sst at 2021-06-15T00:00:00
Fetching ARCO data: 0%| | 0/11 [00:00<?, ?it/s]
2025-05-15 03:27:08.358 | DEBUG | earth2studio.data.utils:_make_local_details:629 - Copying /gcp-public-data-arco-era5/ar/full_37-1h-0p25deg-chunk-1.zarr-v3/total_column_water_vapour/1064640.0.0 to local cache
Fetching ARCO data: 0%| | 0/11 [00:00<?, ?it/s]
2025-05-15 03:27:08.361 | DEBUG | earth2studio.data.utils:_make_local_details:629 - Copying /gcp-public-data-arco-era5/ar/full_37-1h-0p25deg-chunk-1.zarr-v3/geopotential/1064640.0.0.0 to local cache
Fetching ARCO data: 0%| | 0/11 [00:00<?, ?it/s]
2025-05-15 03:27:08.362 | DEBUG | earth2studio.data.utils:_make_local_details:629 - Copying /gcp-public-data-arco-era5/ar/full_37-1h-0p25deg-chunk-1.zarr-v3/10m_v_component_of_wind/1064640.0.0 to local cache
Fetching ARCO data: 0%| | 0/11 [00:00<?, ?it/s]
2025-05-15 03:27:08.363 | DEBUG | earth2studio.data.utils:_make_local_details:629 - Copying /gcp-public-data-arco-era5/ar/full_37-1h-0p25deg-chunk-1.zarr-v3/10m_u_component_of_wind/1064640.0.0 to local cache
Fetching ARCO data: 0%| | 0/11 [00:00<?, ?it/s]
2025-05-15 03:27:08.363 | DEBUG | earth2studio.data.utils:_make_local_details:629 - Copying /gcp-public-data-arco-era5/ar/full_37-1h-0p25deg-chunk-1.zarr-v3/geopotential/1064640.0.0.0 to local cache
Fetching ARCO data: 0%| | 0/11 [00:00<?, ?it/s]
2025-05-15 03:27:08.365 | DEBUG | earth2studio.data.utils:_make_local_details:629 - Copying /gcp-public-data-arco-era5/ar/full_37-1h-0p25deg-chunk-1.zarr-v3/sea_surface_temperature/1064640.0.0 to local cache
Fetching ARCO data: 0%| | 0/11 [00:00<?, ?it/s]
2025-05-15 03:27:08.366 | DEBUG | earth2studio.data.utils:_make_local_details:629 - Copying /gcp-public-data-arco-era5/ar/full_37-1h-0p25deg-chunk-1.zarr-v3/2m_temperature/1064640.0.0 to local cache
Fetching ARCO data: 0%| | 0/11 [00:00<?, ?it/s]
2025-05-15 03:27:08.368 | DEBUG | earth2studio.data.utils:_make_local_details:629 - Copying /gcp-public-data-arco-era5/ar/full_37-1h-0p25deg-chunk-1.zarr-v3/geopotential/1064640.0.0.0 to local cache
Fetching ARCO data: 0%| | 0/11 [00:00<?, ?it/s]
2025-05-15 03:27:08.369 | DEBUG | earth2studio.data.utils:_make_local_details:629 - Copying /gcp-public-data-arco-era5/ar/full_37-1h-0p25deg-chunk-1.zarr-v3/geopotential/1064640.0.0.0 to local cache
Fetching ARCO data: 0%| | 0/11 [00:00<?, ?it/s]
2025-05-15 03:27:08.370 | DEBUG | earth2studio.data.utils:_make_local_details:629 - Copying /gcp-public-data-arco-era5/ar/full_37-1h-0p25deg-chunk-1.zarr-v3/temperature/1064640.0.0.0 to local cache
Fetching ARCO data: 0%| | 0/11 [00:00<?, ?it/s]
Fetching ARCO data: 9%|▉ | 1/11 [00:00<00:01, 8.14it/s]
2025-05-15 03:27:08.426 | DEBUG | earth2studio.data.utils:_make_local_details:629 - Copying /gcp-public-data-arco-era5/ar/full_37-1h-0p25deg-chunk-1.zarr-v3/geopotential/1064640.0.0.0 to local cache
Fetching ARCO data: 9%|▉ | 1/11 [00:00<00:01, 8.14it/s]
Fetching ARCO data: 36%|███▋ | 4/11 [00:00<00:00, 11.27it/s]
Fetching ARCO data: 55%|█████▍ | 6/11 [00:01<00:01, 2.78it/s]
Fetching ARCO data: 64%|██████▎ | 7/11 [00:02<00:01, 2.50it/s]
Fetching ARCO data: 73%|███████▎ | 8/11 [00:02<00:01, 2.91it/s]
Fetching ARCO data: 82%|████████▏ | 9/11 [00:02<00:00, 3.18it/s]
Fetching ARCO data: 91%|█████████ | 10/11 [00:02<00:00, 3.49it/s]
Fetching ARCO data: 100%|██████████| 11/11 [00:03<00:00, 3.63it/s]
Atmosphere outputs (variables, lead_time [hrs]): ['z500' 'tau300-700' 'z1000' 't2m' 'tcwv' 't850' 'z250' 'ws10m'] [ 6 12 18 24 30 36 42 48 54 60 66 72 78 84 90 96]
Ocean outputs (variables, lead_time [hrs]): ['sst'] [48 96]
Model Iteration for Longer Forecasts#
Similar to other models in earth2studio, we can use the model iterator to loop over forecasted outputs. A single step of the DLESyM model produces predictions over 4 days (96 hours), so to make a sub-seasonal forecast we can take 15 steps for a total of 60 days.
n_steps = 16
model_iter_ll = model_ll.create_iterator(x, coords)
for i in range(n_steps):
x, x_coords = next(model_iter_ll)
if i > 0: # Don't retrieve the first step as it is the initial condition
x_atmos, x_atmos_coords = model_ll.retrieve_valid_atmos_outputs(x, x_coords)
x_ocean, x_ocean_coords = model_ll.retrieve_valid_ocean_outputs(x, x_coords)
print(f"Completed forecast with {n_steps} steps")
Completed forecast with 16 steps
Using Built-in Deterministic Workflow#
Because the DLESyMLatLon model permits usage of data coming directly from an earth2studio data source, we can use the built-in deterministic workflow to generate a forecast as well. The only caveat is we need to explitcitly specify the output lead time coordinates that will be generated by the model, since it has different input and output lead time dimensions. %%
import earth2studio.run as run
from earth2studio.io import KVBackend
io = KVBackend()
output_coords = model_ll.output_coords(coords)
inp_lead_time = model_ll.input_coords()["lead_time"]
out_lead_times = [
output_coords["lead_time"] + output_coords["lead_time"][-1] * i
for i in range(n_steps)
]
output_coords["lead_time"] = np.concatenate([inp_lead_time, *out_lead_times])
io = run.deterministic(
[ic_date], n_steps, model_ll, data, io, output_coords=output_coords
)
ds = io.to_xarray()
print(ds)
2025-05-15 03:27:20.056 | INFO | earth2studio.run:deterministic:75 - Running simple workflow!
2025-05-15 03:27:20.056 | INFO | earth2studio.run:deterministic:82 - Inference device: cuda
Fetching ARCO data: 0%| | 0/11 [00:00<?, ?it/s]
2025-05-15 03:27:20.060 | DEBUG | earth2studio.data.arco:fetch_array:252 - Fetching ARCO zarr array for variable: t2m at 2021-06-13T00:00:00
Fetching ARCO data: 0%| | 0/11 [00:00<?, ?it/s]
2025-05-15 03:27:20.061 | DEBUG | earth2studio.data.arco:fetch_array:252 - Fetching ARCO zarr array for variable: u10m at 2021-06-13T00:00:00
Fetching ARCO data: 0%| | 0/11 [00:00<?, ?it/s]
2025-05-15 03:27:20.061 | DEBUG | earth2studio.data.arco:fetch_array:252 - Fetching ARCO zarr array for variable: z250 at 2021-06-13T00:00:00
Fetching ARCO data: 0%| | 0/11 [00:00<?, ?it/s]
2025-05-15 03:27:20.062 | DEBUG | earth2studio.data.arco:fetch_array:252 - Fetching ARCO zarr array for variable: sst at 2021-06-13T00:00:00
Fetching ARCO data: 0%| | 0/11 [00:00<?, ?it/s]
2025-05-15 03:27:20.062 | DEBUG | earth2studio.data.arco:fetch_array:252 - Fetching ARCO zarr array for variable: z1000 at 2021-06-13T00:00:00
Fetching ARCO data: 0%| | 0/11 [00:00<?, ?it/s]
2025-05-15 03:27:20.063 | DEBUG | earth2studio.data.arco:fetch_array:252 - Fetching ARCO zarr array for variable: tcwv at 2021-06-13T00:00:00
Fetching ARCO data: 0%| | 0/11 [00:00<?, ?it/s]
2025-05-15 03:27:20.064 | DEBUG | earth2studio.data.arco:fetch_array:252 - Fetching ARCO zarr array for variable: z500 at 2021-06-13T00:00:00
Fetching ARCO data: 0%| | 0/11 [00:00<?, ?it/s]
2025-05-15 03:27:20.064 | DEBUG | earth2studio.data.arco:fetch_array:252 - Fetching ARCO zarr array for variable: v10m at 2021-06-13T00:00:00
Fetching ARCO data: 0%| | 0/11 [00:00<?, ?it/s]
2025-05-15 03:27:20.065 | DEBUG | earth2studio.data.arco:fetch_array:252 - Fetching ARCO zarr array for variable: z300 at 2021-06-13T00:00:00
Fetching ARCO data: 0%| | 0/11 [00:00<?, ?it/s]
2025-05-15 03:27:20.066 | DEBUG | earth2studio.data.arco:fetch_array:252 - Fetching ARCO zarr array for variable: z700 at 2021-06-13T00:00:00
Fetching ARCO data: 0%| | 0/11 [00:00<?, ?it/s]
2025-05-15 03:27:20.066 | DEBUG | earth2studio.data.arco:fetch_array:252 - Fetching ARCO zarr array for variable: t850 at 2021-06-13T00:00:00
Fetching ARCO data: 0%| | 0/11 [00:00<?, ?it/s]
Fetching ARCO data: 55%|█████▍ | 6/11 [00:00<00:00, 28.00it/s]
Fetching ARCO data: 100%|██████████| 11/11 [00:00<00:00, 39.61it/s]
Fetching ARCO data: 0%| | 0/11 [00:00<?, ?it/s]
2025-05-15 03:27:20.342 | DEBUG | earth2studio.data.arco:fetch_array:252 - Fetching ARCO zarr array for variable: t2m at 2021-06-13T06:00:00
Fetching ARCO data: 0%| | 0/11 [00:00<?, ?it/s]
2025-05-15 03:27:20.342 | DEBUG | earth2studio.data.arco:fetch_array:252 - Fetching ARCO zarr array for variable: z250 at 2021-06-13T06:00:00
Fetching ARCO data: 0%| | 0/11 [00:00<?, ?it/s]
2025-05-15 03:27:20.343 | DEBUG | earth2studio.data.arco:fetch_array:252 - Fetching ARCO zarr array for variable: sst at 2021-06-13T06:00:00
Fetching ARCO data: 0%| | 0/11 [00:00<?, ?it/s]
2025-05-15 03:27:20.343 | DEBUG | earth2studio.data.arco:fetch_array:252 - Fetching ARCO zarr array for variable: t850 at 2021-06-13T06:00:00
Fetching ARCO data: 0%| | 0/11 [00:00<?, ?it/s]
2025-05-15 03:27:20.344 | DEBUG | earth2studio.data.arco:fetch_array:252 - Fetching ARCO zarr array for variable: z300 at 2021-06-13T06:00:00
Fetching ARCO data: 0%| | 0/11 [00:00<?, ?it/s]
2025-05-15 03:27:20.344 | DEBUG | earth2studio.data.arco:fetch_array:252 - Fetching ARCO zarr array for variable: tcwv at 2021-06-13T06:00:00
Fetching ARCO data: 0%| | 0/11 [00:00<?, ?it/s]
2025-05-15 03:27:20.345 | DEBUG | earth2studio.data.arco:fetch_array:252 - Fetching ARCO zarr array for variable: z700 at 2021-06-13T06:00:00
Fetching ARCO data: 0%| | 0/11 [00:00<?, ?it/s]
2025-05-15 03:27:20.345 | DEBUG | earth2studio.data.arco:fetch_array:252 - Fetching ARCO zarr array for variable: u10m at 2021-06-13T06:00:00
Fetching ARCO data: 0%| | 0/11 [00:00<?, ?it/s]
2025-05-15 03:27:20.346 | DEBUG | earth2studio.data.arco:fetch_array:252 - Fetching ARCO zarr array for variable: z500 at 2021-06-13T06:00:00
Fetching ARCO data: 0%| | 0/11 [00:00<?, ?it/s]
2025-05-15 03:27:20.346 | DEBUG | earth2studio.data.arco:fetch_array:252 - Fetching ARCO zarr array for variable: v10m at 2021-06-13T06:00:00
Fetching ARCO data: 0%| | 0/11 [00:00<?, ?it/s]
2025-05-15 03:27:20.347 | DEBUG | earth2studio.data.arco:fetch_array:252 - Fetching ARCO zarr array for variable: z1000 at 2021-06-13T06:00:00
Fetching ARCO data: 0%| | 0/11 [00:00<?, ?it/s]
Fetching ARCO data: 9%|▉ | 1/11 [00:00<00:01, 7.80it/s]
Fetching ARCO data: 55%|█████▍ | 6/11 [00:00<00:00, 25.99it/s]
Fetching ARCO data: 100%|██████████| 11/11 [00:00<00:00, 36.73it/s]
Fetching ARCO data: 0%| | 0/11 [00:00<?, ?it/s]
2025-05-15 03:27:20.645 | DEBUG | earth2studio.data.arco:fetch_array:252 - Fetching ARCO zarr array for variable: t850 at 2021-06-13T12:00:00
Fetching ARCO data: 0%| | 0/11 [00:00<?, ?it/s]
2025-05-15 03:27:20.646 | DEBUG | earth2studio.data.arco:fetch_array:252 - Fetching ARCO zarr array for variable: z1000 at 2021-06-13T12:00:00
Fetching ARCO data: 0%| | 0/11 [00:00<?, ?it/s]
2025-05-15 03:27:20.646 | DEBUG | earth2studio.data.arco:fetch_array:252 - Fetching ARCO zarr array for variable: tcwv at 2021-06-13T12:00:00
Fetching ARCO data: 0%| | 0/11 [00:00<?, ?it/s]
2025-05-15 03:27:20.646 | DEBUG | earth2studio.data.arco:fetch_array:252 - Fetching ARCO zarr array for variable: sst at 2021-06-13T12:00:00
Fetching ARCO data: 0%| | 0/11 [00:00<?, ?it/s]
2025-05-15 03:27:20.647 | DEBUG | earth2studio.data.arco:fetch_array:252 - Fetching ARCO zarr array for variable: z250 at 2021-06-13T12:00:00
Fetching ARCO data: 0%| | 0/11 [00:00<?, ?it/s]
2025-05-15 03:27:20.647 | DEBUG | earth2studio.data.arco:fetch_array:252 - Fetching ARCO zarr array for variable: z300 at 2021-06-13T12:00:00
Fetching ARCO data: 0%| | 0/11 [00:00<?, ?it/s]
2025-05-15 03:27:20.648 | DEBUG | earth2studio.data.arco:fetch_array:252 - Fetching ARCO zarr array for variable: z700 at 2021-06-13T12:00:00
Fetching ARCO data: 0%| | 0/11 [00:00<?, ?it/s]
2025-05-15 03:27:20.648 | DEBUG | earth2studio.data.arco:fetch_array:252 - Fetching ARCO zarr array for variable: u10m at 2021-06-13T12:00:00
Fetching ARCO data: 0%| | 0/11 [00:00<?, ?it/s]
2025-05-15 03:27:20.649 | DEBUG | earth2studio.data.arco:fetch_array:252 - Fetching ARCO zarr array for variable: z500 at 2021-06-13T12:00:00
Fetching ARCO data: 0%| | 0/11 [00:00<?, ?it/s]
2025-05-15 03:27:20.649 | DEBUG | earth2studio.data.arco:fetch_array:252 - Fetching ARCO zarr array for variable: v10m at 2021-06-13T12:00:00
Fetching ARCO data: 0%| | 0/11 [00:00<?, ?it/s]
2025-05-15 03:27:20.650 | DEBUG | earth2studio.data.arco:fetch_array:252 - Fetching ARCO zarr array for variable: t2m at 2021-06-13T12:00:00
Fetching ARCO data: 0%| | 0/11 [00:00<?, ?it/s]
Fetching ARCO data: 9%|▉ | 1/11 [00:00<00:01, 6.12it/s]
Fetching ARCO data: 55%|█████▍ | 6/11 [00:00<00:00, 25.93it/s]
Fetching ARCO data: 100%|██████████| 11/11 [00:00<00:00, 32.65it/s]
Fetching ARCO data: 0%| | 0/11 [00:00<?, ?it/s]
2025-05-15 03:27:20.986 | DEBUG | earth2studio.data.arco:fetch_array:252 - Fetching ARCO zarr array for variable: z250 at 2021-06-13T18:00:00
Fetching ARCO data: 0%| | 0/11 [00:00<?, ?it/s]
2025-05-15 03:27:20.986 | DEBUG | earth2studio.data.arco:fetch_array:252 - Fetching ARCO zarr array for variable: t2m at 2021-06-13T18:00:00
Fetching ARCO data: 0%| | 0/11 [00:00<?, ?it/s]
2025-05-15 03:27:20.987 | DEBUG | earth2studio.data.arco:fetch_array:252 - Fetching ARCO zarr array for variable: z500 at 2021-06-13T18:00:00
Fetching ARCO data: 0%| | 0/11 [00:00<?, ?it/s]
2025-05-15 03:27:20.987 | DEBUG | earth2studio.data.arco:fetch_array:252 - Fetching ARCO zarr array for variable: sst at 2021-06-13T18:00:00
Fetching ARCO data: 0%| | 0/11 [00:00<?, ?it/s]
2025-05-15 03:27:20.988 | DEBUG | earth2studio.data.arco:fetch_array:252 - Fetching ARCO zarr array for variable: tcwv at 2021-06-13T18:00:00
Fetching ARCO data: 0%| | 0/11 [00:00<?, ?it/s]
2025-05-15 03:27:20.988 | DEBUG | earth2studio.data.arco:fetch_array:252 - Fetching ARCO zarr array for variable: z300 at 2021-06-13T18:00:00
Fetching ARCO data: 0%| | 0/11 [00:00<?, ?it/s]
2025-05-15 03:27:20.988 | DEBUG | earth2studio.data.arco:fetch_array:252 - Fetching ARCO zarr array for variable: z700 at 2021-06-13T18:00:00
Fetching ARCO data: 0%| | 0/11 [00:00<?, ?it/s]
2025-05-15 03:27:20.989 | DEBUG | earth2studio.data.arco:fetch_array:252 - Fetching ARCO zarr array for variable: u10m at 2021-06-13T18:00:00
Fetching ARCO data: 0%| | 0/11 [00:00<?, ?it/s]
2025-05-15 03:27:20.989 | DEBUG | earth2studio.data.arco:fetch_array:252 - Fetching ARCO zarr array for variable: t850 at 2021-06-13T18:00:00
Fetching ARCO data: 0%| | 0/11 [00:00<?, ?it/s]
2025-05-15 03:27:20.990 | DEBUG | earth2studio.data.arco:fetch_array:252 - Fetching ARCO zarr array for variable: v10m at 2021-06-13T18:00:00
Fetching ARCO data: 0%| | 0/11 [00:00<?, ?it/s]
2025-05-15 03:27:20.990 | DEBUG | earth2studio.data.arco:fetch_array:252 - Fetching ARCO zarr array for variable: z1000 at 2021-06-13T18:00:00
Fetching ARCO data: 0%| | 0/11 [00:00<?, ?it/s]
Fetching ARCO data: 9%|▉ | 1/11 [00:00<00:01, 5.11it/s]
Fetching ARCO data: 55%|█████▍ | 6/11 [00:00<00:00, 21.50it/s]
Fetching ARCO data: 100%|██████████| 11/11 [00:00<00:00, 29.31it/s]
Fetching ARCO data: 0%| | 0/11 [00:00<?, ?it/s]
2025-05-15 03:27:21.365 | DEBUG | earth2studio.data.arco:fetch_array:252 - Fetching ARCO zarr array for variable: z1000 at 2021-06-14T00:00:00
Fetching ARCO data: 0%| | 0/11 [00:00<?, ?it/s]
2025-05-15 03:27:21.365 | DEBUG | earth2studio.data.arco:fetch_array:252 - Fetching ARCO zarr array for variable: t850 at 2021-06-14T00:00:00
Fetching ARCO data: 0%| | 0/11 [00:00<?, ?it/s]
2025-05-15 03:27:21.366 | DEBUG | earth2studio.data.arco:fetch_array:252 - Fetching ARCO zarr array for variable: sst at 2021-06-14T00:00:00
Fetching ARCO data: 0%| | 0/11 [00:00<?, ?it/s]
2025-05-15 03:27:21.366 | DEBUG | earth2studio.data.arco:fetch_array:252 - Fetching ARCO zarr array for variable: z500 at 2021-06-14T00:00:00
Fetching ARCO data: 0%| | 0/11 [00:00<?, ?it/s]
2025-05-15 03:27:21.367 | DEBUG | earth2studio.data.arco:fetch_array:252 - Fetching ARCO zarr array for variable: z300 at 2021-06-14T00:00:00
Fetching ARCO data: 0%| | 0/11 [00:00<?, ?it/s]
2025-05-15 03:27:21.367 | DEBUG | earth2studio.data.arco:fetch_array:252 - Fetching ARCO zarr array for variable: z250 at 2021-06-14T00:00:00
Fetching ARCO data: 0%| | 0/11 [00:00<?, ?it/s]
2025-05-15 03:27:21.368 | DEBUG | earth2studio.data.arco:fetch_array:252 - Fetching ARCO zarr array for variable: z700 at 2021-06-14T00:00:00
Fetching ARCO data: 0%| | 0/11 [00:00<?, ?it/s]
2025-05-15 03:27:21.368 | DEBUG | earth2studio.data.arco:fetch_array:252 - Fetching ARCO zarr array for variable: u10m at 2021-06-14T00:00:00
Fetching ARCO data: 0%| | 0/11 [00:00<?, ?it/s]
2025-05-15 03:27:21.369 | DEBUG | earth2studio.data.arco:fetch_array:252 - Fetching ARCO zarr array for variable: tcwv at 2021-06-14T00:00:00
Fetching ARCO data: 0%| | 0/11 [00:00<?, ?it/s]
2025-05-15 03:27:21.369 | DEBUG | earth2studio.data.arco:fetch_array:252 - Fetching ARCO zarr array for variable: v10m at 2021-06-14T00:00:00
Fetching ARCO data: 0%| | 0/11 [00:00<?, ?it/s]
2025-05-15 03:27:21.370 | DEBUG | earth2studio.data.arco:fetch_array:252 - Fetching ARCO zarr array for variable: t2m at 2021-06-14T00:00:00
Fetching ARCO data: 0%| | 0/11 [00:00<?, ?it/s]
Fetching ARCO data: 9%|▉ | 1/11 [00:00<00:02, 4.31it/s]
Fetching ARCO data: 55%|█████▍ | 6/11 [00:00<00:00, 17.96it/s]
Fetching ARCO data: 100%|██████████| 11/11 [00:00<00:00, 26.27it/s]
Fetching ARCO data: 0%| | 0/11 [00:00<?, ?it/s]
2025-05-15 03:27:21.787 | DEBUG | earth2studio.data.arco:fetch_array:252 - Fetching ARCO zarr array for variable: t2m at 2021-06-14T06:00:00
Fetching ARCO data: 0%| | 0/11 [00:00<?, ?it/s]
2025-05-15 03:27:21.788 | DEBUG | earth2studio.data.arco:fetch_array:252 - Fetching ARCO zarr array for variable: z250 at 2021-06-14T06:00:00
Fetching ARCO data: 0%| | 0/11 [00:00<?, ?it/s]
2025-05-15 03:27:21.788 | DEBUG | earth2studio.data.arco:fetch_array:252 - Fetching ARCO zarr array for variable: sst at 2021-06-14T06:00:00
Fetching ARCO data: 0%| | 0/11 [00:00<?, ?it/s]
2025-05-15 03:27:21.789 | DEBUG | earth2studio.data.arco:fetch_array:252 - Fetching ARCO zarr array for variable: t850 at 2021-06-14T06:00:00
Fetching ARCO data: 0%| | 0/11 [00:00<?, ?it/s]
2025-05-15 03:27:21.789 | DEBUG | earth2studio.data.arco:fetch_array:252 - Fetching ARCO zarr array for variable: z300 at 2021-06-14T06:00:00
Fetching ARCO data: 0%| | 0/11 [00:00<?, ?it/s]
2025-05-15 03:27:21.790 | DEBUG | earth2studio.data.arco:fetch_array:252 - Fetching ARCO zarr array for variable: tcwv at 2021-06-14T06:00:00
Fetching ARCO data: 0%| | 0/11 [00:00<?, ?it/s]
2025-05-15 03:27:21.790 | DEBUG | earth2studio.data.arco:fetch_array:252 - Fetching ARCO zarr array for variable: z700 at 2021-06-14T06:00:00
Fetching ARCO data: 0%| | 0/11 [00:00<?, ?it/s]
2025-05-15 03:27:21.791 | DEBUG | earth2studio.data.arco:fetch_array:252 - Fetching ARCO zarr array for variable: u10m at 2021-06-14T06:00:00
Fetching ARCO data: 0%| | 0/11 [00:00<?, ?it/s]
2025-05-15 03:27:21.791 | DEBUG | earth2studio.data.arco:fetch_array:252 - Fetching ARCO zarr array for variable: z500 at 2021-06-14T06:00:00
Fetching ARCO data: 0%| | 0/11 [00:00<?, ?it/s]
2025-05-15 03:27:21.792 | DEBUG | earth2studio.data.arco:fetch_array:252 - Fetching ARCO zarr array for variable: v10m at 2021-06-14T06:00:00
Fetching ARCO data: 0%| | 0/11 [00:00<?, ?it/s]
2025-05-15 03:27:21.792 | DEBUG | earth2studio.data.arco:fetch_array:252 - Fetching ARCO zarr array for variable: z1000 at 2021-06-14T06:00:00
Fetching ARCO data: 0%| | 0/11 [00:00<?, ?it/s]
Fetching ARCO data: 9%|▉ | 1/11 [00:00<00:02, 3.86it/s]
Fetching ARCO data: 55%|█████▍ | 6/11 [00:00<00:00, 16.19it/s]
Fetching ARCO data: 100%|██████████| 11/11 [00:00<00:00, 24.48it/s]
Fetching ARCO data: 0%| | 0/11 [00:00<?, ?it/s]
2025-05-15 03:27:22.241 | DEBUG | earth2studio.data.arco:fetch_array:252 - Fetching ARCO zarr array for variable: t850 at 2021-06-14T12:00:00
Fetching ARCO data: 0%| | 0/11 [00:00<?, ?it/s]
2025-05-15 03:27:22.241 | DEBUG | earth2studio.data.arco:fetch_array:252 - Fetching ARCO zarr array for variable: z1000 at 2021-06-14T12:00:00
Fetching ARCO data: 0%| | 0/11 [00:00<?, ?it/s]
2025-05-15 03:27:22.242 | DEBUG | earth2studio.data.arco:fetch_array:252 - Fetching ARCO zarr array for variable: tcwv at 2021-06-14T12:00:00
Fetching ARCO data: 0%| | 0/11 [00:00<?, ?it/s]
2025-05-15 03:27:22.242 | DEBUG | earth2studio.data.arco:fetch_array:252 - Fetching ARCO zarr array for variable: sst at 2021-06-14T12:00:00
Fetching ARCO data: 0%| | 0/11 [00:00<?, ?it/s]
2025-05-15 03:27:22.243 | DEBUG | earth2studio.data.arco:fetch_array:252 - Fetching ARCO zarr array for variable: z250 at 2021-06-14T12:00:00
Fetching ARCO data: 0%| | 0/11 [00:00<?, ?it/s]
2025-05-15 03:27:22.243 | DEBUG | earth2studio.data.arco:fetch_array:252 - Fetching ARCO zarr array for variable: z300 at 2021-06-14T12:00:00
Fetching ARCO data: 0%| | 0/11 [00:00<?, ?it/s]
2025-05-15 03:27:22.244 | DEBUG | earth2studio.data.arco:fetch_array:252 - Fetching ARCO zarr array for variable: z700 at 2021-06-14T12:00:00
Fetching ARCO data: 0%| | 0/11 [00:00<?, ?it/s]
2025-05-15 03:27:22.244 | DEBUG | earth2studio.data.arco:fetch_array:252 - Fetching ARCO zarr array for variable: u10m at 2021-06-14T12:00:00
Fetching ARCO data: 0%| | 0/11 [00:00<?, ?it/s]
2025-05-15 03:27:22.245 | DEBUG | earth2studio.data.arco:fetch_array:252 - Fetching ARCO zarr array for variable: z500 at 2021-06-14T12:00:00
Fetching ARCO data: 0%| | 0/11 [00:00<?, ?it/s]
2025-05-15 03:27:22.245 | DEBUG | earth2studio.data.arco:fetch_array:252 - Fetching ARCO zarr array for variable: v10m at 2021-06-14T12:00:00
Fetching ARCO data: 0%| | 0/11 [00:00<?, ?it/s]
2025-05-15 03:27:22.245 | DEBUG | earth2studio.data.arco:fetch_array:252 - Fetching ARCO zarr array for variable: t2m at 2021-06-14T12:00:00
Fetching ARCO data: 0%| | 0/11 [00:00<?, ?it/s]
Fetching ARCO data: 9%|▉ | 1/11 [00:00<00:02, 3.89it/s]
Fetching ARCO data: 55%|█████▍ | 6/11 [00:00<00:00, 18.06it/s]
Fetching ARCO data: 100%|██████████| 11/11 [00:00<00:00, 24.56it/s]
Fetching ARCO data: 0%| | 0/11 [00:00<?, ?it/s]
2025-05-15 03:27:22.692 | DEBUG | earth2studio.data.arco:fetch_array:252 - Fetching ARCO zarr array for variable: z250 at 2021-06-14T18:00:00
Fetching ARCO data: 0%| | 0/11 [00:00<?, ?it/s]
2025-05-15 03:27:22.693 | DEBUG | earth2studio.data.arco:fetch_array:252 - Fetching ARCO zarr array for variable: t2m at 2021-06-14T18:00:00
Fetching ARCO data: 0%| | 0/11 [00:00<?, ?it/s]
2025-05-15 03:27:22.693 | DEBUG | earth2studio.data.arco:fetch_array:252 - Fetching ARCO zarr array for variable: z500 at 2021-06-14T18:00:00
Fetching ARCO data: 0%| | 0/11 [00:00<?, ?it/s]
2025-05-15 03:27:22.694 | DEBUG | earth2studio.data.arco:fetch_array:252 - Fetching ARCO zarr array for variable: sst at 2021-06-14T18:00:00
Fetching ARCO data: 0%| | 0/11 [00:00<?, ?it/s]
2025-05-15 03:27:22.694 | DEBUG | earth2studio.data.arco:fetch_array:252 - Fetching ARCO zarr array for variable: tcwv at 2021-06-14T18:00:00
Fetching ARCO data: 0%| | 0/11 [00:00<?, ?it/s]
2025-05-15 03:27:22.695 | DEBUG | earth2studio.data.arco:fetch_array:252 - Fetching ARCO zarr array for variable: z300 at 2021-06-14T18:00:00
Fetching ARCO data: 0%| | 0/11 [00:00<?, ?it/s]
2025-05-15 03:27:22.696 | DEBUG | earth2studio.data.arco:fetch_array:252 - Fetching ARCO zarr array for variable: z700 at 2021-06-14T18:00:00
Fetching ARCO data: 0%| | 0/11 [00:00<?, ?it/s]
2025-05-15 03:27:22.696 | DEBUG | earth2studio.data.arco:fetch_array:252 - Fetching ARCO zarr array for variable: u10m at 2021-06-14T18:00:00
Fetching ARCO data: 0%| | 0/11 [00:00<?, ?it/s]
2025-05-15 03:27:22.697 | DEBUG | earth2studio.data.arco:fetch_array:252 - Fetching ARCO zarr array for variable: t850 at 2021-06-14T18:00:00
Fetching ARCO data: 0%| | 0/11 [00:00<?, ?it/s]
2025-05-15 03:27:22.697 | DEBUG | earth2studio.data.arco:fetch_array:252 - Fetching ARCO zarr array for variable: v10m at 2021-06-14T18:00:00
Fetching ARCO data: 0%| | 0/11 [00:00<?, ?it/s]
2025-05-15 03:27:22.697 | DEBUG | earth2studio.data.arco:fetch_array:252 - Fetching ARCO zarr array for variable: z1000 at 2021-06-14T18:00:00
Fetching ARCO data: 0%| | 0/11 [00:00<?, ?it/s]
Fetching ARCO data: 9%|▉ | 1/11 [00:00<00:02, 3.91it/s]
Fetching ARCO data: 55%|█████▍ | 6/11 [00:00<00:00, 19.10it/s]
Fetching ARCO data: 100%|██████████| 11/11 [00:00<00:00, 24.71it/s]
Fetching ARCO data: 0%| | 0/11 [00:00<?, ?it/s]
2025-05-15 03:27:23.141 | DEBUG | earth2studio.data.arco:fetch_array:252 - Fetching ARCO zarr array for variable: z1000 at 2021-06-15T00:00:00
Fetching ARCO data: 0%| | 0/11 [00:00<?, ?it/s]
2025-05-15 03:27:23.142 | DEBUG | earth2studio.data.arco:fetch_array:252 - Fetching ARCO zarr array for variable: t850 at 2021-06-15T00:00:00
Fetching ARCO data: 0%| | 0/11 [00:00<?, ?it/s]
2025-05-15 03:27:23.142 | DEBUG | earth2studio.data.arco:fetch_array:252 - Fetching ARCO zarr array for variable: sst at 2021-06-15T00:00:00
Fetching ARCO data: 0%| | 0/11 [00:00<?, ?it/s]
2025-05-15 03:27:23.143 | DEBUG | earth2studio.data.arco:fetch_array:252 - Fetching ARCO zarr array for variable: z500 at 2021-06-15T00:00:00
Fetching ARCO data: 0%| | 0/11 [00:00<?, ?it/s]
2025-05-15 03:27:23.143 | DEBUG | earth2studio.data.arco:fetch_array:252 - Fetching ARCO zarr array for variable: z300 at 2021-06-15T00:00:00
Fetching ARCO data: 0%| | 0/11 [00:00<?, ?it/s]
2025-05-15 03:27:23.144 | DEBUG | earth2studio.data.arco:fetch_array:252 - Fetching ARCO zarr array for variable: z250 at 2021-06-15T00:00:00
Fetching ARCO data: 0%| | 0/11 [00:00<?, ?it/s]
2025-05-15 03:27:23.144 | DEBUG | earth2studio.data.arco:fetch_array:252 - Fetching ARCO zarr array for variable: z700 at 2021-06-15T00:00:00
Fetching ARCO data: 0%| | 0/11 [00:00<?, ?it/s]
2025-05-15 03:27:23.145 | DEBUG | earth2studio.data.arco:fetch_array:252 - Fetching ARCO zarr array for variable: u10m at 2021-06-15T00:00:00
Fetching ARCO data: 0%| | 0/11 [00:00<?, ?it/s]
2025-05-15 03:27:23.145 | DEBUG | earth2studio.data.arco:fetch_array:252 - Fetching ARCO zarr array for variable: tcwv at 2021-06-15T00:00:00
Fetching ARCO data: 0%| | 0/11 [00:00<?, ?it/s]
2025-05-15 03:27:23.146 | DEBUG | earth2studio.data.arco:fetch_array:252 - Fetching ARCO zarr array for variable: v10m at 2021-06-15T00:00:00
Fetching ARCO data: 0%| | 0/11 [00:00<?, ?it/s]
2025-05-15 03:27:23.146 | DEBUG | earth2studio.data.arco:fetch_array:252 - Fetching ARCO zarr array for variable: t2m at 2021-06-15T00:00:00
Fetching ARCO data: 0%| | 0/11 [00:00<?, ?it/s]
Fetching ARCO data: 9%|▉ | 1/11 [00:00<00:02, 3.76it/s]
Fetching ARCO data: 55%|█████▍ | 6/11 [00:00<00:00, 18.65it/s]
Fetching ARCO data: 100%|██████████| 11/11 [00:00<00:00, 24.19it/s]
2025-05-15 03:27:23.874 | SUCCESS | earth2studio.run:deterministic:106 - Fetched data from ARCO
2025-05-15 03:27:24.309 | INFO | earth2studio.run:deterministic:136 - Inference starting!
Running inference: 0%| | 0/17 [00:00<?, ?it/s]
Running inference: 6%|▌ | 1/17 [00:00<00:08, 1.93it/s]
Running inference: 12%|█▏ | 2/17 [00:11<01:39, 6.64s/it]
Running inference: 18%|█▊ | 3/17 [00:22<02:01, 8.65s/it]
Running inference: 24%|██▎ | 4/17 [00:33<02:04, 9.56s/it]
Running inference: 29%|██▉ | 5/17 [00:44<02:00, 10.03s/it]
Running inference: 35%|███▌ | 6/17 [00:55<01:53, 10.34s/it]
Running inference: 41%|████ | 7/17 [01:06<01:45, 10.52s/it]
Running inference: 47%|████▋ | 8/17 [01:17<01:36, 10.69s/it]
Running inference: 53%|█████▎ | 9/17 [01:28<01:26, 10.80s/it]
Running inference: 59%|█████▉ | 10/17 [01:39<01:15, 10.85s/it]
Running inference: 65%|██████▍ | 11/17 [01:50<01:05, 10.88s/it]
Running inference: 71%|███████ | 12/17 [02:01<00:54, 10.90s/it]
Running inference: 76%|███████▋ | 13/17 [02:12<00:43, 10.92s/it]
Running inference: 82%|████████▏ | 14/17 [02:22<00:32, 10.93s/it]
Running inference: 88%|████████▊ | 15/17 [02:34<00:21, 10.95s/it]
Running inference: 94%|█████████▍| 16/17 [02:44<00:10, 10.93s/it]
Running inference: 100%|██████████| 17/17 [02:55<00:00, 10.96s/it]
Running inference: 100%|██████████| 17/17 [02:55<00:00, 10.35s/it]
2025-05-15 03:30:20.222 | SUCCESS | earth2studio.run:deterministic:146 - Inference complete
<xarray.Dataset> Size: 10GB
Dimensions: (time: 1, lead_time: 265, lat: 721, lon: 1440)
Coordinates:
* time (time) datetime64[s] 8B 2021-06-15
* lead_time (lead_time) timedelta64[ns] 2kB -2 days +00:00:00 ... 64 days...
* lat (lat) float64 6kB 90.0 89.75 89.5 89.25 ... -89.5 -89.75 -90.0
* lon (lon) float64 12kB 0.0 0.25 0.5 0.75 ... 359.0 359.2 359.5 359.8
Data variables:
z500 (time, lead_time, lat, lon) float32 1GB 5.253e+04 ... 4.724e+04
tau300-700 (time, lead_time, lat, lon) float32 1GB 5.85e+04 ... 5.453e+04
z1000 (time, lead_time, lat, lon) float32 1GB 890.4 890.4 ... -936.4
t2m (time, lead_time, lat, lon) float32 1GB 273.7 273.7 ... 214.5
tcwv (time, lead_time, lat, lon) float32 1GB 8.898 8.898 ... 0.3016
t850 (time, lead_time, lat, lon) float32 1GB 265.6 265.6 ... 235.4
z250 (time, lead_time, lat, lon) float32 1GB 9.844e+04 ... 8.992e+04
ws10m (time, lead_time, lat, lon) float32 1GB 0.0292 0.0292 ... 6.945
sst (time, lead_time, lat, lon) float32 1GB 271.5 271.5 ... 272.1
Plotting the Outputs#
Let’s plot some of the forecasted outputs for the atmosphere and ocean components.
import cartopy.crs as ccrs
import cartopy.feature as cfeature
import matplotlib.pyplot as plt
# lat = x_atmos_coords["lat"]
# lon = x_atmos_coords["lon"]
atmos_var, atmos_units = "ws10m", "m/s"
ocean_var, ocean_units = "sst", "K"
# atmos_var_idx = list(x_atmos_coords["variable"]).index(atmos_var)
# ocean_var_idx = list(x_ocean_coords["variable"]).index(ocean_var)
lead_time = ds.lead_time.values[-1]
plt.close("all")
# Create a Robinson projection
projection = ccrs.Robinson()
# Create a figure and axes with the specified projection
fig, axs = plt.subplots(1, 2, subplot_kw={"projection": projection}, figsize=(15, 6))
# Plot the field using pcolormesh
im = axs[0].pcolormesh(
ds.lon.values,
ds.lat.values,
ds[atmos_var].sel(time=ic_date, lead_time=lead_time).values,
transform=ccrs.PlateCarree(),
cmap="cividis",
)
# Set title
axs[0].set_title(
f"Initialization: {ic_date} - Lead time: {lead_time.astype('timedelta64[h]')}"
)
# Add coastlines and gridlines
axs[0].coastlines()
axs[0].gridlines()
cbar = fig.colorbar(im, ax=axs[0], orientation="horizontal", pad=0.05)
cbar.set_label(f"{atmos_var} [{atmos_units}]")
# Plot the ocean component
im = axs[1].pcolormesh(
ds.lon.values,
ds.lat.values,
ds[ocean_var].sel(time=ic_date, lead_time=lead_time).values,
transform=ccrs.PlateCarree(),
cmap="Spectral_r",
)
axs[1].set_title(
f"Initialization: {ic_date} - Lead time: {lead_time.astype('timedelta64[h]')}"
)
# Add coastlines and gridlines
axs[1].add_feature(cfeature.LAND, color="grey", zorder=100)
axs[1].coastlines()
axs[1].gridlines()
cbar = fig.colorbar(im, ax=axs[1], orientation="horizontal", pad=0.05)
cbar.set_label(f"{ocean_var} [{ocean_units}]")
plt.tight_layout()
plt.savefig("outputs/14_ws10m_sst_prediction.png")
Total running time of the script: (5 minutes 54.795 seconds)