Note
Go to the end to download the full example code.
Running StormCast Ensemble Inference#
Ensemble StormCast inference workflow.
This example will demonstrate how to run a simple inference workflow to generate a ensemble forecast using StormCast. For details about the stormcast model, see
Set Up#
All workflows inside Earth2Studio require constructed components to be
handed to them. In this example, let’s take a look at the most basic ensemble workflow:
earth2studio.run.ensemble().
def ensemble(
time: list[str] | list[datetime] | list[np.datetime64],
nsteps: int,
nensemble: int,
prognostic: PrognosticModel,
data: DataSource,
io: IOBackend,
perturbation: Perturbation,
batch_size: int | None = None,
output_coords: CoordSystem = OrderedDict({}),
device: torch.device | None = None,
) -> IOBackend:
"""Built in ensemble workflow.
Parameters
----------
time : list[str] | list[datetime] | list[np.datetime64]
List of string, datetimes or np.datetime64
nsteps : int
Number of forecast steps
nensemble : int
Number of ensemble members to run inference for.
prognostic : PrognosticModel
Prognostic models
data : DataSource
Data source
io : IOBackend
IO object
perturbation_method : Perturbation
Method to perturb the initial condition to create an ensemble.
batch_size: int, optional
Number of ensemble members to run in a single batch,
by default None.
output_coords: CoordSystem, optional
IO output coordinate system override, by default OrderedDict({})
device : torch.device, optional
Device to run inference on, by default None
Returns
-------
IOBackend
Output IO object
"""
Thus, we need the following:
Prognostic Model: Use the built in StormCast Model
earth2studio.models.px.StormCast.- perturbation_method: Use the Zero Method
earth2studio.perturbation.Zero. We will not perturb the initial data because StormCast has stochastic generation of ensemble members.
- perturbation_method: Use the Zero Method
Datasource: Pull data from the HRRR data api
earth2studio.data.HRRR.IO Backend: Let’s save the outputs into a Zarr store
earth2studio.io.ZarrBackend.
StormCast also requires a conditioning data source. We use a forecast data source here,
ARCO earth2studio.data.ARCO, but a forecast data source such as GFS_FX
could also be used with appropriate time stamps.
import numpy as np
from loguru import logger
from tqdm import tqdm
logger.remove()
logger.add(lambda msg: tqdm.write(msg, end=""), colorize=True)
import os
os.makedirs("outputs", exist_ok=True)
from dotenv import load_dotenv
load_dotenv() # TODO: make common example prep function
from earth2studio.data import ARCO, HRRR
from earth2studio.io import ZarrBackend
from earth2studio.models.px import StormCast
from earth2studio.perturbation import Zero
# Load the default model package which downloads the check point from NGC
package = StormCast.load_default_package()
model = StormCast.load_model(package)
# Instantiate the (Zero) perturbation method
z = Zero()
# Create the data source
data = HRRR()
# Create and set the conditioning data source
conditioning_data_source = ARCO()
model.conditioning_data_source = conditioning_data_source
# Create the IO handler, store in memory
io = ZarrBackend()
Execute the Workflow#
With all components initialized, running the workflow is a single line of Python code. Workflow will return the provided IO object back to the user, which can be used to then post process. Some have additional APIs that can be handy for post-processing or saving to file. Check the API docs for more information.
For the forecast we will predict for 4 hours
import earth2studio.run as run
nsteps = 4
nensemble = 8
batch_size = 2
date = "2022-11-04T21:00:00"
io = run.ensemble(
[date],
nsteps,
nensemble,
model,
data,
io,
z,
batch_size=batch_size,
output_coords={"variable": np.array(["t2m", "refc"])},
)
print(io.root.tree())
2025-01-23 04:48:26.616 | INFO | earth2studio.run:ensemble:315 - Running ensemble inference!
2025-01-23 04:48:26.616 | INFO | earth2studio.run:ensemble:323 - Inference device: cuda
Fetching HRRR data: 0%| | 0/99 [00:00<?, ?it/s]
2025-01-23 04:48:26.745 | DEBUG | earth2studio.data.hrrr:async_fetch:130 - Fetching HRRR data for variable: u10m at 2022-11-04T21:00:00 lead time 0:00:00
Fetching HRRR data: 0%| | 0/99 [00:00<?, ?it/s]
Fetching HRRR data: 1%| | 1/99 [00:01<01:59, 1.22s/it]
2025-01-23 04:48:27.962 | DEBUG | earth2studio.data.hrrr:async_fetch:130 - Fetching HRRR data for variable: v10m at 2022-11-04T21:00:00 lead time 0:00:00
Fetching HRRR data: 1%| | 1/99 [00:01<01:59, 1.22s/it]
Fetching HRRR data: 2%|▏ | 2/99 [00:01<01:08, 1.42it/s]
2025-01-23 04:48:28.308 | DEBUG | earth2studio.data.hrrr:async_fetch:130 - Fetching HRRR data for variable: t2m at 2022-11-04T21:00:00 lead time 0:00:00
Fetching HRRR data: 2%|▏ | 2/99 [00:01<01:08, 1.42it/s]
Fetching HRRR data: 3%|▎ | 3/99 [00:01<00:54, 1.77it/s]
2025-01-23 04:48:28.708 | DEBUG | earth2studio.data.hrrr:async_fetch:130 - Fetching HRRR data for variable: mslp at 2022-11-04T21:00:00 lead time 0:00:00
Fetching HRRR data: 3%|▎ | 3/99 [00:01<00:54, 1.77it/s]
Fetching HRRR data: 4%|▍ | 4/99 [00:02<00:47, 2.00it/s]
2025-01-23 04:48:29.107 | DEBUG | earth2studio.data.hrrr:async_fetch:130 - Fetching HRRR data for variable: u1hl at 2022-11-04T21:00:00 lead time 0:00:00
Fetching HRRR data: 4%|▍ | 4/99 [00:02<00:47, 2.00it/s]
Fetching HRRR data: 5%|▌ | 5/99 [00:03<00:53, 1.77it/s]
2025-01-23 04:48:29.788 | DEBUG | earth2studio.data.hrrr:async_fetch:130 - Fetching HRRR data for variable: u2hl at 2022-11-04T21:00:00 lead time 0:00:00
Fetching HRRR data: 5%|▌ | 5/99 [00:03<00:53, 1.77it/s]
Fetching HRRR data: 6%|▌ | 6/99 [00:03<00:47, 1.94it/s]
2025-01-23 04:48:30.207 | DEBUG | earth2studio.data.hrrr:async_fetch:130 - Fetching HRRR data for variable: u3hl at 2022-11-04T21:00:00 lead time 0:00:00
Fetching HRRR data: 6%|▌ | 6/99 [00:03<00:47, 1.94it/s]
Fetching HRRR data: 7%|▋ | 7/99 [00:03<00:44, 2.06it/s]
2025-01-23 04:48:30.632 | DEBUG | earth2studio.data.hrrr:async_fetch:130 - Fetching HRRR data for variable: u4hl at 2022-11-04T21:00:00 lead time 0:00:00
Fetching HRRR data: 7%|▋ | 7/99 [00:03<00:44, 2.06it/s]
Fetching HRRR data: 8%|▊ | 8/99 [00:04<00:40, 2.24it/s]
2025-01-23 04:48:30.996 | DEBUG | earth2studio.data.hrrr:async_fetch:130 - Fetching HRRR data for variable: u5hl at 2022-11-04T21:00:00 lead time 0:00:00
Fetching HRRR data: 8%|▊ | 8/99 [00:04<00:40, 2.24it/s]
Fetching HRRR data: 9%|▉ | 9/99 [00:04<00:38, 2.36it/s]
2025-01-23 04:48:31.370 | DEBUG | earth2studio.data.hrrr:async_fetch:130 - Fetching HRRR data for variable: u6hl at 2022-11-04T21:00:00 lead time 0:00:00
Fetching HRRR data: 9%|▉ | 9/99 [00:04<00:38, 2.36it/s]
Fetching HRRR data: 10%|█ | 10/99 [00:04<00:36, 2.46it/s]
2025-01-23 04:48:31.740 | DEBUG | earth2studio.data.hrrr:async_fetch:130 - Fetching HRRR data for variable: u7hl at 2022-11-04T21:00:00 lead time 0:00:00
Fetching HRRR data: 10%|█ | 10/99 [00:04<00:36, 2.46it/s]
Fetching HRRR data: 11%|█ | 11/99 [00:05<00:34, 2.53it/s]
2025-01-23 04:48:32.107 | DEBUG | earth2studio.data.hrrr:async_fetch:130 - Fetching HRRR data for variable: u8hl at 2022-11-04T21:00:00 lead time 0:00:00
Fetching HRRR data: 11%|█ | 11/99 [00:05<00:34, 2.53it/s]
Fetching HRRR data: 12%|█▏ | 12/99 [00:05<00:35, 2.48it/s]
2025-01-23 04:48:32.528 | DEBUG | earth2studio.data.hrrr:async_fetch:130 - Fetching HRRR data for variable: u9hl at 2022-11-04T21:00:00 lead time 0:00:00
Fetching HRRR data: 12%|█▏ | 12/99 [00:05<00:35, 2.48it/s]
Fetching HRRR data: 13%|█▎ | 13/99 [00:06<00:33, 2.57it/s]
2025-01-23 04:48:32.883 | DEBUG | earth2studio.data.hrrr:async_fetch:130 - Fetching HRRR data for variable: u10hl at 2022-11-04T21:00:00 lead time 0:00:00
Fetching HRRR data: 13%|█▎ | 13/99 [00:06<00:33, 2.57it/s]
Fetching HRRR data: 14%|█▍ | 14/99 [00:06<00:34, 2.46it/s]
2025-01-23 04:48:33.329 | DEBUG | earth2studio.data.hrrr:async_fetch:130 - Fetching HRRR data for variable: u11hl at 2022-11-04T21:00:00 lead time 0:00:00
Fetching HRRR data: 14%|█▍ | 14/99 [00:06<00:34, 2.46it/s]
Fetching HRRR data: 15%|█▌ | 15/99 [00:07<00:35, 2.33it/s]
2025-01-23 04:48:33.810 | DEBUG | earth2studio.data.hrrr:async_fetch:130 - Fetching HRRR data for variable: u13hl at 2022-11-04T21:00:00 lead time 0:00:00
Fetching HRRR data: 15%|█▌ | 15/99 [00:07<00:35, 2.33it/s]
Fetching HRRR data: 16%|█▌ | 16/99 [00:07<00:33, 2.46it/s]
2025-01-23 04:48:34.166 | DEBUG | earth2studio.data.hrrr:async_fetch:130 - Fetching HRRR data for variable: u15hl at 2022-11-04T21:00:00 lead time 0:00:00
Fetching HRRR data: 16%|█▌ | 16/99 [00:07<00:33, 2.46it/s]
Fetching HRRR data: 17%|█▋ | 17/99 [00:07<00:32, 2.52it/s]
2025-01-23 04:48:34.539 | DEBUG | earth2studio.data.hrrr:async_fetch:130 - Fetching HRRR data for variable: u20hl at 2022-11-04T21:00:00 lead time 0:00:00
Fetching HRRR data: 17%|█▋ | 17/99 [00:07<00:32, 2.52it/s]
Fetching HRRR data: 18%|█▊ | 18/99 [00:08<00:35, 2.28it/s]
2025-01-23 04:48:35.073 | DEBUG | earth2studio.data.hrrr:async_fetch:130 - Fetching HRRR data for variable: u25hl at 2022-11-04T21:00:00 lead time 0:00:00
Fetching HRRR data: 18%|█▊ | 18/99 [00:08<00:35, 2.28it/s]
Fetching HRRR data: 19%|█▉ | 19/99 [00:08<00:35, 2.26it/s]
2025-01-23 04:48:35.525 | DEBUG | earth2studio.data.hrrr:async_fetch:130 - Fetching HRRR data for variable: u30hl at 2022-11-04T21:00:00 lead time 0:00:00
Fetching HRRR data: 19%|█▉ | 19/99 [00:08<00:35, 2.26it/s]
Fetching HRRR data: 20%|██ | 20/99 [00:09<00:34, 2.31it/s]
2025-01-23 04:48:35.936 | DEBUG | earth2studio.data.hrrr:async_fetch:130 - Fetching HRRR data for variable: v1hl at 2022-11-04T21:00:00 lead time 0:00:00
Fetching HRRR data: 20%|██ | 20/99 [00:09<00:34, 2.31it/s]
Fetching HRRR data: 21%|██ | 21/99 [00:09<00:35, 2.18it/s]
2025-01-23 04:48:36.454 | DEBUG | earth2studio.data.hrrr:async_fetch:130 - Fetching HRRR data for variable: v2hl at 2022-11-04T21:00:00 lead time 0:00:00
Fetching HRRR data: 21%|██ | 21/99 [00:09<00:35, 2.18it/s]
Fetching HRRR data: 22%|██▏ | 22/99 [00:10<00:35, 2.19it/s]
2025-01-23 04:48:36.903 | DEBUG | earth2studio.data.hrrr:async_fetch:130 - Fetching HRRR data for variable: v3hl at 2022-11-04T21:00:00 lead time 0:00:00
Fetching HRRR data: 22%|██▏ | 22/99 [00:10<00:35, 2.19it/s]
Fetching HRRR data: 23%|██▎ | 23/99 [00:10<00:34, 2.20it/s]
2025-01-23 04:48:37.352 | DEBUG | earth2studio.data.hrrr:async_fetch:130 - Fetching HRRR data for variable: v4hl at 2022-11-04T21:00:00 lead time 0:00:00
Fetching HRRR data: 23%|██▎ | 23/99 [00:10<00:34, 2.20it/s]
Fetching HRRR data: 24%|██▍ | 24/99 [00:10<00:32, 2.33it/s]
2025-01-23 04:48:37.722 | DEBUG | earth2studio.data.hrrr:async_fetch:130 - Fetching HRRR data for variable: v5hl at 2022-11-04T21:00:00 lead time 0:00:00
Fetching HRRR data: 24%|██▍ | 24/99 [00:10<00:32, 2.33it/s]
Fetching HRRR data: 25%|██▌ | 25/99 [00:11<00:29, 2.53it/s]
2025-01-23 04:48:38.040 | DEBUG | earth2studio.data.hrrr:async_fetch:130 - Fetching HRRR data for variable: v6hl at 2022-11-04T21:00:00 lead time 0:00:00
Fetching HRRR data: 25%|██▌ | 25/99 [00:11<00:29, 2.53it/s]
Fetching HRRR data: 26%|██▋ | 26/99 [00:11<00:26, 2.71it/s]
2025-01-23 04:48:38.346 | DEBUG | earth2studio.data.hrrr:async_fetch:130 - Fetching HRRR data for variable: v7hl at 2022-11-04T21:00:00 lead time 0:00:00
Fetching HRRR data: 26%|██▋ | 26/99 [00:11<00:26, 2.71it/s]
Fetching HRRR data: 27%|██▋ | 27/99 [00:12<00:28, 2.50it/s]
2025-01-23 04:48:38.821 | DEBUG | earth2studio.data.hrrr:async_fetch:130 - Fetching HRRR data for variable: v8hl at 2022-11-04T21:00:00 lead time 0:00:00
Fetching HRRR data: 27%|██▋ | 27/99 [00:12<00:28, 2.50it/s]
Fetching HRRR data: 28%|██▊ | 28/99 [00:12<00:26, 2.70it/s]
2025-01-23 04:48:39.123 | DEBUG | earth2studio.data.hrrr:async_fetch:130 - Fetching HRRR data for variable: v9hl at 2022-11-04T21:00:00 lead time 0:00:00
Fetching HRRR data: 28%|██▊ | 28/99 [00:12<00:26, 2.70it/s]
Fetching HRRR data: 29%|██▉ | 29/99 [00:12<00:24, 2.83it/s]
2025-01-23 04:48:39.436 | DEBUG | earth2studio.data.hrrr:async_fetch:130 - Fetching HRRR data for variable: v10hl at 2022-11-04T21:00:00 lead time 0:00:00
Fetching HRRR data: 29%|██▉ | 29/99 [00:12<00:24, 2.83it/s]
Fetching HRRR data: 30%|███ | 30/99 [00:13<00:27, 2.53it/s]
2025-01-23 04:48:39.931 | DEBUG | earth2studio.data.hrrr:async_fetch:130 - Fetching HRRR data for variable: v11hl at 2022-11-04T21:00:00 lead time 0:00:00
Fetching HRRR data: 30%|███ | 30/99 [00:13<00:27, 2.53it/s]
Fetching HRRR data: 31%|███▏ | 31/99 [00:13<00:28, 2.37it/s]
2025-01-23 04:48:40.414 | DEBUG | earth2studio.data.hrrr:async_fetch:130 - Fetching HRRR data for variable: v13hl at 2022-11-04T21:00:00 lead time 0:00:00
Fetching HRRR data: 31%|███▏ | 31/99 [00:13<00:28, 2.37it/s]
Fetching HRRR data: 32%|███▏ | 32/99 [00:13<00:26, 2.54it/s]
2025-01-23 04:48:40.739 | DEBUG | earth2studio.data.hrrr:async_fetch:130 - Fetching HRRR data for variable: v15hl at 2022-11-04T21:00:00 lead time 0:00:00
Fetching HRRR data: 32%|███▏ | 32/99 [00:13<00:26, 2.54it/s]
Fetching HRRR data: 33%|███▎ | 33/99 [00:14<00:33, 1.96it/s]
2025-01-23 04:48:41.527 | DEBUG | earth2studio.data.hrrr:async_fetch:130 - Fetching HRRR data for variable: v20hl at 2022-11-04T21:00:00 lead time 0:00:00
Fetching HRRR data: 33%|███▎ | 33/99 [00:14<00:33, 1.96it/s]
Fetching HRRR data: 34%|███▍ | 34/99 [00:15<00:30, 2.13it/s]
2025-01-23 04:48:41.898 | DEBUG | earth2studio.data.hrrr:async_fetch:130 - Fetching HRRR data for variable: v25hl at 2022-11-04T21:00:00 lead time 0:00:00
Fetching HRRR data: 34%|███▍ | 34/99 [00:15<00:30, 2.13it/s]
Fetching HRRR data: 35%|███▌ | 35/99 [00:15<00:26, 2.40it/s]
2025-01-23 04:48:42.194 | DEBUG | earth2studio.data.hrrr:async_fetch:130 - Fetching HRRR data for variable: v30hl at 2022-11-04T21:00:00 lead time 0:00:00
Fetching HRRR data: 35%|███▌ | 35/99 [00:15<00:26, 2.40it/s]
Fetching HRRR data: 36%|███▋ | 36/99 [00:15<00:23, 2.67it/s]
2025-01-23 04:48:42.470 | DEBUG | earth2studio.data.hrrr:async_fetch:130 - Fetching HRRR data for variable: t1hl at 2022-11-04T21:00:00 lead time 0:00:00
Fetching HRRR data: 36%|███▋ | 36/99 [00:15<00:23, 2.67it/s]
Fetching HRRR data: 37%|███▋ | 37/99 [00:16<00:23, 2.66it/s]
2025-01-23 04:48:42.847 | DEBUG | earth2studio.data.hrrr:async_fetch:130 - Fetching HRRR data for variable: t2hl at 2022-11-04T21:00:00 lead time 0:00:00
Fetching HRRR data: 37%|███▋ | 37/99 [00:16<00:23, 2.66it/s]
Fetching HRRR data: 38%|███▊ | 38/99 [00:16<00:22, 2.71it/s]
2025-01-23 04:48:43.198 | DEBUG | earth2studio.data.hrrr:async_fetch:130 - Fetching HRRR data for variable: t3hl at 2022-11-04T21:00:00 lead time 0:00:00
Fetching HRRR data: 38%|███▊ | 38/99 [00:16<00:22, 2.71it/s]
Fetching HRRR data: 39%|███▉ | 39/99 [00:16<00:22, 2.71it/s]
2025-01-23 04:48:43.568 | DEBUG | earth2studio.data.hrrr:async_fetch:130 - Fetching HRRR data for variable: t4hl at 2022-11-04T21:00:00 lead time 0:00:00
Fetching HRRR data: 39%|███▉ | 39/99 [00:16<00:22, 2.71it/s]
Fetching HRRR data: 40%|████ | 40/99 [00:17<00:22, 2.65it/s]
2025-01-23 04:48:43.965 | DEBUG | earth2studio.data.hrrr:async_fetch:130 - Fetching HRRR data for variable: t5hl at 2022-11-04T21:00:00 lead time 0:00:00
Fetching HRRR data: 40%|████ | 40/99 [00:17<00:22, 2.65it/s]
Fetching HRRR data: 41%|████▏ | 41/99 [00:17<00:21, 2.65it/s]
2025-01-23 04:48:44.342 | DEBUG | earth2studio.data.hrrr:async_fetch:130 - Fetching HRRR data for variable: t6hl at 2022-11-04T21:00:00 lead time 0:00:00
Fetching HRRR data: 41%|████▏ | 41/99 [00:17<00:21, 2.65it/s]
Fetching HRRR data: 42%|████▏ | 42/99 [00:17<00:20, 2.73it/s]
2025-01-23 04:48:44.685 | DEBUG | earth2studio.data.hrrr:async_fetch:130 - Fetching HRRR data for variable: t7hl at 2022-11-04T21:00:00 lead time 0:00:00
Fetching HRRR data: 42%|████▏ | 42/99 [00:17<00:20, 2.73it/s]
Fetching HRRR data: 43%|████▎ | 43/99 [00:18<00:20, 2.76it/s]
2025-01-23 04:48:45.035 | DEBUG | earth2studio.data.hrrr:async_fetch:130 - Fetching HRRR data for variable: t8hl at 2022-11-04T21:00:00 lead time 0:00:00
Fetching HRRR data: 43%|████▎ | 43/99 [00:18<00:20, 2.76it/s]
Fetching HRRR data: 44%|████▍ | 44/99 [00:18<00:19, 2.77it/s]
2025-01-23 04:48:45.395 | DEBUG | earth2studio.data.hrrr:async_fetch:130 - Fetching HRRR data for variable: t9hl at 2022-11-04T21:00:00 lead time 0:00:00
Fetching HRRR data: 44%|████▍ | 44/99 [00:18<00:19, 2.77it/s]
Fetching HRRR data: 45%|████▌ | 45/99 [00:19<00:19, 2.78it/s]
2025-01-23 04:48:45.751 | DEBUG | earth2studio.data.hrrr:async_fetch:130 - Fetching HRRR data for variable: t10hl at 2022-11-04T21:00:00 lead time 0:00:00
Fetching HRRR data: 45%|████▌ | 45/99 [00:19<00:19, 2.78it/s]
Fetching HRRR data: 46%|████▋ | 46/99 [00:19<00:19, 2.77it/s]
2025-01-23 04:48:46.113 | DEBUG | earth2studio.data.hrrr:async_fetch:130 - Fetching HRRR data for variable: t11hl at 2022-11-04T21:00:00 lead time 0:00:00
Fetching HRRR data: 46%|████▋ | 46/99 [00:19<00:19, 2.77it/s]
Fetching HRRR data: 47%|████▋ | 47/99 [00:19<00:18, 2.76it/s]
2025-01-23 04:48:46.480 | DEBUG | earth2studio.data.hrrr:async_fetch:130 - Fetching HRRR data for variable: t13hl at 2022-11-04T21:00:00 lead time 0:00:00
Fetching HRRR data: 47%|████▋ | 47/99 [00:19<00:18, 2.76it/s]
Fetching HRRR data: 48%|████▊ | 48/99 [00:20<00:18, 2.76it/s]
2025-01-23 04:48:46.842 | DEBUG | earth2studio.data.hrrr:async_fetch:130 - Fetching HRRR data for variable: t15hl at 2022-11-04T21:00:00 lead time 0:00:00
Fetching HRRR data: 48%|████▊ | 48/99 [00:20<00:18, 2.76it/s]
Fetching HRRR data: 49%|████▉ | 49/99 [00:20<00:17, 2.89it/s]
2025-01-23 04:48:47.151 | DEBUG | earth2studio.data.hrrr:async_fetch:130 - Fetching HRRR data for variable: t20hl at 2022-11-04T21:00:00 lead time 0:00:00
Fetching HRRR data: 49%|████▉ | 49/99 [00:20<00:17, 2.89it/s]
Fetching HRRR data: 51%|█████ | 50/99 [00:20<00:16, 2.89it/s]
2025-01-23 04:48:47.498 | DEBUG | earth2studio.data.hrrr:async_fetch:130 - Fetching HRRR data for variable: t25hl at 2022-11-04T21:00:00 lead time 0:00:00
Fetching HRRR data: 51%|█████ | 50/99 [00:20<00:16, 2.89it/s]
Fetching HRRR data: 52%|█████▏ | 51/99 [00:21<00:17, 2.82it/s]
2025-01-23 04:48:47.871 | DEBUG | earth2studio.data.hrrr:async_fetch:130 - Fetching HRRR data for variable: t30hl at 2022-11-04T21:00:00 lead time 0:00:00
Fetching HRRR data: 52%|█████▏ | 51/99 [00:21<00:17, 2.82it/s]
Fetching HRRR data: 53%|█████▎ | 52/99 [00:21<00:17, 2.67it/s]
2025-01-23 04:48:48.291 | DEBUG | earth2studio.data.hrrr:async_fetch:130 - Fetching HRRR data for variable: q1hl at 2022-11-04T21:00:00 lead time 0:00:00
Fetching HRRR data: 53%|█████▎ | 52/99 [00:21<00:17, 2.67it/s]
Fetching HRRR data: 54%|█████▎ | 53/99 [00:21<00:16, 2.82it/s]
2025-01-23 04:48:48.602 | DEBUG | earth2studio.data.hrrr:async_fetch:130 - Fetching HRRR data for variable: q2hl at 2022-11-04T21:00:00 lead time 0:00:00
Fetching HRRR data: 54%|█████▎ | 53/99 [00:21<00:16, 2.82it/s]
Fetching HRRR data: 55%|█████▍ | 54/99 [00:22<00:15, 2.94it/s]
2025-01-23 04:48:48.908 | DEBUG | earth2studio.data.hrrr:async_fetch:130 - Fetching HRRR data for variable: q3hl at 2022-11-04T21:00:00 lead time 0:00:00
Fetching HRRR data: 55%|█████▍ | 54/99 [00:22<00:15, 2.94it/s]
Fetching HRRR data: 56%|█████▌ | 55/99 [00:22<00:14, 3.02it/s]
2025-01-23 04:48:49.217 | DEBUG | earth2studio.data.hrrr:async_fetch:130 - Fetching HRRR data for variable: q4hl at 2022-11-04T21:00:00 lead time 0:00:00
Fetching HRRR data: 56%|█████▌ | 55/99 [00:22<00:14, 3.02it/s]
Fetching HRRR data: 57%|█████▋ | 56/99 [00:22<00:13, 3.09it/s]
2025-01-23 04:48:49.522 | DEBUG | earth2studio.data.hrrr:async_fetch:130 - Fetching HRRR data for variable: q5hl at 2022-11-04T21:00:00 lead time 0:00:00
Fetching HRRR data: 57%|█████▋ | 56/99 [00:22<00:13, 3.09it/s]
Fetching HRRR data: 58%|█████▊ | 57/99 [00:23<00:13, 3.15it/s]
2025-01-23 04:48:49.825 | DEBUG | earth2studio.data.hrrr:async_fetch:130 - Fetching HRRR data for variable: q6hl at 2022-11-04T21:00:00 lead time 0:00:00
Fetching HRRR data: 58%|█████▊ | 57/99 [00:23<00:13, 3.15it/s]
Fetching HRRR data: 59%|█████▊ | 58/99 [00:23<00:12, 3.18it/s]
2025-01-23 04:48:50.135 | DEBUG | earth2studio.data.hrrr:async_fetch:130 - Fetching HRRR data for variable: q7hl at 2022-11-04T21:00:00 lead time 0:00:00
Fetching HRRR data: 59%|█████▊ | 58/99 [00:23<00:12, 3.18it/s]
Fetching HRRR data: 60%|█████▉ | 59/99 [00:23<00:12, 3.17it/s]
2025-01-23 04:48:50.450 | DEBUG | earth2studio.data.hrrr:async_fetch:130 - Fetching HRRR data for variable: q8hl at 2022-11-04T21:00:00 lead time 0:00:00
Fetching HRRR data: 60%|█████▉ | 59/99 [00:23<00:12, 3.17it/s]
Fetching HRRR data: 61%|██████ | 60/99 [00:24<00:12, 3.18it/s]
2025-01-23 04:48:50.764 | DEBUG | earth2studio.data.hrrr:async_fetch:130 - Fetching HRRR data for variable: q9hl at 2022-11-04T21:00:00 lead time 0:00:00
Fetching HRRR data: 61%|██████ | 60/99 [00:24<00:12, 3.18it/s]
Fetching HRRR data: 62%|██████▏ | 61/99 [00:24<00:11, 3.19it/s]
2025-01-23 04:48:51.074 | DEBUG | earth2studio.data.hrrr:async_fetch:130 - Fetching HRRR data for variable: q10hl at 2022-11-04T21:00:00 lead time 0:00:00
Fetching HRRR data: 62%|██████▏ | 61/99 [00:24<00:11, 3.19it/s]
Fetching HRRR data: 63%|██████▎ | 62/99 [00:24<00:11, 3.21it/s]
2025-01-23 04:48:51.382 | DEBUG | earth2studio.data.hrrr:async_fetch:130 - Fetching HRRR data for variable: q11hl at 2022-11-04T21:00:00 lead time 0:00:00
Fetching HRRR data: 63%|██████▎ | 62/99 [00:24<00:11, 3.21it/s]
Fetching HRRR data: 64%|██████▎ | 63/99 [00:24<00:11, 3.23it/s]
2025-01-23 04:48:51.686 | DEBUG | earth2studio.data.hrrr:async_fetch:130 - Fetching HRRR data for variable: q13hl at 2022-11-04T21:00:00 lead time 0:00:00
Fetching HRRR data: 64%|██████▎ | 63/99 [00:24<00:11, 3.23it/s]
Fetching HRRR data: 65%|██████▍ | 64/99 [00:25<00:10, 3.26it/s]
2025-01-23 04:48:51.985 | DEBUG | earth2studio.data.hrrr:async_fetch:130 - Fetching HRRR data for variable: q15hl at 2022-11-04T21:00:00 lead time 0:00:00
Fetching HRRR data: 65%|██████▍ | 64/99 [00:25<00:10, 3.26it/s]
Fetching HRRR data: 66%|██████▌ | 65/99 [00:25<00:10, 3.24it/s]
2025-01-23 04:48:52.299 | DEBUG | earth2studio.data.hrrr:async_fetch:130 - Fetching HRRR data for variable: q20hl at 2022-11-04T21:00:00 lead time 0:00:00
Fetching HRRR data: 66%|██████▌ | 65/99 [00:25<00:10, 3.24it/s]
Fetching HRRR data: 67%|██████▋ | 66/99 [00:26<00:15, 2.15it/s]
2025-01-23 04:48:53.130 | DEBUG | earth2studio.data.hrrr:async_fetch:130 - Fetching HRRR data for variable: q25hl at 2022-11-04T21:00:00 lead time 0:00:00
Fetching HRRR data: 67%|██████▋ | 66/99 [00:26<00:15, 2.15it/s]
Fetching HRRR data: 68%|██████▊ | 67/99 [00:26<00:14, 2.28it/s]
2025-01-23 04:48:53.507 | DEBUG | earth2studio.data.hrrr:async_fetch:130 - Fetching HRRR data for variable: q30hl at 2022-11-04T21:00:00 lead time 0:00:00
Fetching HRRR data: 68%|██████▊ | 67/99 [00:26<00:14, 2.28it/s]
Fetching HRRR data: 69%|██████▊ | 68/99 [00:27<00:12, 2.47it/s]
2025-01-23 04:48:53.832 | DEBUG | earth2studio.data.hrrr:async_fetch:130 - Fetching HRRR data for variable: Z1hl at 2022-11-04T21:00:00 lead time 0:00:00
Fetching HRRR data: 69%|██████▊ | 68/99 [00:27<00:12, 2.47it/s]
Fetching HRRR data: 70%|██████▉ | 69/99 [00:27<00:12, 2.37it/s]
2025-01-23 04:48:54.292 | DEBUG | earth2studio.data.hrrr:async_fetch:130 - Fetching HRRR data for variable: Z2hl at 2022-11-04T21:00:00 lead time 0:00:00
Fetching HRRR data: 70%|██████▉ | 69/99 [00:27<00:12, 2.37it/s]
Fetching HRRR data: 71%|███████ | 70/99 [00:28<00:12, 2.27it/s]
2025-01-23 04:48:54.777 | DEBUG | earth2studio.data.hrrr:async_fetch:130 - Fetching HRRR data for variable: Z3hl at 2022-11-04T21:00:00 lead time 0:00:00
Fetching HRRR data: 71%|███████ | 70/99 [00:28<00:12, 2.27it/s]
Fetching HRRR data: 72%|███████▏ | 71/99 [00:28<00:12, 2.28it/s]
2025-01-23 04:48:55.213 | DEBUG | earth2studio.data.hrrr:async_fetch:130 - Fetching HRRR data for variable: Z4hl at 2022-11-04T21:00:00 lead time 0:00:00
Fetching HRRR data: 72%|███████▏ | 71/99 [00:28<00:12, 2.28it/s]
Fetching HRRR data: 73%|███████▎ | 72/99 [00:28<00:11, 2.29it/s]
2025-01-23 04:48:55.646 | DEBUG | earth2studio.data.hrrr:async_fetch:130 - Fetching HRRR data for variable: Z5hl at 2022-11-04T21:00:00 lead time 0:00:00
Fetching HRRR data: 73%|███████▎ | 72/99 [00:28<00:11, 2.29it/s]
Fetching HRRR data: 74%|███████▎ | 73/99 [00:29<00:11, 2.27it/s]
2025-01-23 04:48:56.093 | DEBUG | earth2studio.data.hrrr:async_fetch:130 - Fetching HRRR data for variable: Z6hl at 2022-11-04T21:00:00 lead time 0:00:00
Fetching HRRR data: 74%|███████▎ | 73/99 [00:29<00:11, 2.27it/s]
Fetching HRRR data: 75%|███████▍ | 74/99 [00:29<00:11, 2.21it/s]
2025-01-23 04:48:56.577 | DEBUG | earth2studio.data.hrrr:async_fetch:130 - Fetching HRRR data for variable: Z7hl at 2022-11-04T21:00:00 lead time 0:00:00
Fetching HRRR data: 75%|███████▍ | 74/99 [00:29<00:11, 2.21it/s]
Fetching HRRR data: 76%|███████▌ | 75/99 [00:30<00:10, 2.23it/s]
2025-01-23 04:48:57.017 | DEBUG | earth2studio.data.hrrr:async_fetch:130 - Fetching HRRR data for variable: Z8hl at 2022-11-04T21:00:00 lead time 0:00:00
Fetching HRRR data: 76%|███████▌ | 75/99 [00:30<00:10, 2.23it/s]
Fetching HRRR data: 77%|███████▋ | 76/99 [00:30<00:10, 2.28it/s]
2025-01-23 04:48:57.430 | DEBUG | earth2studio.data.hrrr:async_fetch:130 - Fetching HRRR data for variable: Z9hl at 2022-11-04T21:00:00 lead time 0:00:00
Fetching HRRR data: 77%|███████▋ | 76/99 [00:30<00:10, 2.28it/s]
Fetching HRRR data: 78%|███████▊ | 77/99 [00:31<00:09, 2.23it/s]
2025-01-23 04:48:57.901 | DEBUG | earth2studio.data.hrrr:async_fetch:130 - Fetching HRRR data for variable: Z10hl at 2022-11-04T21:00:00 lead time 0:00:00
Fetching HRRR data: 78%|███████▊ | 77/99 [00:31<00:09, 2.23it/s]
Fetching HRRR data: 79%|███████▉ | 78/99 [00:31<00:09, 2.24it/s]
2025-01-23 04:48:58.343 | DEBUG | earth2studio.data.hrrr:async_fetch:130 - Fetching HRRR data for variable: Z11hl at 2022-11-04T21:00:00 lead time 0:00:00
Fetching HRRR data: 79%|███████▉ | 78/99 [00:31<00:09, 2.24it/s]
Fetching HRRR data: 80%|███████▉ | 79/99 [00:32<00:09, 2.22it/s]
2025-01-23 04:48:58.802 | DEBUG | earth2studio.data.hrrr:async_fetch:130 - Fetching HRRR data for variable: Z13hl at 2022-11-04T21:00:00 lead time 0:00:00
Fetching HRRR data: 80%|███████▉ | 79/99 [00:32<00:09, 2.22it/s]
Fetching HRRR data: 81%|████████ | 80/99 [00:32<00:08, 2.23it/s]
2025-01-23 04:48:59.249 | DEBUG | earth2studio.data.hrrr:async_fetch:130 - Fetching HRRR data for variable: Z15hl at 2022-11-04T21:00:00 lead time 0:00:00
Fetching HRRR data: 81%|████████ | 80/99 [00:32<00:08, 2.23it/s]
Fetching HRRR data: 82%|████████▏ | 81/99 [00:32<00:08, 2.21it/s]
2025-01-23 04:48:59.709 | DEBUG | earth2studio.data.hrrr:async_fetch:130 - Fetching HRRR data for variable: Z20hl at 2022-11-04T21:00:00 lead time 0:00:00
Fetching HRRR data: 82%|████████▏ | 81/99 [00:32<00:08, 2.21it/s]
Fetching HRRR data: 83%|████████▎ | 82/99 [00:33<00:07, 2.25it/s]
2025-01-23 04:49:00.136 | DEBUG | earth2studio.data.hrrr:async_fetch:130 - Fetching HRRR data for variable: Z25hl at 2022-11-04T21:00:00 lead time 0:00:00
Fetching HRRR data: 83%|████████▎ | 82/99 [00:33<00:07, 2.25it/s]
Fetching HRRR data: 84%|████████▍ | 83/99 [00:33<00:06, 2.31it/s]
2025-01-23 04:49:00.543 | DEBUG | earth2studio.data.hrrr:async_fetch:130 - Fetching HRRR data for variable: Z30hl at 2022-11-04T21:00:00 lead time 0:00:00
Fetching HRRR data: 84%|████████▍ | 83/99 [00:33<00:06, 2.31it/s]
Fetching HRRR data: 85%|████████▍ | 84/99 [00:34<00:06, 2.47it/s]
2025-01-23 04:49:00.881 | DEBUG | earth2studio.data.hrrr:async_fetch:130 - Fetching HRRR data for variable: p1hl at 2022-11-04T21:00:00 lead time 0:00:00
Fetching HRRR data: 85%|████████▍ | 84/99 [00:34<00:06, 2.47it/s]
Fetching HRRR data: 86%|████████▌ | 85/99 [00:34<00:05, 2.45it/s]
2025-01-23 04:49:01.299 | DEBUG | earth2studio.data.hrrr:async_fetch:130 - Fetching HRRR data for variable: p2hl at 2022-11-04T21:00:00 lead time 0:00:00
Fetching HRRR data: 86%|████████▌ | 85/99 [00:34<00:05, 2.45it/s]
Fetching HRRR data: 87%|████████▋ | 86/99 [00:35<00:05, 2.25it/s]
2025-01-23 04:49:01.825 | DEBUG | earth2studio.data.hrrr:async_fetch:130 - Fetching HRRR data for variable: p3hl at 2022-11-04T21:00:00 lead time 0:00:00
Fetching HRRR data: 87%|████████▋ | 86/99 [00:35<00:05, 2.25it/s]
Fetching HRRR data: 88%|████████▊ | 87/99 [00:35<00:05, 2.22it/s]
2025-01-23 04:49:02.291 | DEBUG | earth2studio.data.hrrr:async_fetch:130 - Fetching HRRR data for variable: p4hl at 2022-11-04T21:00:00 lead time 0:00:00
Fetching HRRR data: 88%|████████▊ | 87/99 [00:35<00:05, 2.22it/s]
Fetching HRRR data: 89%|████████▉ | 88/99 [00:35<00:04, 2.28it/s]
2025-01-23 04:49:02.703 | DEBUG | earth2studio.data.hrrr:async_fetch:130 - Fetching HRRR data for variable: p5hl at 2022-11-04T21:00:00 lead time 0:00:00
Fetching HRRR data: 89%|████████▉ | 88/99 [00:35<00:04, 2.28it/s]
Fetching HRRR data: 90%|████████▉ | 89/99 [00:36<00:05, 1.99it/s]
2025-01-23 04:49:03.351 | DEBUG | earth2studio.data.hrrr:async_fetch:130 - Fetching HRRR data for variable: p6hl at 2022-11-04T21:00:00 lead time 0:00:00
Fetching HRRR data: 90%|████████▉ | 89/99 [00:36<00:05, 1.99it/s]
Fetching HRRR data: 91%|█████████ | 90/99 [00:37<00:04, 2.04it/s]
2025-01-23 04:49:03.811 | DEBUG | earth2studio.data.hrrr:async_fetch:130 - Fetching HRRR data for variable: p7hl at 2022-11-04T21:00:00 lead time 0:00:00
Fetching HRRR data: 91%|█████████ | 90/99 [00:37<00:04, 2.04it/s]
Fetching HRRR data: 92%|█████████▏| 91/99 [00:37<00:03, 2.15it/s]
2025-01-23 04:49:04.221 | DEBUG | earth2studio.data.hrrr:async_fetch:130 - Fetching HRRR data for variable: p8hl at 2022-11-04T21:00:00 lead time 0:00:00
Fetching HRRR data: 92%|█████████▏| 91/99 [00:37<00:03, 2.15it/s]
Fetching HRRR data: 93%|█████████▎| 92/99 [00:37<00:03, 2.11it/s]
2025-01-23 04:49:04.716 | DEBUG | earth2studio.data.hrrr:async_fetch:130 - Fetching HRRR data for variable: p9hl at 2022-11-04T21:00:00 lead time 0:00:00
Fetching HRRR data: 93%|█████████▎| 92/99 [00:37<00:03, 2.11it/s]
Fetching HRRR data: 94%|█████████▍| 93/99 [00:38<00:02, 2.13it/s]
2025-01-23 04:49:05.171 | DEBUG | earth2studio.data.hrrr:async_fetch:130 - Fetching HRRR data for variable: p10hl at 2022-11-04T21:00:00 lead time 0:00:00
Fetching HRRR data: 94%|█████████▍| 93/99 [00:38<00:02, 2.13it/s]
Fetching HRRR data: 95%|█████████▍| 94/99 [00:38<00:02, 2.18it/s]
2025-01-23 04:49:05.607 | DEBUG | earth2studio.data.hrrr:async_fetch:130 - Fetching HRRR data for variable: p11hl at 2022-11-04T21:00:00 lead time 0:00:00
Fetching HRRR data: 95%|█████████▍| 94/99 [00:38<00:02, 2.18it/s]
Fetching HRRR data: 96%|█████████▌| 95/99 [00:39<00:01, 2.24it/s]
2025-01-23 04:49:06.026 | DEBUG | earth2studio.data.hrrr:async_fetch:130 - Fetching HRRR data for variable: p13hl at 2022-11-04T21:00:00 lead time 0:00:00
Fetching HRRR data: 96%|█████████▌| 95/99 [00:39<00:01, 2.24it/s]
Fetching HRRR data: 97%|█████████▋| 96/99 [00:39<00:01, 2.22it/s]
2025-01-23 04:49:06.487 | DEBUG | earth2studio.data.hrrr:async_fetch:130 - Fetching HRRR data for variable: p15hl at 2022-11-04T21:00:00 lead time 0:00:00
Fetching HRRR data: 97%|█████████▋| 96/99 [00:39<00:01, 2.22it/s]
Fetching HRRR data: 98%|█████████▊| 97/99 [00:40<00:00, 2.25it/s]
2025-01-23 04:49:06.914 | DEBUG | earth2studio.data.hrrr:async_fetch:130 - Fetching HRRR data for variable: p20hl at 2022-11-04T21:00:00 lead time 0:00:00
Fetching HRRR data: 98%|█████████▊| 97/99 [00:40<00:00, 2.25it/s]
Fetching HRRR data: 99%|█████████▉| 98/99 [00:40<00:00, 2.28it/s]
2025-01-23 04:49:07.339 | DEBUG | earth2studio.data.hrrr:async_fetch:130 - Fetching HRRR data for variable: refc at 2022-11-04T21:00:00 lead time 0:00:00
Fetching HRRR data: 99%|█████████▉| 98/99 [00:40<00:00, 2.28it/s]
Fetching HRRR data: 100%|██████████| 99/99 [00:41<00:00, 1.78it/s]
Fetching HRRR data: 100%|██████████| 99/99 [00:41<00:00, 2.39it/s]
2025-01-23 04:50:05.618 | SUCCESS | earth2studio.run:ensemble:345 - Fetched data from HRRR
2025-01-23 04:50:05.625 | INFO | earth2studio.run:ensemble:367 - Starting 8 Member Ensemble Inference with 4 number of batches.
Total Ensemble Batches: 0%| | 0/4 [00:00<?, ?it/s]
Running batch 0 inference: 0%| | 0/5 [00:00<?, ?it/s]
Fetching ARCO data: 0%| | 0/26 [00:00<?, ?it/s]
2025-01-23 04:50:05.787 | DEBUG | earth2studio.data.arco:fetch_array:227 - Fetching ARCO zarr array for variable: u10m at 2022-11-04T21:00:00
Running batch 0 inference: 20%|██ | 1/5 [00:00<00:00, 15.28it/s]
Total Ensemble Batches: 0%| | 0/4 [00:00<?, ?it/s]
Fetching ARCO data: 0%| | 0/26 [00:00<?, ?it/s]
2025-01-23 04:50:06.491 | DEBUG | earth2studio.data.arco:fetch_array:227 - Fetching ARCO zarr array for variable: v10m at 2022-11-04T21:00:00
Running batch 0 inference: 20%|██ | 1/5 [00:00<00:03, 1.30it/s]
Total Ensemble Batches: 0%| | 0/4 [00:00<?, ?it/s]
Fetching ARCO data: 0%| | 0/26 [00:00<?, ?it/s]
2025-01-23 04:50:07.420 | DEBUG | earth2studio.data.arco:fetch_array:227 - Fetching ARCO zarr array for variable: t2m at 2022-11-04T21:00:00
Running batch 0 inference: 20%|██ | 1/5 [00:01<00:06, 1.70s/it]
Total Ensemble Batches: 0%| | 0/4 [00:01<?, ?it/s]
Fetching ARCO data: 0%| | 0/26 [00:01<?, ?it/s]
2025-01-23 04:50:08.288 | DEBUG | earth2studio.data.arco:fetch_array:227 - Fetching ARCO zarr array for variable: tcwv at 2022-11-04T21:00:00
Running batch 0 inference: 20%|██ | 1/5 [00:02<00:10, 2.57s/it]
Total Ensemble Batches: 0%| | 0/4 [00:02<?, ?it/s]
Fetching ARCO data: 0%| | 0/26 [00:02<?, ?it/s]
Fetching ARCO data: 4%|▍ | 1/26 [00:03<01:18, 3.12s/it]
2025-01-23 04:50:08.923 | DEBUG | earth2studio.data.arco:fetch_array:227 - Fetching ARCO zarr array for variable: msl at 2022-11-04T21:00:00
Running batch 0 inference: 20%|██ | 1/5 [00:03<00:12, 3.20s/it]
Total Ensemble Batches: 0%| | 0/4 [00:03<?, ?it/s]
Fetching ARCO data: 15%|█▌ | 4/26 [00:03<01:08, 3.12s/it]
2025-01-23 04:50:09.757 | DEBUG | earth2studio.data.arco:fetch_array:227 - Fetching ARCO zarr array for variable: sp at 2022-11-04T21:00:00
Running batch 0 inference: 20%|██ | 1/5 [00:04<00:16, 4.04s/it]
Total Ensemble Batches: 0%| | 0/4 [00:04<?, ?it/s]
Fetching ARCO data: 15%|█▌ | 4/26 [00:03<01:08, 3.12s/it]
2025-01-23 04:50:10.288 | DEBUG | earth2studio.data.arco:fetch_array:227 - Fetching ARCO zarr array for variable: u1000 at 2022-11-04T21:00:00
Running batch 0 inference: 20%|██ | 1/5 [00:04<00:18, 4.57s/it]
Total Ensemble Batches: 0%| | 0/4 [00:04<?, ?it/s]
Fetching ARCO data: 15%|█▌ | 4/26 [00:04<01:08, 3.12s/it]
2025-01-23 04:50:13.741 | DEBUG | earth2studio.data.arco:fetch_array:227 - Fetching ARCO zarr array for variable: u850 at 2022-11-04T21:00:00
Running batch 0 inference: 20%|██ | 1/5 [00:08<00:32, 8.02s/it]
Total Ensemble Batches: 0%| | 0/4 [00:08<?, ?it/s]
Fetching ARCO data: 15%|█▌ | 4/26 [00:07<01:08, 3.12s/it]
Fetching ARCO data: 19%|█▉ | 5/26 [00:08<00:32, 1.54s/it]
2025-01-23 04:50:13.955 | DEBUG | earth2studio.data.arco:fetch_array:227 - Fetching ARCO zarr array for variable: u500 at 2022-11-04T21:00:00
Running batch 0 inference: 20%|██ | 1/5 [00:08<00:32, 8.23s/it]
Total Ensemble Batches: 0%| | 0/4 [00:08<?, ?it/s]
Fetching ARCO data: 31%|███ | 8/26 [00:08<00:27, 1.54s/it]
2025-01-23 04:50:14.150 | DEBUG | earth2studio.data.arco:fetch_array:227 - Fetching ARCO zarr array for variable: u250 at 2022-11-04T21:00:00
Running batch 0 inference: 20%|██ | 1/5 [00:08<00:33, 8.43s/it]
Total Ensemble Batches: 0%| | 0/4 [00:08<?, ?it/s]
Fetching ARCO data: 31%|███ | 8/26 [00:08<00:27, 1.54s/it]
2025-01-23 04:50:14.345 | DEBUG | earth2studio.data.arco:fetch_array:227 - Fetching ARCO zarr array for variable: v1000 at 2022-11-04T21:00:00
Running batch 0 inference: 20%|██ | 1/5 [00:08<00:34, 8.62s/it]
Total Ensemble Batches: 0%| | 0/4 [00:08<?, ?it/s]
Fetching ARCO data: 31%|███ | 8/26 [00:08<00:27, 1.54s/it]
2025-01-23 04:50:17.004 | DEBUG | earth2studio.data.arco:fetch_array:227 - Fetching ARCO zarr array for variable: v850 at 2022-11-04T21:00:00
Running batch 0 inference: 20%|██ | 1/5 [00:11<00:45, 11.28s/it]
Total Ensemble Batches: 0%| | 0/4 [00:11<?, ?it/s]
Fetching ARCO data: 31%|███ | 8/26 [00:11<00:27, 1.54s/it]
Fetching ARCO data: 35%|███▍ | 9/26 [00:11<00:19, 1.14s/it]
2025-01-23 04:50:17.220 | DEBUG | earth2studio.data.arco:fetch_array:227 - Fetching ARCO zarr array for variable: v500 at 2022-11-04T21:00:00
Running batch 0 inference: 20%|██ | 1/5 [00:11<00:45, 11.50s/it]
Total Ensemble Batches: 0%| | 0/4 [00:11<?, ?it/s]
Fetching ARCO data: 46%|████▌ | 12/26 [00:11<00:15, 1.14s/it]
2025-01-23 04:50:17.423 | DEBUG | earth2studio.data.arco:fetch_array:227 - Fetching ARCO zarr array for variable: v250 at 2022-11-04T21:00:00
Running batch 0 inference: 20%|██ | 1/5 [00:11<00:46, 11.70s/it]
Total Ensemble Batches: 0%| | 0/4 [00:11<?, ?it/s]
Fetching ARCO data: 46%|████▌ | 12/26 [00:11<00:15, 1.14s/it]
2025-01-23 04:50:17.623 | DEBUG | earth2studio.data.arco:fetch_array:227 - Fetching ARCO zarr array for variable: z1000 at 2022-11-04T21:00:00
Running batch 0 inference: 20%|██ | 1/5 [00:11<00:47, 11.90s/it]
Total Ensemble Batches: 0%| | 0/4 [00:11<?, ?it/s]
Fetching ARCO data: 46%|████▌ | 12/26 [00:11<00:15, 1.14s/it]
2025-01-23 04:50:20.138 | DEBUG | earth2studio.data.arco:fetch_array:227 - Fetching ARCO zarr array for variable: z850 at 2022-11-04T21:00:00
Running batch 0 inference: 20%|██ | 1/5 [00:14<00:57, 14.42s/it]
Total Ensemble Batches: 0%| | 0/4 [00:14<?, ?it/s]
Fetching ARCO data: 46%|████▌ | 12/26 [00:14<00:15, 1.14s/it]
Fetching ARCO data: 50%|█████ | 13/26 [00:14<00:12, 1.02it/s]
2025-01-23 04:50:20.332 | DEBUG | earth2studio.data.arco:fetch_array:227 - Fetching ARCO zarr array for variable: z500 at 2022-11-04T21:00:00
Running batch 0 inference: 20%|██ | 1/5 [00:14<00:58, 14.61s/it]
Total Ensemble Batches: 0%| | 0/4 [00:14<?, ?it/s]
Fetching ARCO data: 62%|██████▏ | 16/26 [00:14<00:09, 1.02it/s]
2025-01-23 04:50:20.510 | DEBUG | earth2studio.data.arco:fetch_array:227 - Fetching ARCO zarr array for variable: z250 at 2022-11-04T21:00:00
Running batch 0 inference: 20%|██ | 1/5 [00:14<00:59, 14.79s/it]
Total Ensemble Batches: 0%| | 0/4 [00:14<?, ?it/s]
Fetching ARCO data: 62%|██████▏ | 16/26 [00:14<00:09, 1.02it/s]
2025-01-23 04:50:20.688 | DEBUG | earth2studio.data.arco:fetch_array:227 - Fetching ARCO zarr array for variable: t1000 at 2022-11-04T21:00:00
Running batch 0 inference: 20%|██ | 1/5 [00:14<00:59, 14.97s/it]
Total Ensemble Batches: 0%| | 0/4 [00:15<?, ?it/s]
Fetching ARCO data: 62%|██████▏ | 16/26 [00:14<00:09, 1.02it/s]
2025-01-23 04:50:22.943 | DEBUG | earth2studio.data.arco:fetch_array:227 - Fetching ARCO zarr array for variable: t850 at 2022-11-04T21:00:00
Running batch 0 inference: 20%|██ | 1/5 [00:17<01:08, 17.22s/it]
Total Ensemble Batches: 0%| | 0/4 [00:17<?, ?it/s]
Fetching ARCO data: 62%|██████▏ | 16/26 [00:17<00:09, 1.02it/s]
Fetching ARCO data: 65%|██████▌ | 17/26 [00:17<00:07, 1.14it/s]
2025-01-23 04:50:23.145 | DEBUG | earth2studio.data.arco:fetch_array:227 - Fetching ARCO zarr array for variable: t500 at 2022-11-04T21:00:00
Running batch 0 inference: 20%|██ | 1/5 [00:17<01:09, 17.42s/it]
Total Ensemble Batches: 0%| | 0/4 [00:17<?, ?it/s]
Fetching ARCO data: 77%|███████▋ | 20/26 [00:17<00:05, 1.14it/s]
2025-01-23 04:50:23.332 | DEBUG | earth2studio.data.arco:fetch_array:227 - Fetching ARCO zarr array for variable: t250 at 2022-11-04T21:00:00
Running batch 0 inference: 20%|██ | 1/5 [00:17<01:10, 17.61s/it]
Total Ensemble Batches: 0%| | 0/4 [00:17<?, ?it/s]
Fetching ARCO data: 77%|███████▋ | 20/26 [00:17<00:05, 1.14it/s]
2025-01-23 04:50:23.517 | DEBUG | earth2studio.data.arco:fetch_array:227 - Fetching ARCO zarr array for variable: q1000 at 2022-11-04T21:00:00
Running batch 0 inference: 20%|██ | 1/5 [00:17<01:11, 17.80s/it]
Total Ensemble Batches: 0%| | 0/4 [00:17<?, ?it/s]
Fetching ARCO data: 77%|███████▋ | 20/26 [00:17<00:05, 1.14it/s]
2025-01-23 04:50:27.143 | DEBUG | earth2studio.data.arco:fetch_array:227 - Fetching ARCO zarr array for variable: q850 at 2022-11-04T21:00:00
Running batch 0 inference: 20%|██ | 1/5 [00:21<01:25, 21.42s/it]
Total Ensemble Batches: 0%| | 0/4 [00:21<?, ?it/s]
Fetching ARCO data: 77%|███████▋ | 20/26 [00:21<00:05, 1.14it/s]
Fetching ARCO data: 81%|████████ | 21/26 [00:21<00:04, 1.07it/s]
2025-01-23 04:50:27.352 | DEBUG | earth2studio.data.arco:fetch_array:227 - Fetching ARCO zarr array for variable: q500 at 2022-11-04T21:00:00
Running batch 0 inference: 20%|██ | 1/5 [00:21<01:26, 21.63s/it]
Total Ensemble Batches: 0%| | 0/4 [00:21<?, ?it/s]
Fetching ARCO data: 92%|█████████▏| 24/26 [00:21<00:01, 1.07it/s]
2025-01-23 04:50:27.542 | DEBUG | earth2studio.data.arco:fetch_array:227 - Fetching ARCO zarr array for variable: q250 at 2022-11-04T21:00:00
Running batch 0 inference: 20%|██ | 1/5 [00:21<01:27, 21.82s/it]
Total Ensemble Batches: 0%| | 0/4 [00:21<?, ?it/s]
Fetching ARCO data: 92%|█████████▏| 24/26 [00:21<00:01, 1.07it/s]
Fetching ARCO data: 96%|█████████▌| 25/26 [00:21<00:00, 1.53it/s]
Fetching ARCO data: 100%|██████████| 26/26 [00:21<00:00, 1.18it/s]
Running batch 0 inference: 40%|████ | 2/5 [00:57<01:25, 28.62s/it]
Fetching ARCO data: 0%| | 0/26 [00:00<?, ?it/s]
2025-01-23 04:51:02.969 | DEBUG | earth2studio.data.arco:fetch_array:227 - Fetching ARCO zarr array for variable: u10m at 2022-11-04T22:00:00
Running batch 0 inference: 40%|████ | 2/5 [00:57<01:25, 28.62s/it]
Total Ensemble Batches: 0%| | 0/4 [00:57<?, ?it/s]
Fetching ARCO data: 0%| | 0/26 [00:00<?, ?it/s]
2025-01-23 04:51:03.742 | DEBUG | earth2studio.data.arco:fetch_array:227 - Fetching ARCO zarr array for variable: v10m at 2022-11-04T22:00:00
Running batch 0 inference: 40%|████ | 2/5 [00:58<01:25, 28.62s/it]
Total Ensemble Batches: 0%| | 0/4 [00:58<?, ?it/s]
Fetching ARCO data: 0%| | 0/26 [00:00<?, ?it/s]
2025-01-23 04:51:04.271 | DEBUG | earth2studio.data.arco:fetch_array:227 - Fetching ARCO zarr array for variable: t2m at 2022-11-04T22:00:00
Running batch 0 inference: 40%|████ | 2/5 [00:58<01:25, 28.62s/it]
Total Ensemble Batches: 0%| | 0/4 [00:58<?, ?it/s]
Fetching ARCO data: 0%| | 0/26 [00:01<?, ?it/s]
2025-01-23 04:51:04.764 | DEBUG | earth2studio.data.arco:fetch_array:227 - Fetching ARCO zarr array for variable: tcwv at 2022-11-04T22:00:00
Running batch 0 inference: 40%|████ | 2/5 [00:59<01:25, 28.62s/it]
Total Ensemble Batches: 0%| | 0/4 [00:59<?, ?it/s]
Fetching ARCO data: 0%| | 0/26 [00:01<?, ?it/s]
Fetching ARCO data: 4%|▍ | 1/26 [00:02<00:58, 2.36s/it]
2025-01-23 04:51:05.337 | DEBUG | earth2studio.data.arco:fetch_array:227 - Fetching ARCO zarr array for variable: msl at 2022-11-04T22:00:00
Running batch 0 inference: 40%|████ | 2/5 [00:59<01:25, 28.62s/it]
Total Ensemble Batches: 0%| | 0/4 [00:59<?, ?it/s]
Fetching ARCO data: 15%|█▌ | 4/26 [00:02<00:51, 2.36s/it]
2025-01-23 04:51:06.049 | DEBUG | earth2studio.data.arco:fetch_array:227 - Fetching ARCO zarr array for variable: sp at 2022-11-04T22:00:00
Running batch 0 inference: 40%|████ | 2/5 [01:00<01:25, 28.62s/it]
Total Ensemble Batches: 0%| | 0/4 [01:00<?, ?it/s]
Fetching ARCO data: 15%|█▌ | 4/26 [00:03<00:51, 2.36s/it]
2025-01-23 04:51:06.589 | DEBUG | earth2studio.data.arco:fetch_array:227 - Fetching ARCO zarr array for variable: u1000 at 2022-11-04T22:00:00
Running batch 0 inference: 40%|████ | 2/5 [01:00<01:25, 28.62s/it]
Total Ensemble Batches: 0%| | 0/4 [01:00<?, ?it/s]
Fetching ARCO data: 15%|█▌ | 4/26 [00:03<00:51, 2.36s/it]
2025-01-23 04:51:09.690 | DEBUG | earth2studio.data.arco:fetch_array:227 - Fetching ARCO zarr array for variable: u850 at 2022-11-04T22:00:00
Running batch 0 inference: 40%|████ | 2/5 [01:03<01:25, 28.62s/it]
Total Ensemble Batches: 0%| | 0/4 [01:04<?, ?it/s]
Fetching ARCO data: 15%|█▌ | 4/26 [00:06<00:51, 2.36s/it]
Fetching ARCO data: 19%|█▉ | 5/26 [00:06<00:27, 1.32s/it]
2025-01-23 04:51:09.900 | DEBUG | earth2studio.data.arco:fetch_array:227 - Fetching ARCO zarr array for variable: u500 at 2022-11-04T22:00:00
Running batch 0 inference: 40%|████ | 2/5 [01:04<01:25, 28.62s/it]
Total Ensemble Batches: 0%| | 0/4 [01:04<?, ?it/s]
Fetching ARCO data: 31%|███ | 8/26 [00:06<00:23, 1.32s/it]
2025-01-23 04:51:10.092 | DEBUG | earth2studio.data.arco:fetch_array:227 - Fetching ARCO zarr array for variable: u250 at 2022-11-04T22:00:00
Running batch 0 inference: 40%|████ | 2/5 [01:04<01:25, 28.62s/it]
Total Ensemble Batches: 0%| | 0/4 [01:04<?, ?it/s]
Fetching ARCO data: 31%|███ | 8/26 [00:07<00:23, 1.32s/it]
2025-01-23 04:51:10.286 | DEBUG | earth2studio.data.arco:fetch_array:227 - Fetching ARCO zarr array for variable: v1000 at 2022-11-04T22:00:00
Running batch 0 inference: 40%|████ | 2/5 [01:04<01:25, 28.62s/it]
Total Ensemble Batches: 0%| | 0/4 [01:04<?, ?it/s]
Fetching ARCO data: 31%|███ | 8/26 [00:07<00:23, 1.32s/it]
2025-01-23 04:51:13.993 | DEBUG | earth2studio.data.arco:fetch_array:227 - Fetching ARCO zarr array for variable: v850 at 2022-11-04T22:00:00
Running batch 0 inference: 40%|████ | 2/5 [01:08<01:25, 28.62s/it]
Total Ensemble Batches: 0%| | 0/4 [01:08<?, ?it/s]
Fetching ARCO data: 31%|███ | 8/26 [00:11<00:23, 1.32s/it]
Fetching ARCO data: 35%|███▍ | 9/26 [00:11<00:20, 1.19s/it]
2025-01-23 04:51:14.208 | DEBUG | earth2studio.data.arco:fetch_array:227 - Fetching ARCO zarr array for variable: v500 at 2022-11-04T22:00:00
Running batch 0 inference: 40%|████ | 2/5 [01:08<01:25, 28.62s/it]
Total Ensemble Batches: 0%| | 0/4 [01:08<?, ?it/s]
Fetching ARCO data: 46%|████▌ | 12/26 [00:11<00:16, 1.19s/it]
2025-01-23 04:51:14.406 | DEBUG | earth2studio.data.arco:fetch_array:227 - Fetching ARCO zarr array for variable: v250 at 2022-11-04T22:00:00
Running batch 0 inference: 40%|████ | 2/5 [01:08<01:25, 28.62s/it]
Total Ensemble Batches: 0%| | 0/4 [01:08<?, ?it/s]
Fetching ARCO data: 46%|████▌ | 12/26 [00:11<00:16, 1.19s/it]
2025-01-23 04:51:14.603 | DEBUG | earth2studio.data.arco:fetch_array:227 - Fetching ARCO zarr array for variable: z1000 at 2022-11-04T22:00:00
Running batch 0 inference: 40%|████ | 2/5 [01:08<01:25, 28.62s/it]
Total Ensemble Batches: 0%| | 0/4 [01:08<?, ?it/s]
Fetching ARCO data: 46%|████▌ | 12/26 [00:11<00:16, 1.19s/it]
2025-01-23 04:51:16.396 | DEBUG | earth2studio.data.arco:fetch_array:227 - Fetching ARCO zarr array for variable: z850 at 2022-11-04T22:00:00
Running batch 0 inference: 40%|████ | 2/5 [01:10<01:25, 28.62s/it]
Total Ensemble Batches: 0%| | 0/4 [01:10<?, ?it/s]
Fetching ARCO data: 46%|████▌ | 12/26 [00:13<00:16, 1.19s/it]
Fetching ARCO data: 50%|█████ | 13/26 [00:13<00:12, 1.08it/s]
2025-01-23 04:51:16.588 | DEBUG | earth2studio.data.arco:fetch_array:227 - Fetching ARCO zarr array for variable: z500 at 2022-11-04T22:00:00
Running batch 0 inference: 40%|████ | 2/5 [01:10<01:25, 28.62s/it]
Total Ensemble Batches: 0%| | 0/4 [01:10<?, ?it/s]
Fetching ARCO data: 62%|██████▏ | 16/26 [00:13<00:09, 1.08it/s]
2025-01-23 04:51:16.765 | DEBUG | earth2studio.data.arco:fetch_array:227 - Fetching ARCO zarr array for variable: z250 at 2022-11-04T22:00:00
Running batch 0 inference: 40%|████ | 2/5 [01:11<01:25, 28.62s/it]
Total Ensemble Batches: 0%| | 0/4 [01:11<?, ?it/s]
Fetching ARCO data: 62%|██████▏ | 16/26 [00:13<00:09, 1.08it/s]
2025-01-23 04:51:16.944 | DEBUG | earth2studio.data.arco:fetch_array:227 - Fetching ARCO zarr array for variable: t1000 at 2022-11-04T22:00:00
Running batch 0 inference: 40%|████ | 2/5 [01:11<01:25, 28.62s/it]
Total Ensemble Batches: 0%| | 0/4 [01:11<?, ?it/s]
Fetching ARCO data: 62%|██████▏ | 16/26 [00:13<00:09, 1.08it/s]
2025-01-23 04:51:19.987 | DEBUG | earth2studio.data.arco:fetch_array:227 - Fetching ARCO zarr array for variable: t850 at 2022-11-04T22:00:00
Running batch 0 inference: 40%|████ | 2/5 [01:14<01:25, 28.62s/it]
Total Ensemble Batches: 0%| | 0/4 [01:14<?, ?it/s]
Fetching ARCO data: 62%|██████▏ | 16/26 [00:17<00:09, 1.08it/s]
Fetching ARCO data: 65%|██████▌ | 17/26 [00:17<00:08, 1.09it/s]
2025-01-23 04:51:20.186 | DEBUG | earth2studio.data.arco:fetch_array:227 - Fetching ARCO zarr array for variable: t500 at 2022-11-04T22:00:00
Running batch 0 inference: 40%|████ | 2/5 [01:14<01:25, 28.62s/it]
Total Ensemble Batches: 0%| | 0/4 [01:14<?, ?it/s]
Fetching ARCO data: 77%|███████▋ | 20/26 [00:17<00:05, 1.09it/s]
2025-01-23 04:51:20.372 | DEBUG | earth2studio.data.arco:fetch_array:227 - Fetching ARCO zarr array for variable: t250 at 2022-11-04T22:00:00
Running batch 0 inference: 40%|████ | 2/5 [01:14<01:25, 28.62s/it]
Total Ensemble Batches: 0%| | 0/4 [01:14<?, ?it/s]
Fetching ARCO data: 77%|███████▋ | 20/26 [00:17<00:05, 1.09it/s]
2025-01-23 04:51:20.557 | DEBUG | earth2studio.data.arco:fetch_array:227 - Fetching ARCO zarr array for variable: q1000 at 2022-11-04T22:00:00
Running batch 0 inference: 40%|████ | 2/5 [01:14<01:25, 28.62s/it]
Total Ensemble Batches: 0%| | 0/4 [01:14<?, ?it/s]
Fetching ARCO data: 77%|███████▋ | 20/26 [00:17<00:05, 1.09it/s]
2025-01-23 04:51:24.114 | DEBUG | earth2studio.data.arco:fetch_array:227 - Fetching ARCO zarr array for variable: q850 at 2022-11-04T22:00:00
Running batch 0 inference: 40%|████ | 2/5 [01:18<01:25, 28.62s/it]
Total Ensemble Batches: 0%| | 0/4 [01:18<?, ?it/s]
Fetching ARCO data: 77%|███████▋ | 20/26 [00:21<00:05, 1.09it/s]
Fetching ARCO data: 81%|████████ | 21/26 [00:21<00:04, 1.04it/s]
2025-01-23 04:51:24.319 | DEBUG | earth2studio.data.arco:fetch_array:227 - Fetching ARCO zarr array for variable: q500 at 2022-11-04T22:00:00
Running batch 0 inference: 40%|████ | 2/5 [01:18<01:25, 28.62s/it]
Total Ensemble Batches: 0%| | 0/4 [01:18<?, ?it/s]
Fetching ARCO data: 92%|█████████▏| 24/26 [00:21<00:01, 1.04it/s]
2025-01-23 04:51:24.508 | DEBUG | earth2studio.data.arco:fetch_array:227 - Fetching ARCO zarr array for variable: q250 at 2022-11-04T22:00:00
Running batch 0 inference: 40%|████ | 2/5 [01:18<01:25, 28.62s/it]
Total Ensemble Batches: 0%| | 0/4 [01:18<?, ?it/s]
Fetching ARCO data: 92%|█████████▏| 24/26 [00:21<00:01, 1.04it/s]
Fetching ARCO data: 96%|█████████▌| 25/26 [00:21<00:00, 1.50it/s]
Fetching ARCO data: 100%|██████████| 26/26 [00:21<00:00, 1.20it/s]
Running batch 0 inference: 60%|██████ | 3/5 [01:54<01:21, 40.53s/it]
Fetching ARCO data: 0%| | 0/26 [00:00<?, ?it/s]
2025-01-23 04:52:00.164 | DEBUG | earth2studio.data.arco:fetch_array:227 - Fetching ARCO zarr array for variable: u10m at 2022-11-04T23:00:00
Running batch 0 inference: 60%|██████ | 3/5 [01:54<01:21, 40.53s/it]
Total Ensemble Batches: 0%| | 0/4 [01:54<?, ?it/s]
Fetching ARCO data: 0%| | 0/26 [00:00<?, ?it/s]
2025-01-23 04:52:00.792 | DEBUG | earth2studio.data.arco:fetch_array:227 - Fetching ARCO zarr array for variable: v10m at 2022-11-04T23:00:00
Running batch 0 inference: 60%|██████ | 3/5 [01:55<01:21, 40.53s/it]
Total Ensemble Batches: 0%| | 0/4 [01:55<?, ?it/s]
Fetching ARCO data: 0%| | 0/26 [00:00<?, ?it/s]
2025-01-23 04:52:01.516 | DEBUG | earth2studio.data.arco:fetch_array:227 - Fetching ARCO zarr array for variable: t2m at 2022-11-04T23:00:00
Running batch 0 inference: 60%|██████ | 3/5 [01:55<01:21, 40.53s/it]
Total Ensemble Batches: 0%| | 0/4 [01:55<?, ?it/s]
Fetching ARCO data: 0%| | 0/26 [00:01<?, ?it/s]
2025-01-23 04:52:02.169 | DEBUG | earth2studio.data.arco:fetch_array:227 - Fetching ARCO zarr array for variable: tcwv at 2022-11-04T23:00:00
Running batch 0 inference: 60%|██████ | 3/5 [01:56<01:21, 40.53s/it]
Total Ensemble Batches: 0%| | 0/4 [01:56<?, ?it/s]
Fetching ARCO data: 0%| | 0/26 [00:02<?, ?it/s]
Fetching ARCO data: 4%|▍ | 1/26 [00:02<01:06, 2.68s/it]
2025-01-23 04:52:02.854 | DEBUG | earth2studio.data.arco:fetch_array:227 - Fetching ARCO zarr array for variable: msl at 2022-11-04T23:00:00
Running batch 0 inference: 60%|██████ | 3/5 [01:57<01:21, 40.53s/it]
Total Ensemble Batches: 0%| | 0/4 [01:57<?, ?it/s]
Fetching ARCO data: 15%|█▌ | 4/26 [00:02<00:58, 2.68s/it]
2025-01-23 04:52:03.490 | DEBUG | earth2studio.data.arco:fetch_array:227 - Fetching ARCO zarr array for variable: sp at 2022-11-04T23:00:00
Running batch 0 inference: 60%|██████ | 3/5 [01:57<01:21, 40.53s/it]
Total Ensemble Batches: 0%| | 0/4 [01:57<?, ?it/s]
Fetching ARCO data: 15%|█▌ | 4/26 [00:03<00:58, 2.68s/it]
2025-01-23 04:52:03.884 | DEBUG | earth2studio.data.arco:fetch_array:227 - Fetching ARCO zarr array for variable: u1000 at 2022-11-04T23:00:00
Running batch 0 inference: 60%|██████ | 3/5 [01:58<01:21, 40.53s/it]
Total Ensemble Batches: 0%| | 0/4 [01:58<?, ?it/s]
Fetching ARCO data: 15%|█▌ | 4/26 [00:03<00:58, 2.68s/it]
2025-01-23 04:52:06.075 | DEBUG | earth2studio.data.arco:fetch_array:227 - Fetching ARCO zarr array for variable: u850 at 2022-11-04T23:00:00
Running batch 0 inference: 60%|██████ | 3/5 [02:00<01:21, 40.53s/it]
Total Ensemble Batches: 0%| | 0/4 [02:00<?, ?it/s]
Fetching ARCO data: 15%|█▌ | 4/26 [00:05<00:58, 2.68s/it]
Fetching ARCO data: 19%|█▉ | 5/26 [00:06<00:23, 1.13s/it]
2025-01-23 04:52:06.295 | DEBUG | earth2studio.data.arco:fetch_array:227 - Fetching ARCO zarr array for variable: u500 at 2022-11-04T23:00:00
Running batch 0 inference: 60%|██████ | 3/5 [02:00<01:21, 40.53s/it]
Total Ensemble Batches: 0%| | 0/4 [02:00<?, ?it/s]
Fetching ARCO data: 31%|███ | 8/26 [00:06<00:20, 1.13s/it]
2025-01-23 04:52:06.490 | DEBUG | earth2studio.data.arco:fetch_array:227 - Fetching ARCO zarr array for variable: u250 at 2022-11-04T23:00:00
Running batch 0 inference: 60%|██████ | 3/5 [02:00<01:21, 40.53s/it]
Total Ensemble Batches: 0%| | 0/4 [02:00<?, ?it/s]
Fetching ARCO data: 31%|███ | 8/26 [00:06<00:20, 1.13s/it]
2025-01-23 04:52:06.683 | DEBUG | earth2studio.data.arco:fetch_array:227 - Fetching ARCO zarr array for variable: v1000 at 2022-11-04T23:00:00
Running batch 0 inference: 60%|██████ | 3/5 [02:00<01:21, 40.53s/it]
Total Ensemble Batches: 0%| | 0/4 [02:01<?, ?it/s]
Fetching ARCO data: 31%|███ | 8/26 [00:06<00:20, 1.13s/it]
2025-01-23 04:52:09.690 | DEBUG | earth2studio.data.arco:fetch_array:227 - Fetching ARCO zarr array for variable: v850 at 2022-11-04T23:00:00
Running batch 0 inference: 60%|██████ | 3/5 [02:03<01:21, 40.53s/it]
Total Ensemble Batches: 0%| | 0/4 [02:04<?, ?it/s]
Fetching ARCO data: 31%|███ | 8/26 [00:09<00:20, 1.13s/it]
Fetching ARCO data: 35%|███▍ | 9/26 [00:09<00:17, 1.01s/it]
2025-01-23 04:52:09.904 | DEBUG | earth2studio.data.arco:fetch_array:227 - Fetching ARCO zarr array for variable: v500 at 2022-11-04T23:00:00
Running batch 0 inference: 60%|██████ | 3/5 [02:04<01:21, 40.53s/it]
Total Ensemble Batches: 0%| | 0/4 [02:04<?, ?it/s]
Fetching ARCO data: 46%|████▌ | 12/26 [00:09<00:14, 1.01s/it]
2025-01-23 04:52:10.102 | DEBUG | earth2studio.data.arco:fetch_array:227 - Fetching ARCO zarr array for variable: v250 at 2022-11-04T23:00:00
Running batch 0 inference: 60%|██████ | 3/5 [02:04<01:21, 40.53s/it]
Total Ensemble Batches: 0%| | 0/4 [02:04<?, ?it/s]
Fetching ARCO data: 46%|████▌ | 12/26 [00:09<00:14, 1.01s/it]
2025-01-23 04:52:10.299 | DEBUG | earth2studio.data.arco:fetch_array:227 - Fetching ARCO zarr array for variable: z1000 at 2022-11-04T23:00:00
Running batch 0 inference: 60%|██████ | 3/5 [02:04<01:21, 40.53s/it]
Total Ensemble Batches: 0%| | 0/4 [02:04<?, ?it/s]
Fetching ARCO data: 46%|████▌ | 12/26 [00:10<00:14, 1.01s/it]
2025-01-23 04:52:12.480 | DEBUG | earth2studio.data.arco:fetch_array:227 - Fetching ARCO zarr array for variable: z850 at 2022-11-04T23:00:00
Running batch 0 inference: 60%|██████ | 3/5 [02:06<01:21, 40.53s/it]
Total Ensemble Batches: 0%| | 0/4 [02:06<?, ?it/s]
Fetching ARCO data: 46%|████▌ | 12/26 [00:12<00:14, 1.01s/it]
Fetching ARCO data: 50%|█████ | 13/26 [00:12<00:11, 1.15it/s]
2025-01-23 04:52:12.671 | DEBUG | earth2studio.data.arco:fetch_array:227 - Fetching ARCO zarr array for variable: z500 at 2022-11-04T23:00:00
Running batch 0 inference: 60%|██████ | 3/5 [02:06<01:21, 40.53s/it]
Total Ensemble Batches: 0%| | 0/4 [02:07<?, ?it/s]
Fetching ARCO data: 62%|██████▏ | 16/26 [00:12<00:08, 1.15it/s]
2025-01-23 04:52:12.847 | DEBUG | earth2studio.data.arco:fetch_array:227 - Fetching ARCO zarr array for variable: z250 at 2022-11-04T23:00:00
Running batch 0 inference: 60%|██████ | 3/5 [02:07<01:21, 40.53s/it]
Total Ensemble Batches: 0%| | 0/4 [02:07<?, ?it/s]
Fetching ARCO data: 62%|██████▏ | 16/26 [00:12<00:08, 1.15it/s]
2025-01-23 04:52:13.025 | DEBUG | earth2studio.data.arco:fetch_array:227 - Fetching ARCO zarr array for variable: t1000 at 2022-11-04T23:00:00
Running batch 0 inference: 60%|██████ | 3/5 [02:07<01:21, 40.53s/it]
Total Ensemble Batches: 0%| | 0/4 [02:07<?, ?it/s]
Fetching ARCO data: 62%|██████▏ | 16/26 [00:12<00:08, 1.15it/s]
2025-01-23 04:52:15.734 | DEBUG | earth2studio.data.arco:fetch_array:227 - Fetching ARCO zarr array for variable: t850 at 2022-11-04T23:00:00
Running batch 0 inference: 60%|██████ | 3/5 [02:10<01:21, 40.53s/it]
Total Ensemble Batches: 0%| | 0/4 [02:10<?, ?it/s]
Fetching ARCO data: 62%|██████▏ | 16/26 [00:15<00:08, 1.15it/s]
Fetching ARCO data: 65%|██████▌ | 17/26 [00:15<00:07, 1.18it/s]
2025-01-23 04:52:15.934 | DEBUG | earth2studio.data.arco:fetch_array:227 - Fetching ARCO zarr array for variable: t500 at 2022-11-04T23:00:00
Running batch 0 inference: 60%|██████ | 3/5 [02:10<01:21, 40.53s/it]
Total Ensemble Batches: 0%| | 0/4 [02:10<?, ?it/s]
Fetching ARCO data: 77%|███████▋ | 20/26 [00:15<00:05, 1.18it/s]
2025-01-23 04:52:16.117 | DEBUG | earth2studio.data.arco:fetch_array:227 - Fetching ARCO zarr array for variable: t250 at 2022-11-04T23:00:00
Running batch 0 inference: 60%|██████ | 3/5 [02:10<01:21, 40.53s/it]
Total Ensemble Batches: 0%| | 0/4 [02:10<?, ?it/s]
Fetching ARCO data: 77%|███████▋ | 20/26 [00:15<00:05, 1.18it/s]
2025-01-23 04:52:16.300 | DEBUG | earth2studio.data.arco:fetch_array:227 - Fetching ARCO zarr array for variable: q1000 at 2022-11-04T23:00:00
Running batch 0 inference: 60%|██████ | 3/5 [02:10<01:21, 40.53s/it]
Total Ensemble Batches: 0%| | 0/4 [02:10<?, ?it/s]
Fetching ARCO data: 77%|███████▋ | 20/26 [00:16<00:05, 1.18it/s]
2025-01-23 04:52:19.252 | DEBUG | earth2studio.data.arco:fetch_array:227 - Fetching ARCO zarr array for variable: q850 at 2022-11-04T23:00:00
Running batch 0 inference: 60%|██████ | 3/5 [02:13<01:21, 40.53s/it]
Total Ensemble Batches: 0%| | 0/4 [02:13<?, ?it/s]
Fetching ARCO data: 77%|███████▋ | 20/26 [00:19<00:05, 1.18it/s]
Fetching ARCO data: 81%|████████ | 21/26 [00:19<00:04, 1.16it/s]
2025-01-23 04:52:19.456 | DEBUG | earth2studio.data.arco:fetch_array:227 - Fetching ARCO zarr array for variable: q500 at 2022-11-04T23:00:00
Running batch 0 inference: 60%|██████ | 3/5 [02:13<01:21, 40.53s/it]
Total Ensemble Batches: 0%| | 0/4 [02:13<?, ?it/s]
Fetching ARCO data: 92%|█████████▏| 24/26 [00:19<00:01, 1.16it/s]
2025-01-23 04:52:19.645 | DEBUG | earth2studio.data.arco:fetch_array:227 - Fetching ARCO zarr array for variable: q250 at 2022-11-04T23:00:00
Running batch 0 inference: 60%|██████ | 3/5 [02:13<01:21, 40.53s/it]
Total Ensemble Batches: 0%| | 0/4 [02:14<?, ?it/s]
Fetching ARCO data: 92%|█████████▏| 24/26 [00:19<00:01, 1.16it/s]
Fetching ARCO data: 96%|█████████▌| 25/26 [00:19<00:00, 1.66it/s]
Fetching ARCO data: 100%|██████████| 26/26 [00:19<00:00, 1.32it/s]
Running batch 0 inference: 80%|████████ | 4/5 [02:49<00:46, 46.02s/it]
Fetching ARCO data: 0%| | 0/26 [00:00<?, ?it/s]
2025-01-23 04:52:55.412 | DEBUG | earth2studio.data.arco:fetch_array:227 - Fetching ARCO zarr array for variable: u10m at 2022-11-05T00:00:00
Running batch 0 inference: 80%|████████ | 4/5 [02:49<00:46, 46.02s/it]
Total Ensemble Batches: 0%| | 0/4 [02:49<?, ?it/s]
Fetching ARCO data: 0%| | 0/26 [00:00<?, ?it/s]
2025-01-23 04:52:56.429 | DEBUG | earth2studio.data.arco:fetch_array:227 - Fetching ARCO zarr array for variable: v10m at 2022-11-05T00:00:00
Running batch 0 inference: 80%|████████ | 4/5 [02:50<00:46, 46.02s/it]
Total Ensemble Batches: 0%| | 0/4 [02:50<?, ?it/s]
Fetching ARCO data: 0%| | 0/26 [00:01<?, ?it/s]
2025-01-23 04:52:57.277 | DEBUG | earth2studio.data.arco:fetch_array:227 - Fetching ARCO zarr array for variable: t2m at 2022-11-05T00:00:00
Running batch 0 inference: 80%|████████ | 4/5 [02:51<00:46, 46.02s/it]
Total Ensemble Batches: 0%| | 0/4 [02:51<?, ?it/s]
Fetching ARCO data: 0%| | 0/26 [00:01<?, ?it/s]
2025-01-23 04:52:58.071 | DEBUG | earth2studio.data.arco:fetch_array:227 - Fetching ARCO zarr array for variable: tcwv at 2022-11-05T00:00:00
Running batch 0 inference: 80%|████████ | 4/5 [02:52<00:46, 46.02s/it]
Total Ensemble Batches: 0%| | 0/4 [02:52<?, ?it/s]
Fetching ARCO data: 0%| | 0/26 [00:02<?, ?it/s]
Fetching ARCO data: 4%|▍ | 1/26 [00:03<01:25, 3.43s/it]
2025-01-23 04:52:58.848 | DEBUG | earth2studio.data.arco:fetch_array:227 - Fetching ARCO zarr array for variable: msl at 2022-11-05T00:00:00
Running batch 0 inference: 80%|████████ | 4/5 [02:53<00:46, 46.02s/it]
Total Ensemble Batches: 0%| | 0/4 [02:53<?, ?it/s]
Fetching ARCO data: 15%|█▌ | 4/26 [00:03<01:15, 3.43s/it]
2025-01-23 04:52:59.540 | DEBUG | earth2studio.data.arco:fetch_array:227 - Fetching ARCO zarr array for variable: sp at 2022-11-05T00:00:00
Running batch 0 inference: 80%|████████ | 4/5 [02:53<00:46, 46.02s/it]
Total Ensemble Batches: 0%| | 0/4 [02:53<?, ?it/s]
Fetching ARCO data: 15%|█▌ | 4/26 [00:04<01:15, 3.43s/it]
2025-01-23 04:53:00.214 | DEBUG | earth2studio.data.arco:fetch_array:227 - Fetching ARCO zarr array for variable: u1000 at 2022-11-05T00:00:00
Running batch 0 inference: 80%|████████ | 4/5 [02:54<00:46, 46.02s/it]
Total Ensemble Batches: 0%| | 0/4 [02:54<?, ?it/s]
Fetching ARCO data: 15%|█▌ | 4/26 [00:04<01:15, 3.43s/it]
2025-01-23 04:53:04.131 | DEBUG | earth2studio.data.arco:fetch_array:227 - Fetching ARCO zarr array for variable: u850 at 2022-11-05T00:00:00
Running batch 0 inference: 80%|████████ | 4/5 [02:58<00:46, 46.02s/it]
Total Ensemble Batches: 0%| | 0/4 [02:58<?, ?it/s]
Fetching ARCO data: 15%|█▌ | 4/26 [00:08<01:15, 3.43s/it]
Fetching ARCO data: 19%|█▉ | 5/26 [00:08<00:35, 1.68s/it]
2025-01-23 04:53:04.342 | DEBUG | earth2studio.data.arco:fetch_array:227 - Fetching ARCO zarr array for variable: u500 at 2022-11-05T00:00:00
Running batch 0 inference: 80%|████████ | 4/5 [02:58<00:46, 46.02s/it]
Total Ensemble Batches: 0%| | 0/4 [02:58<?, ?it/s]
Fetching ARCO data: 31%|███ | 8/26 [00:08<00:30, 1.68s/it]
2025-01-23 04:53:04.535 | DEBUG | earth2studio.data.arco:fetch_array:227 - Fetching ARCO zarr array for variable: u250 at 2022-11-05T00:00:00
Running batch 0 inference: 80%|████████ | 4/5 [02:58<00:46, 46.02s/it]
Total Ensemble Batches: 0%| | 0/4 [02:58<?, ?it/s]
Fetching ARCO data: 31%|███ | 8/26 [00:09<00:30, 1.68s/it]
2025-01-23 04:53:04.728 | DEBUG | earth2studio.data.arco:fetch_array:227 - Fetching ARCO zarr array for variable: v1000 at 2022-11-05T00:00:00
Running batch 0 inference: 80%|████████ | 4/5 [02:59<00:46, 46.02s/it]
Total Ensemble Batches: 0%| | 0/4 [02:59<?, ?it/s]
Fetching ARCO data: 31%|███ | 8/26 [00:09<00:30, 1.68s/it]
2025-01-23 04:53:08.650 | DEBUG | earth2studio.data.arco:fetch_array:227 - Fetching ARCO zarr array for variable: v850 at 2022-11-05T00:00:00
Running batch 0 inference: 80%|████████ | 4/5 [03:02<00:46, 46.02s/it]
Total Ensemble Batches: 0%| | 0/4 [03:03<?, ?it/s]
Fetching ARCO data: 31%|███ | 8/26 [00:13<00:30, 1.68s/it]
Fetching ARCO data: 35%|███▍ | 9/26 [00:13<00:23, 1.38s/it]
2025-01-23 04:53:08.865 | DEBUG | earth2studio.data.arco:fetch_array:227 - Fetching ARCO zarr array for variable: v500 at 2022-11-05T00:00:00
Running batch 0 inference: 80%|████████ | 4/5 [03:03<00:46, 46.02s/it]
Total Ensemble Batches: 0%| | 0/4 [03:03<?, ?it/s]
Fetching ARCO data: 46%|████▌ | 12/26 [00:13<00:19, 1.38s/it]
2025-01-23 04:53:09.064 | DEBUG | earth2studio.data.arco:fetch_array:227 - Fetching ARCO zarr array for variable: v250 at 2022-11-05T00:00:00
Running batch 0 inference: 80%|████████ | 4/5 [03:03<00:46, 46.02s/it]
Total Ensemble Batches: 0%| | 0/4 [03:03<?, ?it/s]
Fetching ARCO data: 46%|████▌ | 12/26 [00:13<00:19, 1.38s/it]
2025-01-23 04:53:09.260 | DEBUG | earth2studio.data.arco:fetch_array:227 - Fetching ARCO zarr array for variable: z1000 at 2022-11-05T00:00:00
Running batch 0 inference: 80%|████████ | 4/5 [03:03<00:46, 46.02s/it]
Total Ensemble Batches: 0%| | 0/4 [03:03<?, ?it/s]
Fetching ARCO data: 46%|████▌ | 12/26 [00:13<00:19, 1.38s/it]
2025-01-23 04:53:12.000 | DEBUG | earth2studio.data.arco:fetch_array:227 - Fetching ARCO zarr array for variable: z850 at 2022-11-05T00:00:00
Running batch 0 inference: 80%|████████ | 4/5 [03:06<00:46, 46.02s/it]
Total Ensemble Batches: 0%| | 0/4 [03:06<?, ?it/s]
Fetching ARCO data: 46%|████▌ | 12/26 [00:16<00:19, 1.38s/it]
Fetching ARCO data: 50%|█████ | 13/26 [00:16<00:14, 1.14s/it]
2025-01-23 04:53:12.191 | DEBUG | earth2studio.data.arco:fetch_array:227 - Fetching ARCO zarr array for variable: z500 at 2022-11-05T00:00:00
Running batch 0 inference: 80%|████████ | 4/5 [03:06<00:46, 46.02s/it]
Total Ensemble Batches: 0%| | 0/4 [03:06<?, ?it/s]
Fetching ARCO data: 62%|██████▏ | 16/26 [00:16<00:11, 1.14s/it]
2025-01-23 04:53:12.372 | DEBUG | earth2studio.data.arco:fetch_array:227 - Fetching ARCO zarr array for variable: z250 at 2022-11-05T00:00:00
Running batch 0 inference: 80%|████████ | 4/5 [03:06<00:46, 46.02s/it]
Total Ensemble Batches: 0%| | 0/4 [03:06<?, ?it/s]
Fetching ARCO data: 62%|██████▏ | 16/26 [00:16<00:11, 1.14s/it]
2025-01-23 04:53:12.550 | DEBUG | earth2studio.data.arco:fetch_array:227 - Fetching ARCO zarr array for variable: t1000 at 2022-11-05T00:00:00
Running batch 0 inference: 80%|████████ | 4/5 [03:06<00:46, 46.02s/it]
Total Ensemble Batches: 0%| | 0/4 [03:06<?, ?it/s]
Fetching ARCO data: 62%|██████▏ | 16/26 [00:17<00:11, 1.14s/it]
2025-01-23 04:53:15.511 | DEBUG | earth2studio.data.arco:fetch_array:227 - Fetching ARCO zarr array for variable: t850 at 2022-11-05T00:00:00
Running batch 0 inference: 80%|████████ | 4/5 [03:09<00:46, 46.02s/it]
Total Ensemble Batches: 0%| | 0/4 [03:09<?, ?it/s]
Fetching ARCO data: 62%|██████▏ | 16/26 [00:20<00:11, 1.14s/it]
Fetching ARCO data: 65%|██████▌ | 17/26 [00:20<00:09, 1.04s/it]
2025-01-23 04:53:15.710 | DEBUG | earth2studio.data.arco:fetch_array:227 - Fetching ARCO zarr array for variable: t500 at 2022-11-05T00:00:00
Running batch 0 inference: 80%|████████ | 4/5 [03:09<00:46, 46.02s/it]
Total Ensemble Batches: 0%| | 0/4 [03:10<?, ?it/s]
Fetching ARCO data: 77%|███████▋ | 20/26 [00:20<00:06, 1.04s/it]
2025-01-23 04:53:15.897 | DEBUG | earth2studio.data.arco:fetch_array:227 - Fetching ARCO zarr array for variable: t250 at 2022-11-05T00:00:00
Running batch 0 inference: 80%|████████ | 4/5 [03:10<00:46, 46.02s/it]
Total Ensemble Batches: 0%| | 0/4 [03:10<?, ?it/s]
Fetching ARCO data: 77%|███████▋ | 20/26 [00:20<00:06, 1.04s/it]
2025-01-23 04:53:16.081 | DEBUG | earth2studio.data.arco:fetch_array:227 - Fetching ARCO zarr array for variable: q1000 at 2022-11-05T00:00:00
Running batch 0 inference: 80%|████████ | 4/5 [03:10<00:46, 46.02s/it]
Total Ensemble Batches: 0%| | 0/4 [03:10<?, ?it/s]
Fetching ARCO data: 77%|███████▋ | 20/26 [00:20<00:06, 1.04s/it]
2025-01-23 04:53:18.827 | DEBUG | earth2studio.data.arco:fetch_array:227 - Fetching ARCO zarr array for variable: q850 at 2022-11-05T00:00:00
Running batch 0 inference: 80%|████████ | 4/5 [03:13<00:46, 46.02s/it]
Total Ensemble Batches: 0%| | 0/4 [03:13<?, ?it/s]
Fetching ARCO data: 77%|███████▋ | 20/26 [00:23<00:06, 1.04s/it]
Fetching ARCO data: 81%|████████ | 21/26 [00:23<00:04, 1.04it/s]
2025-01-23 04:53:19.033 | DEBUG | earth2studio.data.arco:fetch_array:227 - Fetching ARCO zarr array for variable: q500 at 2022-11-05T00:00:00
Running batch 0 inference: 80%|████████ | 4/5 [03:13<00:46, 46.02s/it]
Total Ensemble Batches: 0%| | 0/4 [03:13<?, ?it/s]
Fetching ARCO data: 92%|█████████▏| 24/26 [00:23<00:01, 1.04it/s]
2025-01-23 04:53:19.221 | DEBUG | earth2studio.data.arco:fetch_array:227 - Fetching ARCO zarr array for variable: q250 at 2022-11-05T00:00:00
Running batch 0 inference: 80%|████████ | 4/5 [03:13<00:46, 46.02s/it]
Total Ensemble Batches: 0%| | 0/4 [03:13<?, ?it/s]
Fetching ARCO data: 92%|█████████▏| 24/26 [00:23<00:01, 1.04it/s]
Fetching ARCO data: 96%|█████████▌| 25/26 [00:24<00:00, 1.49it/s]
Fetching ARCO data: 100%|██████████| 26/26 [00:24<00:00, 1.08it/s]
Running batch 0 inference: 100%|██████████| 5/5 [03:49<00:00, 50.75s/it]
Total Ensemble Batches: 25%|██▌ | 1/4 [03:49<11:28, 229.40s/it]
Running batch 2 inference: 0%| | 0/5 [00:00<?, ?it/s]
Fetching ARCO data: 0%| | 0/26 [00:00<?, ?it/s]
2025-01-23 04:53:55.208 | DEBUG | earth2studio.data.arco:fetch_array:227 - Fetching ARCO zarr array for variable: u10m at 2022-11-04T21:00:00
Fetching ARCO data: 0%| | 0/26 [00:00<?, ?it/s]
Total Ensemble Batches: 25%|██▌ | 1/4 [03:49<11:28, 229.40s/it]
Running batch 2 inference: 20%|██ | 1/5 [00:00<00:00, 12.31it/s]
2025-01-23 04:53:55.214 | DEBUG | earth2studio.data.arco:fetch_array:227 - Fetching ARCO zarr array for variable: v10m at 2022-11-04T21:00:00
Fetching ARCO data: 0%| | 0/26 [00:00<?, ?it/s]
Total Ensemble Batches: 25%|██▌ | 1/4 [03:49<11:28, 229.40s/it]
Running batch 2 inference: 20%|██ | 1/5 [00:00<00:00, 11.42it/s]
2025-01-23 04:53:55.221 | DEBUG | earth2studio.data.arco:fetch_array:227 - Fetching ARCO zarr array for variable: t2m at 2022-11-04T21:00:00
Fetching ARCO data: 0%| | 0/26 [00:00<?, ?it/s]
Total Ensemble Batches: 25%|██▌ | 1/4 [03:49<11:28, 229.40s/it]
Running batch 2 inference: 20%|██ | 1/5 [00:00<00:00, 10.64it/s]
2025-01-23 04:53:55.227 | DEBUG | earth2studio.data.arco:fetch_array:227 - Fetching ARCO zarr array for variable: tcwv at 2022-11-04T21:00:00
Fetching ARCO data: 0%| | 0/26 [00:00<?, ?it/s]
Total Ensemble Batches: 25%|██▌ | 1/4 [03:49<11:28, 229.40s/it]
Running batch 2 inference: 20%|██ | 1/5 [00:00<00:00, 10.00it/s]
2025-01-23 04:53:55.243 | DEBUG | earth2studio.data.arco:fetch_array:227 - Fetching ARCO zarr array for variable: msl at 2022-11-04T21:00:00
Fetching ARCO data: 15%|█▌ | 4/26 [00:00<00:00, 106.62it/s]
Total Ensemble Batches: 25%|██▌ | 1/4 [03:49<11:28, 229.40s/it]
Running batch 2 inference: 20%|██ | 1/5 [00:00<00:00, 8.61it/s]
2025-01-23 04:53:55.248 | DEBUG | earth2studio.data.arco:fetch_array:227 - Fetching ARCO zarr array for variable: sp at 2022-11-04T21:00:00
Fetching ARCO data: 15%|█▌ | 4/26 [00:00<00:00, 94.45it/s]
Total Ensemble Batches: 25%|██▌ | 1/4 [03:49<11:28, 229.40s/it]
Running batch 2 inference: 20%|██ | 1/5 [00:00<00:00, 8.27it/s]
2025-01-23 04:53:55.253 | DEBUG | earth2studio.data.arco:fetch_array:227 - Fetching ARCO zarr array for variable: u1000 at 2022-11-04T21:00:00
Fetching ARCO data: 15%|█▌ | 4/26 [00:00<00:00, 84.78it/s]
Total Ensemble Batches: 25%|██▌ | 1/4 [03:49<11:28, 229.40s/it]
Running batch 2 inference: 20%|██ | 1/5 [00:00<00:00, 7.95it/s]
2025-01-23 04:53:55.446 | DEBUG | earth2studio.data.arco:fetch_array:227 - Fetching ARCO zarr array for variable: u850 at 2022-11-04T21:00:00
Fetching ARCO data: 15%|█▌ | 4/26 [00:00<00:01, 16.62it/s]
Total Ensemble Batches: 25%|██▌ | 1/4 [03:49<11:28, 229.40s/it]
Running batch 2 inference: 20%|██ | 1/5 [00:00<00:01, 3.13it/s]
Fetching ARCO data: 19%|█▉ | 5/26 [00:00<00:01, 11.49it/s]
2025-01-23 04:53:55.648 | DEBUG | earth2studio.data.arco:fetch_array:227 - Fetching ARCO zarr array for variable: u500 at 2022-11-04T21:00:00
Fetching ARCO data: 31%|███ | 8/26 [00:00<00:01, 11.49it/s]
Total Ensemble Batches: 25%|██▌ | 1/4 [03:50<11:28, 229.40s/it]
Running batch 2 inference: 20%|██ | 1/5 [00:00<00:02, 1.92it/s]
2025-01-23 04:53:55.842 | DEBUG | earth2studio.data.arco:fetch_array:227 - Fetching ARCO zarr array for variable: u250 at 2022-11-04T21:00:00
Fetching ARCO data: 31%|███ | 8/26 [00:00<00:01, 11.49it/s]
Total Ensemble Batches: 25%|██▌ | 1/4 [03:50<11:28, 229.40s/it]
Running batch 2 inference: 20%|██ | 1/5 [00:00<00:02, 1.40it/s]
2025-01-23 04:53:56.036 | DEBUG | earth2studio.data.arco:fetch_array:227 - Fetching ARCO zarr array for variable: v1000 at 2022-11-04T21:00:00
Fetching ARCO data: 31%|███ | 8/26 [00:00<00:01, 11.49it/s]
Total Ensemble Batches: 25%|██▌ | 1/4 [03:50<11:28, 229.40s/it]
Running batch 2 inference: 20%|██ | 1/5 [00:00<00:03, 1.10it/s]
2025-01-23 04:53:56.239 | DEBUG | earth2studio.data.arco:fetch_array:227 - Fetching ARCO zarr array for variable: v850 at 2022-11-04T21:00:00
Fetching ARCO data: 31%|███ | 8/26 [00:01<00:01, 11.49it/s]
Total Ensemble Batches: 25%|██▌ | 1/4 [03:50<11:28, 229.40s/it]
Running batch 2 inference: 20%|██ | 1/5 [00:01<00:04, 1.11s/it]
Fetching ARCO data: 35%|███▍ | 9/26 [00:01<00:02, 6.82it/s]
2025-01-23 04:53:56.444 | DEBUG | earth2studio.data.arco:fetch_array:227 - Fetching ARCO zarr array for variable: v500 at 2022-11-04T21:00:00
Fetching ARCO data: 46%|████▌ | 12/26 [00:01<00:02, 6.82it/s]
Total Ensemble Batches: 25%|██▌ | 1/4 [03:50<11:28, 229.40s/it]
Running batch 2 inference: 20%|██ | 1/5 [00:01<00:05, 1.32s/it]
2025-01-23 04:53:56.641 | DEBUG | earth2studio.data.arco:fetch_array:227 - Fetching ARCO zarr array for variable: v250 at 2022-11-04T21:00:00
Fetching ARCO data: 46%|████▌ | 12/26 [00:01<00:02, 6.82it/s]
Total Ensemble Batches: 25%|██▌ | 1/4 [03:51<11:28, 229.40s/it]
Running batch 2 inference: 20%|██ | 1/5 [00:01<00:06, 1.51s/it]
2025-01-23 04:53:56.838 | DEBUG | earth2studio.data.arco:fetch_array:227 - Fetching ARCO zarr array for variable: z1000 at 2022-11-04T21:00:00
Fetching ARCO data: 46%|████▌ | 12/26 [00:01<00:02, 6.82it/s]
Total Ensemble Batches: 25%|██▌ | 1/4 [03:51<11:28, 229.40s/it]
Running batch 2 inference: 20%|██ | 1/5 [00:01<00:06, 1.71s/it]
2025-01-23 04:53:57.015 | DEBUG | earth2studio.data.arco:fetch_array:227 - Fetching ARCO zarr array for variable: z850 at 2022-11-04T21:00:00
Fetching ARCO data: 46%|████▌ | 12/26 [00:01<00:02, 6.82it/s]
Total Ensemble Batches: 25%|██▌ | 1/4 [03:51<11:28, 229.40s/it]
Running batch 2 inference: 20%|██ | 1/5 [00:01<00:07, 1.89s/it]
Fetching ARCO data: 50%|█████ | 13/26 [00:01<00:02, 6.06it/s]
2025-01-23 04:53:57.201 | DEBUG | earth2studio.data.arco:fetch_array:227 - Fetching ARCO zarr array for variable: z500 at 2022-11-04T21:00:00
Fetching ARCO data: 62%|██████▏ | 16/26 [00:01<00:01, 6.06it/s]
Total Ensemble Batches: 25%|██▌ | 1/4 [03:51<11:28, 229.40s/it]
Running batch 2 inference: 20%|██ | 1/5 [00:02<00:08, 2.07s/it]
2025-01-23 04:53:57.379 | DEBUG | earth2studio.data.arco:fetch_array:227 - Fetching ARCO zarr array for variable: z250 at 2022-11-04T21:00:00
Fetching ARCO data: 62%|██████▏ | 16/26 [00:02<00:01, 6.06it/s]
Total Ensemble Batches: 25%|██▌ | 1/4 [03:51<11:28, 229.40s/it]
Running batch 2 inference: 20%|██ | 1/5 [00:02<00:09, 2.25s/it]
2025-01-23 04:53:57.557 | DEBUG | earth2studio.data.arco:fetch_array:227 - Fetching ARCO zarr array for variable: t1000 at 2022-11-04T21:00:00
Fetching ARCO data: 62%|██████▏ | 16/26 [00:02<00:01, 6.06it/s]
Total Ensemble Batches: 25%|██▌ | 1/4 [03:51<11:28, 229.40s/it]
Running batch 2 inference: 20%|██ | 1/5 [00:02<00:09, 2.43s/it]
2025-01-23 04:53:57.741 | DEBUG | earth2studio.data.arco:fetch_array:227 - Fetching ARCO zarr array for variable: t850 at 2022-11-04T21:00:00
Fetching ARCO data: 62%|██████▏ | 16/26 [00:02<00:01, 6.06it/s]
Total Ensemble Batches: 25%|██▌ | 1/4 [03:52<11:28, 229.40s/it]
Running batch 2 inference: 20%|██ | 1/5 [00:02<00:10, 2.61s/it]
Fetching ARCO data: 65%|██████▌ | 17/26 [00:02<00:01, 5.81it/s]
2025-01-23 04:53:57.934 | DEBUG | earth2studio.data.arco:fetch_array:227 - Fetching ARCO zarr array for variable: t500 at 2022-11-04T21:00:00
Fetching ARCO data: 77%|███████▋ | 20/26 [00:02<00:01, 5.81it/s]
Total Ensemble Batches: 25%|██▌ | 1/4 [03:52<11:28, 229.40s/it]
Running batch 2 inference: 20%|██ | 1/5 [00:02<00:11, 2.81s/it]
2025-01-23 04:53:58.118 | DEBUG | earth2studio.data.arco:fetch_array:227 - Fetching ARCO zarr array for variable: t250 at 2022-11-04T21:00:00
Fetching ARCO data: 77%|███████▋ | 20/26 [00:02<00:01, 5.81it/s]
Total Ensemble Batches: 25%|██▌ | 1/4 [03:52<11:28, 229.40s/it]
Running batch 2 inference: 20%|██ | 1/5 [00:02<00:11, 2.99s/it]
2025-01-23 04:53:58.302 | DEBUG | earth2studio.data.arco:fetch_array:227 - Fetching ARCO zarr array for variable: q1000 at 2022-11-04T21:00:00
Fetching ARCO data: 77%|███████▋ | 20/26 [00:03<00:01, 5.81it/s]
Total Ensemble Batches: 25%|██▌ | 1/4 [03:52<11:28, 229.40s/it]
Running batch 2 inference: 20%|██ | 1/5 [00:03<00:12, 3.18s/it]
2025-01-23 04:53:58.491 | DEBUG | earth2studio.data.arco:fetch_array:227 - Fetching ARCO zarr array for variable: q850 at 2022-11-04T21:00:00
Fetching ARCO data: 77%|███████▋ | 20/26 [00:03<00:01, 5.81it/s]
Total Ensemble Batches: 25%|██▌ | 1/4 [03:52<11:28, 229.40s/it]
Running batch 2 inference: 20%|██ | 1/5 [00:03<00:13, 3.36s/it]
Fetching ARCO data: 81%|████████ | 21/26 [00:03<00:00, 5.63it/s]
2025-01-23 04:53:58.687 | DEBUG | earth2studio.data.arco:fetch_array:227 - Fetching ARCO zarr array for variable: q500 at 2022-11-04T21:00:00
Fetching ARCO data: 92%|█████████▏| 24/26 [00:03<00:00, 5.63it/s]
Total Ensemble Batches: 25%|██▌ | 1/4 [03:53<11:28, 229.40s/it]
Running batch 2 inference: 20%|██ | 1/5 [00:03<00:14, 3.56s/it]
2025-01-23 04:53:58.885 | DEBUG | earth2studio.data.arco:fetch_array:227 - Fetching ARCO zarr array for variable: q250 at 2022-11-04T21:00:00
Fetching ARCO data: 92%|█████████▏| 24/26 [00:03<00:00, 5.63it/s]
Total Ensemble Batches: 25%|██▌ | 1/4 [03:53<11:28, 229.40s/it]
Running batch 2 inference: 20%|██ | 1/5 [00:03<00:15, 3.76s/it]
Fetching ARCO data: 96%|█████████▌| 25/26 [00:03<00:00, 6.61it/s]
Fetching ARCO data: 100%|██████████| 26/26 [00:03<00:00, 6.72it/s]
Running batch 2 inference: 40%|████ | 2/5 [00:39<00:59, 19.89s/it]
Fetching ARCO data: 0%| | 0/26 [00:00<?, ?it/s]
2025-01-23 04:54:34.921 | DEBUG | earth2studio.data.arco:fetch_array:227 - Fetching ARCO zarr array for variable: u10m at 2022-11-04T22:00:00
Fetching ARCO data: 0%| | 0/26 [00:00<?, ?it/s]
Total Ensemble Batches: 25%|██▌ | 1/4 [04:29<11:28, 229.40s/it]
Running batch 2 inference: 40%|████ | 2/5 [00:39<00:59, 19.89s/it]
2025-01-23 04:54:34.927 | DEBUG | earth2studio.data.arco:fetch_array:227 - Fetching ARCO zarr array for variable: v10m at 2022-11-04T22:00:00
Fetching ARCO data: 0%| | 0/26 [00:00<?, ?it/s]
Total Ensemble Batches: 25%|██▌ | 1/4 [04:29<11:28, 229.40s/it]
Running batch 2 inference: 40%|████ | 2/5 [00:39<00:59, 19.89s/it]
2025-01-23 04:54:34.933 | DEBUG | earth2studio.data.arco:fetch_array:227 - Fetching ARCO zarr array for variable: t2m at 2022-11-04T22:00:00
Fetching ARCO data: 0%| | 0/26 [00:00<?, ?it/s]
Total Ensemble Batches: 25%|██▌ | 1/4 [04:29<11:28, 229.40s/it]
Running batch 2 inference: 40%|████ | 2/5 [00:39<00:59, 19.89s/it]
2025-01-23 04:54:34.939 | DEBUG | earth2studio.data.arco:fetch_array:227 - Fetching ARCO zarr array for variable: tcwv at 2022-11-04T22:00:00
Fetching ARCO data: 0%| | 0/26 [00:00<?, ?it/s]
Total Ensemble Batches: 25%|██▌ | 1/4 [04:29<11:28, 229.40s/it]
Running batch 2 inference: 40%|████ | 2/5 [00:39<00:59, 19.89s/it]
2025-01-23 04:54:34.955 | DEBUG | earth2studio.data.arco:fetch_array:227 - Fetching ARCO zarr array for variable: msl at 2022-11-04T22:00:00
Fetching ARCO data: 15%|█▌ | 4/26 [00:00<00:00, 110.19it/s]
Total Ensemble Batches: 25%|██▌ | 1/4 [04:29<11:28, 229.40s/it]
Running batch 2 inference: 40%|████ | 2/5 [00:39<00:59, 19.89s/it]
2025-01-23 04:54:34.959 | DEBUG | earth2studio.data.arco:fetch_array:227 - Fetching ARCO zarr array for variable: sp at 2022-11-04T22:00:00
Fetching ARCO data: 15%|█▌ | 4/26 [00:00<00:00, 98.03it/s]
Total Ensemble Batches: 25%|██▌ | 1/4 [04:29<11:28, 229.40s/it]
Running batch 2 inference: 40%|████ | 2/5 [00:39<00:59, 19.89s/it]
2025-01-23 04:54:34.964 | DEBUG | earth2studio.data.arco:fetch_array:227 - Fetching ARCO zarr array for variable: u1000 at 2022-11-04T22:00:00
Fetching ARCO data: 15%|█▌ | 4/26 [00:00<00:00, 87.25it/s]
Total Ensemble Batches: 25%|██▌ | 1/4 [04:29<11:28, 229.40s/it]
Running batch 2 inference: 40%|████ | 2/5 [00:39<00:59, 19.89s/it]
2025-01-23 04:54:35.158 | DEBUG | earth2studio.data.arco:fetch_array:227 - Fetching ARCO zarr array for variable: u850 at 2022-11-04T22:00:00
Fetching ARCO data: 15%|█▌ | 4/26 [00:00<00:01, 16.73it/s]
Total Ensemble Batches: 25%|██▌ | 1/4 [04:29<11:28, 229.40s/it]
Running batch 2 inference: 40%|████ | 2/5 [00:40<00:59, 19.89s/it]
Fetching ARCO data: 19%|█▉ | 5/26 [00:00<00:01, 11.54it/s]
2025-01-23 04:54:35.359 | DEBUG | earth2studio.data.arco:fetch_array:227 - Fetching ARCO zarr array for variable: u500 at 2022-11-04T22:00:00
Fetching ARCO data: 31%|███ | 8/26 [00:00<00:01, 11.54it/s]
Total Ensemble Batches: 25%|██▌ | 1/4 [04:29<11:28, 229.40s/it]
Running batch 2 inference: 40%|████ | 2/5 [00:40<00:59, 19.89s/it]
2025-01-23 04:54:35.553 | DEBUG | earth2studio.data.arco:fetch_array:227 - Fetching ARCO zarr array for variable: u250 at 2022-11-04T22:00:00
Fetching ARCO data: 31%|███ | 8/26 [00:00<00:01, 11.54it/s]
Total Ensemble Batches: 25%|██▌ | 1/4 [04:29<11:28, 229.40s/it]
Running batch 2 inference: 40%|████ | 2/5 [00:40<00:59, 19.89s/it]
2025-01-23 04:54:35.750 | DEBUG | earth2studio.data.arco:fetch_array:227 - Fetching ARCO zarr array for variable: v1000 at 2022-11-04T22:00:00
Fetching ARCO data: 31%|███ | 8/26 [00:00<00:01, 11.54it/s]
Total Ensemble Batches: 25%|██▌ | 1/4 [04:30<11:28, 229.40s/it]
Running batch 2 inference: 40%|████ | 2/5 [00:40<00:59, 19.89s/it]
2025-01-23 04:54:35.949 | DEBUG | earth2studio.data.arco:fetch_array:227 - Fetching ARCO zarr array for variable: v850 at 2022-11-04T22:00:00
Fetching ARCO data: 31%|███ | 8/26 [00:01<00:01, 11.54it/s]
Total Ensemble Batches: 25%|██▌ | 1/4 [04:30<11:28, 229.40s/it]
Running batch 2 inference: 40%|████ | 2/5 [00:40<00:59, 19.89s/it]
Fetching ARCO data: 35%|███▍ | 9/26 [00:01<00:02, 6.82it/s]
2025-01-23 04:54:36.155 | DEBUG | earth2studio.data.arco:fetch_array:227 - Fetching ARCO zarr array for variable: v500 at 2022-11-04T22:00:00
Fetching ARCO data: 46%|████▌ | 12/26 [00:01<00:02, 6.82it/s]
Total Ensemble Batches: 25%|██▌ | 1/4 [04:30<11:28, 229.40s/it]
Running batch 2 inference: 40%|████ | 2/5 [00:41<00:59, 19.89s/it]
2025-01-23 04:54:36.353 | DEBUG | earth2studio.data.arco:fetch_array:227 - Fetching ARCO zarr array for variable: v250 at 2022-11-04T22:00:00
Fetching ARCO data: 46%|████▌ | 12/26 [00:01<00:02, 6.82it/s]
Total Ensemble Batches: 25%|██▌ | 1/4 [04:30<11:28, 229.40s/it]
Running batch 2 inference: 40%|████ | 2/5 [00:41<00:59, 19.89s/it]
2025-01-23 04:54:36.554 | DEBUG | earth2studio.data.arco:fetch_array:227 - Fetching ARCO zarr array for variable: z1000 at 2022-11-04T22:00:00
Fetching ARCO data: 46%|████▌ | 12/26 [00:01<00:02, 6.82it/s]
Total Ensemble Batches: 25%|██▌ | 1/4 [04:30<11:28, 229.40s/it]
Running batch 2 inference: 40%|████ | 2/5 [00:41<00:59, 19.89s/it]
2025-01-23 04:54:36.730 | DEBUG | earth2studio.data.arco:fetch_array:227 - Fetching ARCO zarr array for variable: z850 at 2022-11-04T22:00:00
Fetching ARCO data: 46%|████▌ | 12/26 [00:01<00:02, 6.82it/s]
Total Ensemble Batches: 25%|██▌ | 1/4 [04:31<11:28, 229.40s/it]
Running batch 2 inference: 40%|████ | 2/5 [00:41<00:59, 19.89s/it]
Fetching ARCO data: 50%|█████ | 13/26 [00:01<00:02, 6.04it/s]
2025-01-23 04:54:36.916 | DEBUG | earth2studio.data.arco:fetch_array:227 - Fetching ARCO zarr array for variable: z500 at 2022-11-04T22:00:00
Fetching ARCO data: 62%|██████▏ | 16/26 [00:01<00:01, 6.04it/s]
Total Ensemble Batches: 25%|██▌ | 1/4 [04:31<11:28, 229.40s/it]
Running batch 2 inference: 40%|████ | 2/5 [00:41<00:59, 19.89s/it]
2025-01-23 04:54:37.093 | DEBUG | earth2studio.data.arco:fetch_array:227 - Fetching ARCO zarr array for variable: z250 at 2022-11-04T22:00:00
Fetching ARCO data: 62%|██████▏ | 16/26 [00:02<00:01, 6.04it/s]
Total Ensemble Batches: 25%|██▌ | 1/4 [04:31<11:28, 229.40s/it]
Running batch 2 inference: 40%|████ | 2/5 [00:41<00:59, 19.89s/it]
2025-01-23 04:54:37.269 | DEBUG | earth2studio.data.arco:fetch_array:227 - Fetching ARCO zarr array for variable: t1000 at 2022-11-04T22:00:00
Fetching ARCO data: 62%|██████▏ | 16/26 [00:02<00:01, 6.04it/s]
Total Ensemble Batches: 25%|██▌ | 1/4 [04:31<11:28, 229.40s/it]
Running batch 2 inference: 40%|████ | 2/5 [00:42<00:59, 19.89s/it]
2025-01-23 04:54:37.457 | DEBUG | earth2studio.data.arco:fetch_array:227 - Fetching ARCO zarr array for variable: t850 at 2022-11-04T22:00:00
Fetching ARCO data: 62%|██████▏ | 16/26 [00:02<00:01, 6.04it/s]
Total Ensemble Batches: 25%|██▌ | 1/4 [04:31<11:28, 229.40s/it]
Running batch 2 inference: 40%|████ | 2/5 [00:42<00:59, 19.89s/it]
Fetching ARCO data: 65%|██████▌ | 17/26 [00:02<00:01, 5.80it/s]
2025-01-23 04:54:37.652 | DEBUG | earth2studio.data.arco:fetch_array:227 - Fetching ARCO zarr array for variable: t500 at 2022-11-04T22:00:00
Fetching ARCO data: 77%|███████▋ | 20/26 [00:02<00:01, 5.80it/s]
Total Ensemble Batches: 25%|██▌ | 1/4 [04:32<11:28, 229.40s/it]
Running batch 2 inference: 40%|████ | 2/5 [00:42<00:59, 19.89s/it]
2025-01-23 04:54:37.838 | DEBUG | earth2studio.data.arco:fetch_array:227 - Fetching ARCO zarr array for variable: t250 at 2022-11-04T22:00:00
Fetching ARCO data: 77%|███████▋ | 20/26 [00:02<00:01, 5.80it/s]
Total Ensemble Batches: 25%|██▌ | 1/4 [04:32<11:28, 229.40s/it]
Running batch 2 inference: 40%|████ | 2/5 [00:42<00:59, 19.89s/it]
2025-01-23 04:54:38.023 | DEBUG | earth2studio.data.arco:fetch_array:227 - Fetching ARCO zarr array for variable: q1000 at 2022-11-04T22:00:00
Fetching ARCO data: 77%|███████▋ | 20/26 [00:03<00:01, 5.80it/s]
Total Ensemble Batches: 25%|██▌ | 1/4 [04:32<11:28, 229.40s/it]
Running batch 2 inference: 40%|████ | 2/5 [00:42<00:59, 19.89s/it]
2025-01-23 04:54:38.211 | DEBUG | earth2studio.data.arco:fetch_array:227 - Fetching ARCO zarr array for variable: q850 at 2022-11-04T22:00:00
Fetching ARCO data: 77%|███████▋ | 20/26 [00:03<00:01, 5.80it/s]
Total Ensemble Batches: 25%|██▌ | 1/4 [04:32<11:28, 229.40s/it]
Running batch 2 inference: 40%|████ | 2/5 [00:43<00:59, 19.89s/it]
Fetching ARCO data: 81%|████████ | 21/26 [00:03<00:00, 5.60it/s]
2025-01-23 04:54:38.410 | DEBUG | earth2studio.data.arco:fetch_array:227 - Fetching ARCO zarr array for variable: q500 at 2022-11-04T22:00:00
Fetching ARCO data: 92%|█████████▏| 24/26 [00:03<00:00, 5.60it/s]
Total Ensemble Batches: 25%|██▌ | 1/4 [04:32<11:28, 229.40s/it]
Running batch 2 inference: 40%|████ | 2/5 [00:43<00:59, 19.89s/it]
2025-01-23 04:54:38.599 | DEBUG | earth2studio.data.arco:fetch_array:227 - Fetching ARCO zarr array for variable: q250 at 2022-11-04T22:00:00
Fetching ARCO data: 92%|█████████▏| 24/26 [00:03<00:00, 5.60it/s]
Total Ensemble Batches: 25%|██▌ | 1/4 [04:32<11:28, 229.40s/it]
Running batch 2 inference: 40%|████ | 2/5 [00:43<00:59, 19.89s/it]
Fetching ARCO data: 96%|█████████▌| 25/26 [00:03<00:00, 6.62it/s]
Fetching ARCO data: 100%|██████████| 26/26 [00:03<00:00, 6.71it/s]
Running batch 2 inference: 60%|██████ | 3/5 [01:19<00:56, 28.21s/it]
Fetching ARCO data: 0%| | 0/26 [00:00<?, ?it/s]
2025-01-23 04:55:14.763 | DEBUG | earth2studio.data.arco:fetch_array:227 - Fetching ARCO zarr array for variable: u10m at 2022-11-04T23:00:00
Fetching ARCO data: 0%| | 0/26 [00:00<?, ?it/s]
Total Ensemble Batches: 25%|██▌ | 1/4 [05:09<11:28, 229.40s/it]
Running batch 2 inference: 60%|██████ | 3/5 [01:19<00:56, 28.21s/it]
2025-01-23 04:55:14.769 | DEBUG | earth2studio.data.arco:fetch_array:227 - Fetching ARCO zarr array for variable: v10m at 2022-11-04T23:00:00
Fetching ARCO data: 0%| | 0/26 [00:00<?, ?it/s]
Total Ensemble Batches: 25%|██▌ | 1/4 [05:09<11:28, 229.40s/it]
Running batch 2 inference: 60%|██████ | 3/5 [01:19<00:56, 28.21s/it]
2025-01-23 04:55:14.776 | DEBUG | earth2studio.data.arco:fetch_array:227 - Fetching ARCO zarr array for variable: t2m at 2022-11-04T23:00:00
Fetching ARCO data: 0%| | 0/26 [00:00<?, ?it/s]
Total Ensemble Batches: 25%|██▌ | 1/4 [05:09<11:28, 229.40s/it]
Running batch 2 inference: 60%|██████ | 3/5 [01:19<00:56, 28.21s/it]
2025-01-23 04:55:14.781 | DEBUG | earth2studio.data.arco:fetch_array:227 - Fetching ARCO zarr array for variable: tcwv at 2022-11-04T23:00:00
Fetching ARCO data: 0%| | 0/26 [00:00<?, ?it/s]
Total Ensemble Batches: 25%|██▌ | 1/4 [05:09<11:28, 229.40s/it]
Running batch 2 inference: 60%|██████ | 3/5 [01:19<00:56, 28.21s/it]
2025-01-23 04:55:14.798 | DEBUG | earth2studio.data.arco:fetch_array:227 - Fetching ARCO zarr array for variable: msl at 2022-11-04T23:00:00
Fetching ARCO data: 15%|█▌ | 4/26 [00:00<00:00, 108.15it/s]
Total Ensemble Batches: 25%|██▌ | 1/4 [05:09<11:28, 229.40s/it]
Running batch 2 inference: 60%|██████ | 3/5 [01:19<00:56, 28.21s/it]
2025-01-23 04:55:14.802 | DEBUG | earth2studio.data.arco:fetch_array:227 - Fetching ARCO zarr array for variable: sp at 2022-11-04T23:00:00
Fetching ARCO data: 15%|█▌ | 4/26 [00:00<00:00, 96.52it/s]
Total Ensemble Batches: 25%|██▌ | 1/4 [05:09<11:28, 229.40s/it]
Running batch 2 inference: 60%|██████ | 3/5 [01:19<00:56, 28.21s/it]
2025-01-23 04:55:14.807 | DEBUG | earth2studio.data.arco:fetch_array:227 - Fetching ARCO zarr array for variable: u1000 at 2022-11-04T23:00:00
Fetching ARCO data: 15%|█▌ | 4/26 [00:00<00:00, 87.04it/s]
Total Ensemble Batches: 25%|██▌ | 1/4 [05:09<11:28, 229.40s/it]
Running batch 2 inference: 60%|██████ | 3/5 [01:19<00:56, 28.21s/it]
2025-01-23 04:55:15.001 | DEBUG | earth2studio.data.arco:fetch_array:227 - Fetching ARCO zarr array for variable: u850 at 2022-11-04T23:00:00
Fetching ARCO data: 15%|█▌ | 4/26 [00:00<00:01, 16.64it/s]
Total Ensemble Batches: 25%|██▌ | 1/4 [05:09<11:28, 229.40s/it]
Running batch 2 inference: 60%|██████ | 3/5 [01:19<00:56, 28.21s/it]
Fetching ARCO data: 19%|█▉ | 5/26 [00:00<00:01, 11.50it/s]
2025-01-23 04:55:15.203 | DEBUG | earth2studio.data.arco:fetch_array:227 - Fetching ARCO zarr array for variable: u500 at 2022-11-04T23:00:00
Fetching ARCO data: 31%|███ | 8/26 [00:00<00:01, 11.50it/s]
Total Ensemble Batches: 25%|██▌ | 1/4 [05:09<11:28, 229.40s/it]
Running batch 2 inference: 60%|██████ | 3/5 [01:20<00:56, 28.21s/it]
2025-01-23 04:55:15.399 | DEBUG | earth2studio.data.arco:fetch_array:227 - Fetching ARCO zarr array for variable: u250 at 2022-11-04T23:00:00
Fetching ARCO data: 31%|███ | 8/26 [00:00<00:01, 11.50it/s]
Total Ensemble Batches: 25%|██▌ | 1/4 [05:09<11:28, 229.40s/it]
Running batch 2 inference: 60%|██████ | 3/5 [01:20<00:56, 28.21s/it]
2025-01-23 04:55:15.593 | DEBUG | earth2studio.data.arco:fetch_array:227 - Fetching ARCO zarr array for variable: v1000 at 2022-11-04T23:00:00
Fetching ARCO data: 31%|███ | 8/26 [00:00<00:01, 11.50it/s]
Total Ensemble Batches: 25%|██▌ | 1/4 [05:09<11:28, 229.40s/it]
Running batch 2 inference: 60%|██████ | 3/5 [01:20<00:56, 28.21s/it]
2025-01-23 04:55:15.794 | DEBUG | earth2studio.data.arco:fetch_array:227 - Fetching ARCO zarr array for variable: v850 at 2022-11-04T23:00:00
Fetching ARCO data: 31%|███ | 8/26 [00:01<00:01, 11.50it/s]
Total Ensemble Batches: 25%|██▌ | 1/4 [05:10<11:28, 229.40s/it]
Running batch 2 inference: 60%|██████ | 3/5 [01:20<00:56, 28.21s/it]
Fetching ARCO data: 35%|███▍ | 9/26 [00:01<00:02, 6.80it/s]
2025-01-23 04:55:16.001 | DEBUG | earth2studio.data.arco:fetch_array:227 - Fetching ARCO zarr array for variable: v500 at 2022-11-04T23:00:00
Fetching ARCO data: 46%|████▌ | 12/26 [00:01<00:02, 6.80it/s]
Total Ensemble Batches: 25%|██▌ | 1/4 [05:10<11:28, 229.40s/it]
Running batch 2 inference: 60%|██████ | 3/5 [01:20<00:56, 28.21s/it]
2025-01-23 04:55:16.200 | DEBUG | earth2studio.data.arco:fetch_array:227 - Fetching ARCO zarr array for variable: v250 at 2022-11-04T23:00:00
Fetching ARCO data: 46%|████▌ | 12/26 [00:01<00:02, 6.80it/s]
Total Ensemble Batches: 25%|██▌ | 1/4 [05:10<11:28, 229.40s/it]
Running batch 2 inference: 60%|██████ | 3/5 [01:21<00:56, 28.21s/it]
2025-01-23 04:55:16.399 | DEBUG | earth2studio.data.arco:fetch_array:227 - Fetching ARCO zarr array for variable: z1000 at 2022-11-04T23:00:00
Fetching ARCO data: 46%|████▌ | 12/26 [00:01<00:02, 6.80it/s]
Total Ensemble Batches: 25%|██▌ | 1/4 [05:10<11:28, 229.40s/it]
Running batch 2 inference: 60%|██████ | 3/5 [01:21<00:56, 28.21s/it]
2025-01-23 04:55:16.577 | DEBUG | earth2studio.data.arco:fetch_array:227 - Fetching ARCO zarr array for variable: z850 at 2022-11-04T23:00:00
Fetching ARCO data: 46%|████▌ | 12/26 [00:01<00:02, 6.80it/s]
Total Ensemble Batches: 25%|██▌ | 1/4 [05:10<11:28, 229.40s/it]
Running batch 2 inference: 60%|██████ | 3/5 [01:21<00:56, 28.21s/it]
Fetching ARCO data: 50%|█████ | 13/26 [00:01<00:02, 6.02it/s]
2025-01-23 04:55:16.767 | DEBUG | earth2studio.data.arco:fetch_array:227 - Fetching ARCO zarr array for variable: z500 at 2022-11-04T23:00:00
Fetching ARCO data: 62%|██████▏ | 16/26 [00:02<00:01, 6.02it/s]
Total Ensemble Batches: 25%|██▌ | 1/4 [05:11<11:28, 229.40s/it]
Running batch 2 inference: 60%|██████ | 3/5 [01:21<00:56, 28.21s/it]
2025-01-23 04:55:16.946 | DEBUG | earth2studio.data.arco:fetch_array:227 - Fetching ARCO zarr array for variable: z250 at 2022-11-04T23:00:00
Fetching ARCO data: 62%|██████▏ | 16/26 [00:02<00:01, 6.02it/s]
Total Ensemble Batches: 25%|██▌ | 1/4 [05:11<11:28, 229.40s/it]
Running batch 2 inference: 60%|██████ | 3/5 [01:21<00:56, 28.21s/it]
2025-01-23 04:55:17.124 | DEBUG | earth2studio.data.arco:fetch_array:227 - Fetching ARCO zarr array for variable: t1000 at 2022-11-04T23:00:00
Fetching ARCO data: 62%|██████▏ | 16/26 [00:02<00:01, 6.02it/s]
Total Ensemble Batches: 25%|██▌ | 1/4 [05:11<11:28, 229.40s/it]
Running batch 2 inference: 60%|██████ | 3/5 [01:21<00:56, 28.21s/it]
2025-01-23 04:55:17.310 | DEBUG | earth2studio.data.arco:fetch_array:227 - Fetching ARCO zarr array for variable: t850 at 2022-11-04T23:00:00
Fetching ARCO data: 62%|██████▏ | 16/26 [00:02<00:01, 6.02it/s]
Total Ensemble Batches: 25%|██▌ | 1/4 [05:11<11:28, 229.40s/it]
Running batch 2 inference: 60%|██████ | 3/5 [01:22<00:56, 28.21s/it]
Fetching ARCO data: 65%|██████▌ | 17/26 [00:02<00:01, 5.77it/s]
2025-01-23 04:55:17.508 | DEBUG | earth2studio.data.arco:fetch_array:227 - Fetching ARCO zarr array for variable: t500 at 2022-11-04T23:00:00
Fetching ARCO data: 77%|███████▋ | 20/26 [00:02<00:01, 5.77it/s]
Total Ensemble Batches: 25%|██▌ | 1/4 [05:11<11:28, 229.40s/it]
Running batch 2 inference: 60%|██████ | 3/5 [01:22<00:56, 28.21s/it]
2025-01-23 04:55:17.696 | DEBUG | earth2studio.data.arco:fetch_array:227 - Fetching ARCO zarr array for variable: t250 at 2022-11-04T23:00:00
Fetching ARCO data: 77%|███████▋ | 20/26 [00:02<00:01, 5.77it/s]
Total Ensemble Batches: 25%|██▌ | 1/4 [05:12<11:28, 229.40s/it]
Running batch 2 inference: 60%|██████ | 3/5 [01:22<00:56, 28.21s/it]
2025-01-23 04:55:17.882 | DEBUG | earth2studio.data.arco:fetch_array:227 - Fetching ARCO zarr array for variable: q1000 at 2022-11-04T23:00:00
Fetching ARCO data: 77%|███████▋ | 20/26 [00:03<00:01, 5.77it/s]
Total Ensemble Batches: 25%|██▌ | 1/4 [05:12<11:28, 229.40s/it]
Running batch 2 inference: 60%|██████ | 3/5 [01:22<00:56, 28.21s/it]
2025-01-23 04:55:18.072 | DEBUG | earth2studio.data.arco:fetch_array:227 - Fetching ARCO zarr array for variable: q850 at 2022-11-04T23:00:00
Fetching ARCO data: 77%|███████▋ | 20/26 [00:03<00:01, 5.77it/s]
Total Ensemble Batches: 25%|██▌ | 1/4 [05:12<11:28, 229.40s/it]
Running batch 2 inference: 60%|██████ | 3/5 [01:22<00:56, 28.21s/it]
Fetching ARCO data: 81%|████████ | 21/26 [00:03<00:00, 5.57it/s]
2025-01-23 04:55:18.270 | DEBUG | earth2studio.data.arco:fetch_array:227 - Fetching ARCO zarr array for variable: q500 at 2022-11-04T23:00:00
Fetching ARCO data: 92%|█████████▏| 24/26 [00:03<00:00, 5.57it/s]
Total Ensemble Batches: 25%|██▌ | 1/4 [05:12<11:28, 229.40s/it]
Running batch 2 inference: 60%|██████ | 3/5 [01:23<00:56, 28.21s/it]
2025-01-23 04:55:18.460 | DEBUG | earth2studio.data.arco:fetch_array:227 - Fetching ARCO zarr array for variable: q250 at 2022-11-04T23:00:00
Fetching ARCO data: 92%|█████████▏| 24/26 [00:03<00:00, 5.57it/s]
Total Ensemble Batches: 25%|██▌ | 1/4 [05:12<11:28, 229.40s/it]
Running batch 2 inference: 60%|██████ | 3/5 [01:23<00:56, 28.21s/it]
Fetching ARCO data: 96%|█████████▌| 25/26 [00:03<00:00, 6.59it/s]
Fetching ARCO data: 100%|██████████| 26/26 [00:03<00:00, 6.68it/s]
Running batch 2 inference: 80%|████████ | 4/5 [01:59<00:32, 32.59s/it]
Fetching ARCO data: 0%| | 0/26 [00:00<?, ?it/s]
2025-01-23 04:55:54.729 | DEBUG | earth2studio.data.arco:fetch_array:227 - Fetching ARCO zarr array for variable: u10m at 2022-11-05T00:00:00
Fetching ARCO data: 0%| | 0/26 [00:00<?, ?it/s]
Total Ensemble Batches: 25%|██▌ | 1/4 [05:49<11:28, 229.40s/it]
Running batch 2 inference: 80%|████████ | 4/5 [01:59<00:32, 32.59s/it]
2025-01-23 04:55:54.735 | DEBUG | earth2studio.data.arco:fetch_array:227 - Fetching ARCO zarr array for variable: v10m at 2022-11-05T00:00:00
Fetching ARCO data: 0%| | 0/26 [00:00<?, ?it/s]
Total Ensemble Batches: 25%|██▌ | 1/4 [05:49<11:28, 229.40s/it]
Running batch 2 inference: 80%|████████ | 4/5 [01:59<00:32, 32.59s/it]
2025-01-23 04:55:54.741 | DEBUG | earth2studio.data.arco:fetch_array:227 - Fetching ARCO zarr array for variable: t2m at 2022-11-05T00:00:00
Fetching ARCO data: 0%| | 0/26 [00:00<?, ?it/s]
Total Ensemble Batches: 25%|██▌ | 1/4 [05:49<11:28, 229.40s/it]
Running batch 2 inference: 80%|████████ | 4/5 [01:59<00:32, 32.59s/it]
2025-01-23 04:55:54.746 | DEBUG | earth2studio.data.arco:fetch_array:227 - Fetching ARCO zarr array for variable: tcwv at 2022-11-05T00:00:00
Fetching ARCO data: 0%| | 0/26 [00:00<?, ?it/s]
Total Ensemble Batches: 25%|██▌ | 1/4 [05:49<11:28, 229.40s/it]
Running batch 2 inference: 80%|████████ | 4/5 [01:59<00:32, 32.59s/it]
2025-01-23 04:55:54.761 | DEBUG | earth2studio.data.arco:fetch_array:227 - Fetching ARCO zarr array for variable: msl at 2022-11-05T00:00:00
Fetching ARCO data: 15%|█▌ | 4/26 [00:00<00:00, 117.72it/s]
Total Ensemble Batches: 25%|██▌ | 1/4 [05:49<11:28, 229.40s/it]
Running batch 2 inference: 80%|████████ | 4/5 [01:59<00:32, 32.59s/it]
2025-01-23 04:55:54.766 | DEBUG | earth2studio.data.arco:fetch_array:227 - Fetching ARCO zarr array for variable: sp at 2022-11-05T00:00:00
Fetching ARCO data: 15%|█▌ | 4/26 [00:00<00:00, 101.91it/s]
Total Ensemble Batches: 25%|██▌ | 1/4 [05:49<11:28, 229.40s/it]
Running batch 2 inference: 80%|████████ | 4/5 [01:59<00:32, 32.59s/it]
2025-01-23 04:55:54.772 | DEBUG | earth2studio.data.arco:fetch_array:227 - Fetching ARCO zarr array for variable: u1000 at 2022-11-05T00:00:00
Fetching ARCO data: 15%|█▌ | 4/26 [00:00<00:00, 88.88it/s]
Total Ensemble Batches: 25%|██▌ | 1/4 [05:49<11:28, 229.40s/it]
Running batch 2 inference: 80%|████████ | 4/5 [01:59<00:32, 32.59s/it]
2025-01-23 04:55:54.968 | DEBUG | earth2studio.data.arco:fetch_array:227 - Fetching ARCO zarr array for variable: u850 at 2022-11-05T00:00:00
Fetching ARCO data: 15%|█▌ | 4/26 [00:00<00:01, 16.60it/s]
Total Ensemble Batches: 25%|██▌ | 1/4 [05:49<11:28, 229.40s/it]
Running batch 2 inference: 80%|████████ | 4/5 [01:59<00:32, 32.59s/it]
Fetching ARCO data: 19%|█▉ | 5/26 [00:00<00:01, 11.44it/s]
2025-01-23 04:55:55.172 | DEBUG | earth2studio.data.arco:fetch_array:227 - Fetching ARCO zarr array for variable: u500 at 2022-11-05T00:00:00
Fetching ARCO data: 31%|███ | 8/26 [00:00<00:01, 11.44it/s]
Total Ensemble Batches: 25%|██▌ | 1/4 [05:49<11:28, 229.40s/it]
Running batch 2 inference: 80%|████████ | 4/5 [02:00<00:32, 32.59s/it]
2025-01-23 04:55:55.367 | DEBUG | earth2studio.data.arco:fetch_array:227 - Fetching ARCO zarr array for variable: u250 at 2022-11-05T00:00:00
Fetching ARCO data: 31%|███ | 8/26 [00:00<00:01, 11.44it/s]
Total Ensemble Batches: 25%|██▌ | 1/4 [05:49<11:28, 229.40s/it]
Running batch 2 inference: 80%|████████ | 4/5 [02:00<00:32, 32.59s/it]
2025-01-23 04:55:55.562 | DEBUG | earth2studio.data.arco:fetch_array:227 - Fetching ARCO zarr array for variable: v1000 at 2022-11-05T00:00:00
Fetching ARCO data: 31%|███ | 8/26 [00:00<00:01, 11.44it/s]
Total Ensemble Batches: 25%|██▌ | 1/4 [05:49<11:28, 229.40s/it]
Running batch 2 inference: 80%|████████ | 4/5 [02:00<00:32, 32.59s/it]
2025-01-23 04:55:55.762 | DEBUG | earth2studio.data.arco:fetch_array:227 - Fetching ARCO zarr array for variable: v850 at 2022-11-05T00:00:00
Fetching ARCO data: 31%|███ | 8/26 [00:01<00:01, 11.44it/s]
Total Ensemble Batches: 25%|██▌ | 1/4 [05:50<11:28, 229.40s/it]
Running batch 2 inference: 80%|████████ | 4/5 [02:00<00:32, 32.59s/it]
Fetching ARCO data: 35%|███▍ | 9/26 [00:01<00:02, 6.79it/s]
2025-01-23 04:55:55.971 | DEBUG | earth2studio.data.arco:fetch_array:227 - Fetching ARCO zarr array for variable: v500 at 2022-11-05T00:00:00
Fetching ARCO data: 46%|████▌ | 12/26 [00:01<00:02, 6.79it/s]
Total Ensemble Batches: 25%|██▌ | 1/4 [05:50<11:28, 229.40s/it]
Running batch 2 inference: 80%|████████ | 4/5 [02:00<00:32, 32.59s/it]
2025-01-23 04:55:56.171 | DEBUG | earth2studio.data.arco:fetch_array:227 - Fetching ARCO zarr array for variable: v250 at 2022-11-05T00:00:00
Fetching ARCO data: 46%|████▌ | 12/26 [00:01<00:02, 6.79it/s]
Total Ensemble Batches: 25%|██▌ | 1/4 [05:50<11:28, 229.40s/it]
Running batch 2 inference: 80%|████████ | 4/5 [02:01<00:32, 32.59s/it]
2025-01-23 04:55:56.371 | DEBUG | earth2studio.data.arco:fetch_array:227 - Fetching ARCO zarr array for variable: z1000 at 2022-11-05T00:00:00
Fetching ARCO data: 46%|████▌ | 12/26 [00:01<00:02, 6.79it/s]
Total Ensemble Batches: 25%|██▌ | 1/4 [05:50<11:28, 229.40s/it]
Running batch 2 inference: 80%|████████ | 4/5 [02:01<00:32, 32.59s/it]
2025-01-23 04:55:56.549 | DEBUG | earth2studio.data.arco:fetch_array:227 - Fetching ARCO zarr array for variable: z850 at 2022-11-05T00:00:00
Fetching ARCO data: 46%|████▌ | 12/26 [00:01<00:02, 6.79it/s]
Total Ensemble Batches: 25%|██▌ | 1/4 [05:50<11:28, 229.40s/it]
Running batch 2 inference: 80%|████████ | 4/5 [02:01<00:32, 32.59s/it]
Fetching ARCO data: 50%|█████ | 13/26 [00:02<00:02, 6.01it/s]
2025-01-23 04:55:56.736 | DEBUG | earth2studio.data.arco:fetch_array:227 - Fetching ARCO zarr array for variable: z500 at 2022-11-05T00:00:00
Fetching ARCO data: 62%|██████▏ | 16/26 [00:02<00:01, 6.01it/s]
Total Ensemble Batches: 25%|██▌ | 1/4 [05:51<11:28, 229.40s/it]
Running batch 2 inference: 80%|████████ | 4/5 [02:01<00:32, 32.59s/it]
2025-01-23 04:55:56.915 | DEBUG | earth2studio.data.arco:fetch_array:227 - Fetching ARCO zarr array for variable: z250 at 2022-11-05T00:00:00
Fetching ARCO data: 62%|██████▏ | 16/26 [00:02<00:01, 6.01it/s]
Total Ensemble Batches: 25%|██▌ | 1/4 [05:51<11:28, 229.40s/it]
Running batch 2 inference: 80%|████████ | 4/5 [02:01<00:32, 32.59s/it]
2025-01-23 04:55:57.098 | DEBUG | earth2studio.data.arco:fetch_array:227 - Fetching ARCO zarr array for variable: t1000 at 2022-11-05T00:00:00
Fetching ARCO data: 62%|██████▏ | 16/26 [00:02<00:01, 6.01it/s]
Total Ensemble Batches: 25%|██▌ | 1/4 [05:51<11:28, 229.40s/it]
Running batch 2 inference: 80%|████████ | 4/5 [02:01<00:32, 32.59s/it]
2025-01-23 04:55:57.286 | DEBUG | earth2studio.data.arco:fetch_array:227 - Fetching ARCO zarr array for variable: t850 at 2022-11-05T00:00:00
Fetching ARCO data: 62%|██████▏ | 16/26 [00:02<00:01, 6.01it/s]
Total Ensemble Batches: 25%|██▌ | 1/4 [05:51<11:28, 229.40s/it]
Running batch 2 inference: 80%|████████ | 4/5 [02:02<00:32, 32.59s/it]
Fetching ARCO data: 65%|██████▌ | 17/26 [00:02<00:01, 5.74it/s]
2025-01-23 04:55:57.485 | DEBUG | earth2studio.data.arco:fetch_array:227 - Fetching ARCO zarr array for variable: t500 at 2022-11-05T00:00:00
Fetching ARCO data: 77%|███████▋ | 20/26 [00:02<00:01, 5.74it/s]
Total Ensemble Batches: 25%|██▌ | 1/4 [05:51<11:28, 229.40s/it]
Running batch 2 inference: 80%|████████ | 4/5 [02:02<00:32, 32.59s/it]
2025-01-23 04:55:57.672 | DEBUG | earth2studio.data.arco:fetch_array:227 - Fetching ARCO zarr array for variable: t250 at 2022-11-05T00:00:00
Fetching ARCO data: 77%|███████▋ | 20/26 [00:02<00:01, 5.74it/s]
Total Ensemble Batches: 25%|██▌ | 1/4 [05:52<11:28, 229.40s/it]
Running batch 2 inference: 80%|████████ | 4/5 [02:02<00:32, 32.59s/it]
2025-01-23 04:55:57.858 | DEBUG | earth2studio.data.arco:fetch_array:227 - Fetching ARCO zarr array for variable: q1000 at 2022-11-05T00:00:00
Fetching ARCO data: 77%|███████▋ | 20/26 [00:03<00:01, 5.74it/s]
Total Ensemble Batches: 25%|██▌ | 1/4 [05:52<11:28, 229.40s/it]
Running batch 2 inference: 80%|████████ | 4/5 [02:02<00:32, 32.59s/it]
2025-01-23 04:55:58.049 | DEBUG | earth2studio.data.arco:fetch_array:227 - Fetching ARCO zarr array for variable: q850 at 2022-11-05T00:00:00
Fetching ARCO data: 77%|███████▋ | 20/26 [00:03<00:01, 5.74it/s]
Total Ensemble Batches: 25%|██▌ | 1/4 [05:52<11:28, 229.40s/it]
Running batch 2 inference: 80%|████████ | 4/5 [02:02<00:32, 32.59s/it]
Fetching ARCO data: 81%|████████ | 21/26 [00:03<00:00, 5.55it/s]
2025-01-23 04:55:58.249 | DEBUG | earth2studio.data.arco:fetch_array:227 - Fetching ARCO zarr array for variable: q500 at 2022-11-05T00:00:00
Fetching ARCO data: 92%|█████████▏| 24/26 [00:03<00:00, 5.55it/s]
Total Ensemble Batches: 25%|██▌ | 1/4 [05:52<11:28, 229.40s/it]
Running batch 2 inference: 80%|████████ | 4/5 [02:03<00:32, 32.59s/it]
2025-01-23 04:55:58.440 | DEBUG | earth2studio.data.arco:fetch_array:227 - Fetching ARCO zarr array for variable: q250 at 2022-11-05T00:00:00
Fetching ARCO data: 92%|█████████▏| 24/26 [00:03<00:00, 5.55it/s]
Total Ensemble Batches: 25%|██▌ | 1/4 [05:52<11:28, 229.40s/it]
Running batch 2 inference: 80%|████████ | 4/5 [02:03<00:32, 32.59s/it]
Fetching ARCO data: 96%|█████████▌| 25/26 [00:03<00:00, 6.56it/s]
Fetching ARCO data: 100%|██████████| 26/26 [00:03<00:00, 6.66it/s]
Running batch 2 inference: 100%|██████████| 5/5 [02:39<00:00, 35.19s/it]
Total Ensemble Batches: 50%|█████ | 2/4 [06:29<06:16, 188.43s/it]
Running batch 4 inference: 0%| | 0/5 [00:00<?, ?it/s]
Fetching ARCO data: 0%| | 0/26 [00:00<?, ?it/s]
2025-01-23 04:56:34.968 | DEBUG | earth2studio.data.arco:fetch_array:227 - Fetching ARCO zarr array for variable: u10m at 2022-11-04T21:00:00
Fetching ARCO data: 0%| | 0/26 [00:00<?, ?it/s]
Total Ensemble Batches: 50%|█████ | 2/4 [06:29<06:16, 188.43s/it]
Running batch 4 inference: 20%|██ | 1/5 [00:00<00:00, 11.73it/s]
2025-01-23 04:56:34.973 | DEBUG | earth2studio.data.arco:fetch_array:227 - Fetching ARCO zarr array for variable: v10m at 2022-11-04T21:00:00
Fetching ARCO data: 0%| | 0/26 [00:00<?, ?it/s]
Total Ensemble Batches: 50%|█████ | 2/4 [06:29<06:16, 188.43s/it]
Running batch 4 inference: 20%|██ | 1/5 [00:00<00:00, 11.06it/s]
2025-01-23 04:56:34.979 | DEBUG | earth2studio.data.arco:fetch_array:227 - Fetching ARCO zarr array for variable: t2m at 2022-11-04T21:00:00
Fetching ARCO data: 0%| | 0/26 [00:00<?, ?it/s]
Total Ensemble Batches: 50%|█████ | 2/4 [06:29<06:16, 188.43s/it]
Running batch 4 inference: 20%|██ | 1/5 [00:00<00:00, 10.41it/s]
2025-01-23 04:56:34.984 | DEBUG | earth2studio.data.arco:fetch_array:227 - Fetching ARCO zarr array for variable: tcwv at 2022-11-04T21:00:00
Fetching ARCO data: 0%| | 0/26 [00:00<?, ?it/s]
Total Ensemble Batches: 50%|█████ | 2/4 [06:29<06:16, 188.43s/it]
Running batch 4 inference: 20%|██ | 1/5 [00:00<00:00, 9.87it/s]
2025-01-23 04:56:35.000 | DEBUG | earth2studio.data.arco:fetch_array:227 - Fetching ARCO zarr array for variable: msl at 2022-11-04T21:00:00
Fetching ARCO data: 15%|█▌ | 4/26 [00:00<00:00, 119.59it/s]
Total Ensemble Batches: 50%|█████ | 2/4 [06:29<06:16, 188.43s/it]
Running batch 4 inference: 20%|██ | 1/5 [00:00<00:00, 8.58it/s]
2025-01-23 04:56:35.004 | DEBUG | earth2studio.data.arco:fetch_array:227 - Fetching ARCO zarr array for variable: sp at 2022-11-04T21:00:00
Fetching ARCO data: 15%|█▌ | 4/26 [00:00<00:00, 105.84it/s]
Total Ensemble Batches: 50%|█████ | 2/4 [06:29<06:16, 188.43s/it]
Running batch 4 inference: 20%|██ | 1/5 [00:00<00:00, 8.28it/s]
2025-01-23 04:56:35.008 | DEBUG | earth2studio.data.arco:fetch_array:227 - Fetching ARCO zarr array for variable: u1000 at 2022-11-04T21:00:00
Fetching ARCO data: 15%|█▌ | 4/26 [00:00<00:00, 94.82it/s]
Total Ensemble Batches: 50%|█████ | 2/4 [06:29<06:16, 188.43s/it]
Running batch 4 inference: 20%|██ | 1/5 [00:00<00:00, 7.98it/s]
2025-01-23 04:56:35.204 | DEBUG | earth2studio.data.arco:fetch_array:227 - Fetching ARCO zarr array for variable: u850 at 2022-11-04T21:00:00
Fetching ARCO data: 15%|█▌ | 4/26 [00:00<00:01, 16.80it/s]
Total Ensemble Batches: 50%|█████ | 2/4 [06:29<06:16, 188.43s/it]
Running batch 4 inference: 20%|██ | 1/5 [00:00<00:01, 3.11it/s]
Fetching ARCO data: 19%|█▉ | 5/26 [00:00<00:01, 11.50it/s]
2025-01-23 04:56:35.409 | DEBUG | earth2studio.data.arco:fetch_array:227 - Fetching ARCO zarr array for variable: u500 at 2022-11-04T21:00:00
Fetching ARCO data: 31%|███ | 8/26 [00:00<00:01, 11.50it/s]
Total Ensemble Batches: 50%|█████ | 2/4 [06:29<06:16, 188.43s/it]
Running batch 4 inference: 20%|██ | 1/5 [00:00<00:02, 1.90it/s]
2025-01-23 04:56:35.605 | DEBUG | earth2studio.data.arco:fetch_array:227 - Fetching ARCO zarr array for variable: u250 at 2022-11-04T21:00:00
Fetching ARCO data: 31%|███ | 8/26 [00:00<00:01, 11.50it/s]
Total Ensemble Batches: 50%|█████ | 2/4 [06:29<06:16, 188.43s/it]
Running batch 4 inference: 20%|██ | 1/5 [00:00<00:02, 1.39it/s]
2025-01-23 04:56:35.801 | DEBUG | earth2studio.data.arco:fetch_array:227 - Fetching ARCO zarr array for variable: v1000 at 2022-11-04T21:00:00
Fetching ARCO data: 31%|███ | 8/26 [00:00<00:01, 11.50it/s]
Total Ensemble Batches: 50%|█████ | 2/4 [06:30<06:16, 188.43s/it]
Running batch 4 inference: 20%|██ | 1/5 [00:00<00:03, 1.09it/s]
2025-01-23 04:56:36.003 | DEBUG | earth2studio.data.arco:fetch_array:227 - Fetching ARCO zarr array for variable: v850 at 2022-11-04T21:00:00
Fetching ARCO data: 31%|███ | 8/26 [00:01<00:01, 11.50it/s]
Total Ensemble Batches: 50%|█████ | 2/4 [06:30<06:16, 188.43s/it]
Running batch 4 inference: 20%|██ | 1/5 [00:01<00:04, 1.12s/it]
Fetching ARCO data: 35%|███▍ | 9/26 [00:01<00:02, 6.77it/s]
2025-01-23 04:56:36.212 | DEBUG | earth2studio.data.arco:fetch_array:227 - Fetching ARCO zarr array for variable: v500 at 2022-11-04T21:00:00
Fetching ARCO data: 46%|████▌ | 12/26 [00:01<00:02, 6.77it/s]
Total Ensemble Batches: 50%|█████ | 2/4 [06:30<06:16, 188.43s/it]
Running batch 4 inference: 20%|██ | 1/5 [00:01<00:05, 1.33s/it]
2025-01-23 04:56:36.413 | DEBUG | earth2studio.data.arco:fetch_array:227 - Fetching ARCO zarr array for variable: v250 at 2022-11-04T21:00:00
Fetching ARCO data: 46%|████▌ | 12/26 [00:01<00:02, 6.77it/s]
Total Ensemble Batches: 50%|█████ | 2/4 [06:30<06:16, 188.43s/it]
Running batch 4 inference: 20%|██ | 1/5 [00:01<00:06, 1.53s/it]
2025-01-23 04:56:36.614 | DEBUG | earth2studio.data.arco:fetch_array:227 - Fetching ARCO zarr array for variable: z1000 at 2022-11-04T21:00:00
Fetching ARCO data: 46%|████▌ | 12/26 [00:01<00:02, 6.77it/s]
Total Ensemble Batches: 50%|█████ | 2/4 [06:30<06:16, 188.43s/it]
Running batch 4 inference: 20%|██ | 1/5 [00:01<00:06, 1.73s/it]
2025-01-23 04:56:36.795 | DEBUG | earth2studio.data.arco:fetch_array:227 - Fetching ARCO zarr array for variable: z850 at 2022-11-04T21:00:00
Fetching ARCO data: 46%|████▌ | 12/26 [00:01<00:02, 6.77it/s]
Total Ensemble Batches: 50%|█████ | 2/4 [06:31<06:16, 188.43s/it]
Running batch 4 inference: 20%|██ | 1/5 [00:01<00:07, 1.91s/it]
Fetching ARCO data: 50%|█████ | 13/26 [00:02<00:02, 5.98it/s]
2025-01-23 04:56:36.983 | DEBUG | earth2studio.data.arco:fetch_array:227 - Fetching ARCO zarr array for variable: z500 at 2022-11-04T21:00:00
Fetching ARCO data: 62%|██████▏ | 16/26 [00:02<00:01, 5.98it/s]
Total Ensemble Batches: 50%|█████ | 2/4 [06:31<06:16, 188.43s/it]
Running batch 4 inference: 20%|██ | 1/5 [00:02<00:08, 2.10s/it]
2025-01-23 04:56:37.162 | DEBUG | earth2studio.data.arco:fetch_array:227 - Fetching ARCO zarr array for variable: z250 at 2022-11-04T21:00:00
Fetching ARCO data: 62%|██████▏ | 16/26 [00:02<00:01, 5.98it/s]
Total Ensemble Batches: 50%|█████ | 2/4 [06:31<06:16, 188.43s/it]
Running batch 4 inference: 20%|██ | 1/5 [00:02<00:09, 2.28s/it]
2025-01-23 04:56:37.347 | DEBUG | earth2studio.data.arco:fetch_array:227 - Fetching ARCO zarr array for variable: t1000 at 2022-11-04T21:00:00
Fetching ARCO data: 62%|██████▏ | 16/26 [00:02<00:01, 5.98it/s]
Total Ensemble Batches: 50%|█████ | 2/4 [06:31<06:16, 188.43s/it]
Running batch 4 inference: 20%|██ | 1/5 [00:02<00:09, 2.46s/it]
2025-01-23 04:56:37.535 | DEBUG | earth2studio.data.arco:fetch_array:227 - Fetching ARCO zarr array for variable: t850 at 2022-11-04T21:00:00
Fetching ARCO data: 62%|██████▏ | 16/26 [00:02<00:01, 5.98it/s]
Total Ensemble Batches: 50%|█████ | 2/4 [06:31<06:16, 188.43s/it]
Running batch 4 inference: 20%|██ | 1/5 [00:02<00:10, 2.65s/it]
Fetching ARCO data: 65%|██████▌ | 17/26 [00:02<00:01, 5.72it/s]
2025-01-23 04:56:37.733 | DEBUG | earth2studio.data.arco:fetch_array:227 - Fetching ARCO zarr array for variable: t500 at 2022-11-04T21:00:00
Fetching ARCO data: 77%|███████▋ | 20/26 [00:02<00:01, 5.72it/s]
Total Ensemble Batches: 50%|█████ | 2/4 [06:32<06:16, 188.43s/it]
Running batch 4 inference: 20%|██ | 1/5 [00:02<00:11, 2.85s/it]
2025-01-23 04:56:37.922 | DEBUG | earth2studio.data.arco:fetch_array:227 - Fetching ARCO zarr array for variable: t250 at 2022-11-04T21:00:00
Fetching ARCO data: 77%|███████▋ | 20/26 [00:02<00:01, 5.72it/s]
Total Ensemble Batches: 50%|█████ | 2/4 [06:32<06:16, 188.43s/it]
Running batch 4 inference: 20%|██ | 1/5 [00:03<00:12, 3.04s/it]
2025-01-23 04:56:38.110 | DEBUG | earth2studio.data.arco:fetch_array:227 - Fetching ARCO zarr array for variable: q1000 at 2022-11-04T21:00:00
Fetching ARCO data: 77%|███████▋ | 20/26 [00:03<00:01, 5.72it/s]
Total Ensemble Batches: 50%|█████ | 2/4 [06:32<06:16, 188.43s/it]
Running batch 4 inference: 20%|██ | 1/5 [00:03<00:12, 3.23s/it]
2025-01-23 04:56:38.302 | DEBUG | earth2studio.data.arco:fetch_array:227 - Fetching ARCO zarr array for variable: q850 at 2022-11-04T21:00:00
Fetching ARCO data: 77%|███████▋ | 20/26 [00:03<00:01, 5.72it/s]
Total Ensemble Batches: 50%|█████ | 2/4 [06:32<06:16, 188.43s/it]
Running batch 4 inference: 20%|██ | 1/5 [00:03<00:13, 3.42s/it]
Fetching ARCO data: 81%|████████ | 21/26 [00:03<00:00, 5.53it/s]
2025-01-23 04:56:38.502 | DEBUG | earth2studio.data.arco:fetch_array:227 - Fetching ARCO zarr array for variable: q500 at 2022-11-04T21:00:00
Fetching ARCO data: 92%|█████████▏| 24/26 [00:03<00:00, 5.53it/s]
Total Ensemble Batches: 50%|█████ | 2/4 [06:32<06:16, 188.43s/it]
Running batch 4 inference: 20%|██ | 1/5 [00:03<00:14, 3.62s/it]
2025-01-23 04:56:38.693 | DEBUG | earth2studio.data.arco:fetch_array:227 - Fetching ARCO zarr array for variable: q250 at 2022-11-04T21:00:00
Fetching ARCO data: 92%|█████████▏| 24/26 [00:03<00:00, 5.53it/s]
Total Ensemble Batches: 50%|█████ | 2/4 [06:33<06:16, 188.43s/it]
Running batch 4 inference: 20%|██ | 1/5 [00:03<00:15, 3.81s/it]
Fetching ARCO data: 96%|█████████▌| 25/26 [00:03<00:00, 6.53it/s]
Fetching ARCO data: 100%|██████████| 26/26 [00:03<00:00, 6.63it/s]
Running batch 4 inference: 40%|████ | 2/5 [00:40<01:00, 20.10s/it]
Fetching ARCO data: 0%| | 0/26 [00:00<?, ?it/s]
2025-01-23 04:57:15.081 | DEBUG | earth2studio.data.arco:fetch_array:227 - Fetching ARCO zarr array for variable: u10m at 2022-11-04T22:00:00
Fetching ARCO data: 0%| | 0/26 [00:00<?, ?it/s]
Total Ensemble Batches: 50%|█████ | 2/4 [07:09<06:16, 188.43s/it]
Running batch 4 inference: 40%|████ | 2/5 [00:40<01:00, 20.10s/it]
2025-01-23 04:57:15.087 | DEBUG | earth2studio.data.arco:fetch_array:227 - Fetching ARCO zarr array for variable: v10m at 2022-11-04T22:00:00
Fetching ARCO data: 0%| | 0/26 [00:00<?, ?it/s]
Total Ensemble Batches: 50%|█████ | 2/4 [07:09<06:16, 188.43s/it]
Running batch 4 inference: 40%|████ | 2/5 [00:40<01:00, 20.10s/it]
2025-01-23 04:57:15.093 | DEBUG | earth2studio.data.arco:fetch_array:227 - Fetching ARCO zarr array for variable: t2m at 2022-11-04T22:00:00
Fetching ARCO data: 0%| | 0/26 [00:00<?, ?it/s]
Total Ensemble Batches: 50%|█████ | 2/4 [07:09<06:16, 188.43s/it]
Running batch 4 inference: 40%|████ | 2/5 [00:40<01:00, 20.10s/it]
2025-01-23 04:57:15.099 | DEBUG | earth2studio.data.arco:fetch_array:227 - Fetching ARCO zarr array for variable: tcwv at 2022-11-04T22:00:00
Fetching ARCO data: 0%| | 0/26 [00:00<?, ?it/s]
Total Ensemble Batches: 50%|█████ | 2/4 [07:09<06:16, 188.43s/it]
Running batch 4 inference: 40%|████ | 2/5 [00:40<01:00, 20.10s/it]
2025-01-23 04:57:15.114 | DEBUG | earth2studio.data.arco:fetch_array:227 - Fetching ARCO zarr array for variable: msl at 2022-11-04T22:00:00
Fetching ARCO data: 15%|█▌ | 4/26 [00:00<00:00, 112.76it/s]
Total Ensemble Batches: 50%|█████ | 2/4 [07:09<06:16, 188.43s/it]
Running batch 4 inference: 40%|████ | 2/5 [00:40<01:00, 20.10s/it]
2025-01-23 04:57:15.118 | DEBUG | earth2studio.data.arco:fetch_array:227 - Fetching ARCO zarr array for variable: sp at 2022-11-04T22:00:00
Fetching ARCO data: 15%|█▌ | 4/26 [00:00<00:00, 100.33it/s]
Total Ensemble Batches: 50%|█████ | 2/4 [07:09<06:16, 188.43s/it]
Running batch 4 inference: 40%|████ | 2/5 [00:40<01:00, 20.10s/it]
2025-01-23 04:57:15.123 | DEBUG | earth2studio.data.arco:fetch_array:227 - Fetching ARCO zarr array for variable: u1000 at 2022-11-04T22:00:00
Fetching ARCO data: 15%|█▌ | 4/26 [00:00<00:00, 89.77it/s]
Total Ensemble Batches: 50%|█████ | 2/4 [07:09<06:16, 188.43s/it]
Running batch 4 inference: 40%|████ | 2/5 [00:40<01:00, 20.10s/it]
2025-01-23 04:57:15.319 | DEBUG | earth2studio.data.arco:fetch_array:227 - Fetching ARCO zarr array for variable: u850 at 2022-11-04T22:00:00
Fetching ARCO data: 15%|█▌ | 4/26 [00:00<00:01, 16.64it/s]
Total Ensemble Batches: 50%|█████ | 2/4 [07:09<06:16, 188.43s/it]
Running batch 4 inference: 40%|████ | 2/5 [00:40<01:00, 20.10s/it]
Fetching ARCO data: 19%|█▉ | 5/26 [00:00<00:01, 11.46it/s]
2025-01-23 04:57:15.522 | DEBUG | earth2studio.data.arco:fetch_array:227 - Fetching ARCO zarr array for variable: u500 at 2022-11-04T22:00:00
Fetching ARCO data: 31%|███ | 8/26 [00:00<00:01, 11.46it/s]
Total Ensemble Batches: 50%|█████ | 2/4 [07:09<06:16, 188.43s/it]
Running batch 4 inference: 40%|████ | 2/5 [00:40<01:00, 20.10s/it]
2025-01-23 04:57:15.716 | DEBUG | earth2studio.data.arco:fetch_array:227 - Fetching ARCO zarr array for variable: u250 at 2022-11-04T22:00:00
Fetching ARCO data: 31%|███ | 8/26 [00:00<00:01, 11.46it/s]
Total Ensemble Batches: 50%|█████ | 2/4 [07:10<06:16, 188.43s/it]
Running batch 4 inference: 40%|████ | 2/5 [00:40<01:00, 20.10s/it]
2025-01-23 04:57:15.911 | DEBUG | earth2studio.data.arco:fetch_array:227 - Fetching ARCO zarr array for variable: v1000 at 2022-11-04T22:00:00
Fetching ARCO data: 31%|███ | 8/26 [00:00<00:01, 11.46it/s]
Total Ensemble Batches: 50%|█████ | 2/4 [07:10<06:16, 188.43s/it]
Running batch 4 inference: 40%|████ | 2/5 [00:41<01:00, 20.10s/it]
2025-01-23 04:57:16.111 | DEBUG | earth2studio.data.arco:fetch_array:227 - Fetching ARCO zarr array for variable: v850 at 2022-11-04T22:00:00
Fetching ARCO data: 31%|███ | 8/26 [00:01<00:01, 11.46it/s]
Total Ensemble Batches: 50%|█████ | 2/4 [07:10<06:16, 188.43s/it]
Running batch 4 inference: 40%|████ | 2/5 [00:41<01:00, 20.10s/it]
Fetching ARCO data: 35%|███▍ | 9/26 [00:01<00:02, 6.80it/s]
2025-01-23 04:57:16.319 | DEBUG | earth2studio.data.arco:fetch_array:227 - Fetching ARCO zarr array for variable: v500 at 2022-11-04T22:00:00
Fetching ARCO data: 46%|████▌ | 12/26 [00:01<00:02, 6.80it/s]
Total Ensemble Batches: 50%|█████ | 2/4 [07:10<06:16, 188.43s/it]
Running batch 4 inference: 40%|████ | 2/5 [00:41<01:00, 20.10s/it]
2025-01-23 04:57:16.520 | DEBUG | earth2studio.data.arco:fetch_array:227 - Fetching ARCO zarr array for variable: v250 at 2022-11-04T22:00:00
Fetching ARCO data: 46%|████▌ | 12/26 [00:01<00:02, 6.80it/s]
Total Ensemble Batches: 50%|█████ | 2/4 [07:10<06:16, 188.43s/it]
Running batch 4 inference: 40%|████ | 2/5 [00:41<01:00, 20.10s/it]
2025-01-23 04:57:16.720 | DEBUG | earth2studio.data.arco:fetch_array:227 - Fetching ARCO zarr array for variable: z1000 at 2022-11-04T22:00:00
Fetching ARCO data: 46%|████▌ | 12/26 [00:01<00:02, 6.80it/s]
Total Ensemble Batches: 50%|█████ | 2/4 [07:11<06:16, 188.43s/it]
Running batch 4 inference: 40%|████ | 2/5 [00:41<01:00, 20.10s/it]
2025-01-23 04:57:16.899 | DEBUG | earth2studio.data.arco:fetch_array:227 - Fetching ARCO zarr array for variable: z850 at 2022-11-04T22:00:00
Fetching ARCO data: 46%|████▌ | 12/26 [00:01<00:02, 6.80it/s]
Total Ensemble Batches: 50%|█████ | 2/4 [07:11<06:16, 188.43s/it]
Running batch 4 inference: 40%|████ | 2/5 [00:42<01:00, 20.10s/it]
Fetching ARCO data: 50%|█████ | 13/26 [00:02<00:02, 6.01it/s]
2025-01-23 04:57:17.087 | DEBUG | earth2studio.data.arco:fetch_array:227 - Fetching ARCO zarr array for variable: z500 at 2022-11-04T22:00:00
Fetching ARCO data: 62%|██████▏ | 16/26 [00:02<00:01, 6.01it/s]
Total Ensemble Batches: 50%|█████ | 2/4 [07:11<06:16, 188.43s/it]
Running batch 4 inference: 40%|████ | 2/5 [00:42<01:00, 20.10s/it]
2025-01-23 04:57:17.266 | DEBUG | earth2studio.data.arco:fetch_array:227 - Fetching ARCO zarr array for variable: z250 at 2022-11-04T22:00:00
Fetching ARCO data: 62%|██████▏ | 16/26 [00:02<00:01, 6.01it/s]
Total Ensemble Batches: 50%|█████ | 2/4 [07:11<06:16, 188.43s/it]
Running batch 4 inference: 40%|████ | 2/5 [00:42<01:00, 20.10s/it]
2025-01-23 04:57:17.450 | DEBUG | earth2studio.data.arco:fetch_array:227 - Fetching ARCO zarr array for variable: t1000 at 2022-11-04T22:00:00
Fetching ARCO data: 62%|██████▏ | 16/26 [00:02<00:01, 6.01it/s]
Total Ensemble Batches: 50%|█████ | 2/4 [07:11<06:16, 188.43s/it]
Running batch 4 inference: 40%|████ | 2/5 [00:42<01:00, 20.10s/it]
2025-01-23 04:57:17.639 | DEBUG | earth2studio.data.arco:fetch_array:227 - Fetching ARCO zarr array for variable: t850 at 2022-11-04T22:00:00
Fetching ARCO data: 62%|██████▏ | 16/26 [00:02<00:01, 6.01it/s]
Total Ensemble Batches: 50%|█████ | 2/4 [07:12<06:16, 188.43s/it]
Running batch 4 inference: 40%|████ | 2/5 [00:42<01:00, 20.10s/it]
Fetching ARCO data: 65%|██████▌ | 17/26 [00:02<00:01, 5.74it/s]
2025-01-23 04:57:17.835 | DEBUG | earth2studio.data.arco:fetch_array:227 - Fetching ARCO zarr array for variable: t500 at 2022-11-04T22:00:00
Fetching ARCO data: 77%|███████▋ | 20/26 [00:02<00:01, 5.74it/s]
Total Ensemble Batches: 50%|█████ | 2/4 [07:12<06:16, 188.43s/it]
Running batch 4 inference: 40%|████ | 2/5 [00:42<01:00, 20.10s/it]
2025-01-23 04:57:18.020 | DEBUG | earth2studio.data.arco:fetch_array:227 - Fetching ARCO zarr array for variable: t250 at 2022-11-04T22:00:00
Fetching ARCO data: 77%|███████▋ | 20/26 [00:02<00:01, 5.74it/s]
Total Ensemble Batches: 50%|█████ | 2/4 [07:12<06:16, 188.43s/it]
Running batch 4 inference: 40%|████ | 2/5 [00:43<01:00, 20.10s/it]
2025-01-23 04:57:18.206 | DEBUG | earth2studio.data.arco:fetch_array:227 - Fetching ARCO zarr array for variable: q1000 at 2022-11-04T22:00:00
Fetching ARCO data: 77%|███████▋ | 20/26 [00:03<00:01, 5.74it/s]
Total Ensemble Batches: 50%|█████ | 2/4 [07:12<06:16, 188.43s/it]
Running batch 4 inference: 40%|████ | 2/5 [00:43<01:00, 20.10s/it]
2025-01-23 04:57:18.397 | DEBUG | earth2studio.data.arco:fetch_array:227 - Fetching ARCO zarr array for variable: q850 at 2022-11-04T22:00:00
Fetching ARCO data: 77%|███████▋ | 20/26 [00:03<00:01, 5.74it/s]
Total Ensemble Batches: 50%|█████ | 2/4 [07:12<06:16, 188.43s/it]
Running batch 4 inference: 40%|████ | 2/5 [00:43<01:00, 20.10s/it]
Fetching ARCO data: 81%|████████ | 21/26 [00:03<00:00, 5.56it/s]
2025-01-23 04:57:18.596 | DEBUG | earth2studio.data.arco:fetch_array:227 - Fetching ARCO zarr array for variable: q500 at 2022-11-04T22:00:00
Fetching ARCO data: 92%|█████████▏| 24/26 [00:03<00:00, 5.56it/s]
Total Ensemble Batches: 50%|█████ | 2/4 [07:12<06:16, 188.43s/it]
Running batch 4 inference: 40%|████ | 2/5 [00:43<01:00, 20.10s/it]
2025-01-23 04:57:18.786 | DEBUG | earth2studio.data.arco:fetch_array:227 - Fetching ARCO zarr array for variable: q250 at 2022-11-04T22:00:00
Fetching ARCO data: 92%|█████████▏| 24/26 [00:03<00:00, 5.56it/s]
Total Ensemble Batches: 50%|█████ | 2/4 [07:13<06:16, 188.43s/it]
Running batch 4 inference: 40%|████ | 2/5 [00:43<01:00, 20.10s/it]
Fetching ARCO data: 96%|█████████▌| 25/26 [00:03<00:00, 6.57it/s]
Fetching ARCO data: 100%|██████████| 26/26 [00:03<00:00, 6.67it/s]
Running batch 4 inference: 60%|██████ | 3/5 [01:20<00:56, 28.44s/it]
Fetching ARCO data: 0%| | 0/26 [00:00<?, ?it/s]
2025-01-23 04:57:55.207 | DEBUG | earth2studio.data.arco:fetch_array:227 - Fetching ARCO zarr array for variable: u10m at 2022-11-04T23:00:00
Fetching ARCO data: 0%| | 0/26 [00:00<?, ?it/s]
Total Ensemble Batches: 50%|█████ | 2/4 [07:49<06:16, 188.43s/it]
Running batch 4 inference: 60%|██████ | 3/5 [01:20<00:56, 28.44s/it]
2025-01-23 04:57:55.213 | DEBUG | earth2studio.data.arco:fetch_array:227 - Fetching ARCO zarr array for variable: v10m at 2022-11-04T23:00:00
Fetching ARCO data: 0%| | 0/26 [00:00<?, ?it/s]
Total Ensemble Batches: 50%|█████ | 2/4 [07:49<06:16, 188.43s/it]
Running batch 4 inference: 60%|██████ | 3/5 [01:20<00:56, 28.44s/it]
2025-01-23 04:57:55.219 | DEBUG | earth2studio.data.arco:fetch_array:227 - Fetching ARCO zarr array for variable: t2m at 2022-11-04T23:00:00
Fetching ARCO data: 0%| | 0/26 [00:00<?, ?it/s]
Total Ensemble Batches: 50%|█████ | 2/4 [07:49<06:16, 188.43s/it]
Running batch 4 inference: 60%|██████ | 3/5 [01:20<00:56, 28.44s/it]
2025-01-23 04:57:55.225 | DEBUG | earth2studio.data.arco:fetch_array:227 - Fetching ARCO zarr array for variable: tcwv at 2022-11-04T23:00:00
Fetching ARCO data: 0%| | 0/26 [00:00<?, ?it/s]
Total Ensemble Batches: 50%|█████ | 2/4 [07:49<06:16, 188.43s/it]
Running batch 4 inference: 60%|██████ | 3/5 [01:20<00:56, 28.44s/it]
2025-01-23 04:57:55.242 | DEBUG | earth2studio.data.arco:fetch_array:227 - Fetching ARCO zarr array for variable: msl at 2022-11-04T23:00:00
Fetching ARCO data: 15%|█▌ | 4/26 [00:00<00:00, 109.23it/s]
Total Ensemble Batches: 50%|█████ | 2/4 [07:49<06:16, 188.43s/it]
Running batch 4 inference: 60%|██████ | 3/5 [01:20<00:56, 28.44s/it]
2025-01-23 04:57:55.247 | DEBUG | earth2studio.data.arco:fetch_array:227 - Fetching ARCO zarr array for variable: sp at 2022-11-04T23:00:00
Fetching ARCO data: 15%|█▌ | 4/26 [00:00<00:00, 96.36it/s]
Total Ensemble Batches: 50%|█████ | 2/4 [07:49<06:16, 188.43s/it]
Running batch 4 inference: 60%|██████ | 3/5 [01:20<00:56, 28.44s/it]
2025-01-23 04:57:55.251 | DEBUG | earth2studio.data.arco:fetch_array:227 - Fetching ARCO zarr array for variable: u1000 at 2022-11-04T23:00:00
Fetching ARCO data: 15%|█▌ | 4/26 [00:00<00:00, 87.22it/s]
Total Ensemble Batches: 50%|█████ | 2/4 [07:49<06:16, 188.43s/it]
Running batch 4 inference: 60%|██████ | 3/5 [01:20<00:56, 28.44s/it]
2025-01-23 04:57:55.446 | DEBUG | earth2studio.data.arco:fetch_array:227 - Fetching ARCO zarr array for variable: u850 at 2022-11-04T23:00:00
Fetching ARCO data: 15%|█▌ | 4/26 [00:00<00:01, 16.61it/s]
Total Ensemble Batches: 50%|█████ | 2/4 [07:49<06:16, 188.43s/it]
Running batch 4 inference: 60%|██████ | 3/5 [01:20<00:56, 28.44s/it]
Fetching ARCO data: 19%|█▉ | 5/26 [00:00<00:01, 11.48it/s]
2025-01-23 04:57:55.648 | DEBUG | earth2studio.data.arco:fetch_array:227 - Fetching ARCO zarr array for variable: u500 at 2022-11-04T23:00:00
Fetching ARCO data: 31%|███ | 8/26 [00:00<00:01, 11.48it/s]
Total Ensemble Batches: 50%|█████ | 2/4 [07:50<06:16, 188.43s/it]
Running batch 4 inference: 60%|██████ | 3/5 [01:20<00:56, 28.44s/it]
2025-01-23 04:57:55.842 | DEBUG | earth2studio.data.arco:fetch_array:227 - Fetching ARCO zarr array for variable: u250 at 2022-11-04T23:00:00
Fetching ARCO data: 31%|███ | 8/26 [00:00<00:01, 11.48it/s]
Total Ensemble Batches: 50%|█████ | 2/4 [07:50<06:16, 188.43s/it]
Running batch 4 inference: 60%|██████ | 3/5 [01:20<00:56, 28.44s/it]
2025-01-23 04:57:56.038 | DEBUG | earth2studio.data.arco:fetch_array:227 - Fetching ARCO zarr array for variable: v1000 at 2022-11-04T23:00:00
Fetching ARCO data: 31%|███ | 8/26 [00:00<00:01, 11.48it/s]
Total Ensemble Batches: 50%|█████ | 2/4 [07:50<06:16, 188.43s/it]
Running batch 4 inference: 60%|██████ | 3/5 [01:21<00:56, 28.44s/it]
2025-01-23 04:57:56.237 | DEBUG | earth2studio.data.arco:fetch_array:227 - Fetching ARCO zarr array for variable: v850 at 2022-11-04T23:00:00
Fetching ARCO data: 31%|███ | 8/26 [00:01<00:01, 11.48it/s]
Total Ensemble Batches: 50%|█████ | 2/4 [07:50<06:16, 188.43s/it]
Running batch 4 inference: 60%|██████ | 3/5 [01:21<00:56, 28.44s/it]
Fetching ARCO data: 35%|███▍ | 9/26 [00:01<00:02, 6.80it/s]
2025-01-23 04:57:56.446 | DEBUG | earth2studio.data.arco:fetch_array:227 - Fetching ARCO zarr array for variable: v500 at 2022-11-04T23:00:00
Fetching ARCO data: 46%|████▌ | 12/26 [00:01<00:02, 6.80it/s]
Total Ensemble Batches: 50%|█████ | 2/4 [07:50<06:16, 188.43s/it]
Running batch 4 inference: 60%|██████ | 3/5 [01:21<00:56, 28.44s/it]
2025-01-23 04:57:56.645 | DEBUG | earth2studio.data.arco:fetch_array:227 - Fetching ARCO zarr array for variable: v250 at 2022-11-04T23:00:00
Fetching ARCO data: 46%|████▌ | 12/26 [00:01<00:02, 6.80it/s]
Total Ensemble Batches: 50%|█████ | 2/4 [07:51<06:16, 188.43s/it]
Running batch 4 inference: 60%|██████ | 3/5 [01:21<00:56, 28.44s/it]
2025-01-23 04:57:56.844 | DEBUG | earth2studio.data.arco:fetch_array:227 - Fetching ARCO zarr array for variable: z1000 at 2022-11-04T23:00:00
Fetching ARCO data: 46%|████▌ | 12/26 [00:01<00:02, 6.80it/s]
Total Ensemble Batches: 50%|█████ | 2/4 [07:51<06:16, 188.43s/it]
Running batch 4 inference: 60%|██████ | 3/5 [01:21<00:56, 28.44s/it]
2025-01-23 04:57:57.022 | DEBUG | earth2studio.data.arco:fetch_array:227 - Fetching ARCO zarr array for variable: z850 at 2022-11-04T23:00:00
Fetching ARCO data: 46%|████▌ | 12/26 [00:01<00:02, 6.80it/s]
Total Ensemble Batches: 50%|█████ | 2/4 [07:51<06:16, 188.43s/it]
Running batch 4 inference: 60%|██████ | 3/5 [01:22<00:56, 28.44s/it]
Fetching ARCO data: 50%|█████ | 13/26 [00:01<00:02, 6.03it/s]
2025-01-23 04:57:57.209 | DEBUG | earth2studio.data.arco:fetch_array:227 - Fetching ARCO zarr array for variable: z500 at 2022-11-04T23:00:00
Fetching ARCO data: 62%|██████▏ | 16/26 [00:02<00:01, 6.03it/s]
Total Ensemble Batches: 50%|█████ | 2/4 [07:51<06:16, 188.43s/it]
Running batch 4 inference: 60%|██████ | 3/5 [01:22<00:56, 28.44s/it]
2025-01-23 04:57:57.390 | DEBUG | earth2studio.data.arco:fetch_array:227 - Fetching ARCO zarr array for variable: z250 at 2022-11-04T23:00:00
Fetching ARCO data: 62%|██████▏ | 16/26 [00:02<00:01, 6.03it/s]
Total Ensemble Batches: 50%|█████ | 2/4 [07:51<06:16, 188.43s/it]
Running batch 4 inference: 60%|██████ | 3/5 [01:22<00:56, 28.44s/it]
2025-01-23 04:57:57.570 | DEBUG | earth2studio.data.arco:fetch_array:227 - Fetching ARCO zarr array for variable: t1000 at 2022-11-04T23:00:00
Fetching ARCO data: 62%|██████▏ | 16/26 [00:02<00:01, 6.03it/s]
Total Ensemble Batches: 50%|█████ | 2/4 [07:51<06:16, 188.43s/it]
Running batch 4 inference: 60%|██████ | 3/5 [01:22<00:56, 28.44s/it]
2025-01-23 04:57:57.761 | DEBUG | earth2studio.data.arco:fetch_array:227 - Fetching ARCO zarr array for variable: t850 at 2022-11-04T23:00:00
Fetching ARCO data: 62%|██████▏ | 16/26 [00:02<00:01, 6.03it/s]
Total Ensemble Batches: 50%|█████ | 2/4 [07:52<06:16, 188.43s/it]
Running batch 4 inference: 60%|██████ | 3/5 [01:22<00:56, 28.44s/it]
Fetching ARCO data: 65%|██████▌ | 17/26 [00:02<00:01, 5.76it/s]
2025-01-23 04:57:57.955 | DEBUG | earth2studio.data.arco:fetch_array:227 - Fetching ARCO zarr array for variable: t500 at 2022-11-04T23:00:00
Fetching ARCO data: 77%|███████▋ | 20/26 [00:02<00:01, 5.76it/s]
Total Ensemble Batches: 50%|█████ | 2/4 [07:52<06:16, 188.43s/it]
Running batch 4 inference: 60%|██████ | 3/5 [01:23<00:56, 28.44s/it]
2025-01-23 04:57:58.141 | DEBUG | earth2studio.data.arco:fetch_array:227 - Fetching ARCO zarr array for variable: t250 at 2022-11-04T23:00:00
Fetching ARCO data: 77%|███████▋ | 20/26 [00:02<00:01, 5.76it/s]
Total Ensemble Batches: 50%|█████ | 2/4 [07:52<06:16, 188.43s/it]
Running batch 4 inference: 60%|██████ | 3/5 [01:23<00:56, 28.44s/it]
2025-01-23 04:57:58.327 | DEBUG | earth2studio.data.arco:fetch_array:227 - Fetching ARCO zarr array for variable: q1000 at 2022-11-04T23:00:00
Fetching ARCO data: 77%|███████▋ | 20/26 [00:03<00:01, 5.76it/s]
Total Ensemble Batches: 50%|█████ | 2/4 [07:52<06:16, 188.43s/it]
Running batch 4 inference: 60%|██████ | 3/5 [01:23<00:56, 28.44s/it]
2025-01-23 04:57:58.516 | DEBUG | earth2studio.data.arco:fetch_array:227 - Fetching ARCO zarr array for variable: q850 at 2022-11-04T23:00:00
Fetching ARCO data: 77%|███████▋ | 20/26 [00:03<00:01, 5.76it/s]
Total Ensemble Batches: 50%|█████ | 2/4 [07:52<06:16, 188.43s/it]
Running batch 4 inference: 60%|██████ | 3/5 [01:23<00:56, 28.44s/it]
Fetching ARCO data: 81%|████████ | 21/26 [00:03<00:00, 5.57it/s]
2025-01-23 04:57:58.714 | DEBUG | earth2studio.data.arco:fetch_array:227 - Fetching ARCO zarr array for variable: q500 at 2022-11-04T23:00:00
Fetching ARCO data: 92%|█████████▏| 24/26 [00:03<00:00, 5.57it/s]
Total Ensemble Batches: 50%|█████ | 2/4 [07:53<06:16, 188.43s/it]
Running batch 4 inference: 60%|██████ | 3/5 [01:23<00:56, 28.44s/it]
2025-01-23 04:57:58.906 | DEBUG | earth2studio.data.arco:fetch_array:227 - Fetching ARCO zarr array for variable: q250 at 2022-11-04T23:00:00
Fetching ARCO data: 92%|█████████▏| 24/26 [00:03<00:00, 5.57it/s]
Total Ensemble Batches: 50%|█████ | 2/4 [07:53<06:16, 188.43s/it]
Running batch 4 inference: 60%|██████ | 3/5 [01:24<00:56, 28.44s/it]
Fetching ARCO data: 96%|█████████▌| 25/26 [00:03<00:00, 6.58it/s]
Fetching ARCO data: 100%|██████████| 26/26 [00:03<00:00, 6.68it/s]
Running batch 4 inference: 80%|████████ | 4/5 [02:00<00:32, 32.81s/it]
Fetching ARCO data: 0%| | 0/26 [00:00<?, ?it/s]
2025-01-23 04:58:35.355 | DEBUG | earth2studio.data.arco:fetch_array:227 - Fetching ARCO zarr array for variable: u10m at 2022-11-05T00:00:00
Fetching ARCO data: 0%| | 0/26 [00:00<?, ?it/s]
Total Ensemble Batches: 50%|█████ | 2/4 [08:29<06:16, 188.43s/it]
Running batch 4 inference: 80%|████████ | 4/5 [02:00<00:32, 32.81s/it]
2025-01-23 04:58:35.361 | DEBUG | earth2studio.data.arco:fetch_array:227 - Fetching ARCO zarr array for variable: v10m at 2022-11-05T00:00:00
Fetching ARCO data: 0%| | 0/26 [00:00<?, ?it/s]
Total Ensemble Batches: 50%|█████ | 2/4 [08:29<06:16, 188.43s/it]
Running batch 4 inference: 80%|████████ | 4/5 [02:00<00:32, 32.81s/it]
2025-01-23 04:58:35.366 | DEBUG | earth2studio.data.arco:fetch_array:227 - Fetching ARCO zarr array for variable: t2m at 2022-11-05T00:00:00
Fetching ARCO data: 0%| | 0/26 [00:00<?, ?it/s]
Total Ensemble Batches: 50%|█████ | 2/4 [08:29<06:16, 188.43s/it]
Running batch 4 inference: 80%|████████ | 4/5 [02:00<00:32, 32.81s/it]
2025-01-23 04:58:35.372 | DEBUG | earth2studio.data.arco:fetch_array:227 - Fetching ARCO zarr array for variable: tcwv at 2022-11-05T00:00:00
Fetching ARCO data: 0%| | 0/26 [00:00<?, ?it/s]
Total Ensemble Batches: 50%|█████ | 2/4 [08:29<06:16, 188.43s/it]
Running batch 4 inference: 80%|████████ | 4/5 [02:00<00:32, 32.81s/it]
2025-01-23 04:58:35.388 | DEBUG | earth2studio.data.arco:fetch_array:227 - Fetching ARCO zarr array for variable: msl at 2022-11-05T00:00:00
Fetching ARCO data: 15%|█▌ | 4/26 [00:00<00:00, 114.78it/s]
Total Ensemble Batches: 50%|█████ | 2/4 [08:29<06:16, 188.43s/it]
Running batch 4 inference: 80%|████████ | 4/5 [02:00<00:32, 32.81s/it]
2025-01-23 04:58:35.392 | DEBUG | earth2studio.data.arco:fetch_array:227 - Fetching ARCO zarr array for variable: sp at 2022-11-05T00:00:00
Fetching ARCO data: 15%|█▌ | 4/26 [00:00<00:00, 101.84it/s]
Total Ensemble Batches: 50%|█████ | 2/4 [08:29<06:16, 188.43s/it]
Running batch 4 inference: 80%|████████ | 4/5 [02:00<00:32, 32.81s/it]
2025-01-23 04:58:35.397 | DEBUG | earth2studio.data.arco:fetch_array:227 - Fetching ARCO zarr array for variable: u1000 at 2022-11-05T00:00:00
Fetching ARCO data: 15%|█▌ | 4/26 [00:00<00:00, 90.46it/s]
Total Ensemble Batches: 50%|█████ | 2/4 [08:29<06:16, 188.43s/it]
Running batch 4 inference: 80%|████████ | 4/5 [02:00<00:32, 32.81s/it]
2025-01-23 04:58:35.593 | DEBUG | earth2studio.data.arco:fetch_array:227 - Fetching ARCO zarr array for variable: u850 at 2022-11-05T00:00:00
Fetching ARCO data: 15%|█▌ | 4/26 [00:00<00:01, 16.67it/s]
Total Ensemble Batches: 50%|█████ | 2/4 [08:29<06:16, 188.43s/it]
Running batch 4 inference: 80%|████████ | 4/5 [02:00<00:32, 32.81s/it]
Fetching ARCO data: 19%|█▉ | 5/26 [00:00<00:01, 11.48it/s]
2025-01-23 04:58:35.796 | DEBUG | earth2studio.data.arco:fetch_array:227 - Fetching ARCO zarr array for variable: u500 at 2022-11-05T00:00:00
Fetching ARCO data: 31%|███ | 8/26 [00:00<00:01, 11.48it/s]
Total Ensemble Batches: 50%|█████ | 2/4 [08:30<06:16, 188.43s/it]
Running batch 4 inference: 80%|████████ | 4/5 [02:00<00:32, 32.81s/it]
2025-01-23 04:58:35.991 | DEBUG | earth2studio.data.arco:fetch_array:227 - Fetching ARCO zarr array for variable: u250 at 2022-11-05T00:00:00
Fetching ARCO data: 31%|███ | 8/26 [00:00<00:01, 11.48it/s]
Total Ensemble Batches: 50%|█████ | 2/4 [08:30<06:16, 188.43s/it]
Running batch 4 inference: 80%|████████ | 4/5 [02:01<00:32, 32.81s/it]
2025-01-23 04:58:36.189 | DEBUG | earth2studio.data.arco:fetch_array:227 - Fetching ARCO zarr array for variable: v1000 at 2022-11-05T00:00:00
Fetching ARCO data: 31%|███ | 8/26 [00:00<00:01, 11.48it/s]
Total Ensemble Batches: 50%|█████ | 2/4 [08:30<06:16, 188.43s/it]
Running batch 4 inference: 80%|████████ | 4/5 [02:01<00:32, 32.81s/it]
2025-01-23 04:58:36.389 | DEBUG | earth2studio.data.arco:fetch_array:227 - Fetching ARCO zarr array for variable: v850 at 2022-11-05T00:00:00
Fetching ARCO data: 31%|███ | 8/26 [00:01<00:01, 11.48it/s]
Total Ensemble Batches: 50%|█████ | 2/4 [08:30<06:16, 188.43s/it]
Running batch 4 inference: 80%|████████ | 4/5 [02:01<00:32, 32.81s/it]
Fetching ARCO data: 35%|███▍ | 9/26 [00:01<00:02, 6.79it/s]
2025-01-23 04:58:36.596 | DEBUG | earth2studio.data.arco:fetch_array:227 - Fetching ARCO zarr array for variable: v500 at 2022-11-05T00:00:00
Fetching ARCO data: 46%|████▌ | 12/26 [00:01<00:02, 6.79it/s]
Total Ensemble Batches: 50%|█████ | 2/4 [08:30<06:16, 188.43s/it]
Running batch 4 inference: 80%|████████ | 4/5 [02:01<00:32, 32.81s/it]
2025-01-23 04:58:36.796 | DEBUG | earth2studio.data.arco:fetch_array:227 - Fetching ARCO zarr array for variable: v250 at 2022-11-05T00:00:00
Fetching ARCO data: 46%|████▌ | 12/26 [00:01<00:02, 6.79it/s]
Total Ensemble Batches: 50%|█████ | 2/4 [08:31<06:16, 188.43s/it]
Running batch 4 inference: 80%|████████ | 4/5 [02:01<00:32, 32.81s/it]
2025-01-23 04:58:36.995 | DEBUG | earth2studio.data.arco:fetch_array:227 - Fetching ARCO zarr array for variable: z1000 at 2022-11-05T00:00:00
Fetching ARCO data: 46%|████▌ | 12/26 [00:01<00:02, 6.79it/s]
Total Ensemble Batches: 50%|█████ | 2/4 [08:31<06:16, 188.43s/it]
Running batch 4 inference: 80%|████████ | 4/5 [02:02<00:32, 32.81s/it]
2025-01-23 04:58:37.174 | DEBUG | earth2studio.data.arco:fetch_array:227 - Fetching ARCO zarr array for variable: z850 at 2022-11-05T00:00:00
Fetching ARCO data: 46%|████▌ | 12/26 [00:01<00:02, 6.79it/s]
Total Ensemble Batches: 50%|█████ | 2/4 [08:31<06:16, 188.43s/it]
Running batch 4 inference: 80%|████████ | 4/5 [02:02<00:32, 32.81s/it]
Fetching ARCO data: 50%|█████ | 13/26 [00:02<00:02, 6.00it/s]
2025-01-23 04:58:37.363 | DEBUG | earth2studio.data.arco:fetch_array:227 - Fetching ARCO zarr array for variable: z500 at 2022-11-05T00:00:00
Fetching ARCO data: 62%|██████▏ | 16/26 [00:02<00:01, 6.00it/s]
Total Ensemble Batches: 50%|█████ | 2/4 [08:31<06:16, 188.43s/it]
Running batch 4 inference: 80%|████████ | 4/5 [02:02<00:32, 32.81s/it]
2025-01-23 04:58:37.543 | DEBUG | earth2studio.data.arco:fetch_array:227 - Fetching ARCO zarr array for variable: z250 at 2022-11-05T00:00:00
Fetching ARCO data: 62%|██████▏ | 16/26 [00:02<00:01, 6.00it/s]
Total Ensemble Batches: 50%|█████ | 2/4 [08:31<06:16, 188.43s/it]
Running batch 4 inference: 80%|████████ | 4/5 [02:02<00:32, 32.81s/it]
2025-01-23 04:58:37.724 | DEBUG | earth2studio.data.arco:fetch_array:227 - Fetching ARCO zarr array for variable: t1000 at 2022-11-05T00:00:00
Fetching ARCO data: 62%|██████▏ | 16/26 [00:02<00:01, 6.00it/s]
Total Ensemble Batches: 50%|█████ | 2/4 [08:32<06:16, 188.43s/it]
Running batch 4 inference: 80%|████████ | 4/5 [02:02<00:32, 32.81s/it]
2025-01-23 04:58:37.910 | DEBUG | earth2studio.data.arco:fetch_array:227 - Fetching ARCO zarr array for variable: t850 at 2022-11-05T00:00:00
Fetching ARCO data: 62%|██████▏ | 16/26 [00:02<00:01, 6.00it/s]
Total Ensemble Batches: 50%|█████ | 2/4 [08:32<06:16, 188.43s/it]
Running batch 4 inference: 80%|████████ | 4/5 [02:03<00:32, 32.81s/it]
Fetching ARCO data: 65%|██████▌ | 17/26 [00:02<00:01, 5.75it/s]
2025-01-23 04:58:38.106 | DEBUG | earth2studio.data.arco:fetch_array:227 - Fetching ARCO zarr array for variable: t500 at 2022-11-05T00:00:00
Fetching ARCO data: 77%|███████▋ | 20/26 [00:02<00:01, 5.75it/s]
Total Ensemble Batches: 50%|█████ | 2/4 [08:32<06:16, 188.43s/it]
Running batch 4 inference: 80%|████████ | 4/5 [02:03<00:32, 32.81s/it]
2025-01-23 04:58:38.292 | DEBUG | earth2studio.data.arco:fetch_array:227 - Fetching ARCO zarr array for variable: t250 at 2022-11-05T00:00:00
Fetching ARCO data: 77%|███████▋ | 20/26 [00:02<00:01, 5.75it/s]
Total Ensemble Batches: 50%|█████ | 2/4 [08:32<06:16, 188.43s/it]
Running batch 4 inference: 80%|████████ | 4/5 [02:03<00:32, 32.81s/it]
2025-01-23 04:58:38.478 | DEBUG | earth2studio.data.arco:fetch_array:227 - Fetching ARCO zarr array for variable: q1000 at 2022-11-05T00:00:00
Fetching ARCO data: 77%|███████▋ | 20/26 [00:03<00:01, 5.75it/s]
Total Ensemble Batches: 50%|█████ | 2/4 [08:32<06:16, 188.43s/it]
Running batch 4 inference: 80%|████████ | 4/5 [02:03<00:32, 32.81s/it]
2025-01-23 04:58:38.669 | DEBUG | earth2studio.data.arco:fetch_array:227 - Fetching ARCO zarr array for variable: q850 at 2022-11-05T00:00:00
Fetching ARCO data: 77%|███████▋ | 20/26 [00:03<00:01, 5.75it/s]
Total Ensemble Batches: 50%|█████ | 2/4 [08:33<06:16, 188.43s/it]
Running batch 4 inference: 80%|████████ | 4/5 [02:03<00:32, 32.81s/it]
Fetching ARCO data: 81%|████████ | 21/26 [00:03<00:00, 5.56it/s]
2025-01-23 04:58:38.869 | DEBUG | earth2studio.data.arco:fetch_array:227 - Fetching ARCO zarr array for variable: q500 at 2022-11-05T00:00:00
Fetching ARCO data: 92%|█████████▏| 24/26 [00:03<00:00, 5.56it/s]
Total Ensemble Batches: 50%|█████ | 2/4 [08:33<06:16, 188.43s/it]
Running batch 4 inference: 80%|████████ | 4/5 [02:03<00:32, 32.81s/it]
2025-01-23 04:58:39.060 | DEBUG | earth2studio.data.arco:fetch_array:227 - Fetching ARCO zarr array for variable: q250 at 2022-11-05T00:00:00
Fetching ARCO data: 92%|█████████▏| 24/26 [00:03<00:00, 5.56it/s]
Total Ensemble Batches: 50%|█████ | 2/4 [08:33<06:16, 188.43s/it]
Running batch 4 inference: 80%|████████ | 4/5 [02:04<00:32, 32.81s/it]
Fetching ARCO data: 96%|█████████▌| 25/26 [00:03<00:00, 6.57it/s]
Fetching ARCO data: 100%|██████████| 26/26 [00:03<00:00, 6.67it/s]
Running batch 4 inference: 100%|██████████| 5/5 [02:40<00:00, 35.37s/it]
Total Ensemble Batches: 75%|███████▌ | 3/4 [09:09<02:55, 175.79s/it]
Running batch 6 inference: 0%| | 0/5 [00:00<?, ?it/s]
Fetching ARCO data: 0%| | 0/26 [00:00<?, ?it/s]
2025-01-23 04:59:15.702 | DEBUG | earth2studio.data.arco:fetch_array:227 - Fetching ARCO zarr array for variable: u10m at 2022-11-04T21:00:00
Fetching ARCO data: 0%| | 0/26 [00:00<?, ?it/s]
Total Ensemble Batches: 75%|███████▌ | 3/4 [09:10<02:55, 175.79s/it]
Running batch 6 inference: 20%|██ | 1/5 [00:00<00:00, 11.37it/s]
2025-01-23 04:59:15.708 | DEBUG | earth2studio.data.arco:fetch_array:227 - Fetching ARCO zarr array for variable: v10m at 2022-11-04T21:00:00
Fetching ARCO data: 0%| | 0/26 [00:00<?, ?it/s]
Total Ensemble Batches: 75%|███████▌ | 3/4 [09:10<02:55, 175.79s/it]
Running batch 6 inference: 20%|██ | 1/5 [00:00<00:00, 10.67it/s]
2025-01-23 04:59:15.714 | DEBUG | earth2studio.data.arco:fetch_array:227 - Fetching ARCO zarr array for variable: t2m at 2022-11-04T21:00:00
Fetching ARCO data: 0%| | 0/26 [00:00<?, ?it/s]
Total Ensemble Batches: 75%|███████▌ | 3/4 [09:10<02:55, 175.79s/it]
Running batch 6 inference: 20%|██ | 1/5 [00:00<00:00, 10.02it/s]
2025-01-23 04:59:15.720 | DEBUG | earth2studio.data.arco:fetch_array:227 - Fetching ARCO zarr array for variable: tcwv at 2022-11-04T21:00:00
Fetching ARCO data: 0%| | 0/26 [00:00<?, ?it/s]
Total Ensemble Batches: 75%|███████▌ | 3/4 [09:10<02:55, 175.79s/it]
Running batch 6 inference: 20%|██ | 1/5 [00:00<00:00, 9.45it/s]
2025-01-23 04:59:15.736 | DEBUG | earth2studio.data.arco:fetch_array:227 - Fetching ARCO zarr array for variable: msl at 2022-11-04T21:00:00
Fetching ARCO data: 15%|█▌ | 4/26 [00:00<00:00, 108.75it/s]
Total Ensemble Batches: 75%|███████▌ | 3/4 [09:10<02:55, 175.79s/it]
Running batch 6 inference: 20%|██ | 1/5 [00:00<00:00, 8.22it/s]
2025-01-23 04:59:15.740 | DEBUG | earth2studio.data.arco:fetch_array:227 - Fetching ARCO zarr array for variable: sp at 2022-11-04T21:00:00
Fetching ARCO data: 15%|█▌ | 4/26 [00:00<00:00, 97.24it/s]
Total Ensemble Batches: 75%|███████▌ | 3/4 [09:10<02:55, 175.79s/it]
Running batch 6 inference: 20%|██ | 1/5 [00:00<00:00, 7.93it/s]
2025-01-23 04:59:15.745 | DEBUG | earth2studio.data.arco:fetch_array:227 - Fetching ARCO zarr array for variable: u1000 at 2022-11-04T21:00:00
Fetching ARCO data: 15%|█▌ | 4/26 [00:00<00:00, 87.36it/s]
Total Ensemble Batches: 75%|███████▌ | 3/4 [09:10<02:55, 175.79s/it]
Running batch 6 inference: 20%|██ | 1/5 [00:00<00:00, 7.65it/s]
2025-01-23 04:59:15.940 | DEBUG | earth2studio.data.arco:fetch_array:227 - Fetching ARCO zarr array for variable: u850 at 2022-11-04T21:00:00
Fetching ARCO data: 15%|█▌ | 4/26 [00:00<00:01, 16.61it/s]
Total Ensemble Batches: 75%|███████▌ | 3/4 [09:10<02:55, 175.79s/it]
Running batch 6 inference: 20%|██ | 1/5 [00:00<00:01, 3.07it/s]
Fetching ARCO data: 19%|█▉ | 5/26 [00:00<00:01, 11.47it/s]
2025-01-23 04:59:16.143 | DEBUG | earth2studio.data.arco:fetch_array:227 - Fetching ARCO zarr array for variable: u500 at 2022-11-04T21:00:00
Fetching ARCO data: 31%|███ | 8/26 [00:00<00:01, 11.47it/s]
Total Ensemble Batches: 75%|███████▌ | 3/4 [09:10<02:55, 175.79s/it]
Running batch 6 inference: 20%|██ | 1/5 [00:00<00:02, 1.89it/s]
2025-01-23 04:59:16.339 | DEBUG | earth2studio.data.arco:fetch_array:227 - Fetching ARCO zarr array for variable: u250 at 2022-11-04T21:00:00
Fetching ARCO data: 31%|███ | 8/26 [00:00<00:01, 11.47it/s]
Total Ensemble Batches: 75%|███████▌ | 3/4 [09:10<02:55, 175.79s/it]
Running batch 6 inference: 20%|██ | 1/5 [00:00<00:02, 1.38it/s]
2025-01-23 04:59:16.535 | DEBUG | earth2studio.data.arco:fetch_array:227 - Fetching ARCO zarr array for variable: v1000 at 2022-11-04T21:00:00
Fetching ARCO data: 31%|███ | 8/26 [00:00<00:01, 11.47it/s]
Total Ensemble Batches: 75%|███████▌ | 3/4 [09:10<02:55, 175.79s/it]
Running batch 6 inference: 20%|██ | 1/5 [00:00<00:03, 1.09it/s]
2025-01-23 04:59:16.735 | DEBUG | earth2studio.data.arco:fetch_array:227 - Fetching ARCO zarr array for variable: v850 at 2022-11-04T21:00:00
Fetching ARCO data: 31%|███ | 8/26 [00:01<00:01, 11.47it/s]
Total Ensemble Batches: 75%|███████▌ | 3/4 [09:11<02:55, 175.79s/it]
Running batch 6 inference: 20%|██ | 1/5 [00:01<00:04, 1.12s/it]
Fetching ARCO data: 35%|███▍ | 9/26 [00:01<00:02, 6.79it/s]
2025-01-23 04:59:16.942 | DEBUG | earth2studio.data.arco:fetch_array:227 - Fetching ARCO zarr array for variable: v500 at 2022-11-04T21:00:00
Fetching ARCO data: 46%|████▌ | 12/26 [00:01<00:02, 6.79it/s]
Total Ensemble Batches: 75%|███████▌ | 3/4 [09:11<02:55, 175.79s/it]
Running batch 6 inference: 20%|██ | 1/5 [00:01<00:05, 1.33s/it]
2025-01-23 04:59:17.141 | DEBUG | earth2studio.data.arco:fetch_array:227 - Fetching ARCO zarr array for variable: v250 at 2022-11-04T21:00:00
Fetching ARCO data: 46%|████▌ | 12/26 [00:01<00:02, 6.79it/s]
Total Ensemble Batches: 75%|███████▌ | 3/4 [09:11<02:55, 175.79s/it]
Running batch 6 inference: 20%|██ | 1/5 [00:01<00:06, 1.53s/it]
2025-01-23 04:59:17.343 | DEBUG | earth2studio.data.arco:fetch_array:227 - Fetching ARCO zarr array for variable: z1000 at 2022-11-04T21:00:00
Fetching ARCO data: 46%|████▌ | 12/26 [00:01<00:02, 6.79it/s]
Total Ensemble Batches: 75%|███████▌ | 3/4 [09:11<02:55, 175.79s/it]
Running batch 6 inference: 20%|██ | 1/5 [00:01<00:06, 1.73s/it]
2025-01-23 04:59:17.522 | DEBUG | earth2studio.data.arco:fetch_array:227 - Fetching ARCO zarr array for variable: z850 at 2022-11-04T21:00:00
Fetching ARCO data: 46%|████▌ | 12/26 [00:01<00:02, 6.79it/s]
Total Ensemble Batches: 75%|███████▌ | 3/4 [09:11<02:55, 175.79s/it]
Running batch 6 inference: 20%|██ | 1/5 [00:01<00:07, 1.91s/it]
Fetching ARCO data: 50%|█████ | 13/26 [00:02<00:02, 6.00it/s]
2025-01-23 04:59:17.710 | DEBUG | earth2studio.data.arco:fetch_array:227 - Fetching ARCO zarr array for variable: z500 at 2022-11-04T21:00:00
Fetching ARCO data: 62%|██████▏ | 16/26 [00:02<00:01, 6.00it/s]
Total Ensemble Batches: 75%|███████▌ | 3/4 [09:12<02:55, 175.79s/it]
Running batch 6 inference: 20%|██ | 1/5 [00:02<00:08, 2.10s/it]
2025-01-23 04:59:17.889 | DEBUG | earth2studio.data.arco:fetch_array:227 - Fetching ARCO zarr array for variable: z250 at 2022-11-04T21:00:00
Fetching ARCO data: 62%|██████▏ | 16/26 [00:02<00:01, 6.00it/s]
Total Ensemble Batches: 75%|███████▌ | 3/4 [09:12<02:55, 175.79s/it]
Running batch 6 inference: 20%|██ | 1/5 [00:02<00:09, 2.27s/it]
2025-01-23 04:59:18.068 | DEBUG | earth2studio.data.arco:fetch_array:227 - Fetching ARCO zarr array for variable: t1000 at 2022-11-04T21:00:00
Fetching ARCO data: 62%|██████▏ | 16/26 [00:02<00:01, 6.00it/s]
Total Ensemble Batches: 75%|███████▌ | 3/4 [09:12<02:55, 175.79s/it]
Running batch 6 inference: 20%|██ | 1/5 [00:02<00:09, 2.45s/it]
2025-01-23 04:59:18.255 | DEBUG | earth2studio.data.arco:fetch_array:227 - Fetching ARCO zarr array for variable: t850 at 2022-11-04T21:00:00
Fetching ARCO data: 62%|██████▏ | 16/26 [00:02<00:01, 6.00it/s]
Total Ensemble Batches: 75%|███████▌ | 3/4 [09:12<02:55, 175.79s/it]
Running batch 6 inference: 20%|██ | 1/5 [00:02<00:10, 2.64s/it]
Fetching ARCO data: 65%|██████▌ | 17/26 [00:02<00:01, 5.75it/s]
2025-01-23 04:59:18.454 | DEBUG | earth2studio.data.arco:fetch_array:227 - Fetching ARCO zarr array for variable: t500 at 2022-11-04T21:00:00
Fetching ARCO data: 77%|███████▋ | 20/26 [00:02<00:01, 5.75it/s]
Total Ensemble Batches: 75%|███████▌ | 3/4 [09:12<02:55, 175.79s/it]
Running batch 6 inference: 20%|██ | 1/5 [00:02<00:11, 2.84s/it]
2025-01-23 04:59:18.641 | DEBUG | earth2studio.data.arco:fetch_array:227 - Fetching ARCO zarr array for variable: t250 at 2022-11-04T21:00:00
Fetching ARCO data: 77%|███████▋ | 20/26 [00:02<00:01, 5.75it/s]
Total Ensemble Batches: 75%|███████▌ | 3/4 [09:13<02:55, 175.79s/it]
Running batch 6 inference: 20%|██ | 1/5 [00:03<00:12, 3.03s/it]
2025-01-23 04:59:18.826 | DEBUG | earth2studio.data.arco:fetch_array:227 - Fetching ARCO zarr array for variable: q1000 at 2022-11-04T21:00:00
Fetching ARCO data: 77%|███████▋ | 20/26 [00:03<00:01, 5.75it/s]
Total Ensemble Batches: 75%|███████▌ | 3/4 [09:13<02:55, 175.79s/it]
Running batch 6 inference: 20%|██ | 1/5 [00:03<00:12, 3.21s/it]
2025-01-23 04:59:19.016 | DEBUG | earth2studio.data.arco:fetch_array:227 - Fetching ARCO zarr array for variable: q850 at 2022-11-04T21:00:00
Fetching ARCO data: 77%|███████▋ | 20/26 [00:03<00:01, 5.75it/s]
Total Ensemble Batches: 75%|███████▌ | 3/4 [09:13<02:55, 175.79s/it]
Running batch 6 inference: 20%|██ | 1/5 [00:03<00:13, 3.40s/it]
Fetching ARCO data: 81%|████████ | 21/26 [00:03<00:00, 5.56it/s]
2025-01-23 04:59:19.215 | DEBUG | earth2studio.data.arco:fetch_array:227 - Fetching ARCO zarr array for variable: q500 at 2022-11-04T21:00:00
Fetching ARCO data: 92%|█████████▏| 24/26 [00:03<00:00, 5.56it/s]
Total Ensemble Batches: 75%|███████▌ | 3/4 [09:13<02:55, 175.79s/it]
Running batch 6 inference: 20%|██ | 1/5 [00:03<00:14, 3.60s/it]
2025-01-23 04:59:19.405 | DEBUG | earth2studio.data.arco:fetch_array:227 - Fetching ARCO zarr array for variable: q250 at 2022-11-04T21:00:00
Fetching ARCO data: 92%|█████████▏| 24/26 [00:03<00:00, 5.56it/s]
Total Ensemble Batches: 75%|███████▌ | 3/4 [09:13<02:55, 175.79s/it]
Running batch 6 inference: 20%|██ | 1/5 [00:03<00:15, 3.79s/it]
Fetching ARCO data: 96%|█████████▌| 25/26 [00:03<00:00, 6.58it/s]
Fetching ARCO data: 100%|██████████| 26/26 [00:03<00:00, 6.67it/s]
Running batch 6 inference: 40%|████ | 2/5 [00:40<01:00, 20.13s/it]
Fetching ARCO data: 0%| | 0/26 [00:00<?, ?it/s]
2025-01-23 04:59:55.884 | DEBUG | earth2studio.data.arco:fetch_array:227 - Fetching ARCO zarr array for variable: u10m at 2022-11-04T22:00:00
Fetching ARCO data: 0%| | 0/26 [00:00<?, ?it/s]
Total Ensemble Batches: 75%|███████▌ | 3/4 [09:50<02:55, 175.79s/it]
Running batch 6 inference: 40%|████ | 2/5 [00:40<01:00, 20.13s/it]
2025-01-23 04:59:55.890 | DEBUG | earth2studio.data.arco:fetch_array:227 - Fetching ARCO zarr array for variable: v10m at 2022-11-04T22:00:00
Fetching ARCO data: 0%| | 0/26 [00:00<?, ?it/s]
Total Ensemble Batches: 75%|███████▌ | 3/4 [09:50<02:55, 175.79s/it]
Running batch 6 inference: 40%|████ | 2/5 [00:40<01:00, 20.13s/it]
2025-01-23 04:59:55.895 | DEBUG | earth2studio.data.arco:fetch_array:227 - Fetching ARCO zarr array for variable: t2m at 2022-11-04T22:00:00
Fetching ARCO data: 0%| | 0/26 [00:00<?, ?it/s]
Total Ensemble Batches: 75%|███████▌ | 3/4 [09:50<02:55, 175.79s/it]
Running batch 6 inference: 40%|████ | 2/5 [00:40<01:00, 20.13s/it]
2025-01-23 04:59:55.901 | DEBUG | earth2studio.data.arco:fetch_array:227 - Fetching ARCO zarr array for variable: tcwv at 2022-11-04T22:00:00
Fetching ARCO data: 0%| | 0/26 [00:00<?, ?it/s]
Total Ensemble Batches: 75%|███████▌ | 3/4 [09:50<02:55, 175.79s/it]
Running batch 6 inference: 40%|████ | 2/5 [00:40<01:00, 20.13s/it]
2025-01-23 04:59:55.918 | DEBUG | earth2studio.data.arco:fetch_array:227 - Fetching ARCO zarr array for variable: msl at 2022-11-04T22:00:00
Fetching ARCO data: 15%|█▌ | 4/26 [00:00<00:00, 111.12it/s]
Total Ensemble Batches: 75%|███████▌ | 3/4 [09:50<02:55, 175.79s/it]
Running batch 6 inference: 40%|████ | 2/5 [00:40<01:00, 20.13s/it]
2025-01-23 04:59:55.922 | DEBUG | earth2studio.data.arco:fetch_array:227 - Fetching ARCO zarr array for variable: sp at 2022-11-04T22:00:00
Fetching ARCO data: 15%|█▌ | 4/26 [00:00<00:00, 98.85it/s]
Total Ensemble Batches: 75%|███████▌ | 3/4 [09:50<02:55, 175.79s/it]
Running batch 6 inference: 40%|████ | 2/5 [00:40<01:00, 20.13s/it]
2025-01-23 04:59:55.928 | DEBUG | earth2studio.data.arco:fetch_array:227 - Fetching ARCO zarr array for variable: u1000 at 2022-11-04T22:00:00
Fetching ARCO data: 15%|█▌ | 4/26 [00:00<00:00, 87.64it/s]
Total Ensemble Batches: 75%|███████▌ | 3/4 [09:50<02:55, 175.79s/it]
Running batch 6 inference: 40%|████ | 2/5 [00:40<01:00, 20.13s/it]
2025-01-23 04:59:56.123 | DEBUG | earth2studio.data.arco:fetch_array:227 - Fetching ARCO zarr array for variable: u850 at 2022-11-04T22:00:00
Fetching ARCO data: 15%|█▌ | 4/26 [00:00<00:01, 16.63it/s]
Total Ensemble Batches: 75%|███████▌ | 3/4 [09:50<02:55, 175.79s/it]
Running batch 6 inference: 40%|████ | 2/5 [00:40<01:00, 20.13s/it]
Fetching ARCO data: 19%|█▉ | 5/26 [00:00<00:01, 11.44it/s]
2025-01-23 04:59:56.326 | DEBUG | earth2studio.data.arco:fetch_array:227 - Fetching ARCO zarr array for variable: u500 at 2022-11-04T22:00:00
Fetching ARCO data: 31%|███ | 8/26 [00:00<00:01, 11.44it/s]
Total Ensemble Batches: 75%|███████▌ | 3/4 [09:50<02:55, 175.79s/it]
Running batch 6 inference: 40%|████ | 2/5 [00:40<01:00, 20.13s/it]
2025-01-23 04:59:56.522 | DEBUG | earth2studio.data.arco:fetch_array:227 - Fetching ARCO zarr array for variable: u250 at 2022-11-04T22:00:00
Fetching ARCO data: 31%|███ | 8/26 [00:00<00:01, 11.44it/s]
Total Ensemble Batches: 75%|███████▌ | 3/4 [09:50<02:55, 175.79s/it]
Running batch 6 inference: 40%|████ | 2/5 [00:40<01:00, 20.13s/it]
2025-01-23 04:59:56.717 | DEBUG | earth2studio.data.arco:fetch_array:227 - Fetching ARCO zarr array for variable: v1000 at 2022-11-04T22:00:00
Fetching ARCO data: 31%|███ | 8/26 [00:00<00:01, 11.44it/s]
Total Ensemble Batches: 75%|███████▌ | 3/4 [09:51<02:55, 175.79s/it]
Running batch 6 inference: 40%|████ | 2/5 [00:41<01:00, 20.13s/it]
2025-01-23 04:59:56.917 | DEBUG | earth2studio.data.arco:fetch_array:227 - Fetching ARCO zarr array for variable: v850 at 2022-11-04T22:00:00
Fetching ARCO data: 31%|███ | 8/26 [00:01<00:01, 11.44it/s]
Total Ensemble Batches: 75%|███████▌ | 3/4 [09:51<02:55, 175.79s/it]
Running batch 6 inference: 40%|████ | 2/5 [00:41<01:00, 20.13s/it]
Fetching ARCO data: 35%|███▍ | 9/26 [00:01<00:02, 6.78it/s]
2025-01-23 04:59:57.126 | DEBUG | earth2studio.data.arco:fetch_array:227 - Fetching ARCO zarr array for variable: v500 at 2022-11-04T22:00:00
Fetching ARCO data: 46%|████▌ | 12/26 [00:01<00:02, 6.78it/s]
Total Ensemble Batches: 75%|███████▌ | 3/4 [09:51<02:55, 175.79s/it]
Running batch 6 inference: 40%|████ | 2/5 [00:41<01:00, 20.13s/it]
2025-01-23 04:59:57.326 | DEBUG | earth2studio.data.arco:fetch_array:227 - Fetching ARCO zarr array for variable: v250 at 2022-11-04T22:00:00
Fetching ARCO data: 46%|████▌ | 12/26 [00:01<00:02, 6.78it/s]
Total Ensemble Batches: 75%|███████▌ | 3/4 [09:51<02:55, 175.79s/it]
Running batch 6 inference: 40%|████ | 2/5 [00:41<01:00, 20.13s/it]
2025-01-23 04:59:57.528 | DEBUG | earth2studio.data.arco:fetch_array:227 - Fetching ARCO zarr array for variable: z1000 at 2022-11-04T22:00:00
Fetching ARCO data: 46%|████▌ | 12/26 [00:01<00:02, 6.78it/s]
Total Ensemble Batches: 75%|███████▌ | 3/4 [09:51<02:55, 175.79s/it]
Running batch 6 inference: 40%|████ | 2/5 [00:41<01:00, 20.13s/it]
2025-01-23 04:59:57.709 | DEBUG | earth2studio.data.arco:fetch_array:227 - Fetching ARCO zarr array for variable: z850 at 2022-11-04T22:00:00
Fetching ARCO data: 46%|████▌ | 12/26 [00:01<00:02, 6.78it/s]
Total Ensemble Batches: 75%|███████▌ | 3/4 [09:52<02:55, 175.79s/it]
Running batch 6 inference: 40%|████ | 2/5 [00:42<01:00, 20.13s/it]
Fetching ARCO data: 50%|█████ | 13/26 [00:02<00:02, 5.99it/s]
2025-01-23 04:59:57.897 | DEBUG | earth2studio.data.arco:fetch_array:227 - Fetching ARCO zarr array for variable: z500 at 2022-11-04T22:00:00
Fetching ARCO data: 62%|██████▏ | 16/26 [00:02<00:01, 5.99it/s]
Total Ensemble Batches: 75%|███████▌ | 3/4 [09:52<02:55, 175.79s/it]
Running batch 6 inference: 40%|████ | 2/5 [00:42<01:00, 20.13s/it]
2025-01-23 04:59:58.075 | DEBUG | earth2studio.data.arco:fetch_array:227 - Fetching ARCO zarr array for variable: z250 at 2022-11-04T22:00:00
Fetching ARCO data: 62%|██████▏ | 16/26 [00:02<00:01, 5.99it/s]
Total Ensemble Batches: 75%|███████▌ | 3/4 [09:52<02:55, 175.79s/it]
Running batch 6 inference: 40%|████ | 2/5 [00:42<01:00, 20.13s/it]
2025-01-23 04:59:58.253 | DEBUG | earth2studio.data.arco:fetch_array:227 - Fetching ARCO zarr array for variable: t1000 at 2022-11-04T22:00:00
Fetching ARCO data: 62%|██████▏ | 16/26 [00:02<00:01, 5.99it/s]
Total Ensemble Batches: 75%|███████▌ | 3/4 [09:52<02:55, 175.79s/it]
Running batch 6 inference: 40%|████ | 2/5 [00:42<01:00, 20.13s/it]
2025-01-23 04:59:58.440 | DEBUG | earth2studio.data.arco:fetch_array:227 - Fetching ARCO zarr array for variable: t850 at 2022-11-04T22:00:00
Fetching ARCO data: 62%|██████▏ | 16/26 [00:02<00:01, 5.99it/s]
Total Ensemble Batches: 75%|███████▌ | 3/4 [09:52<02:55, 175.79s/it]
Running batch 6 inference: 40%|████ | 2/5 [00:42<01:00, 20.13s/it]
Fetching ARCO data: 65%|██████▌ | 17/26 [00:02<00:01, 5.75it/s]
2025-01-23 04:59:58.636 | DEBUG | earth2studio.data.arco:fetch_array:227 - Fetching ARCO zarr array for variable: t500 at 2022-11-04T22:00:00
Fetching ARCO data: 77%|███████▋ | 20/26 [00:02<00:01, 5.75it/s]
Total Ensemble Batches: 75%|███████▌ | 3/4 [09:53<02:55, 175.79s/it]
Running batch 6 inference: 40%|████ | 2/5 [00:43<01:00, 20.13s/it]
2025-01-23 04:59:58.822 | DEBUG | earth2studio.data.arco:fetch_array:227 - Fetching ARCO zarr array for variable: t250 at 2022-11-04T22:00:00
Fetching ARCO data: 77%|███████▋ | 20/26 [00:02<00:01, 5.75it/s]
Total Ensemble Batches: 75%|███████▌ | 3/4 [09:53<02:55, 175.79s/it]
Running batch 6 inference: 40%|████ | 2/5 [00:43<01:00, 20.13s/it]
2025-01-23 04:59:59.008 | DEBUG | earth2studio.data.arco:fetch_array:227 - Fetching ARCO zarr array for variable: q1000 at 2022-11-04T22:00:00
Fetching ARCO data: 77%|███████▋ | 20/26 [00:03<00:01, 5.75it/s]
Total Ensemble Batches: 75%|███████▌ | 3/4 [09:53<02:55, 175.79s/it]
Running batch 6 inference: 40%|████ | 2/5 [00:43<01:00, 20.13s/it]
2025-01-23 04:59:59.198 | DEBUG | earth2studio.data.arco:fetch_array:227 - Fetching ARCO zarr array for variable: q850 at 2022-11-04T22:00:00
Fetching ARCO data: 77%|███████▋ | 20/26 [00:03<00:01, 5.75it/s]
Total Ensemble Batches: 75%|███████▌ | 3/4 [09:53<02:55, 175.79s/it]
Running batch 6 inference: 40%|████ | 2/5 [00:43<01:00, 20.13s/it]
Fetching ARCO data: 81%|████████ | 21/26 [00:03<00:00, 5.57it/s]
2025-01-23 04:59:59.396 | DEBUG | earth2studio.data.arco:fetch_array:227 - Fetching ARCO zarr array for variable: q500 at 2022-11-04T22:00:00
Fetching ARCO data: 92%|█████████▏| 24/26 [00:03<00:00, 5.57it/s]
Total Ensemble Batches: 75%|███████▌ | 3/4 [09:53<02:55, 175.79s/it]
Running batch 6 inference: 40%|████ | 2/5 [00:43<01:00, 20.13s/it]
2025-01-23 04:59:59.587 | DEBUG | earth2studio.data.arco:fetch_array:227 - Fetching ARCO zarr array for variable: q250 at 2022-11-04T22:00:00
Fetching ARCO data: 92%|█████████▏| 24/26 [00:03<00:00, 5.57it/s]
Total Ensemble Batches: 75%|███████▌ | 3/4 [09:53<02:55, 175.79s/it]
Running batch 6 inference: 40%|████ | 2/5 [00:43<01:00, 20.13s/it]
Fetching ARCO data: 96%|█████████▌| 25/26 [00:03<00:00, 6.59it/s]
Fetching ARCO data: 100%|██████████| 26/26 [00:03<00:00, 6.67it/s]
Running batch 6 inference: 60%|██████ | 3/5 [01:20<00:56, 28.49s/it]
Fetching ARCO data: 0%| | 0/26 [00:00<?, ?it/s]
2025-01-23 05:00:36.073 | DEBUG | earth2studio.data.arco:fetch_array:227 - Fetching ARCO zarr array for variable: u10m at 2022-11-04T23:00:00
Fetching ARCO data: 0%| | 0/26 [00:00<?, ?it/s]
Total Ensemble Batches: 75%|███████▌ | 3/4 [10:30<02:55, 175.79s/it]
Running batch 6 inference: 60%|██████ | 3/5 [01:20<00:56, 28.49s/it]
2025-01-23 05:00:36.079 | DEBUG | earth2studio.data.arco:fetch_array:227 - Fetching ARCO zarr array for variable: v10m at 2022-11-04T23:00:00
Fetching ARCO data: 0%| | 0/26 [00:00<?, ?it/s]
Total Ensemble Batches: 75%|███████▌ | 3/4 [10:30<02:55, 175.79s/it]
Running batch 6 inference: 60%|██████ | 3/5 [01:20<00:56, 28.49s/it]
2025-01-23 05:00:36.084 | DEBUG | earth2studio.data.arco:fetch_array:227 - Fetching ARCO zarr array for variable: t2m at 2022-11-04T23:00:00
Fetching ARCO data: 0%| | 0/26 [00:00<?, ?it/s]
Total Ensemble Batches: 75%|███████▌ | 3/4 [10:30<02:55, 175.79s/it]
Running batch 6 inference: 60%|██████ | 3/5 [01:20<00:56, 28.49s/it]
2025-01-23 05:00:36.090 | DEBUG | earth2studio.data.arco:fetch_array:227 - Fetching ARCO zarr array for variable: tcwv at 2022-11-04T23:00:00
Fetching ARCO data: 0%| | 0/26 [00:00<?, ?it/s]
Total Ensemble Batches: 75%|███████▌ | 3/4 [10:30<02:55, 175.79s/it]
Running batch 6 inference: 60%|██████ | 3/5 [01:20<00:56, 28.49s/it]
2025-01-23 05:00:36.106 | DEBUG | earth2studio.data.arco:fetch_array:227 - Fetching ARCO zarr array for variable: msl at 2022-11-04T23:00:00
Fetching ARCO data: 15%|█▌ | 4/26 [00:00<00:00, 114.46it/s]
Total Ensemble Batches: 75%|███████▌ | 3/4 [10:30<02:55, 175.79s/it]
Running batch 6 inference: 60%|██████ | 3/5 [01:20<00:56, 28.49s/it]
2025-01-23 05:00:36.110 | DEBUG | earth2studio.data.arco:fetch_array:227 - Fetching ARCO zarr array for variable: sp at 2022-11-04T23:00:00
Fetching ARCO data: 15%|█▌ | 4/26 [00:00<00:00, 101.38it/s]
Total Ensemble Batches: 75%|███████▌ | 3/4 [10:30<02:55, 175.79s/it]
Running batch 6 inference: 60%|██████ | 3/5 [01:20<00:56, 28.49s/it]
2025-01-23 05:00:36.115 | DEBUG | earth2studio.data.arco:fetch_array:227 - Fetching ARCO zarr array for variable: u1000 at 2022-11-04T23:00:00
Fetching ARCO data: 15%|█▌ | 4/26 [00:00<00:00, 91.42it/s]
Total Ensemble Batches: 75%|███████▌ | 3/4 [10:30<02:55, 175.79s/it]
Running batch 6 inference: 60%|██████ | 3/5 [01:20<00:56, 28.49s/it]
2025-01-23 05:00:36.310 | DEBUG | earth2studio.data.arco:fetch_array:227 - Fetching ARCO zarr array for variable: u850 at 2022-11-04T23:00:00
Fetching ARCO data: 15%|█▌ | 4/26 [00:00<00:01, 16.71it/s]
Total Ensemble Batches: 75%|███████▌ | 3/4 [10:30<02:55, 175.79s/it]
Running batch 6 inference: 60%|██████ | 3/5 [01:20<00:56, 28.49s/it]
Fetching ARCO data: 19%|█▉ | 5/26 [00:00<00:01, 11.48it/s]
2025-01-23 05:00:36.515 | DEBUG | earth2studio.data.arco:fetch_array:227 - Fetching ARCO zarr array for variable: u500 at 2022-11-04T23:00:00
Fetching ARCO data: 31%|███ | 8/26 [00:00<00:01, 11.48it/s]
Total Ensemble Batches: 75%|███████▌ | 3/4 [10:30<02:55, 175.79s/it]
Running batch 6 inference: 60%|██████ | 3/5 [01:20<00:56, 28.49s/it]
2025-01-23 05:00:36.710 | DEBUG | earth2studio.data.arco:fetch_array:227 - Fetching ARCO zarr array for variable: u250 at 2022-11-04T23:00:00
Fetching ARCO data: 31%|███ | 8/26 [00:00<00:01, 11.48it/s]
Total Ensemble Batches: 75%|███████▌ | 3/4 [10:31<02:55, 175.79s/it]
Running batch 6 inference: 60%|██████ | 3/5 [01:21<00:56, 28.49s/it]
2025-01-23 05:00:36.907 | DEBUG | earth2studio.data.arco:fetch_array:227 - Fetching ARCO zarr array for variable: v1000 at 2022-11-04T23:00:00
Fetching ARCO data: 31%|███ | 8/26 [00:00<00:01, 11.48it/s]
Total Ensemble Batches: 75%|███████▌ | 3/4 [10:31<02:55, 175.79s/it]
Running batch 6 inference: 60%|██████ | 3/5 [01:21<00:56, 28.49s/it]
2025-01-23 05:00:37.108 | DEBUG | earth2studio.data.arco:fetch_array:227 - Fetching ARCO zarr array for variable: v850 at 2022-11-04T23:00:00
Fetching ARCO data: 31%|███ | 8/26 [00:01<00:01, 11.48it/s]
Total Ensemble Batches: 75%|███████▌ | 3/4 [10:31<02:55, 175.79s/it]
Running batch 6 inference: 60%|██████ | 3/5 [01:21<00:56, 28.49s/it]
Fetching ARCO data: 35%|███▍ | 9/26 [00:01<00:02, 6.77it/s]
2025-01-23 05:00:37.318 | DEBUG | earth2studio.data.arco:fetch_array:227 - Fetching ARCO zarr array for variable: v500 at 2022-11-04T23:00:00
Fetching ARCO data: 46%|████▌ | 12/26 [00:01<00:02, 6.77it/s]
Total Ensemble Batches: 75%|███████▌ | 3/4 [10:31<02:55, 175.79s/it]
Running batch 6 inference: 60%|██████ | 3/5 [01:21<00:56, 28.49s/it]
2025-01-23 05:00:37.521 | DEBUG | earth2studio.data.arco:fetch_array:227 - Fetching ARCO zarr array for variable: v250 at 2022-11-04T23:00:00
Fetching ARCO data: 46%|████▌ | 12/26 [00:01<00:02, 6.77it/s]
Total Ensemble Batches: 75%|███████▌ | 3/4 [10:31<02:55, 175.79s/it]
Running batch 6 inference: 60%|██████ | 3/5 [01:21<00:56, 28.49s/it]
2025-01-23 05:00:37.723 | DEBUG | earth2studio.data.arco:fetch_array:227 - Fetching ARCO zarr array for variable: z1000 at 2022-11-04T23:00:00
Fetching ARCO data: 46%|████▌ | 12/26 [00:01<00:02, 6.77it/s]
Total Ensemble Batches: 75%|███████▌ | 3/4 [10:32<02:55, 175.79s/it]
Running batch 6 inference: 60%|██████ | 3/5 [01:22<00:56, 28.49s/it]
2025-01-23 05:00:37.903 | DEBUG | earth2studio.data.arco:fetch_array:227 - Fetching ARCO zarr array for variable: z850 at 2022-11-04T23:00:00
Fetching ARCO data: 46%|████▌ | 12/26 [00:01<00:02, 6.77it/s]
Total Ensemble Batches: 75%|███████▌ | 3/4 [10:32<02:55, 175.79s/it]
Running batch 6 inference: 60%|██████ | 3/5 [01:22<00:56, 28.49s/it]
Fetching ARCO data: 50%|█████ | 13/26 [00:02<00:02, 5.97it/s]
2025-01-23 05:00:38.092 | DEBUG | earth2studio.data.arco:fetch_array:227 - Fetching ARCO zarr array for variable: z500 at 2022-11-04T23:00:00
Fetching ARCO data: 62%|██████▏ | 16/26 [00:02<00:01, 5.97it/s]
Total Ensemble Batches: 75%|███████▌ | 3/4 [10:32<02:55, 175.79s/it]
Running batch 6 inference: 60%|██████ | 3/5 [01:22<00:56, 28.49s/it]
2025-01-23 05:00:38.271 | DEBUG | earth2studio.data.arco:fetch_array:227 - Fetching ARCO zarr array for variable: z250 at 2022-11-04T23:00:00
Fetching ARCO data: 62%|██████▏ | 16/26 [00:02<00:01, 5.97it/s]
Total Ensemble Batches: 75%|███████▌ | 3/4 [10:32<02:55, 175.79s/it]
Running batch 6 inference: 60%|██████ | 3/5 [01:22<00:56, 28.49s/it]
2025-01-23 05:00:38.451 | DEBUG | earth2studio.data.arco:fetch_array:227 - Fetching ARCO zarr array for variable: t1000 at 2022-11-04T23:00:00
Fetching ARCO data: 62%|██████▏ | 16/26 [00:02<00:01, 5.97it/s]
Total Ensemble Batches: 75%|███████▌ | 3/4 [10:32<02:55, 175.79s/it]
Running batch 6 inference: 60%|██████ | 3/5 [01:22<00:56, 28.49s/it]
2025-01-23 05:00:38.637 | DEBUG | earth2studio.data.arco:fetch_array:227 - Fetching ARCO zarr array for variable: t850 at 2022-11-04T23:00:00
Fetching ARCO data: 62%|██████▏ | 16/26 [00:02<00:01, 5.97it/s]
Total Ensemble Batches: 75%|███████▌ | 3/4 [10:33<02:55, 175.79s/it]
Running batch 6 inference: 60%|██████ | 3/5 [01:23<00:56, 28.49s/it]
Fetching ARCO data: 65%|██████▌ | 17/26 [00:02<00:01, 5.74it/s]
2025-01-23 05:00:38.832 | DEBUG | earth2studio.data.arco:fetch_array:227 - Fetching ARCO zarr array for variable: t500 at 2022-11-04T23:00:00
Fetching ARCO data: 77%|███████▋ | 20/26 [00:02<00:01, 5.74it/s]
Total Ensemble Batches: 75%|███████▌ | 3/4 [10:33<02:55, 175.79s/it]
Running batch 6 inference: 60%|██████ | 3/5 [01:23<00:56, 28.49s/it]
2025-01-23 05:00:39.023 | DEBUG | earth2studio.data.arco:fetch_array:227 - Fetching ARCO zarr array for variable: t250 at 2022-11-04T23:00:00
Fetching ARCO data: 77%|███████▋ | 20/26 [00:02<00:01, 5.74it/s]
Total Ensemble Batches: 75%|███████▌ | 3/4 [10:33<02:55, 175.79s/it]
Running batch 6 inference: 60%|██████ | 3/5 [01:23<00:56, 28.49s/it]
2025-01-23 05:00:39.210 | DEBUG | earth2studio.data.arco:fetch_array:227 - Fetching ARCO zarr array for variable: q1000 at 2022-11-04T23:00:00
Fetching ARCO data: 77%|███████▋ | 20/26 [00:03<00:01, 5.74it/s]
Total Ensemble Batches: 75%|███████▌ | 3/4 [10:33<02:55, 175.79s/it]
Running batch 6 inference: 60%|██████ | 3/5 [01:23<00:56, 28.49s/it]
2025-01-23 05:00:39.402 | DEBUG | earth2studio.data.arco:fetch_array:227 - Fetching ARCO zarr array for variable: q850 at 2022-11-04T23:00:00
Fetching ARCO data: 77%|███████▋ | 20/26 [00:03<00:01, 5.74it/s]
Total Ensemble Batches: 75%|███████▌ | 3/4 [10:33<02:55, 175.79s/it]
Running batch 6 inference: 60%|██████ | 3/5 [01:23<00:56, 28.49s/it]
Fetching ARCO data: 81%|████████ | 21/26 [00:03<00:00, 5.54it/s]
2025-01-23 05:00:39.601 | DEBUG | earth2studio.data.arco:fetch_array:227 - Fetching ARCO zarr array for variable: q500 at 2022-11-04T23:00:00
Fetching ARCO data: 92%|█████████▏| 24/26 [00:03<00:00, 5.54it/s]
Total Ensemble Batches: 75%|███████▌ | 3/4 [10:33<02:55, 175.79s/it]
Running batch 6 inference: 60%|██████ | 3/5 [01:23<00:56, 28.49s/it]
2025-01-23 05:00:39.793 | DEBUG | earth2studio.data.arco:fetch_array:227 - Fetching ARCO zarr array for variable: q250 at 2022-11-04T23:00:00
Fetching ARCO data: 92%|█████████▏| 24/26 [00:03<00:00, 5.54it/s]
Total Ensemble Batches: 75%|███████▌ | 3/4 [10:34<02:55, 175.79s/it]
Running batch 6 inference: 60%|██████ | 3/5 [01:24<00:56, 28.49s/it]
Fetching ARCO data: 96%|█████████▌| 25/26 [00:03<00:00, 6.54it/s]
Fetching ARCO data: 100%|██████████| 26/26 [00:03<00:00, 6.64it/s]
Running batch 6 inference: 80%|████████ | 4/5 [02:00<00:32, 32.87s/it]
Fetching ARCO data: 0%| | 0/26 [00:00<?, ?it/s]
2025-01-23 05:01:16.293 | DEBUG | earth2studio.data.arco:fetch_array:227 - Fetching ARCO zarr array for variable: u10m at 2022-11-05T00:00:00
Fetching ARCO data: 0%| | 0/26 [00:00<?, ?it/s]
Total Ensemble Batches: 75%|███████▌ | 3/4 [11:10<02:55, 175.79s/it]
Running batch 6 inference: 80%|████████ | 4/5 [02:00<00:32, 32.87s/it]
2025-01-23 05:01:16.299 | DEBUG | earth2studio.data.arco:fetch_array:227 - Fetching ARCO zarr array for variable: v10m at 2022-11-05T00:00:00
Fetching ARCO data: 0%| | 0/26 [00:00<?, ?it/s]
Total Ensemble Batches: 75%|███████▌ | 3/4 [11:10<02:55, 175.79s/it]
Running batch 6 inference: 80%|████████ | 4/5 [02:00<00:32, 32.87s/it]
2025-01-23 05:01:16.305 | DEBUG | earth2studio.data.arco:fetch_array:227 - Fetching ARCO zarr array for variable: t2m at 2022-11-05T00:00:00
Fetching ARCO data: 0%| | 0/26 [00:00<?, ?it/s]
Total Ensemble Batches: 75%|███████▌ | 3/4 [11:10<02:55, 175.79s/it]
Running batch 6 inference: 80%|████████ | 4/5 [02:00<00:32, 32.87s/it]
2025-01-23 05:01:16.311 | DEBUG | earth2studio.data.arco:fetch_array:227 - Fetching ARCO zarr array for variable: tcwv at 2022-11-05T00:00:00
Fetching ARCO data: 0%| | 0/26 [00:00<?, ?it/s]
Total Ensemble Batches: 75%|███████▌ | 3/4 [11:10<02:55, 175.79s/it]
Running batch 6 inference: 80%|████████ | 4/5 [02:00<00:32, 32.87s/it]
2025-01-23 05:01:16.327 | DEBUG | earth2studio.data.arco:fetch_array:227 - Fetching ARCO zarr array for variable: msl at 2022-11-05T00:00:00
Fetching ARCO data: 15%|█▌ | 4/26 [00:00<00:00, 111.02it/s]
Total Ensemble Batches: 75%|███████▌ | 3/4 [11:10<02:55, 175.79s/it]
Running batch 6 inference: 80%|████████ | 4/5 [02:00<00:32, 32.87s/it]
2025-01-23 05:01:16.332 | DEBUG | earth2studio.data.arco:fetch_array:227 - Fetching ARCO zarr array for variable: sp at 2022-11-05T00:00:00
Fetching ARCO data: 15%|█▌ | 4/26 [00:00<00:00, 96.08it/s]
Total Ensemble Batches: 75%|███████▌ | 3/4 [11:10<02:55, 175.79s/it]
Running batch 6 inference: 80%|████████ | 4/5 [02:00<00:32, 32.87s/it]
2025-01-23 05:01:16.338 | DEBUG | earth2studio.data.arco:fetch_array:227 - Fetching ARCO zarr array for variable: u1000 at 2022-11-05T00:00:00
Fetching ARCO data: 15%|█▌ | 4/26 [00:00<00:00, 84.77it/s]
Total Ensemble Batches: 75%|███████▌ | 3/4 [11:10<02:55, 175.79s/it]
Running batch 6 inference: 80%|████████ | 4/5 [02:00<00:32, 32.87s/it]
2025-01-23 05:01:16.535 | DEBUG | earth2studio.data.arco:fetch_array:227 - Fetching ARCO zarr array for variable: u850 at 2022-11-05T00:00:00
Fetching ARCO data: 15%|█▌ | 4/26 [00:00<00:01, 16.39it/s]
Total Ensemble Batches: 75%|███████▌ | 3/4 [11:10<02:55, 175.79s/it]
Running batch 6 inference: 80%|████████ | 4/5 [02:00<00:32, 32.87s/it]
Fetching ARCO data: 19%|█▉ | 5/26 [00:00<00:01, 11.38it/s]
2025-01-23 05:01:16.737 | DEBUG | earth2studio.data.arco:fetch_array:227 - Fetching ARCO zarr array for variable: u500 at 2022-11-05T00:00:00
Fetching ARCO data: 31%|███ | 8/26 [00:00<00:01, 11.38it/s]
Total Ensemble Batches: 75%|███████▌ | 3/4 [11:11<02:55, 175.79s/it]
Running batch 6 inference: 80%|████████ | 4/5 [02:01<00:32, 32.87s/it]
2025-01-23 05:01:16.932 | DEBUG | earth2studio.data.arco:fetch_array:227 - Fetching ARCO zarr array for variable: u250 at 2022-11-05T00:00:00
Fetching ARCO data: 31%|███ | 8/26 [00:00<00:01, 11.38it/s]
Total Ensemble Batches: 75%|███████▌ | 3/4 [11:11<02:55, 175.79s/it]
Running batch 6 inference: 80%|████████ | 4/5 [02:01<00:32, 32.87s/it]
2025-01-23 05:01:17.127 | DEBUG | earth2studio.data.arco:fetch_array:227 - Fetching ARCO zarr array for variable: v1000 at 2022-11-05T00:00:00
Fetching ARCO data: 31%|███ | 8/26 [00:00<00:01, 11.38it/s]
Total Ensemble Batches: 75%|███████▌ | 3/4 [11:11<02:55, 175.79s/it]
Running batch 6 inference: 80%|████████ | 4/5 [02:01<00:32, 32.87s/it]
2025-01-23 05:01:17.328 | DEBUG | earth2studio.data.arco:fetch_array:227 - Fetching ARCO zarr array for variable: v850 at 2022-11-05T00:00:00
Fetching ARCO data: 31%|███ | 8/26 [00:01<00:01, 11.38it/s]
Total Ensemble Batches: 75%|███████▌ | 3/4 [11:11<02:55, 175.79s/it]
Running batch 6 inference: 80%|████████ | 4/5 [02:01<00:32, 32.87s/it]
Fetching ARCO data: 35%|███▍ | 9/26 [00:01<00:02, 6.77it/s]
2025-01-23 05:01:17.539 | DEBUG | earth2studio.data.arco:fetch_array:227 - Fetching ARCO zarr array for variable: v500 at 2022-11-05T00:00:00
Fetching ARCO data: 46%|████▌ | 12/26 [00:01<00:02, 6.77it/s]
Total Ensemble Batches: 75%|███████▌ | 3/4 [11:11<02:55, 175.79s/it]
Running batch 6 inference: 80%|████████ | 4/5 [02:01<00:32, 32.87s/it]
2025-01-23 05:01:17.741 | DEBUG | earth2studio.data.arco:fetch_array:227 - Fetching ARCO zarr array for variable: v250 at 2022-11-05T00:00:00
Fetching ARCO data: 46%|████▌ | 12/26 [00:01<00:02, 6.77it/s]
Total Ensemble Batches: 75%|███████▌ | 3/4 [11:12<02:55, 175.79s/it]
Running batch 6 inference: 80%|████████ | 4/5 [02:02<00:32, 32.87s/it]
2025-01-23 05:01:17.942 | DEBUG | earth2studio.data.arco:fetch_array:227 - Fetching ARCO zarr array for variable: z1000 at 2022-11-05T00:00:00
Fetching ARCO data: 46%|████▌ | 12/26 [00:01<00:02, 6.77it/s]
Total Ensemble Batches: 75%|███████▌ | 3/4 [11:12<02:55, 175.79s/it]
Running batch 6 inference: 80%|████████ | 4/5 [02:02<00:32, 32.87s/it]
2025-01-23 05:01:18.124 | DEBUG | earth2studio.data.arco:fetch_array:227 - Fetching ARCO zarr array for variable: z850 at 2022-11-05T00:00:00
Fetching ARCO data: 46%|████▌ | 12/26 [00:01<00:02, 6.77it/s]
Total Ensemble Batches: 75%|███████▌ | 3/4 [11:12<02:55, 175.79s/it]
Running batch 6 inference: 80%|████████ | 4/5 [02:02<00:32, 32.87s/it]
Fetching ARCO data: 50%|█████ | 13/26 [00:02<00:02, 5.96it/s]
2025-01-23 05:01:18.314 | DEBUG | earth2studio.data.arco:fetch_array:227 - Fetching ARCO zarr array for variable: z500 at 2022-11-05T00:00:00
Fetching ARCO data: 62%|██████▏ | 16/26 [00:02<00:01, 5.96it/s]
Total Ensemble Batches: 75%|███████▌ | 3/4 [11:12<02:55, 175.79s/it]
Running batch 6 inference: 80%|████████ | 4/5 [02:02<00:32, 32.87s/it]
2025-01-23 05:01:18.495 | DEBUG | earth2studio.data.arco:fetch_array:227 - Fetching ARCO zarr array for variable: z250 at 2022-11-05T00:00:00
Fetching ARCO data: 62%|██████▏ | 16/26 [00:02<00:01, 5.96it/s]
Total Ensemble Batches: 75%|███████▌ | 3/4 [11:12<02:55, 175.79s/it]
Running batch 6 inference: 80%|████████ | 4/5 [02:02<00:32, 32.87s/it]
2025-01-23 05:01:18.677 | DEBUG | earth2studio.data.arco:fetch_array:227 - Fetching ARCO zarr array for variable: t1000 at 2022-11-05T00:00:00
Fetching ARCO data: 62%|██████▏ | 16/26 [00:02<00:01, 5.96it/s]
Total Ensemble Batches: 75%|███████▌ | 3/4 [11:13<02:55, 175.79s/it]
Running batch 6 inference: 80%|████████ | 4/5 [02:03<00:32, 32.87s/it]
2025-01-23 05:01:18.865 | DEBUG | earth2studio.data.arco:fetch_array:227 - Fetching ARCO zarr array for variable: t850 at 2022-11-05T00:00:00
Fetching ARCO data: 62%|██████▏ | 16/26 [00:02<00:01, 5.96it/s]
Total Ensemble Batches: 75%|███████▌ | 3/4 [11:13<02:55, 175.79s/it]
Running batch 6 inference: 80%|████████ | 4/5 [02:03<00:32, 32.87s/it]
Fetching ARCO data: 65%|██████▌ | 17/26 [00:02<00:01, 5.72it/s]
2025-01-23 05:01:19.060 | DEBUG | earth2studio.data.arco:fetch_array:227 - Fetching ARCO zarr array for variable: t500 at 2022-11-05T00:00:00
Fetching ARCO data: 77%|███████▋ | 20/26 [00:02<00:01, 5.72it/s]
Total Ensemble Batches: 75%|███████▌ | 3/4 [11:13<02:55, 175.79s/it]
Running batch 6 inference: 80%|████████ | 4/5 [02:03<00:32, 32.87s/it]
2025-01-23 05:01:19.251 | DEBUG | earth2studio.data.arco:fetch_array:227 - Fetching ARCO zarr array for variable: t250 at 2022-11-05T00:00:00
Fetching ARCO data: 77%|███████▋ | 20/26 [00:02<00:01, 5.72it/s]
Total Ensemble Batches: 75%|███████▌ | 3/4 [11:13<02:55, 175.79s/it]
Running batch 6 inference: 80%|████████ | 4/5 [02:03<00:32, 32.87s/it]
2025-01-23 05:01:19.439 | DEBUG | earth2studio.data.arco:fetch_array:227 - Fetching ARCO zarr array for variable: q1000 at 2022-11-05T00:00:00
Fetching ARCO data: 77%|███████▋ | 20/26 [00:03<00:01, 5.72it/s]
Total Ensemble Batches: 75%|███████▌ | 3/4 [11:13<02:55, 175.79s/it]
Running batch 6 inference: 80%|████████ | 4/5 [02:03<00:32, 32.87s/it]
2025-01-23 05:01:19.631 | DEBUG | earth2studio.data.arco:fetch_array:227 - Fetching ARCO zarr array for variable: q850 at 2022-11-05T00:00:00
Fetching ARCO data: 77%|███████▋ | 20/26 [00:03<00:01, 5.72it/s]
Total Ensemble Batches: 75%|███████▌ | 3/4 [11:14<02:55, 175.79s/it]
Running batch 6 inference: 80%|████████ | 4/5 [02:04<00:32, 32.87s/it]
Fetching ARCO data: 81%|████████ | 21/26 [00:03<00:00, 5.52it/s]
2025-01-23 05:01:19.830 | DEBUG | earth2studio.data.arco:fetch_array:227 - Fetching ARCO zarr array for variable: q500 at 2022-11-05T00:00:00
Fetching ARCO data: 92%|█████████▏| 24/26 [00:03<00:00, 5.52it/s]
Total Ensemble Batches: 75%|███████▌ | 3/4 [11:14<02:55, 175.79s/it]
Running batch 6 inference: 80%|████████ | 4/5 [02:04<00:32, 32.87s/it]
2025-01-23 05:01:20.022 | DEBUG | earth2studio.data.arco:fetch_array:227 - Fetching ARCO zarr array for variable: q250 at 2022-11-05T00:00:00
Fetching ARCO data: 92%|█████████▏| 24/26 [00:03<00:00, 5.52it/s]
Total Ensemble Batches: 75%|███████▌ | 3/4 [11:14<02:55, 175.79s/it]
Running batch 6 inference: 80%|████████ | 4/5 [02:04<00:32, 32.87s/it]
Fetching ARCO data: 96%|█████████▌| 25/26 [00:03<00:00, 6.53it/s]
Fetching ARCO data: 100%|██████████| 26/26 [00:03<00:00, 6.63it/s]
Running batch 6 inference: 100%|██████████| 5/5 [02:40<00:00, 35.42s/it]
Total Ensemble Batches: 100%|██████████| 4/4 [11:50<00:00, 169.95s/it]
Total Ensemble Batches: 100%|██████████| 4/4 [11:50<00:00, 177.72s/it]
2025-01-23 05:01:56.512 | SUCCESS | earth2studio.run:ensemble:412 - Inference complete
/
├── ensemble (8,) int64
├── ilat (512,) int64
├── ilon (640,) int64
├── lat (512, 640) float32
├── lead_time (5,) timedelta64[h]
├── lon (512, 640) float32
├── refc (8, 1, 5, 512, 640) float32
├── t2m (8, 1, 5, 512, 640) float32
└── time (1,) datetime64[ns]
Post Processing#
The last step is to post process our results. Cartopy is a great library for plotting fields on projections of a sphere. Here we will just plot the temperature at 2 meters (t2m) 4 hours into the forecast.
Notice that the Zarr IO function has additional APIs to interact with the stored data.
import cartopy
import cartopy.crs as ccrs
import matplotlib.pyplot as plt
forecast = f"{date}"
step = 4 # 4 hours, since lead_time = 1 hr
plt.close("all")
def plot_(axi, data, title, cmap, vmin=None, vmax=None):
"""Convenience function for plotting pcolormesh."""
# Plot the field using pcolormesh
im = axi.pcolormesh(
io["lon"][:],
io["lat"][:],
data,
transform=ccrs.PlateCarree(),
cmap=cmap,
vmin=vmin,
vmax=vmax,
)
plt.colorbar(im, ax=axi, shrink=0.6, pad=0.04)
# Set title
axi.set_title(title)
# Add coastlines and gridlines
axi.coastlines()
axi.gridlines()
# Set state lines
axi.add_feature(
cartopy.feature.STATES.with_scale("50m"),
linewidth=0.5,
edgecolor="black",
zorder=2,
)
# Create a correct Lambert Conformal projection
projection = ccrs.LambertConformal(
central_longitude=262.5,
central_latitude=38.5,
standard_parallels=(38.5, 38.5),
globe=ccrs.Globe(semimajor_axis=6371229, semiminor_axis=6371229),
)
# Plot 2-meter temperature
variable = "t2m"
cmap = "Spectral_r"
x = io[variable]
plt.close("all")
fig, (ax1, ax2, ax3) = plt.subplots(
nrows=1, ncols=3, subplot_kw={"projection": projection}, figsize=(20, 6)
)
plot_(
ax1,
x[0, 0, step],
f"{forecast} - Lead time: {step}hrs - Member: {0}",
cmap,
)
plot_(
ax2,
io[variable][1, 0, step],
f"{forecast} - Lead time: {step}hrs - Member: {1}",
cmap,
)
plot_(
ax3,
x[:, 0, step].std(axis=0),
f"{forecast} - Lead time: {step}hrs - Std",
cmap,
)
plt.savefig(f"outputs/10_{date}_{variable}_{step}_ensemble.jpg")
# Plot refc
variable = "refc"
cmap = "gist_ncar"
x = io[variable]
plt.close("all")
fig, (ax1, ax2, ax3) = plt.subplots(
nrows=1, ncols=3, subplot_kw={"projection": projection}, figsize=(20, 6)
)
plot_(
ax1,
np.where(x[0, 0, step] > 0, x[0, 0, step], np.nan),
f"{forecast} - Lead time: {step}hrs - Member: {0}",
cmap,
vmin=0,
vmax=60,
)
plot_(
ax2,
np.where(x[1, 0, step] > 0, x[1, 0, step], np.nan),
f"{forecast} - Lead time: {step}hrs - Member: {1}",
cmap,
vmin=0,
vmax=60,
)
plot_(
ax3,
np.where(x[:, 0, step].mean(axis=0) > 0, x[:, 0, step].std(axis=0), np.nan),
f"{forecast} - Lead time: {step}hrs - Std",
cmap,
vmin=0,
vmax=60,
)
plt.savefig(f"outputs/10_{date}_{variable}_{step}_ensemble.jpg")
Total running time of the script: (13 minutes 56.655 seconds)