Skip to content

Creating a Local Data Source

Create and save an offline dataset to use in an inference pipeline.

This example demonstrates how to:

  • Build a small offline dataset by fetching data and writing to a Zarr store
  • Load the local store as a data source for an inference pipeline with the Microsoft Aurora model
  • Run the deterministic workflow and plot results

Set Up

For this example, the following are needed:

import os

os.makedirs("outputs", exist_ok=True)
from dotenv import load_dotenv

load_dotenv()

from earth2studio.data import WB2ERA5, fetch_data
from earth2studio.models.px import Aurora

# Load the default model package which downloads the checkpoint from GCP
package = Aurora.load_default_package()
model = Aurora.load_model(package)

# Create the data source, cache is false
wb2 = WB2ERA5(cache=False, verbose=False)
Console output277 lines
Downloading aurora-0.25-static-z.npy: 0%|          | 0.00/3.96M [00:00<?, ?B/s]
Downloading aurora-0.25-static-z.npy: 100%|โ–ˆโ–ˆโ–ˆโ–ˆโ–ˆโ–ˆโ–ˆโ–ˆโ–ˆโ–ˆ| 3.96M/3.96M [00:00<00:00, 5.72MB/s]
Downloading aurora-0.25-static-z.npy: 100%|โ–ˆโ–ˆโ–ˆโ–ˆโ–ˆโ–ˆโ–ˆโ–ˆโ–ˆโ–ˆ| 3.96M/3.96M [00:00<00:00, 5.70MB/s]

Downloading aurora-0.25-static-slt.npy: 0%|          | 0.00/3.96M [00:00<?, ?B/s]
Downloading aurora-0.25-static-slt.npy: 100%|โ–ˆโ–ˆโ–ˆโ–ˆโ–ˆโ–ˆโ–ˆโ–ˆโ–ˆโ–ˆ| 3.96M/3.96M [00:00<00:00, 7.08MB/s]
Downloading aurora-0.25-static-slt.npy: 100%|โ–ˆโ–ˆโ–ˆโ–ˆโ–ˆโ–ˆโ–ˆโ–ˆโ–ˆโ–ˆ| 3.96M/3.96M [00:00<00:00, 7.01MB/s]

Downloading aurora-0.25-static-lsm.npy: 0%|          | 0.00/3.96M [00:00<?, ?B/s]
Downloading aurora-0.25-static-lsm.npy: 100%|โ–ˆโ–ˆโ–ˆโ–ˆโ–ˆโ–ˆโ–ˆโ–ˆโ–ˆโ–ˆ| 3.96M/3.96M [00:00<00:00, 8.20MB/s]
Downloading aurora-0.25-static-lsm.npy: 100%|โ–ˆโ–ˆโ–ˆโ–ˆโ–ˆโ–ˆโ–ˆโ–ˆโ–ˆโ–ˆ| 3.96M/3.96M [00:00<00:00, 8.14MB/s]

Downloading aurora-0.25-pretrained.ckpt: 0%|          | 0.00/4.68G [00:00<?, ?B/s]
Downloading aurora-0.25-pretrained.ckpt: 0%|          | 10.0M/4.68G [00:00<07:47, 10.7MB/s]
Downloading aurora-0.25-pretrained.ckpt: 0%|          | 20.0M/4.68G [00:01<03:59, 20.9MB/s]
Downloading aurora-0.25-pretrained.ckpt: 1%|          | 30.0M/4.68G [00:01<02:32, 32.7MB/s]
Downloading aurora-0.25-pretrained.ckpt: 1%|          | 40.0M/4.68G [00:01<01:57, 42.4MB/s]
Downloading aurora-0.25-pretrained.ckpt: 1%|โ–         | 60.0M/4.68G [00:01<01:19, 62.7MB/s]
Downloading aurora-0.25-pretrained.ckpt: 2%|โ–         | 80.0M/4.68G [00:01<01:04, 76.4MB/s]
Downloading aurora-0.25-pretrained.ckpt: 2%|โ–         | 100M/4.68G [00:01<00:57, 86.0MB/s] 
Downloading aurora-0.25-pretrained.ckpt: 3%|โ–Ž         | 120M/4.68G [00:02<00:52, 92.7MB/s]
Downloading aurora-0.25-pretrained.ckpt: 3%|โ–Ž         | 140M/4.68G [00:02<00:49, 98.8MB/s]
Downloading aurora-0.25-pretrained.ckpt: 3%|โ–Ž         | 160M/4.68G [00:02<00:47, 103MB/s] 
Downloading aurora-0.25-pretrained.ckpt: 4%|โ–         | 180M/4.68G [00:02<00:45, 106MB/s]
Downloading aurora-0.25-pretrained.ckpt: 4%|โ–         | 200M/4.68G [00:02<00:44, 108MB/s]
Downloading aurora-0.25-pretrained.ckpt: 5%|โ–         | 220M/4.68G [00:03<00:43, 110MB/s]
Downloading aurora-0.25-pretrained.ckpt: 5%|โ–Œ         | 240M/4.68G [00:03<00:42, 111MB/s]
Downloading aurora-0.25-pretrained.ckpt: 5%|โ–Œ         | 260M/4.68G [00:03<00:42, 113MB/s]
Downloading aurora-0.25-pretrained.ckpt: 6%|โ–Œ         | 280M/4.68G [00:03<00:42, 112MB/s]
Downloading aurora-0.25-pretrained.ckpt: 6%|โ–‹         | 300M/4.68G [00:03<00:41, 112MB/s]
Downloading aurora-0.25-pretrained.ckpt: 7%|โ–‹         | 320M/4.68G [00:04<00:41, 113MB/s]
Downloading aurora-0.25-pretrained.ckpt: 7%|โ–‹         | 340M/4.68G [00:04<00:41, 113MB/s]
Downloading aurora-0.25-pretrained.ckpt: 8%|โ–Š         | 360M/4.68G [00:04<00:41, 113MB/s]
Downloading aurora-0.25-pretrained.ckpt: 8%|โ–Š         | 380M/4.68G [00:04<00:40, 113MB/s]
Downloading aurora-0.25-pretrained.ckpt: 8%|โ–Š         | 400M/4.68G [00:04<00:40, 113MB/s]
Downloading aurora-0.25-pretrained.ckpt: 9%|โ–‰         | 420M/4.68G [00:04<00:40, 113MB/s]
Downloading aurora-0.25-pretrained.ckpt: 9%|โ–‰         | 440M/4.68G [00:05<00:40, 113MB/s]
Downloading aurora-0.25-pretrained.ckpt: 10%|โ–‰         | 460M/4.68G [00:05<00:39, 114MB/s]
Downloading aurora-0.25-pretrained.ckpt: 10%|โ–ˆ         | 480M/4.68G [00:05<00:39, 113MB/s]
Downloading aurora-0.25-pretrained.ckpt: 10%|โ–ˆ         | 500M/4.68G [00:05<00:39, 113MB/s]
Downloading aurora-0.25-pretrained.ckpt: 11%|โ–ˆ         | 520M/4.68G [00:05<00:39, 114MB/s]
Downloading aurora-0.25-pretrained.ckpt: 11%|โ–ˆโ–        | 540M/4.68G [00:06<00:39, 114MB/s]
Downloading aurora-0.25-pretrained.ckpt: 12%|โ–ˆโ–        | 560M/4.68G [00:06<00:39, 113MB/s]
Downloading aurora-0.25-pretrained.ckpt: 12%|โ–ˆโ–        | 580M/4.68G [00:06<00:39, 113MB/s]
Downloading aurora-0.25-pretrained.ckpt: 13%|โ–ˆโ–Ž        | 600M/4.68G [00:06<00:39, 113MB/s]
Downloading aurora-0.25-pretrained.ckpt: 13%|โ–ˆโ–Ž        | 620M/4.68G [00:06<00:38, 112MB/s]
Downloading aurora-0.25-pretrained.ckpt: 13%|โ–ˆโ–Ž        | 640M/4.68G [00:06<00:38, 113MB/s]
Downloading aurora-0.25-pretrained.ckpt: 14%|โ–ˆโ–        | 660M/4.68G [00:07<00:38, 112MB/s]
Downloading aurora-0.25-pretrained.ckpt: 14%|โ–ˆโ–        | 680M/4.68G [00:07<00:38, 112MB/s]
Downloading aurora-0.25-pretrained.ckpt: 15%|โ–ˆโ–        | 700M/4.68G [00:07<00:38, 112MB/s]
Downloading aurora-0.25-pretrained.ckpt: 15%|โ–ˆโ–Œ        | 720M/4.68G [00:07<00:38, 111MB/s]
Downloading aurora-0.25-pretrained.ckpt: 15%|โ–ˆโ–Œ        | 740M/4.68G [00:07<00:38, 111MB/s]
Downloading aurora-0.25-pretrained.ckpt: 16%|โ–ˆโ–Œ        | 760M/4.68G [00:08<00:38, 111MB/s]
Downloading aurora-0.25-pretrained.ckpt: 16%|โ–ˆโ–‹        | 780M/4.68G [00:08<00:37, 111MB/s]
Downloading aurora-0.25-pretrained.ckpt: 17%|โ–ˆโ–‹        | 800M/4.68G [00:08<00:37, 111MB/s]
Downloading aurora-0.25-pretrained.ckpt: 17%|โ–ˆโ–‹        | 820M/4.68G [00:08<00:37, 111MB/s]
Downloading aurora-0.25-pretrained.ckpt: 18%|โ–ˆโ–Š        | 840M/4.68G [00:08<00:37, 111MB/s]
Downloading aurora-0.25-pretrained.ckpt: 18%|โ–ˆโ–Š        | 860M/4.68G [00:09<00:36, 112MB/s]
Downloading aurora-0.25-pretrained.ckpt: 18%|โ–ˆโ–Š        | 880M/4.68G [00:09<00:36, 112MB/s]
Downloading aurora-0.25-pretrained.ckpt: 19%|โ–ˆโ–‰        | 900M/4.68G [00:09<00:36, 112MB/s]
Downloading aurora-0.25-pretrained.ckpt: 19%|โ–ˆโ–‰        | 920M/4.68G [00:09<00:36, 112MB/s]
Downloading aurora-0.25-pretrained.ckpt: 20%|โ–ˆโ–‰        | 940M/4.68G [00:09<00:36, 112MB/s]
Downloading aurora-0.25-pretrained.ckpt: 20%|โ–ˆโ–ˆ        | 960M/4.68G [00:09<00:35, 112MB/s]
Downloading aurora-0.25-pretrained.ckpt: 20%|โ–ˆโ–ˆ        | 980M/4.68G [00:10<00:36, 110MB/s]
Downloading aurora-0.25-pretrained.ckpt: 21%|โ–ˆโ–ˆ        | 0.98G/4.68G [00:10<00:35, 111MB/s]
Downloading aurora-0.25-pretrained.ckpt: 21%|โ–ˆโ–ˆโ–       | 1.00G/4.68G [00:10<00:35, 111MB/s]
Downloading aurora-0.25-pretrained.ckpt: 22%|โ–ˆโ–ˆโ–       | 1.02G/4.68G [00:10<00:35, 111MB/s]
Downloading aurora-0.25-pretrained.ckpt: 22%|โ–ˆโ–ˆโ–       | 1.04G/4.68G [00:10<00:35, 111MB/s]
Downloading aurora-0.25-pretrained.ckpt: 23%|โ–ˆโ–ˆโ–Ž       | 1.05G/4.68G [00:11<00:34, 111MB/s]
Downloading aurora-0.25-pretrained.ckpt: 23%|โ–ˆโ–ˆโ–Ž       | 1.07G/4.68G [00:11<00:34, 112MB/s]
Downloading aurora-0.25-pretrained.ckpt: 23%|โ–ˆโ–ˆโ–Ž       | 1.09G/4.68G [00:11<00:34, 112MB/s]
Downloading aurora-0.25-pretrained.ckpt: 24%|โ–ˆโ–ˆโ–       | 1.11G/4.68G [00:11<00:34, 112MB/s]
Downloading aurora-0.25-pretrained.ckpt: 24%|โ–ˆโ–ˆโ–       | 1.13G/4.68G [00:11<00:33, 112MB/s]
Downloading aurora-0.25-pretrained.ckpt: 25%|โ–ˆโ–ˆโ–       | 1.15G/4.68G [00:12<00:33, 112MB/s]
Downloading aurora-0.25-pretrained.ckpt: 25%|โ–ˆโ–ˆโ–Œ       | 1.17G/4.68G [00:12<00:33, 113MB/s]
Downloading aurora-0.25-pretrained.ckpt: 25%|โ–ˆโ–ˆโ–Œ       | 1.19G/4.68G [00:12<00:33, 113MB/s]
Downloading aurora-0.25-pretrained.ckpt: 26%|โ–ˆโ–ˆโ–Œ       | 1.21G/4.68G [00:12<00:33, 113MB/s]
Downloading aurora-0.25-pretrained.ckpt: 26%|โ–ˆโ–ˆโ–‹       | 1.23G/4.68G [00:12<00:32, 113MB/s]
Downloading aurora-0.25-pretrained.ckpt: 27%|โ–ˆโ–ˆโ–‹       | 1.25G/4.68G [00:12<00:32, 113MB/s]
Downloading aurora-0.25-pretrained.ckpt: 27%|โ–ˆโ–ˆโ–‹       | 1.27G/4.68G [00:13<00:32, 113MB/s]
Downloading aurora-0.25-pretrained.ckpt: 28%|โ–ˆโ–ˆโ–Š       | 1.29G/4.68G [00:13<00:32, 113MB/s]
Downloading aurora-0.25-pretrained.ckpt: 28%|โ–ˆโ–ˆโ–Š       | 1.31G/4.68G [00:13<00:32, 113MB/s]
Downloading aurora-0.25-pretrained.ckpt: 28%|โ–ˆโ–ˆโ–Š       | 1.33G/4.68G [00:13<00:32, 112MB/s]
Downloading aurora-0.25-pretrained.ckpt: 29%|โ–ˆโ–ˆโ–‰       | 1.35G/4.68G [00:13<00:31, 112MB/s]
Downloading aurora-0.25-pretrained.ckpt: 29%|โ–ˆโ–ˆโ–‰       | 1.37G/4.68G [00:14<00:31, 112MB/s]
Downloading aurora-0.25-pretrained.ckpt: 30%|โ–ˆโ–ˆโ–‰       | 1.39G/4.68G [00:14<00:31, 112MB/s]
Downloading aurora-0.25-pretrained.ckpt: 30%|โ–ˆโ–ˆโ–ˆ       | 1.41G/4.68G [00:14<00:31, 112MB/s]
Downloading aurora-0.25-pretrained.ckpt: 30%|โ–ˆโ–ˆโ–ˆ       | 1.43G/4.68G [00:14<00:31, 111MB/s]
Downloading aurora-0.25-pretrained.ckpt: 31%|โ–ˆโ–ˆโ–ˆ       | 1.45G/4.68G [00:14<00:31, 112MB/s]
Downloading aurora-0.25-pretrained.ckpt: 31%|โ–ˆโ–ˆโ–ˆโ–      | 1.46G/4.68G [00:15<00:30, 112MB/s]
Downloading aurora-0.25-pretrained.ckpt: 32%|โ–ˆโ–ˆโ–ˆโ–      | 1.48G/4.68G [00:15<00:31, 110MB/s]
Downloading aurora-0.25-pretrained.ckpt: 32%|โ–ˆโ–ˆโ–ˆโ–      | 1.50G/4.68G [00:15<00:33, 103MB/s]
Downloading aurora-0.25-pretrained.ckpt: 32%|โ–ˆโ–ˆโ–ˆโ–      | 1.51G/4.68G [00:15<00:34, 99.8MB/s]
Downloading aurora-0.25-pretrained.ckpt: 33%|โ–ˆโ–ˆโ–ˆโ–Ž      | 1.52G/4.68G [00:15<00:34, 99.1MB/s]
Downloading aurora-0.25-pretrained.ckpt: 33%|โ–ˆโ–ˆโ–ˆโ–Ž      | 1.53G/4.68G [00:15<00:34, 97.4MB/s]
Downloading aurora-0.25-pretrained.ckpt: 33%|โ–ˆโ–ˆโ–ˆโ–Ž      | 1.55G/4.68G [00:16<00:33, 101MB/s] 
Downloading aurora-0.25-pretrained.ckpt: 34%|โ–ˆโ–ˆโ–ˆโ–Ž      | 1.57G/4.68G [00:16<00:32, 103MB/s]
Downloading aurora-0.25-pretrained.ckpt: 34%|โ–ˆโ–ˆโ–ˆโ–      | 1.59G/4.68G [00:16<00:31, 106MB/s]
Downloading aurora-0.25-pretrained.ckpt: 34%|โ–ˆโ–ˆโ–ˆโ–      | 1.61G/4.68G [00:16<00:31, 105MB/s]
Downloading aurora-0.25-pretrained.ckpt: 35%|โ–ˆโ–ˆโ–ˆโ–      | 1.62G/4.68G [00:16<00:32, 103MB/s]
Downloading aurora-0.25-pretrained.ckpt: 35%|โ–ˆโ–ˆโ–ˆโ–Œ      | 1.64G/4.68G [00:16<00:31, 104MB/s]
Downloading aurora-0.25-pretrained.ckpt: 35%|โ–ˆโ–ˆโ–ˆโ–Œ      | 1.65G/4.68G [00:17<00:31, 102MB/s]
Downloading aurora-0.25-pretrained.ckpt: 36%|โ–ˆโ–ˆโ–ˆโ–Œ      | 1.67G/4.68G [00:17<00:31, 104MB/s]
Downloading aurora-0.25-pretrained.ckpt: 36%|โ–ˆโ–ˆโ–ˆโ–Œ      | 1.69G/4.68G [00:17<00:30, 106MB/s]
Downloading aurora-0.25-pretrained.ckpt: 37%|โ–ˆโ–ˆโ–ˆโ–‹      | 1.71G/4.68G [00:17<00:30, 106MB/s]
Downloading aurora-0.25-pretrained.ckpt: 37%|โ–ˆโ–ˆโ–ˆโ–‹      | 1.73G/4.68G [00:17<00:30, 103MB/s]
Downloading aurora-0.25-pretrained.ckpt: 37%|โ–ˆโ–ˆโ–ˆโ–‹      | 1.74G/4.68G [00:18<00:44, 71.7MB/s]
Downloading aurora-0.25-pretrained.ckpt: 38%|โ–ˆโ–ˆโ–ˆโ–Š      | 1.76G/4.68G [00:18<00:38, 81.8MB/s]
Downloading aurora-0.25-pretrained.ckpt: 38%|โ–ˆโ–ˆโ–ˆโ–Š      | 1.78G/4.68G [00:18<00:34, 89.5MB/s]
Downloading aurora-0.25-pretrained.ckpt: 38%|โ–ˆโ–ˆโ–ˆโ–Š      | 1.80G/4.68G [00:18<00:32, 95.5MB/s]
Downloading aurora-0.25-pretrained.ckpt: 39%|โ–ˆโ–ˆโ–ˆโ–Š      | 1.81G/4.68G [00:18<00:32, 94.3MB/s]
Downloading aurora-0.25-pretrained.ckpt: 39%|โ–ˆโ–ˆโ–ˆโ–‰      | 1.83G/4.68G [00:19<00:30, 99.8MB/s]
Downloading aurora-0.25-pretrained.ckpt: 39%|โ–ˆโ–ˆโ–ˆโ–‰      | 1.85G/4.68G [00:19<00:29, 103MB/s] 
Downloading aurora-0.25-pretrained.ckpt: 40%|โ–ˆโ–ˆโ–ˆโ–‰      | 1.87G/4.68G [00:19<00:28, 106MB/s]
Downloading aurora-0.25-pretrained.ckpt: 40%|โ–ˆโ–ˆโ–ˆโ–ˆ      | 1.88G/4.68G [00:19<00:27, 108MB/s]
Downloading aurora-0.25-pretrained.ckpt: 41%|โ–ˆโ–ˆโ–ˆโ–ˆ      | 1.90G/4.68G [00:19<00:27, 110MB/s]
Downloading aurora-0.25-pretrained.ckpt: 41%|โ–ˆโ–ˆโ–ˆโ–ˆ      | 1.92G/4.68G [00:19<00:26, 111MB/s]
Downloading aurora-0.25-pretrained.ckpt: 42%|โ–ˆโ–ˆโ–ˆโ–ˆโ–     | 1.94G/4.68G [00:20<00:26, 111MB/s]
Downloading aurora-0.25-pretrained.ckpt: 42%|โ–ˆโ–ˆโ–ˆโ–ˆโ–     | 1.96G/4.68G [00:20<00:26, 112MB/s]
Downloading aurora-0.25-pretrained.ckpt: 42%|โ–ˆโ–ˆโ–ˆโ–ˆโ–     | 1.98G/4.68G [00:20<00:25, 112MB/s]
Downloading aurora-0.25-pretrained.ckpt: 43%|โ–ˆโ–ˆโ–ˆโ–ˆโ–Ž     | 2.00G/4.68G [00:20<00:25, 111MB/s]
Downloading aurora-0.25-pretrained.ckpt: 43%|โ–ˆโ–ˆโ–ˆโ–ˆโ–Ž     | 2.02G/4.68G [00:20<00:25, 111MB/s]
Downloading aurora-0.25-pretrained.ckpt: 44%|โ–ˆโ–ˆโ–ˆโ–ˆโ–Ž     | 2.04G/4.68G [00:21<00:25, 111MB/s]
Downloading aurora-0.25-pretrained.ckpt: 44%|โ–ˆโ–ˆโ–ˆโ–ˆโ–     | 2.06G/4.68G [00:21<00:25, 112MB/s]
Downloading aurora-0.25-pretrained.ckpt: 44%|โ–ˆโ–ˆโ–ˆโ–ˆโ–     | 2.08G/4.68G [00:21<00:24, 112MB/s]
Downloading aurora-0.25-pretrained.ckpt: 45%|โ–ˆโ–ˆโ–ˆโ–ˆโ–     | 2.10G/4.68G [00:21<00:25, 111MB/s]
Downloading aurora-0.25-pretrained.ckpt: 45%|โ–ˆโ–ˆโ–ˆโ–ˆโ–Œ     | 2.12G/4.68G [00:21<00:24, 110MB/s]
Downloading aurora-0.25-pretrained.ckpt: 46%|โ–ˆโ–ˆโ–ˆโ–ˆโ–Œ     | 2.14G/4.68G [00:22<00:24, 110MB/s]
Downloading aurora-0.25-pretrained.ckpt: 46%|โ–ˆโ–ˆโ–ˆโ–ˆโ–Œ     | 2.16G/4.68G [00:22<00:24, 110MB/s]
Downloading aurora-0.25-pretrained.ckpt: 47%|โ–ˆโ–ˆโ–ˆโ–ˆโ–‹     | 2.18G/4.68G [00:22<00:24, 110MB/s]
Downloading aurora-0.25-pretrained.ckpt: 47%|โ–ˆโ–ˆโ–ˆโ–ˆโ–‹     | 2.20G/4.68G [00:22<00:24, 111MB/s]
Downloading aurora-0.25-pretrained.ckpt: 47%|โ–ˆโ–ˆโ–ˆโ–ˆโ–‹     | 2.22G/4.68G [00:22<00:23, 111MB/s]
Downloading aurora-0.25-pretrained.ckpt: 48%|โ–ˆโ–ˆโ–ˆโ–ˆโ–Š     | 2.24G/4.68G [00:22<00:23, 111MB/s]
Downloading aurora-0.25-pretrained.ckpt: 48%|โ–ˆโ–ˆโ–ˆโ–ˆโ–Š     | 2.26G/4.68G [00:23<00:23, 110MB/s]
Downloading aurora-0.25-pretrained.ckpt: 49%|โ–ˆโ–ˆโ–ˆโ–ˆโ–Š     | 2.28G/4.68G [00:23<00:23, 110MB/s]
Downloading aurora-0.25-pretrained.ckpt: 49%|โ–ˆโ–ˆโ–ˆโ–ˆโ–‰     | 2.29G/4.68G [00:23<00:23, 110MB/s]
Downloading aurora-0.25-pretrained.ckpt: 49%|โ–ˆโ–ˆโ–ˆโ–ˆโ–‰     | 2.31G/4.68G [00:23<00:23, 110MB/s]
Downloading aurora-0.25-pretrained.ckpt: 50%|โ–ˆโ–ˆโ–ˆโ–ˆโ–‰     | 2.33G/4.68G [00:23<00:22, 111MB/s]
Downloading aurora-0.25-pretrained.ckpt: 50%|โ–ˆโ–ˆโ–ˆโ–ˆโ–ˆ     | 2.35G/4.68G [00:24<00:22, 111MB/s]
Downloading aurora-0.25-pretrained.ckpt: 51%|โ–ˆโ–ˆโ–ˆโ–ˆโ–ˆ     | 2.37G/4.68G [00:24<00:22, 111MB/s]
Downloading aurora-0.25-pretrained.ckpt: 51%|โ–ˆโ–ˆโ–ˆโ–ˆโ–ˆ     | 2.39G/4.68G [00:24<00:22, 111MB/s]
Downloading aurora-0.25-pretrained.ckpt: 52%|โ–ˆโ–ˆโ–ˆโ–ˆโ–ˆโ–    | 2.41G/4.68G [00:24<00:21, 111MB/s]
Downloading aurora-0.25-pretrained.ckpt: 52%|โ–ˆโ–ˆโ–ˆโ–ˆโ–ˆโ–    | 2.43G/4.68G [00:24<00:21, 111MB/s]
Downloading aurora-0.25-pretrained.ckpt: 52%|โ–ˆโ–ˆโ–ˆโ–ˆโ–ˆโ–    | 2.45G/4.68G [00:25<00:21, 110MB/s]
Downloading aurora-0.25-pretrained.ckpt: 53%|โ–ˆโ–ˆโ–ˆโ–ˆโ–ˆโ–Ž    | 2.47G/4.68G [00:25<00:21, 111MB/s]
Downloading aurora-0.25-pretrained.ckpt: 53%|โ–ˆโ–ˆโ–ˆโ–ˆโ–ˆโ–Ž    | 2.49G/4.68G [00:25<00:21, 110MB/s]
Downloading aurora-0.25-pretrained.ckpt: 54%|โ–ˆโ–ˆโ–ˆโ–ˆโ–ˆโ–Ž    | 2.51G/4.68G [00:25<00:21, 110MB/s]
Downloading aurora-0.25-pretrained.ckpt: 54%|โ–ˆโ–ˆโ–ˆโ–ˆโ–ˆโ–    | 2.53G/4.68G [00:25<00:20, 111MB/s]
Downloading aurora-0.25-pretrained.ckpt: 54%|โ–ˆโ–ˆโ–ˆโ–ˆโ–ˆโ–    | 2.55G/4.68G [00:26<00:20, 111MB/s]
Downloading aurora-0.25-pretrained.ckpt: 55%|โ–ˆโ–ˆโ–ˆโ–ˆโ–ˆโ–    | 2.57G/4.68G [00:26<00:20, 112MB/s]
Downloading aurora-0.25-pretrained.ckpt: 55%|โ–ˆโ–ˆโ–ˆโ–ˆโ–ˆโ–Œ    | 2.59G/4.68G [00:26<00:20, 112MB/s]
Downloading aurora-0.25-pretrained.ckpt: 56%|โ–ˆโ–ˆโ–ˆโ–ˆโ–ˆโ–Œ    | 2.61G/4.68G [00:26<00:19, 112MB/s]
Downloading aurora-0.25-pretrained.ckpt: 56%|โ–ˆโ–ˆโ–ˆโ–ˆโ–ˆโ–Œ    | 2.63G/4.68G [00:26<00:19, 112MB/s]
Downloading aurora-0.25-pretrained.ckpt: 57%|โ–ˆโ–ˆโ–ˆโ–ˆโ–ˆโ–‹    | 2.65G/4.68G [00:26<00:19, 112MB/s]
Downloading aurora-0.25-pretrained.ckpt: 57%|โ–ˆโ–ˆโ–ˆโ–ˆโ–ˆโ–‹    | 2.67G/4.68G [00:27<00:19, 112MB/s]
Downloading aurora-0.25-pretrained.ckpt: 57%|โ–ˆโ–ˆโ–ˆโ–ˆโ–ˆโ–‹    | 2.69G/4.68G [00:27<00:19, 112MB/s]
Downloading aurora-0.25-pretrained.ckpt: 58%|โ–ˆโ–ˆโ–ˆโ–ˆโ–ˆโ–Š    | 2.71G/4.68G [00:27<00:18, 112MB/s]
Downloading aurora-0.25-pretrained.ckpt: 58%|โ–ˆโ–ˆโ–ˆโ–ˆโ–ˆโ–Š    | 2.72G/4.68G [00:27<00:18, 112MB/s]
Downloading aurora-0.25-pretrained.ckpt: 59%|โ–ˆโ–ˆโ–ˆโ–ˆโ–ˆโ–Š    | 2.74G/4.68G [00:27<00:18, 113MB/s]
Downloading aurora-0.25-pretrained.ckpt: 59%|โ–ˆโ–ˆโ–ˆโ–ˆโ–ˆโ–‰    | 2.76G/4.68G [00:28<00:18, 113MB/s]
Downloading aurora-0.25-pretrained.ckpt: 59%|โ–ˆโ–ˆโ–ˆโ–ˆโ–ˆโ–‰    | 2.78G/4.68G [00:28<00:18, 112MB/s]
Downloading aurora-0.25-pretrained.ckpt: 60%|โ–ˆโ–ˆโ–ˆโ–ˆโ–ˆโ–‰    | 2.80G/4.68G [00:28<00:18, 109MB/s]
Downloading aurora-0.25-pretrained.ckpt: 60%|โ–ˆโ–ˆโ–ˆโ–ˆโ–ˆโ–ˆ    | 2.82G/4.68G [00:28<00:18, 110MB/s]
Downloading aurora-0.25-pretrained.ckpt: 61%|โ–ˆโ–ˆโ–ˆโ–ˆโ–ˆโ–ˆ    | 2.84G/4.68G [00:28<00:17, 111MB/s]
Downloading aurora-0.25-pretrained.ckpt: 61%|โ–ˆโ–ˆโ–ˆโ–ˆโ–ˆโ–ˆ    | 2.86G/4.68G [00:29<00:18, 105MB/s]
Downloading aurora-0.25-pretrained.ckpt: 62%|โ–ˆโ–ˆโ–ˆโ–ˆโ–ˆโ–ˆโ–   | 2.88G/4.68G [00:29<00:18, 103MB/s]
Downloading aurora-0.25-pretrained.ckpt: 62%|โ–ˆโ–ˆโ–ˆโ–ˆโ–ˆโ–ˆโ–   | 2.90G/4.68G [00:29<00:18, 105MB/s]
Downloading aurora-0.25-pretrained.ckpt: 62%|โ–ˆโ–ˆโ–ˆโ–ˆโ–ˆโ–ˆโ–   | 2.92G/4.68G [00:29<00:17, 107MB/s]
Downloading aurora-0.25-pretrained.ckpt: 63%|โ–ˆโ–ˆโ–ˆโ–ˆโ–ˆโ–ˆโ–Ž   | 2.94G/4.68G [00:29<00:17, 109MB/s]
Downloading aurora-0.25-pretrained.ckpt: 63%|โ–ˆโ–ˆโ–ˆโ–ˆโ–ˆโ–ˆโ–Ž   | 2.96G/4.68G [00:30<00:16, 109MB/s]
Downloading aurora-0.25-pretrained.ckpt: 64%|โ–ˆโ–ˆโ–ˆโ–ˆโ–ˆโ–ˆโ–Ž   | 2.98G/4.68G [00:30<00:16, 109MB/s]
Downloading aurora-0.25-pretrained.ckpt: 64%|โ–ˆโ–ˆโ–ˆโ–ˆโ–ˆโ–ˆโ–   | 3.00G/4.68G [00:30<00:16, 109MB/s]
Downloading aurora-0.25-pretrained.ckpt: 64%|โ–ˆโ–ˆโ–ˆโ–ˆโ–ˆโ–ˆโ–   | 3.02G/4.68G [00:30<00:16, 110MB/s]
Downloading aurora-0.25-pretrained.ckpt: 65%|โ–ˆโ–ˆโ–ˆโ–ˆโ–ˆโ–ˆโ–   | 3.04G/4.68G [00:30<00:15, 111MB/s]
Downloading aurora-0.25-pretrained.ckpt: 65%|โ–ˆโ–ˆโ–ˆโ–ˆโ–ˆโ–ˆโ–Œ   | 3.06G/4.68G [00:30<00:15, 111MB/s]
Downloading aurora-0.25-pretrained.ckpt: 66%|โ–ˆโ–ˆโ–ˆโ–ˆโ–ˆโ–ˆโ–Œ   | 3.08G/4.68G [00:31<00:15, 112MB/s]
Downloading aurora-0.25-pretrained.ckpt: 66%|โ–ˆโ–ˆโ–ˆโ–ˆโ–ˆโ–ˆโ–Œ   | 3.10G/4.68G [00:31<00:15, 111MB/s]
Downloading aurora-0.25-pretrained.ckpt: 67%|โ–ˆโ–ˆโ–ˆโ–ˆโ–ˆโ–ˆโ–‹   | 3.12G/4.68G [00:31<00:15, 111MB/s]
Downloading aurora-0.25-pretrained.ckpt: 67%|โ–ˆโ–ˆโ–ˆโ–ˆโ–ˆโ–ˆโ–‹   | 3.13G/4.68G [00:31<00:14, 111MB/s]
Downloading aurora-0.25-pretrained.ckpt: 67%|โ–ˆโ–ˆโ–ˆโ–ˆโ–ˆโ–ˆโ–‹   | 3.15G/4.68G [00:31<00:14, 111MB/s]
Downloading aurora-0.25-pretrained.ckpt: 68%|โ–ˆโ–ˆโ–ˆโ–ˆโ–ˆโ–ˆโ–Š   | 3.17G/4.68G [00:32<00:14, 111MB/s]
Downloading aurora-0.25-pretrained.ckpt: 68%|โ–ˆโ–ˆโ–ˆโ–ˆโ–ˆโ–ˆโ–Š   | 3.19G/4.68G [00:32<00:14, 112MB/s]
Downloading aurora-0.25-pretrained.ckpt: 69%|โ–ˆโ–ˆโ–ˆโ–ˆโ–ˆโ–ˆโ–Š   | 3.21G/4.68G [00:32<00:14, 112MB/s]
Downloading aurora-0.25-pretrained.ckpt: 69%|โ–ˆโ–ˆโ–ˆโ–ˆโ–ˆโ–ˆโ–‰   | 3.23G/4.68G [00:32<00:13, 112MB/s]
Downloading aurora-0.25-pretrained.ckpt: 69%|โ–ˆโ–ˆโ–ˆโ–ˆโ–ˆโ–ˆโ–‰   | 3.25G/4.68G [00:32<00:13, 111MB/s]
Downloading aurora-0.25-pretrained.ckpt: 70%|โ–ˆโ–ˆโ–ˆโ–ˆโ–ˆโ–ˆโ–‰   | 3.27G/4.68G [00:33<00:13, 112MB/s]
Downloading aurora-0.25-pretrained.ckpt: 70%|โ–ˆโ–ˆโ–ˆโ–ˆโ–ˆโ–ˆโ–ˆ   | 3.29G/4.68G [00:33<00:13, 112MB/s]
Downloading aurora-0.25-pretrained.ckpt: 71%|โ–ˆโ–ˆโ–ˆโ–ˆโ–ˆโ–ˆโ–ˆ   | 3.31G/4.68G [00:33<00:13, 112MB/s]
Downloading aurora-0.25-pretrained.ckpt: 71%|โ–ˆโ–ˆโ–ˆโ–ˆโ–ˆโ–ˆโ–ˆ   | 3.33G/4.68G [00:33<00:13, 111MB/s]
Downloading aurora-0.25-pretrained.ckpt: 72%|โ–ˆโ–ˆโ–ˆโ–ˆโ–ˆโ–ˆโ–ˆโ–  | 3.35G/4.68G [00:33<00:12, 111MB/s]
Downloading aurora-0.25-pretrained.ckpt: 72%|โ–ˆโ–ˆโ–ˆโ–ˆโ–ˆโ–ˆโ–ˆโ–  | 3.37G/4.68G [00:33<00:12, 111MB/s]
Downloading aurora-0.25-pretrained.ckpt: 72%|โ–ˆโ–ˆโ–ˆโ–ˆโ–ˆโ–ˆโ–ˆโ–  | 3.39G/4.68G [00:34<00:12, 112MB/s]
Downloading aurora-0.25-pretrained.ckpt: 73%|โ–ˆโ–ˆโ–ˆโ–ˆโ–ˆโ–ˆโ–ˆโ–Ž  | 3.41G/4.68G [00:34<00:12, 112MB/s]
Downloading aurora-0.25-pretrained.ckpt: 73%|โ–ˆโ–ˆโ–ˆโ–ˆโ–ˆโ–ˆโ–ˆโ–Ž  | 3.43G/4.68G [00:34<00:12, 112MB/s]
Downloading aurora-0.25-pretrained.ckpt: 74%|โ–ˆโ–ˆโ–ˆโ–ˆโ–ˆโ–ˆโ–ˆโ–Ž  | 3.45G/4.68G [00:34<00:11, 111MB/s]
Downloading aurora-0.25-pretrained.ckpt: 74%|โ–ˆโ–ˆโ–ˆโ–ˆโ–ˆโ–ˆโ–ˆโ–  | 3.47G/4.68G [00:34<00:11, 112MB/s]
Downloading aurora-0.25-pretrained.ckpt: 74%|โ–ˆโ–ˆโ–ˆโ–ˆโ–ˆโ–ˆโ–ˆโ–  | 3.49G/4.68G [00:35<00:11, 113MB/s]
Downloading aurora-0.25-pretrained.ckpt: 75%|โ–ˆโ–ˆโ–ˆโ–ˆโ–ˆโ–ˆโ–ˆโ–  | 3.51G/4.68G [00:35<00:11, 113MB/s]
Downloading aurora-0.25-pretrained.ckpt: 75%|โ–ˆโ–ˆโ–ˆโ–ˆโ–ˆโ–ˆโ–ˆโ–Œ  | 3.53G/4.68G [00:35<00:11, 113MB/s]
Downloading aurora-0.25-pretrained.ckpt: 76%|โ–ˆโ–ˆโ–ˆโ–ˆโ–ˆโ–ˆโ–ˆโ–Œ  | 3.54G/4.68G [00:35<00:10, 113MB/s]
Downloading aurora-0.25-pretrained.ckpt: 76%|โ–ˆโ–ˆโ–ˆโ–ˆโ–ˆโ–ˆโ–ˆโ–Œ  | 3.56G/4.68G [00:35<00:10, 113MB/s]
Downloading aurora-0.25-pretrained.ckpt: 77%|โ–ˆโ–ˆโ–ˆโ–ˆโ–ˆโ–ˆโ–ˆโ–‹  | 3.58G/4.68G [00:36<00:10, 114MB/s]
Downloading aurora-0.25-pretrained.ckpt: 77%|โ–ˆโ–ˆโ–ˆโ–ˆโ–ˆโ–ˆโ–ˆโ–‹  | 3.60G/4.68G [00:36<00:10, 113MB/s]
Downloading aurora-0.25-pretrained.ckpt: 77%|โ–ˆโ–ˆโ–ˆโ–ˆโ–ˆโ–ˆโ–ˆโ–‹  | 3.62G/4.68G [00:36<00:10, 113MB/s]
Downloading aurora-0.25-pretrained.ckpt: 78%|โ–ˆโ–ˆโ–ˆโ–ˆโ–ˆโ–ˆโ–ˆโ–Š  | 3.64G/4.68G [00:36<00:09, 113MB/s]
Downloading aurora-0.25-pretrained.ckpt: 78%|โ–ˆโ–ˆโ–ˆโ–ˆโ–ˆโ–ˆโ–ˆโ–Š  | 3.66G/4.68G [00:36<00:09, 113MB/s]
Downloading aurora-0.25-pretrained.ckpt: 79%|โ–ˆโ–ˆโ–ˆโ–ˆโ–ˆโ–ˆโ–ˆโ–Š  | 3.68G/4.68G [00:36<00:09, 112MB/s]
Downloading aurora-0.25-pretrained.ckpt: 79%|โ–ˆโ–ˆโ–ˆโ–ˆโ–ˆโ–ˆโ–ˆโ–‰  | 3.70G/4.68G [00:37<00:09, 112MB/s]
Downloading aurora-0.25-pretrained.ckpt: 79%|โ–ˆโ–ˆโ–ˆโ–ˆโ–ˆโ–ˆโ–ˆโ–‰  | 3.72G/4.68G [00:37<00:09, 103MB/s]
Downloading aurora-0.25-pretrained.ckpt: 80%|โ–ˆโ–ˆโ–ˆโ–ˆโ–ˆโ–ˆโ–ˆโ–‰  | 3.73G/4.68G [00:37<00:10, 97.3MB/s]
Downloading aurora-0.25-pretrained.ckpt: 80%|โ–ˆโ–ˆโ–ˆโ–ˆโ–ˆโ–ˆโ–ˆโ–‰  | 3.74G/4.68G [00:37<00:10, 96.9MB/s]
Downloading aurora-0.25-pretrained.ckpt: 80%|โ–ˆโ–ˆโ–ˆโ–ˆโ–ˆโ–ˆโ–ˆโ–ˆ  | 3.75G/4.68G [00:37<00:10, 92.1MB/s]
Downloading aurora-0.25-pretrained.ckpt: 81%|โ–ˆโ–ˆโ–ˆโ–ˆโ–ˆโ–ˆโ–ˆโ–ˆ  | 3.77G/4.68G [00:38<00:13, 70.0MB/s]
Downloading aurora-0.25-pretrained.ckpt: 81%|โ–ˆโ–ˆโ–ˆโ–ˆโ–ˆโ–ˆโ–ˆโ–ˆ  | 3.79G/4.68G [00:38<00:12, 78.3MB/s]
Downloading aurora-0.25-pretrained.ckpt: 81%|โ–ˆโ–ˆโ–ˆโ–ˆโ–ˆโ–ˆโ–ˆโ–ˆโ– | 3.81G/4.68G [00:38<00:10, 86.7MB/s]
Downloading aurora-0.25-pretrained.ckpt: 82%|โ–ˆโ–ˆโ–ˆโ–ˆโ–ˆโ–ˆโ–ˆโ–ˆโ– | 3.83G/4.68G [00:38<00:09, 93.2MB/s]
Downloading aurora-0.25-pretrained.ckpt: 82%|โ–ˆโ–ˆโ–ˆโ–ˆโ–ˆโ–ˆโ–ˆโ–ˆโ– | 3.85G/4.68G [00:38<00:09, 98.7MB/s]
Downloading aurora-0.25-pretrained.ckpt: 83%|โ–ˆโ–ˆโ–ˆโ–ˆโ–ˆโ–ˆโ–ˆโ–ˆโ–Ž | 3.87G/4.68G [00:39<00:08, 103MB/s] 
Downloading aurora-0.25-pretrained.ckpt: 83%|โ–ˆโ–ˆโ–ˆโ–ˆโ–ˆโ–ˆโ–ˆโ–ˆโ–Ž | 3.89G/4.68G [00:39<00:08, 106MB/s]
Downloading aurora-0.25-pretrained.ckpt: 83%|โ–ˆโ–ˆโ–ˆโ–ˆโ–ˆโ–ˆโ–ˆโ–ˆโ–Ž | 3.91G/4.68G [00:39<00:07, 108MB/s]
Downloading aurora-0.25-pretrained.ckpt: 84%|โ–ˆโ–ˆโ–ˆโ–ˆโ–ˆโ–ˆโ–ˆโ–ˆโ– | 3.93G/4.68G [00:39<00:07, 109MB/s]
Downloading aurora-0.25-pretrained.ckpt: 84%|โ–ˆโ–ˆโ–ˆโ–ˆโ–ˆโ–ˆโ–ˆโ–ˆโ– | 3.95G/4.68G [00:39<00:07, 110MB/s]
Downloading aurora-0.25-pretrained.ckpt: 85%|โ–ˆโ–ˆโ–ˆโ–ˆโ–ˆโ–ˆโ–ˆโ–ˆโ– | 3.96G/4.68G [00:40<00:06, 111MB/s]
Downloading aurora-0.25-pretrained.ckpt: 85%|โ–ˆโ–ˆโ–ˆโ–ˆโ–ˆโ–ˆโ–ˆโ–ˆโ–Œ | 3.98G/4.68G [00:40<00:06, 111MB/s]
Downloading aurora-0.25-pretrained.ckpt: 86%|โ–ˆโ–ˆโ–ˆโ–ˆโ–ˆโ–ˆโ–ˆโ–ˆโ–Œ | 4.00G/4.68G [00:40<00:06, 111MB/s]
Downloading aurora-0.25-pretrained.ckpt: 86%|โ–ˆโ–ˆโ–ˆโ–ˆโ–ˆโ–ˆโ–ˆโ–ˆโ–Œ | 4.02G/4.68G [00:40<00:06, 112MB/s]
Downloading aurora-0.25-pretrained.ckpt: 86%|โ–ˆโ–ˆโ–ˆโ–ˆโ–ˆโ–ˆโ–ˆโ–ˆโ–‹ | 4.04G/4.68G [00:40<00:06, 112MB/s]
Downloading aurora-0.25-pretrained.ckpt: 87%|โ–ˆโ–ˆโ–ˆโ–ˆโ–ˆโ–ˆโ–ˆโ–ˆโ–‹ | 4.06G/4.68G [00:41<00:05, 112MB/s]
Downloading aurora-0.25-pretrained.ckpt: 87%|โ–ˆโ–ˆโ–ˆโ–ˆโ–ˆโ–ˆโ–ˆโ–ˆโ–‹ | 4.08G/4.68G [00:41<00:05, 112MB/s]
Downloading aurora-0.25-pretrained.ckpt: 88%|โ–ˆโ–ˆโ–ˆโ–ˆโ–ˆโ–ˆโ–ˆโ–ˆโ–Š | 4.10G/4.68G [00:41<00:05, 109MB/s]
Downloading aurora-0.25-pretrained.ckpt: 88%|โ–ˆโ–ˆโ–ˆโ–ˆโ–ˆโ–ˆโ–ˆโ–ˆโ–Š | 4.12G/4.68G [00:41<00:05, 106MB/s]
Downloading aurora-0.25-pretrained.ckpt: 88%|โ–ˆโ–ˆโ–ˆโ–ˆโ–ˆโ–ˆโ–ˆโ–ˆโ–Š | 4.14G/4.68G [00:41<00:05, 104MB/s]
Downloading aurora-0.25-pretrained.ckpt: 89%|โ–ˆโ–ˆโ–ˆโ–ˆโ–ˆโ–ˆโ–ˆโ–ˆโ–Š | 4.15G/4.68G [00:41<00:05, 104MB/s]
Downloading aurora-0.25-pretrained.ckpt: 89%|โ–ˆโ–ˆโ–ˆโ–ˆโ–ˆโ–ˆโ–ˆโ–ˆโ–‰ | 4.16G/4.68G [00:42<00:05, 102MB/s]
Downloading aurora-0.25-pretrained.ckpt: 89%|โ–ˆโ–ˆโ–ˆโ–ˆโ–ˆโ–ˆโ–ˆโ–ˆโ–‰ | 4.18G/4.68G [00:42<00:05, 102MB/s]
Downloading aurora-0.25-pretrained.ckpt: 90%|โ–ˆโ–ˆโ–ˆโ–ˆโ–ˆโ–ˆโ–ˆโ–ˆโ–‰ | 4.20G/4.68G [00:42<00:05, 102MB/s]
Downloading aurora-0.25-pretrained.ckpt: 90%|โ–ˆโ–ˆโ–ˆโ–ˆโ–ˆโ–ˆโ–ˆโ–ˆโ–‰ | 4.21G/4.68G [00:42<00:04, 102MB/s]
Downloading aurora-0.25-pretrained.ckpt: 90%|โ–ˆโ–ˆโ–ˆโ–ˆโ–ˆโ–ˆโ–ˆโ–ˆโ–ˆ | 4.22G/4.68G [00:42<00:04, 100MB/s]
Downloading aurora-0.25-pretrained.ckpt: 91%|โ–ˆโ–ˆโ–ˆโ–ˆโ–ˆโ–ˆโ–ˆโ–ˆโ–ˆ | 4.24G/4.68G [00:42<00:04, 101MB/s]
Downloading aurora-0.25-pretrained.ckpt: 91%|โ–ˆโ–ˆโ–ˆโ–ˆโ–ˆโ–ˆโ–ˆโ–ˆโ–ˆ | 4.25G/4.68G [00:42<00:04, 100MB/s]
Downloading aurora-0.25-pretrained.ckpt: 91%|โ–ˆโ–ˆโ–ˆโ–ˆโ–ˆโ–ˆโ–ˆโ–ˆโ–ˆ | 4.26G/4.68G [00:43<00:04, 100MB/s]
Downloading aurora-0.25-pretrained.ckpt: 91%|โ–ˆโ–ˆโ–ˆโ–ˆโ–ˆโ–ˆโ–ˆโ–ˆโ–ˆโ–| 4.28G/4.68G [00:43<00:04, 101MB/s]
Downloading aurora-0.25-pretrained.ckpt: 92%|โ–ˆโ–ˆโ–ˆโ–ˆโ–ˆโ–ˆโ–ˆโ–ˆโ–ˆโ–| 4.30G/4.68G [00:43<00:04, 101MB/s]
Downloading aurora-0.25-pretrained.ckpt: 92%|โ–ˆโ–ˆโ–ˆโ–ˆโ–ˆโ–ˆโ–ˆโ–ˆโ–ˆโ–| 4.31G/4.68G [00:43<00:03, 102MB/s]
Downloading aurora-0.25-pretrained.ckpt: 92%|โ–ˆโ–ˆโ–ˆโ–ˆโ–ˆโ–ˆโ–ˆโ–ˆโ–ˆโ–| 4.32G/4.68G [00:43<00:03, 99.9MB/s]
Downloading aurora-0.25-pretrained.ckpt: 93%|โ–ˆโ–ˆโ–ˆโ–ˆโ–ˆโ–ˆโ–ˆโ–ˆโ–ˆโ–Ž| 4.34G/4.68G [00:43<00:03, 100MB/s] 
Downloading aurora-0.25-pretrained.ckpt: 93%|โ–ˆโ–ˆโ–ˆโ–ˆโ–ˆโ–ˆโ–ˆโ–ˆโ–ˆโ–Ž| 4.35G/4.68G [00:44<00:03, 100MB/s]
Downloading aurora-0.25-pretrained.ckpt: 93%|โ–ˆโ–ˆโ–ˆโ–ˆโ–ˆโ–ˆโ–ˆโ–ˆโ–ˆโ–Ž| 4.36G/4.68G [00:44<00:03, 99.8MB/s]
Downloading aurora-0.25-pretrained.ckpt: 93%|โ–ˆโ–ˆโ–ˆโ–ˆโ–ˆโ–ˆโ–ˆโ–ˆโ–ˆโ–Ž| 4.37G/4.68G [00:44<00:03, 101MB/s] 
Downloading aurora-0.25-pretrained.ckpt: 93%|โ–ˆโ–ˆโ–ˆโ–ˆโ–ˆโ–ˆโ–ˆโ–ˆโ–ˆโ–Ž| 4.38G/4.68G [00:44<00:03, 99.0MB/s]
Downloading aurora-0.25-pretrained.ckpt: 94%|โ–ˆโ–ˆโ–ˆโ–ˆโ–ˆโ–ˆโ–ˆโ–ˆโ–ˆโ–| 4.39G/4.68G [00:44<00:03, 100MB/s] 
Downloading aurora-0.25-pretrained.ckpt: 94%|โ–ˆโ–ˆโ–ˆโ–ˆโ–ˆโ–ˆโ–ˆโ–ˆโ–ˆโ–| 4.41G/4.68G [00:44<00:02, 100MB/s]
Downloading aurora-0.25-pretrained.ckpt: 95%|โ–ˆโ–ˆโ–ˆโ–ˆโ–ˆโ–ˆโ–ˆโ–ˆโ–ˆโ–| 4.42G/4.68G [00:44<00:02, 101MB/s]
Downloading aurora-0.25-pretrained.ckpt: 95%|โ–ˆโ–ˆโ–ˆโ–ˆโ–ˆโ–ˆโ–ˆโ–ˆโ–ˆโ–| 4.43G/4.68G [00:44<00:02, 101MB/s]
Downloading aurora-0.25-pretrained.ckpt: 95%|โ–ˆโ–ˆโ–ˆโ–ˆโ–ˆโ–ˆโ–ˆโ–ˆโ–ˆโ–| 4.44G/4.68G [00:45<00:02, 101MB/s]
Downloading aurora-0.25-pretrained.ckpt: 95%|โ–ˆโ–ˆโ–ˆโ–ˆโ–ˆโ–ˆโ–ˆโ–ˆโ–ˆโ–Œ| 4.45G/4.68G [00:45<00:02, 99.6MB/s]
Downloading aurora-0.25-pretrained.ckpt: 95%|โ–ˆโ–ˆโ–ˆโ–ˆโ–ˆโ–ˆโ–ˆโ–ˆโ–ˆโ–Œ| 4.46G/4.68G [00:45<00:02, 101MB/s] 
Downloading aurora-0.25-pretrained.ckpt: 96%|โ–ˆโ–ˆโ–ˆโ–ˆโ–ˆโ–ˆโ–ˆโ–ˆโ–ˆโ–Œ| 4.47G/4.68G [00:45<00:02, 99.8MB/s]
Downloading aurora-0.25-pretrained.ckpt: 96%|โ–ˆโ–ˆโ–ˆโ–ˆโ–ˆโ–ˆโ–ˆโ–ˆโ–ˆโ–Œ| 4.49G/4.68G [00:45<00:02, 101MB/s] 
Downloading aurora-0.25-pretrained.ckpt: 96%|โ–ˆโ–ˆโ–ˆโ–ˆโ–ˆโ–ˆโ–ˆโ–ˆโ–ˆโ–Œ| 4.50G/4.68G [00:45<00:01, 102MB/s]
Downloading aurora-0.25-pretrained.ckpt: 96%|โ–ˆโ–ˆโ–ˆโ–ˆโ–ˆโ–ˆโ–ˆโ–ˆโ–ˆโ–‹| 4.51G/4.68G [00:45<00:01, 97.7MB/s]
Downloading aurora-0.25-pretrained.ckpt: 97%|โ–ˆโ–ˆโ–ˆโ–ˆโ–ˆโ–ˆโ–ˆโ–ˆโ–ˆโ–‹| 4.53G/4.68G [00:45<00:01, 99.8MB/s]
Downloading aurora-0.25-pretrained.ckpt: 97%|โ–ˆโ–ˆโ–ˆโ–ˆโ–ˆโ–ˆโ–ˆโ–ˆโ–ˆโ–‹| 4.55G/4.68G [00:46<00:01, 99.7MB/s]
Downloading aurora-0.25-pretrained.ckpt: 97%|โ–ˆโ–ˆโ–ˆโ–ˆโ–ˆโ–ˆโ–ˆโ–ˆโ–ˆโ–‹| 4.56G/4.68G [00:46<00:01, 100MB/s] 
Downloading aurora-0.25-pretrained.ckpt: 98%|โ–ˆโ–ˆโ–ˆโ–ˆโ–ˆโ–ˆโ–ˆโ–ˆโ–ˆโ–Š| 4.57G/4.68G [00:46<00:01, 98.6MB/s]
Downloading aurora-0.25-pretrained.ckpt: 98%|โ–ˆโ–ˆโ–ˆโ–ˆโ–ˆโ–ˆโ–ˆโ–ˆโ–ˆโ–Š| 4.58G/4.68G [00:46<00:01, 97.3MB/s]
Downloading aurora-0.25-pretrained.ckpt: 98%|โ–ˆโ–ˆโ–ˆโ–ˆโ–ˆโ–ˆโ–ˆโ–ˆโ–ˆโ–Š| 4.59G/4.68G [00:46<00:01, 91.5MB/s]
Downloading aurora-0.25-pretrained.ckpt: 98%|โ–ˆโ–ˆโ–ˆโ–ˆโ–ˆโ–ˆโ–ˆโ–ˆโ–ˆโ–Š| 4.60G/4.68G [00:46<00:00, 89.2MB/s]
Downloading aurora-0.25-pretrained.ckpt: 98%|โ–ˆโ–ˆโ–ˆโ–ˆโ–ˆโ–ˆโ–ˆโ–ˆโ–ˆโ–Š| 4.61G/4.68G [00:46<00:00, 87.4MB/s]
Downloading aurora-0.25-pretrained.ckpt: 99%|โ–ˆโ–ˆโ–ˆโ–ˆโ–ˆโ–ˆโ–ˆโ–ˆโ–ˆโ–Š| 4.62G/4.68G [00:47<00:00, 87.0MB/s]
Downloading aurora-0.25-pretrained.ckpt: 99%|โ–ˆโ–ˆโ–ˆโ–ˆโ–ˆโ–ˆโ–ˆโ–ˆโ–ˆโ–‰| 4.63G/4.68G [00:47<00:00, 86.7MB/s]
Downloading aurora-0.25-pretrained.ckpt: 99%|โ–ˆโ–ˆโ–ˆโ–ˆโ–ˆโ–ˆโ–ˆโ–ˆโ–ˆโ–‰| 4.64G/4.68G [00:47<00:00, 87.6MB/s]
Downloading aurora-0.25-pretrained.ckpt: 99%|โ–ˆโ–ˆโ–ˆโ–ˆโ–ˆโ–ˆโ–ˆโ–ˆโ–ˆโ–‰| 4.65G/4.68G [00:47<00:00, 86.7MB/s]
Downloading aurora-0.25-pretrained.ckpt: 100%|โ–ˆโ–ˆโ–ˆโ–ˆโ–ˆโ–ˆโ–ˆโ–ˆโ–ˆโ–‰| 4.66G/4.68G [00:47<00:00, 88.0MB/s]
Downloading aurora-0.25-pretrained.ckpt: 100%|โ–ˆโ–ˆโ–ˆโ–ˆโ–ˆโ–ˆโ–ˆโ–ˆโ–ˆโ–‰| 4.67G/4.68G [00:47<00:00, 84.9MB/s]
Downloading aurora-0.25-pretrained.ckpt: 100%|โ–ˆโ–ˆโ–ˆโ–ˆโ–ˆโ–ˆโ–ˆโ–ˆโ–ˆโ–‰| 4.68G/4.68G [00:47<00:00, 88.2MB/s]
Downloading aurora-0.25-pretrained.ckpt: 100%|โ–ˆโ–ˆโ–ˆโ–ˆโ–ˆโ–ˆโ–ˆโ–ˆโ–ˆโ–ˆ| 4.68G/4.68G [00:47<00:00, 105MB/s]

Creating a Local Zarr Store from a Datasource

Start with creating a local dataset from the WeatherBench2 data store. Since data sources return in-memory data arrays, there are a variety of ways this could be done. The following is a simple method using Earth2Studio IO objects to pack the requested data into a single Zarr store.

For this example, let's download some data for a Microsoft aurora forecast.

from collections import OrderedDict

import numpy as np

from earth2studio.io import ZarrBackend
from earth2studio.utils.coords import split_coords

times = np.array(
    [np.datetime64("2022-01-01T00:00:00"), np.datetime64("2022-01-01T06:00:00")]
)
variables = model.input_coords()["variable"]
zarr_path = "./outputs/19_wb2_dataset.zarr"
# Create Zarr store to pack data into
zb = ZarrBackend(file_name=zarr_path, backend_kwargs={"overwrite": True})
full_coords = OrderedDict(
    [
        ("time", np.atleast_1d(times)),
        ("lead_time", np.array([np.timedelta64(0, "h")])),
        ("lat", np.linspace(90, -90, 721)),
        ("lon", np.linspace(0, 359.75, 1440)),
    ]
)
zb.add_array(full_coords, array_name=list(variables))

# Loop over timestamps, fetch data and write slices into the pre-created arrays
for t in np.atleast_1d(times):
    x, coords = fetch_data(
        wb2,
        time=np.array([t]),
        variable=variables,
        lead_time=np.array([np.timedelta64(0, "h")]),
        device="cpu",
    )
    xs, reduced_coords, var_names = split_coords(x, coords, dim="variable")
    zb.write(xs, reduced_coords, array_name=list(var_names))

Note that the Zarr store we just created can be used for more than just Earth2Studio inference pipelines. Open it with zarr or xarray to explore/process what you just downloaded.

import zarr

zg = zarr.group(store=zarr.storage.LocalStore(zarr_path))
print(zg.tree())
Console output74 lines
/
โ”œโ”€โ”€ lat (721,) float64
โ”œโ”€โ”€ lead_time (1,) timedelta64[h]
โ”œโ”€โ”€ lon (1440,) float64
โ”œโ”€โ”€ msl (2, 1, 721, 1440) float32
โ”œโ”€โ”€ q100 (2, 1, 721, 1440) float32
โ”œโ”€โ”€ q1000 (2, 1, 721, 1440) float32
โ”œโ”€โ”€ q150 (2, 1, 721, 1440) float32
โ”œโ”€โ”€ q200 (2, 1, 721, 1440) float32
โ”œโ”€โ”€ q250 (2, 1, 721, 1440) float32
โ”œโ”€โ”€ q300 (2, 1, 721, 1440) float32
โ”œโ”€โ”€ q400 (2, 1, 721, 1440) float32
โ”œโ”€โ”€ q50 (2, 1, 721, 1440) float32
โ”œโ”€โ”€ q500 (2, 1, 721, 1440) float32
โ”œโ”€โ”€ q600 (2, 1, 721, 1440) float32
โ”œโ”€โ”€ q700 (2, 1, 721, 1440) float32
โ”œโ”€โ”€ q850 (2, 1, 721, 1440) float32
โ”œโ”€โ”€ q925 (2, 1, 721, 1440) float32
โ”œโ”€โ”€ t100 (2, 1, 721, 1440) float32
โ”œโ”€โ”€ t1000 (2, 1, 721, 1440) float32
โ”œโ”€โ”€ t150 (2, 1, 721, 1440) float32
โ”œโ”€โ”€ t200 (2, 1, 721, 1440) float32
โ”œโ”€โ”€ t250 (2, 1, 721, 1440) float32
โ”œโ”€โ”€ t2m (2, 1, 721, 1440) float32
โ”œโ”€โ”€ t300 (2, 1, 721, 1440) float32
โ”œโ”€โ”€ t400 (2, 1, 721, 1440) float32
โ”œโ”€โ”€ t50 (2, 1, 721, 1440) float32
โ”œโ”€โ”€ t500 (2, 1, 721, 1440) float32
โ”œโ”€โ”€ t600 (2, 1, 721, 1440) float32
โ”œโ”€โ”€ t700 (2, 1, 721, 1440) float32
โ”œโ”€โ”€ t850 (2, 1, 721, 1440) float32
โ”œโ”€โ”€ t925 (2, 1, 721, 1440) float32
โ”œโ”€โ”€ time (2,) datetime64[s]
โ”œโ”€โ”€ u100 (2, 1, 721, 1440) float32
โ”œโ”€โ”€ u1000 (2, 1, 721, 1440) float32
โ”œโ”€โ”€ u10m (2, 1, 721, 1440) float32
โ”œโ”€โ”€ u150 (2, 1, 721, 1440) float32
โ”œโ”€โ”€ u200 (2, 1, 721, 1440) float32
โ”œโ”€โ”€ u250 (2, 1, 721, 1440) float32
โ”œโ”€โ”€ u300 (2, 1, 721, 1440) float32
โ”œโ”€โ”€ u400 (2, 1, 721, 1440) float32
โ”œโ”€โ”€ u50 (2, 1, 721, 1440) float32
โ”œโ”€โ”€ u500 (2, 1, 721, 1440) float32
โ”œโ”€โ”€ u600 (2, 1, 721, 1440) float32
โ”œโ”€โ”€ u700 (2, 1, 721, 1440) float32
โ”œโ”€โ”€ u850 (2, 1, 721, 1440) float32
โ”œโ”€โ”€ u925 (2, 1, 721, 1440) float32
โ”œโ”€โ”€ v100 (2, 1, 721, 1440) float32
โ”œโ”€โ”€ v1000 (2, 1, 721, 1440) float32
โ”œโ”€โ”€ v10m (2, 1, 721, 1440) float32
โ”œโ”€โ”€ v150 (2, 1, 721, 1440) float32
โ”œโ”€โ”€ v200 (2, 1, 721, 1440) float32
โ”œโ”€โ”€ v250 (2, 1, 721, 1440) float32
โ”œโ”€โ”€ v300 (2, 1, 721, 1440) float32
โ”œโ”€โ”€ v400 (2, 1, 721, 1440) float32
โ”œโ”€โ”€ v50 (2, 1, 721, 1440) float32
โ”œโ”€โ”€ v500 (2, 1, 721, 1440) float32
โ”œโ”€โ”€ v600 (2, 1, 721, 1440) float32
โ”œโ”€โ”€ v700 (2, 1, 721, 1440) float32
โ”œโ”€โ”€ v850 (2, 1, 721, 1440) float32
โ”œโ”€โ”€ v925 (2, 1, 721, 1440) float32
โ”œโ”€โ”€ z100 (2, 1, 721, 1440) float32
โ”œโ”€โ”€ z1000 (2, 1, 721, 1440) float32
โ”œโ”€โ”€ z150 (2, 1, 721, 1440) float32
โ”œโ”€โ”€ z200 (2, 1, 721, 1440) float32
โ”œโ”€โ”€ z250 (2, 1, 721, 1440) float32
โ”œโ”€โ”€ z300 (2, 1, 721, 1440) float32
โ”œโ”€โ”€ z400 (2, 1, 721, 1440) float32
โ”œโ”€โ”€ z50 (2, 1, 721, 1440) float32
โ”œโ”€โ”€ z500 (2, 1, 721, 1440) float32
โ”œโ”€โ”€ z600 (2, 1, 721, 1440) float32
โ”œโ”€โ”€ z700 (2, 1, 721, 1440) float32
โ”œโ”€โ”€ z850 (2, 1, 721, 1440) float32
โ””โ”€โ”€ z925 (2, 1, 721, 1440) float32

Execute the Workflow

To use the saved dataset as a data source, we could create our own class that implements the interface required by [earth2studio.data.base.DataSource][], which needs just a __call__(time, variable) method.

However, since we used an IO backend from Earth2Studio we can use the [earth2studio.data.xr.InferenceOutputSource][] which is a convenience class that supports the output of inference pipelines.

import earth2studio.run as run
from earth2studio.data import InferenceOutputSource

offline_source = InferenceOutputSource(zarr_path)
out_zarr_path = "./outputs/19_pangu_output.zarr"
io = ZarrBackend(file_name=out_zarr_path, backend_kwargs={"overwrite": True})
io = run.deterministic(
    times[-1:],
    4,
    model,
    offline_source,
    io,
    output_coords=OrderedDict({"variable": np.array(["msl"])}),
)
Console output18 lines
2026-10-27 22:17:04.167 | INFO     | earth2studio.run:deterministic:85 - Running simple workflow!
2026-10-27 22:17:04.368 | INFO     | earth2studio.run:deterministic:92 - Inference device: cuda
2026-10-27 22:17:06.619 | SUCCESS  | earth2studio.run:deterministic:154 - Fetched data from InferenceOutputSource
2026-10-27 22:17:06.621 | INFO     | earth2studio.run:deterministic:162 - Inference starting!


Running inference:   0%|          | 0/5 [00:00<?, ?it/s]

Running inference:  40%|โ–ˆโ–ˆโ–ˆโ–ˆ      | 2/5 [00:01<00:02,  1.28it/s]

Running inference:  60%|โ–ˆโ–ˆโ–ˆโ–ˆโ–ˆโ–ˆ    | 3/5 [00:02<00:01,  1.03it/s]

Running inference:  80%|โ–ˆโ–ˆโ–ˆโ–ˆโ–ˆโ–ˆโ–ˆโ–ˆ  | 4/5 [00:04<00:01,  1.07s/it]

Running inference: 100%|โ–ˆโ–ˆโ–ˆโ–ˆโ–ˆโ–ˆโ–ˆโ–ˆโ–ˆโ–ˆ| 5/5 [00:05<00:00,  1.13s/it]
Running inference: 100%|โ–ˆโ–ˆโ–ˆโ–ˆโ–ˆโ–ˆโ–ˆโ–ˆโ–ˆโ–ˆ| 5/5 [00:05<00:00,  1.06s/it]
2026-10-27 22:17:11.901 | SUCCESS  | earth2studio.run:deterministic:189 - 
Inference complete
# Post Processing
# ---------------
# The last step is to post-process our results.

import cartopy.crs as ccrs
import matplotlib.pyplot as plt

plt.close("all")
projection = ccrs.Robinson()
fig, axes = plt.subplots(
    2,
    2,
    subplot_kw={"projection": projection},
    figsize=(12, 7),
    constrained_layout=True,
)
axes = axes.ravel()

lon = io["lon"][:]
lat = io["lat"][:]
lead_steps = [1, 2, 3, 4]  # 6h, 12h, 18h, 24h
for ax, step in zip(axes, lead_steps):
    im = ax.pcolormesh(
        lon,
        lat,
        io["msl"][0, step],
        transform=ccrs.PlateCarree(),
        cmap="PiYG",
    )
    ax.set_title(f"msl - Lead time: {6*step}h")
    ax.coastlines()
    ax.gridlines(draw_labels=False)

fig.colorbar(
    im, ax=axes, orientation="horizontal", fraction=0.05, pad=0.07, label="msl"
)
plt.savefig("outputs/19_msl_1day.png", dpi=150)

Output from Creating a Local Data Source


Execution profile

Runtime telemetry

Total runtime4m 8s

Execution environment

CPUAMD EPYC 7742 64-Core Processor
GPUNVIDIA H100 PCIe ยท 79.6 GiB
System RAM58.5 GiB
PlatformLinux 6.8.0-147-generic
Python3.13.13
GPU driver / CUDADriver 595.99.02 ยท CUDA support 13.2