gaia-benchmark/leaderboard · Leaderboard Runtime Error

Is anyone else getting a runtime error for the leaderboard?

This is what I see:

Runtime error
Back-off pulling image "docker-builder-registry-s3.internal.huggingface.tech/spaces/647848ca9c1f42c1f4d7e033:cpu-7e39ef6"
Container logs:

===== Application Startup at 2024-02-07 13:16:14 =====

/home/user/.local/lib/python3.10/site-packages/datasets/load.py:2097: FutureWarning: 'ignore_verifications' was deprecated in favor of 'verification_mode' in version 2.9.1 and will be removed in 3.0.0.
You can remove this warning by passing 'verification_mode=no_checks' instead.
warnings.warn(

Downloading readme: 0%| | 0.00/1.56k [00:00<?, ?B/s]
Downloading readme: 100%|██████████| 1.56k/1.56k [00:00<00:00, 4.68MB/s]

Downloading data files: 0%| | 0/2 [00:00<?, ?it/s]

Downloading data: 0%| | 0.00/8.08k [00:00<?, ?B/s]
Downloading data: 100%|██████████| 8.08k/8.08k [00:00<00:00, 47.4kB/s]

Downloading data: 0%| | 0.00/8.02k [00:00<?, ?B/s]
Downloading data: 100%|██████████| 8.02k/8.02k [00:00<00:00, 123kB/s]

Downloading data files: 100%|██████████| 2/2 [00:00<00:00, 8.37it/s]

Extracting data files: 0%| | 0/2 [00:00<?, ?it/s]
Extracting data files: 100%|██████████| 2/2 [00:00<00:00, 2495.12it/s]

Generating test split: 0%| | 0/7 [00:00<?, ? examples/s]
Generating test split: 100%|██████████| 7/7 [00:00<00:00, 1464.56 examples/s]

Generating validation split: 0%| | 0/6 [00:00<?, ? examples/s]
Generating validation split: 100%|██████████| 6/6 [00:00<00:00, 4636.30 examples/s]

Downloading readme: 0%| | 0.00/1.21k [00:00<?, ?B/s]
Downloading readme: 100%|██████████| 1.21k/1.21k [00:00<00:00, 4.77MB/s]

Downloading data files: 0%| | 0/2 [00:00<?, ?it/s]

Downloading data: 0%| | 0.00/3.12k [00:00<?, ?B/s]
Downloading data: 100%|██████████| 3.12k/3.12k [00:00<00:00, 25.7kB/s]

Downloading data: 0%| | 0.00/3.08k [00:00<?, ?B/s]
Downloading data: 100%|██████████| 3.08k/3.08k [00:00<00:00, 19.5kB/s]

Downloading data files: 100%|██████████| 2/2 [00:00<00:00, 7.09it/s]

Extracting data files: 0%| | 0/2 [00:00<?, ?it/s]
Extracting data files: 100%|██████████| 2/2 [00:00<00:00, 2600.31it/s]

Generating test split: 0%| | 0/7 [00:00<?, ? examples/s]
Generating test split: 100%|██████████| 7/7 [00:00<00:00, 4380.15 examples/s]

Generating validation split: 0%| | 0/6 [00:00<?, ? examples/s]
Generating validation split: 100%|██████████| 6/6 [00:00<00:00, 5139.03 examples/s]

Map: 0%| | 0/6 [00:00<?, ? examples/s]
Map: 100%|██████████| 6/6 [00:00<00:00, 1133.95 examples/s]

Map: 0%| | 0/7 [00:00<?, ? examples/s]
Map: 100%|██████████| 7/7 [00:00<00:00, 1883.75 examples/s]

Downloading builder script: 0%| | 0.00/4.27k [00:00<?, ?B/s]
Downloading builder script: 100%|██████████| 4.27k/4.27k [00:00<00:00, 23.1MB/s]
2023 all

Downloading data: 0%| | 0.00/406k [00:00<?, ?B/s]
Downloading data: 100%|██████████| 406k/406k [00:00<00:00, 30.4MB/s]

Downloading data: 0%| | 0.00/82.5k [00:00<?, ?B/s]
Downloading data: 100%|██████████| 82.5k/82.5k [00:00<00:00, 61.6MB/s]

Downloading data: 0%| | 0.00/379k [00:00<?, ?B/s]
Downloading data: 100%|██████████| 379k/379k [00:00<00:00, 62.9MB/s]

Downloading data: 0%| | 0.00/64.5k [00:00<?, ?B/s]
Downloading data: 100%|██████████| 64.5k/64.5k [00:00<00:00, 59.2MB/s]

Downloading data: 0%| | 0.00/5.45k [00:00<?, ?B/s]
Downloading data: 100%|██████████| 5.45k/5.45k [00:00<00:00, 34.3MB/s]

Downloading data: 0%| | 0.00/188k [00:00<?, ?B/s]
Downloading data: 100%|██████████| 188k/188k [00:00<00:00, 72.6MB/s]

Downloading data: 0%| | 0.00/43.0 [00:00<?, ?B/s]
Downloading data: 100%|██████████| 43.0/43.0 [00:00<00:00, 640kB/s]

Downloading data: 0%| | 0.00/6.84M [00:00<?, ?B/s]
Downloading data: 100%|██████████| 6.84M/6.84M [00:00<00:00, 64.0MB/s]

Downloading data: 0%| | 0.00/5.62k [00:00<?, ?B/s]
Downloading data: 100%|██████████| 5.62k/5.62k [00:00<00:00, 19.7MB/s]

Downloading data: 0%| | 0.00/64.5k [00:00<?, ?B/s]
Downloading data: 100%|██████████| 64.5k/64.5k [00:00<00:00, 74.3MB/s]

Downloading data: 0%| | 0.00/64.5k [00:00<?, ?B/s]
Downloading data: 100%|██████████| 64.5k/64.5k [00:00<00:00, 48.1MB/s]

Downloading data: 0%| | 0.00/764k [00:00<?, ?B/s]
Downloading data: 100%|██████████| 764k/764k [00:00<00:00, 88.8MB/s]

Downloading data: 0%| | 0.00/5.86k [00:00<?, ?B/s]
Downloading data: 100%|██████████| 5.86k/5.86k [00:00<00:00, 17.0MB/s]

Downloading data: 0%| | 0.00/236k [00:00<?, ?B/s]
Downloading data: 100%|██████████| 236k/236k [00:00<00:00, 52.3MB/s]

Downloading data: 0%| | 0.00/1.00k [00:00<?, ?B/s]
Downloading data: 100%|██████████| 1.00k/1.00k [00:00<00:00, 5.77MB/s]