AERIS: Argonne Earth Systems Model for Reliable and Skillful Predictions
Generative machine learning offers new opportunities to better understand
complex Earth system dynamics. Recent diffusion-based methods address spectral
biases and improve ensemble calibration in weather forecasting compared to
deterministic methods, yet have so far proven difficult to scale stably at high
resolutions. We introduce AERIS, a 1.3 to 80B parameter pixel-level Swin
diffusion transformer to address this gap, and SWiPe, a generalizable technique
that composes window parallelism with sequence and pipeline parallelism to
shard window-based transformers without added communication cost or increased
global batch size. On Aurora (10,080 nodes), AERIS sustains 10.21 ExaFLOPS
(mixed precision) and a peak performance of 11.21 ExaFLOPS with 1 times 1
patch size on the 0.25{\deg} ERA5 dataset, achieving 95.5% weak scaling
efficiency, and 81.6% strong scaling efficiency. AERIS outperforms the IFS ENS
and remains stable on seasonal scales to 90 days, highlighting the potential of
billion-parameter diffusion models for weather and climate prediction.
68cc03433df9ac65e93dc4df
Väinö Hatanpää
68cc03433df9ac65e93dc4e0
Eugene Ku
68cc03433df9ac65e93dc4e1
Jason Stock
claimed_verified
2025-09-18T13:25:05.972Z
6309242c1a8d77fa3190be5e
https://cdn-avatars.huggingface.co/v1/production/uploads/6309242c1a8d77fa3190be5e/8lIcbT6UACrP0_WpCuV5p.jpeg
Jason Stock
user
stockeh
68cc03433df9ac65e93dc4e2
Murali Emani
68cc03433df9ac65e93dc4e3
Sam Foreman
claimed_verified
2025-09-18T13:25:03.448Z
623da717c29adf5ef618a217
/avatars/460be23a3e2eb8d344633c3dfdab8a18.svg
Sam Foreman
user
samforeman
68cc03433df9ac65e93dc4e4
Chunyong Jung
68cc03433df9ac65e93dc4e5
Sandeep Madireddy
claimed_verified
2025-09-18T13:25:00.870Z
62ed9b190effdbb91380c8fa
https://cdn-avatars.huggingface.co/v1/production/uploads/62ed9b190effdbb91380c8fa/23k3CDaKnWy0oGVwtDRj-.jpeg
Sandeep Madireddy
user
Sand33p
68cc03433df9ac65e93dc4e6
Tung Nguyen
68cc03433df9ac65e93dc4e7
Varuni Sastry
68cc03433df9ac65e93dc4e8
Ray A. O. Sinurat
claimed_verified
2025-09-19T06:50:00.815Z
6392c95b38794fcb95c1b413
https://cdn-avatars.huggingface.co/v1/production/uploads/no-auth/wsQb1BugLLNq0U2_09-m0.png
Ray Andrew
user
rayandrew
68cc03433df9ac65e93dc4e9
Sam Wheeler
68cc03433df9ac65e93dc4ea
Huihuo Zheng
68cc03433df9ac65e93dc4eb
Troy Arcomano
68cc03433df9ac65e93dc4ec
Venkatram Vishwanath
68cc03433df9ac65e93dc4ed
Rao Kotamarthi
AERIS: Argonne Earth Systems Model for Reliable and Skillful Predictions
Generative machine learning offers new opportunities to better understand
complex Earth system dynamics. Recent diffusion-based methods address spectral
biases and improve ensemble calibration in weather forecasting compared to
deterministic methods, yet have so far proven difficult to scale stably at high
resolutions. We introduce AERIS, a 1.3 to 80B parameter pixel-level Swin
diffusion transformer to address this gap, and SWiPe, a generalizable technique
that composes window parallelism with sequence and pipeline parallelism to
shard window-based transformers without added communication cost or increased
global batch size. On Aurora (10,080 nodes), AERIS sustains 10.21 ExaFLOPS
(mixed precision) and a peak performance of 11.21 ExaFLOPS with 1 times 1
patch size on the 0.25{\deg} ERA5 dataset, achieving 95.5% weak scaling
efficiency, and 81.6% strong scaling efficiency. AERIS outperforms the IFS ENS
and remains stable on seasonal scales to 90 days, highlighting the potential of
billion-parameter diffusion models for weather and climate prediction.
AERIS, a large-scale pixel-level Swin diffusion transformer, addresses scaling issues in high-resolution weather forecasting using SWiPe parallelism, achieving high performance and stability.
diffusion-based methods ensemble calibration weather forecasting AERIS Swin diffusion transformer window parallelism sequence parallelism pipeline parallelism SWiPe ExaFLOPS ERA5 dataset weak scaling efficiency strong scaling efficiency IFS ENS seasonal scales