search

openclimatefix / graph_weather

PyTorch implementation of Ryan Keisler's 2022 "Forecasting Global Weather with Graph Neural Networks" paper (https://arxiv.org/abs/2202.07575)
MIT License
185 stars 45 forks source link

[Paper] Aurora Weather Foundation Model #111

Open jacobbieker opened 3 months ago

jacobbieker commented 3 months ago

Arxiv/Blog/Paper Link

https://www.microsoft.com/en-us/research/blog/introducing-aurora-the-first-large-scale-foundation-model-of-the-atmosphere/

Detailed Description

They used 3D Swin transformer to encode data, trained on era5, gfs, cmip6, and more. They then used 3D perceiver transformer for the processing and decoding, as well as LoRA in the fine tuning stages for longer rollout.

One of the few ones not trained just on ERA5.

Context

jacobbieker commented 3 weeks ago

Code has now been open sourced: https://github.com/microsoft/aurora