Results from a prototype system that suggest that observation-trained machine learning models trained only on Earth system observations can be used to generate multi-decade global reanalyses without using physics-based numerical models.
Abstract
Earth system reanalysis datasets are foundational for weather and climate research and provide the gridded training data used by most machine learning weather prediction systems. Here we show results from a prototype system that suggest that machine learning models trained only on Earth system observations can potentially be used to generate multi-decade global reanalyses without using physics-based numerical models. The resulting gridded fields capture large-scale atmospheric structure and variability across multiple timescales, while exhibiting signs of physical coherence in several key dynamical diagnostics. Evaluations of the prototype against held-out independent atmospheric observations indicate that the root mean square vector error of upper-level winds is close to that of ERA5 when compared at a consistent resolution, and that the standard deviation of the error at the surface is between that of 4th- and 5th-generation ECMWF reanalyses (ERA-Interim and ERA5). Furthermore, while traditional reanalysis production is computationally expensive, typically taking several years to produce, the reanalysis presented here was generated during the course of a single working day. These results suggest that observation-trained machine learning models offer a promising new approach for reanalysis production from observations alone.
Atmospheric reanalyses combine observations with model forecasts using complex data assimilation systems. We test whether a differentiable weather model permits a simpler and more accurate method based on a long-window four-dimensional variational data assimilation (4D-Var) formulation that omits the conventional backg...
Gregory J. Hakim, Jeffrey S. Whitaker, Bo Huang et al.· 0 citations
Reanalysis users presently have no clear way to determine which observations have been assimilated at specific points in space and time. Furthermore, for those grid points where observations have been assimilated, users lack efficient quality control metrics to use in their interpretation of the reanalyses. In additi...
N. Boukachaba, M. Bosilovich, A. D. da Silva et al.· Journal of Hydrometeorology· 0 citations
The National Oceanic and Atmospheric Administration (NOAA) employs independent prediction systems for distinct forecast products. While some separation is practical, we argue that combining short- and medium-range weather into a single prediction system would provide the public with a useful distillation of global weat...
Timothy A. Smith, Mariah Pope, Sergey Frolov et al.· 2 citations
This study proposes a novel deep learning framework that uses a U-Net to generate an initial high-resolution SST estimate, which is subsequently refined using a residual corrective approach, and progressively refines initial U-Net predictions by incorporating dynamically scaled residuals at each step, enabling accurate...
Onkar Jadhav, Tim French, I. Janeković et al.· 1 citation
This paper investigates the performance of a unique proof-of-concept hybrid model in a cycling data assimilation scheme. This previously published model combines the Simplified Parameterization, primitive-Equation Dynamics model (SPEEDY) with an ML-based component that itself is capable of modeling the global atmosph...
D. Elliott, Troy Arcomano, I. Szunyogh et al.· Monthly Weather Review· 0 citations
This paper describes an ensemble of global atmosphere reference simulations covering the period 1980 to 2023 produced with the European Centre for Medium-Range Weather Forecasts (ECMWF) Integrated Forecasting System (IFS). The resulting dataset consists of 6-hourly three-dimensional global outputs from higher- and lowe...
M. Aengenheyster, Christopher D. Roberts, Razvan Aguridan et al.· Scientific Data· 1 citation
We use cookies to run the site and, with your consent, for analytics and to show ads.
See our Cookie Policy.