No Epoch Like the Present: Robust Climate Emulation Requires Out-of-Distribution Generalisation
(2026)
Epistemic and aleatoric uncertainty quantification in weather and climate models
Quarterly Journal of the Royal Meteorological Society Wiley (2026) e70219
Abstract:
Representing and quantifying uncertainty in physical parameterisations is a central challenge in weather and climate modelling, and approaches are often developed separately for different timeâscales. Here, we introduce a unified framework for analysing uncertainty in parameterisations across weather and climate regimes. Using the Lorenz 1996 system as a testbed for simplified chaotic dynamics, we quantify uncertainties in a subgridâscale parameterisation using a Bayesian neural network (BNN). This allows us to disentangle aleatoric uncertainty, arising from internal variability in the training data, and epistemic uncertainties, arising from poorly constrained parameters during training. At runtime, we sample uncertainties in line with stochastic approaches in weather models and perturbedâparameter methods in climate models. On weather timeâscales, aleatoric uncertainty dominates, underscoring the value of stochastic parameterisations. On longer, climate timeâscales and under changing forcings, accounting for both types of uncertainty is necessary for wellâcalibrated ensembles, with epistemic uncertainty widening the range of explored climate states, and aleatoric uncertainty promoting transitions between them. Constraining parameter uncertainty with short simulations reduces epistemic uncertainty and improves longâterm model behaviour under perturbed forcings. This framework links concepts from machine learning with traditional uncertainty quantification in earth system modelling, offering a pathway towards seamless treatment of uncertainty in weather and climate prediction.Corrigendum
Journal of Climate American Meteorological Society 39:10 (2026) 2849-2851
Abstract:
Abstract We correct an error relating to the comparison of precipitation variability in coupled models versus models run with prescribed SSTs (âAMIP modelsâ) and discuss what conclusions to draw from the corrected result.Crowdsourcing the Frontier: Advancing Hybrid PhysicsâML Climate Simulation via a $50,000 Kaggle Competition
Journal of Advances in Modeling Earth Systems American Geophysical Union (AGU) 18:5 (2026)
Abstract:
Abstract Subgrid machineâlearning (machine learning [ML]) parameterizations have the potential to introduce a new generation of climate models that incorporate the effects of higherâresolution physics without incurring the prohibitive computational cost associated with more explicit physicsâbased simulations. However, important issues, ranging from online instability to inconsistent online performance, have limited their operational use for longâterm climate projections. To more rapidly drive progress in solving these issues, domain scientists and ML researchers opened up the offline aspect of this problem to the broader ML and data science community with the release of ClimSim, a NeurIPS Data sets and Benchmarks publication, and an associated Kaggle competition. This paper reports on the downstream results of the Kaggle competition by coupling emulators inspired by the winning teams' architectures to an interactive climate model (including full cloud microphysics, a regime historically prone to online instability) and systematically evaluating their online performance. Our results demonstrate that online stability in the lowâresolution realâgeography setting is reproducible across multiple diverse architectures, which we consider a key milestone. All tested architectures exhibit strikingly similar offline and online biases, though their responses to architectureâagnostic design choices (e.g., expanding the list of input variables) can differ significantly. Multiple Kaggleâinspired architectures achieve stateâofâtheâart results on certain metrics such as zonal mean bias patterns and global Root Mean Squared Error, indicating that crowdsourcing the essence of the offline problem is one path to improving online performance in hybrid physicsâAI climate simulation. Plain Language Summary Future climate models may use machine learning (ML) to replace smallâscale physical processes that are otherwise too costly to simulate directly over long timescales. Such âhybridâ physicsâML models could improve predictions by reducing uncertainties from current approximations. But making them run reliably in full climate simulations has been a major challenge. To speed progress, scientists created an open data set, benchmarking framework, and global competition to drive improvement for these ML components. This paper follows up on that competition by testing ideas from the winning teams within hybrid climate models. For the first time, we show that stable hybrid simulation is now reproducible across a range of diverse ML architectures. We find that different architectures share similar patterns of errors both before and after coupling, although their responses to added training inputs can differ. Finally, some competitionâinspired designs achieve stateâofâtheâart scores on individual performance measures, but no single approach beats the previous benchmark (Hu et al., 2025, https://doi.org/10.1029/2024ms004618 ) on every metric. Key Points Online stability in the lowâresolution realâgeography setting is reproducibly achievable across diverse architectures Offline and online zonal mean biases are nearâidentical across architectures; online runs underestimate tropical precipitable water An expanded variable list is universally beneficial offline but has diverging, architectureâdependent effects onlineSpatial Patterns of Shallow Clouds: Challenging the Concept of Defined Regimes
Geophysical Research Letters Wiley 53:8 (2026) e2025GL119921