FAIR Universe: Weak Lensing ML Uncertainty Challenge Phase-2 Workshop

The workshop will be held on December 12, 2026 at the Paris Congress Center (Palais des Congrès de Paris), France as a part of the 40th annual conference on Neural Information Processing Systems (NeurIPS).

Workshop Schedule Phase-2 Challenge Website Phase-2 Winners

Workshop Schedule

Join us for the Weak Lensing ML Uncertainty Challenge Phase-2 Workshop at NeurIPS 2026

Date: Saturday, December 12

Time: 03:30 PM - 05:45 PM CET(Central European Time)

Location: Sorbonne Room 362-363, Paris Congress Center (Palais des Congrès de Paris)

3:30 PM
TBD Shirley Ho
3:55 PM
TBD Benjamin Wandelt
4:20 PM
FAIR Universe Weak Lensing Uncertainty Challenge Po-Wen Chang · Biwei Dai
4:45 PM
TBD Kangning Diao
4:55 PM
TBD Sachin Konan
5:10 PM
TBD Agni Purani ⋅ Sam Cheng-Tse Huang
5:25 PM
TBD Junlong Shen
5:45 PM
Phase 2 Award & Closing Remark Wahid Bhimji

For more details and uptodated schedule please check the NeurIPS Schedule.

Challenge Abstract

Weak gravitational lensing is a strong cosmological probe that enables direct mapping of the matter distribution and precise constraints on the fundamental parameters governing structure formation in the universe. In recent years, machine learning (ML) has shown strong potential for extracting cosmological information from weak-lensing data beyond traditional summary statistics. However, significant progress has been limited by the lack of standardized benchmarks that capture the complexity of the dataset, simulator imperfections, and various systematic biases encountered in realistic analyses. To address this gap, we introduce the FAIR Universe Weak Lensing ML Uncertainty Challenge, a series of ML competitions aimed at inferring fundamental cosmological properties from weak lensing data under potential distribution shifts, while establishing a standardized benchmark for rigorous comparison across methods. The first phase focused on cosmological parameter inference in the known unknown regime, where the training and test data share the same systematics. In realistic weak-lensing analyses, however, systematics are often unknown and may differ between training and observational data, leading to distribution shifts and biased inference. To further confront these challenges, we propose a new competition targeting out-of-distribution detection in the unknown unknown regime, where models must identify the data shifted by previously unseen systematics without prior knowledge. We provide a dedicated platform and dataset for this task, along with baseline methods including traditional power spectrum analysis, a convolutional neural network, and an autoencoder. The challenge will bring together the physics and ML communities to advance the methodologies for handling systematic uncertainties, data efficiency, and distribution shifts in weak lensing analysis with ML, ultimately facilitating the deployment of ML approaches into upcoming weak lensing surveys.

Organizers

We gratefully acknowledge the efforts of the FAIR Universe Team, composed of researchers dedicated to advancing high energy physics, cosmology, and machine learning for the benefit of the scientific community.

For inquiries, please contact us at: fair-universe@lbl.gov

  • Biwei Dai
  • Po-Wen Chang
  • Wahid Bhimji
  • Paolo Calafiura
  • Ragansu Chakkappai
  • Yuan-Tang Chou
  • Ibrahim Elsharkawy
  • Steven Farrell
  • Isabelle Guyon
  • Chris Harris
  • Benjamin Nachman
  • David Rousseau
  • Uros Seljak
  • Ihsan Ullah
  • Yulei Zhang

Competition Material

Find all the competition resources below: