Comparison of Panel Review and Distributed Peer Review at ALMA

Published: 23 Jul 2026
A figure from the study showing a comparison of rank spread in real distributed peer review and a simulation

Since 2021, ALMA has used a distributed peer review model instead of traditional panel-based review. In a recent study, John Carpenter and Andrea Corvillon analysed more than 20,000 proposals and over 160,000 individual reviews over 13 ALMA cycles (Cycles 0–12) to examine whether the statistical patterns of proposal evaluation changed. Overall, the study finds that the outcomes of distributed peer review are statistically consistent with those of traditional panel review. You can read a summary of the result on the ALMA website and the paper accepted for publication in PNAS.