Comparing Probabilistic Forecasting Systems with the Brier Score

Abstract

This article considers the Brier score for verifying ensemble-based probabilistic forecasts of binary events. New estimators for the effect of ensemble size on the expected Brier score, and associated confidence intervals, are proposed. An example with precipitation forecasts illustrates how these estimates support comparisons of the performances of competing forecasting systems with possibly different ensemble sizes.