Scalar Measures of Performance in Rare-Event Situations
Abstract
A set of 14 scalar, nonprobabilistic measures?some old, some new?is examined in the rare-event situation. The set includes measures of accuracy, association, discrimination, bias, and skill. It is found that all measures considered herein are inequitable in that they induce under- or overforecasting. One condition under which such bias is not induced (for some of the measures) is when the underlying class-conditional distributions are Gaussian (normal) and equivariant.