Severe-Storm-Forecast Results from the PROFS 1983 Forecast Experiment

Abstract

t experiment was conducted from 1 June to 12 August 1983 at the Program for Regional Observing and Forecasting Services (PROFS) in Boulder, Colorado. The exercise included probabilistic forecasts of severe-weather convective outlooks prepared with the use of existing technology and severe-storm warnings made with the use of advanced technology to display a wide variety of data sets on the PROFS workstation. The convective outlooks were evaluated using signal-detection-theory analyses and Brier scores. Considerable skill using signal-detection theory was found for both severe-thunderstorm and tornado outlooks, treated as separate outlooks. On the other hand, Brier skill scores relative to sample climatology show small skill for the thunderstorm outlooks and no skill for the tornado outlooks. The signal-detection analyses provide valuable baseline values for future evaluation studies. Skill scores for the warnings issued at PROFS are compared with a similar set of skill scores for warnings from the Denver WSFO (Weather Service Forecast Office). Considerably higher skill is found in PROFS severe-thunderstorm-warning scores. This result is attributed to advanced technology and the controlled environment in the PROFS forecast office. For tornado warnings, the probability of detection was slightly higher and the false-alarm rate was much lower at the Denver WSFO than at PROFS. The high false-alarm rate at PROFS is ascribed to the lack of familiarity with the new Doppler-radar data, the overreaction to those data, and the incompleteness of the radar data set. An analysis of area- and time-weighted skill scores is also presented to illustrate the concept that frequently issued time- and site-specific severe-storm warnings have a marked potential for improved service to the public.