Operational Forecaster Uncertainty Needs and Future Roles

Abstract

Key results of a comprehensive survey of U.S. National Weather Service operational forecast managers concerning the assessment and communication of forecast uncertainty are presented and discussed. The survey results revealed that forecasters are using uncertainty guidance to assess uncertainty, but that limited data access and ensemble underdispersion and biases are barriers to more effective use. Some respondents expressed skepticism as to the added value of formal ensemble guidance relative to simpler approaches of estimating uncertainty, and related the desire for feature-specific ensemble verification to address this skepticism. Respondents reported receiving requests for uncertainty information primarily from sophisticated users such as emergency managers, and most often during high-impact events. The largest request for additional training material called for simulator-based case studies that demonstrate how uncertainty information should be interpreted and communicated. Respondents were in consensus that forecasters should be significantly involved in the communication of uncertainty forecasts; however, there was disagreement regarding if and how forecasters should adjust objective ensemble guidance. It is contended that whether forecasters directly modify objective ensemble guidance will ultimately depend on how the weather enterprise views ensemble output (as the final forecast or as a guidance supporting conceptual understanding), the enterprise?s commitment to provide the necessary supporting forecast infrastructure, and how rapidly ensemble weaknesses such as underdispersion, biases, and resolution are addressed. The survey results illustrate that forecasters? operational uncertainty needs are intimately tied to the end products and services they produce. Thus, it is critical that the process to develop uncertainty information in existing or new products or services be a sustained collaborative effort between ensemble developers, forecasters, academic partners, and users. As the weather enterprise strives to provide uncertainty information to users, it is asserted that addressing the forecaster needs identified in this survey will be a prerequisite to achieve this goal.