A Bayesian Framework for Verification and Recalibration of Ensemble Forecasts: How Uncertain is NAO Predictability?Source: Journal of Climate:;2015:;volume( 029 ):;issue: 003::page 995Author:Siegert, Stefan
,
Stephenson, David B.
,
Sansom, Philip G.
,
Scaife, Adam A.
,
Eade, Rosie
,
Arribas, Alberto
DOI: 10.1175/JCLI-D-15-0196.1Publisher: American Meteorological Society
Abstract: redictability estimates of ensemble prediction systems are uncertain because of limited numbers of past forecasts and observations. To account for such uncertainty, this paper proposes a Bayesian inferential framework that provides a simple 6-parameter representation of ensemble forecasting systems and the corresponding observations. The framework is probabilistic and thus allows for quantifying uncertainty in predictability measures, such as correlation skill and signal-to-noise ratios. It also provides a natural way to produce recalibrated probabilistic predictions from uncalibrated ensembles forecasts.The framework is used to address important questions concerning the skill of winter hindcasts of the North Atlantic Oscillation for 1992?2011 issued by the Met Office Global Seasonal Forecast System, version 5 (GloSea5), climate prediction system. Although there is much uncertainty in the correlation between ensemble mean and observations, there is strong evidence of skill: the 95% credible interval of the correlation coefficient of [0.19, 0.68] does not overlap zero. There is also strong evidence that the forecasts are not exchangeable with the observations: with over 99% certainty, the signal-to-noise ratio of the forecasts is smaller than the signal-to-noise ratio of the observations, which suggests that raw forecasts should not be taken as representative scenarios of the observations. Forecast recalibration is thus required, which can be coherently addressed within the proposed framework.
|
Collections
Show full item record
contributor author | Siegert, Stefan | |
contributor author | Stephenson, David B. | |
contributor author | Sansom, Philip G. | |
contributor author | Scaife, Adam A. | |
contributor author | Eade, Rosie | |
contributor author | Arribas, Alberto | |
date accessioned | 2017-06-09T17:12:20Z | |
date available | 2017-06-09T17:12:20Z | |
date copyright | 2016/02/01 | |
date issued | 2015 | |
identifier issn | 0894-8755 | |
identifier other | ams-81058.pdf | |
identifier uri | http://onlinelibrary.yabesh.ir/handle/yetl/4224019 | |
description abstract | redictability estimates of ensemble prediction systems are uncertain because of limited numbers of past forecasts and observations. To account for such uncertainty, this paper proposes a Bayesian inferential framework that provides a simple 6-parameter representation of ensemble forecasting systems and the corresponding observations. The framework is probabilistic and thus allows for quantifying uncertainty in predictability measures, such as correlation skill and signal-to-noise ratios. It also provides a natural way to produce recalibrated probabilistic predictions from uncalibrated ensembles forecasts.The framework is used to address important questions concerning the skill of winter hindcasts of the North Atlantic Oscillation for 1992?2011 issued by the Met Office Global Seasonal Forecast System, version 5 (GloSea5), climate prediction system. Although there is much uncertainty in the correlation between ensemble mean and observations, there is strong evidence of skill: the 95% credible interval of the correlation coefficient of [0.19, 0.68] does not overlap zero. There is also strong evidence that the forecasts are not exchangeable with the observations: with over 99% certainty, the signal-to-noise ratio of the forecasts is smaller than the signal-to-noise ratio of the observations, which suggests that raw forecasts should not be taken as representative scenarios of the observations. Forecast recalibration is thus required, which can be coherently addressed within the proposed framework. | |
publisher | American Meteorological Society | |
title | A Bayesian Framework for Verification and Recalibration of Ensemble Forecasts: How Uncertain is NAO Predictability? | |
type | Journal Paper | |
journal volume | 29 | |
journal issue | 3 | |
journal title | Journal of Climate | |
identifier doi | 10.1175/JCLI-D-15-0196.1 | |
journal fristpage | 995 | |
journal lastpage | 1012 | |
tree | Journal of Climate:;2015:;volume( 029 ):;issue: 003 | |
contenttype | Fulltext |