• Login
    View Item 
    •   DSpace Home
    • AMS
    • Weather and Forecasting
    • View Item
    •   DSpace Home
    • AMS
    • Weather and Forecasting
    • View Item
    JavaScript is disabled for your browser. Some features of this site may not work without it.

    Sampling Uncertainty and Confidence Intervals for the Brier Score and Brier Skill Score

    Thumbnail
    View/Open
    ams-66452.pdf (870.9Kb)
    Date
    2008
    Author
    Bradley, A. Allen
    Schwartz, Stuart S.
    Hashino, Tempei
    Metadata
    Show full item record
    Abstract
    For probability forecasts, the Brier score and Brier skill score are commonly used verification measures of forecast accuracy and skill. Using sampling theory, analytical expressions are derived to estimate their sampling uncertainties. The Brier score is an unbiased estimator of the accuracy, and an exact expression defines its sampling variance. The Brier skill score (with climatology as a reference forecast) is a biased estimator, and approximations are needed to estimate its bias and sampling variance. The uncertainty estimators depend only on the moments of the forecasts and observations, so it is easy to routinely compute them at the same time as the Brier score and skill score. The resulting uncertainty estimates can be used to construct error bars or confidence intervals for the verification measures, or perform hypothesis testing. Monte Carlo experiments using synthetic forecasting examples illustrate the performance of the expressions. In general, the estimates provide very reliable information on uncertainty. However, the quality of an estimate depends on both the sample size and the occurrence frequency of the forecast event. The examples also illustrate that with infrequently occurring events, verification sample sizes of a few hundred forecast?observation pairs are needed to establish that a forecast is skillful because of the large uncertainties that exist.
    URI
    http://onlinelibrary.yabesh.ir/handle/yetl/4207790
    Collections
    • Weather and Forecasting

    DSpace software copyright © 2002-2015  DuraSpace
    Contact Us | Send Feedback
    Theme by 
    @mire NV
     

     

    Browse

    All of DSpaceCommunities & CollectionsBy Issue DateAuthorsTitlesSubjectsThis CollectionBy Issue DateAuthorsTitlesSubjects

    My Account

    LoginRegister

    Statistics

    View Usage Statistics

    DSpace software copyright © 2002-2015  DuraSpace
    Contact Us | Send Feedback
    Theme by 
    @mire NV