Working Paper

Asymptotic Variance of Brier (Skill) Score in the Presence of Serial Correlation

Kajal Lahiri, Liu Yang
CESifo, Munich, 2015

CESifo Working Paper No. 5290

We derive autocorrelation-robust asymptotic variances of the Brier score and Brier skill score, which are generally applicable in circumstances with weak serial correlation. A simulation experiment and an empirical application from macroeconomics underscore the importance of taking care of serial correlation. We find that the conventional variances are too conservative to account for the sampling variability in estimating the Brier (skill) score.

CESifo Category
Empirical and Theoretical Methods
Keywords: probability forecasts, serial correlation, Brier score, Brier skill score, survey of professional forecasters
JEL Classification: C010, C120, C530