Research Working Paper


In-Sample Tests of Predictive Ability: A New Approach

By Todd E. Clark and Michael W. McCracken

July 2009

RWP 09-10
Research Division
Federal Reserve Bank of Kansas City


Abstract

This paper presents analytical, Monte Carlo, and empirical evidence linking in-sample tests of predictive content and out-of-sample forecast accuracy. Our approach focuses on the negative effect that finite-sample estimation error has on forecast accuracy despite the presence of significant population-level predictive content. Specifically, we derive simple-to-use in-sample tests that test not only whether a particular variable has predictive content but also whether this content is estimated precisely enough to improve forecast accuracy. Our tests are asymptotically non-central chi-square or non-central normal. We provide a convenient bootstrap method for computing the relevant critical values. In the Monte Carlo and empirical analysis, we compare the effectiveness of our testing procedure with more common testing procedures.


Keywords: predictability, forecast accuracy, in-sample

JEL Classification: C53, C52, C12