Paper
Journal of Asset Management (2006) 7, 170–178; doi:10.1057/palgrave.jam.2240211
A note on the out-of-sample performance of resampled efficiency
Bernd Scherer
heads quantitative research at Deutsche Asset Management in New York and is Adjunct Professor of Finance at the European Business School.
Correspondence: Bernd Scherer, Deutsche Asset Management, 345 Park Avenue, 10154, New York, USA, Tel: +1 212 454 6257; Fax: +1 917 940 6114; E-mail: bernd.scherer@db.com
Revised 10 May 2006.
Abstract
The concept of resampled efficiency (RE) is debated both in academia as well as among practitioners. For supporters of RE the litmus test seems to be out-of-sample performance. While Markowitz and Usmen have shown that RE outperforms a Bayesian alternative, the present study is able to reverse their results. The key is to understand that Bayesian methods are literally impossible to test out-of-sample. For every distribution, a prior will be found that will outperform resampling (and vice versa). Equally, for every prior, a distribution will be found where resampling outperforms. The fact that one method outperforms another for a given set of data means little. In the absence of theory, investors do not know when one method will outperform the other, as they do not know the true distribution.
Keywords:
estimation error, Bayesian statistics, portfolio optimisation, resampling, out-of-sample performance



