General Paper
Journal of the Operational Research Society (2003) 54, 949–957. doi:10.1057/palgrave.jors.2601605
Bad numbers: coping with flawed decision support
T R Willemain1, W A Wallace1, K R Fleischmann1, L B Waisel1,a and S N Ganaway1,b
1Rensselaer Polytechnic Institute, Troy, NY, USA
Correspondence: W A Wallace, Rensselaer Polytechnic Institute, 110 8th Street, Troy, NY 12180-3590, USA. E-mail: wallaw@rpi.edu
aNow with Concurrent Technologies Corporation, Johnstown, PA 15904, USA.
bNow with Verizon Corporation, Baltimore, MD 21202, USA.
Received March 2001; Accepted April 2003.
Abstract
Evidence is accumulating that many spreadsheet-based decision support systems contain errors. These errors can result in bad numbers, which in turn could lead to bad decisions. We review the literature on the origins and consequences of bad (erroneous) numbers produced by models and/or decision support systems built around them. Then, we present a case study in which an experiment in visual support for a sequential decision-making task was tainted by bad numbers. Both the literature review and the experiment indicate a robust human ability to overcome flawed decision support. We conclude with questions that need to be addressed in order to better understand the capabilities of humans to deal with erroneous results from decision support systems.
Keywords:
decision support systems, practice of OR, human–machine systems


