General Paper

Journal of the Operational Research Society (2003) 54, 949–957. doi:10.1057/palgrave.jors.2601605

Bad numbers: coping with flawed decision support

T R Willemain1, W A Wallace1, K R Fleischmann1, L B Waisel1,a and S N Ganaway1,b

1Rensselaer Polytechnic Institute, Troy, NY, USA

Correspondence: W A Wallace, Rensselaer Polytechnic Institute, 110 8th Street, Troy, NY 12180-3590, USA. E-mail: wallaw@rpi.edu

aNow with Concurrent Technologies Corporation, Johnstown, PA 15904, USA.

bNow with Verizon Corporation, Baltimore, MD 21202, USA.

Received March 2001; Accepted April 2003.

Top

Abstract

Evidence is accumulating that many spreadsheet-based decision support systems contain errors. These errors can result in bad numbers, which in turn could lead to bad decisions. We review the literature on the origins and consequences of bad (erroneous) numbers produced by models and/or decision support systems built around them. Then, we present a case study in which an experiment in visual support for a sequential decision-making task was tainted by bad numbers. Both the literature review and the experiment indicate a robust human ability to overcome flawed decision support. We conclude with questions that need to be addressed in order to better understand the capabilities of humans to deal with erroneous results from decision support systems.

Keywords:

decision support systems, practice of OR, human–machine systems

Extra navigation

.

Society resources

ADVERTISEMENT
JORS-Link to full archive