Abstract
There is considerable research on how Decision Support Systems (DSSs) enable users to make better decisions. However, there is less focus on the possibility that some of their features may introduce biases and encourage suboptimal user behavior. We report on an experimental study that examines three DSS features that are generally considered beneficial to the user: the degree of choice the system provides to the user, the presence of competition among concurrent users, and the use of training to increase system familiarity. We hypothesize that the three DSS features may increase risky behavior (measured as the amount invested in a stock investment task with random outcomes) and overconfidence, conceptualized as the illusion of control, the phenomenon whereby people believe their chances of success at a task are greater than would be warranted by objective analysis. Our results confirm the effects of the three DSS features on risky behavior but only degree of choice impacts overconfidence. Moreover, overconfidence does not appear to mediate the impact of the DSS features on risky behavior. Finally, we hypothesize and confirm that, controlling for the effect of actual performance, overconfidence increases user satisfaction with the decision-making process and outcome.
Similar content being viewed by others
References
Adipat B, Zhang D and Zhou L (2011) The effects of tree-view based presentation adaptation on mobile web browsing. MIS Quarterly 35 (1), 99–122.
Allen G and Parsons J (2010) Is query reuse potentially harmful? Anchoring and adjustment in adapting existing database queries. Information Systems Research 21 (1), 56–77.
Alloy LB and Abramson LY (1979) Judgment of contingency in depressed and nondepressed students: sadder but wiser? Journal of Experimental Psychology: General 108 (4), 441–485.
Anderson CL and Agarwal R (2011) The digitization of healthcare: boundary risks, emotion, and consumer willingness to disclose personal health information. Information Systems Research 22 (3), 469–490.
Arnott D (2006) Cognitive biases and decision support systems development: a design science approach. Information Systems Journal 16 (1), 55–78.
Barkhi R (2002) The effects of decision guidance and problem modeling on group decision-making. Journal of Management Information Systems 18 (3), 259–282.
Barr SH and Sharda R (1997) Effectiveness of decision support systems: development or reliance effect? Decision Support Systems 21 (2), 133–146.
Beaudry A and Pinsonneault A (2005) Understanding user responses to information technology: a coping model of user adaptation. MIS Quarterly 29 (3), 493–524.
Beemer BA and Gregg DG (2013) Dynamic interaction in decision support: effects on perceived diagnosticity and confidence in unstructured domains. Systems, Man, and Cybernetics: Systems, IEEE Transactions on 43 (1), 74–84.
Bernile G, Bhagwat V and Rau PR (2014) What doesn’t kill you will only make you more risk-loving: early-life disasters and CEO behavior. Available at SSRN, [WWW document] http://ssrn.com/abstract=2423044 (accessed 23 January 2013).
Bhandari G, Hassanein K and Deaves R (2008) Debiasing investors with decision support systems: an experimental investigation. Decision Support Systems 46 (1), 399–410.
Bhattacherjee A (2001) Understanding information systems continuance: an expectation-confirmation model. MIS Quarterly 25 (3), 351–370.
Burger JM (1986) Desire for control and the illusion of control: the effects of familiarity and sequence of outcomes. Journal of Research in Personality 20 (1), 66–76.
Camerer C and Lovallo D (1999) Overconfidence and excess entry: an experimental approach. The American Economic Review 89 (1), 306–318.
Cohen J (1988) Statistical Power Analysis for the Behavioral Sciences. Lawrence Erlbaum, Hillsdale, NJ.
Cooper AC, Woo CY and Dunkelberg WC (1988) Entrepreneurs’ perceived chances for success. Journal of Business Venturing 3 (2), 97–108.
Cronan TP and Douglas DE (1990) End-user training and computing effectiveness in public agencies: an empirical study. Journal of Management Information Systems 6 (4), 21–39.
Davidson EJ (2002) Technology frames and framing: a socio-cognitive investigation of requirements determination. MIS Quarterly 26 (4), 329–358.
Deci EL, Koestner R and Ryan RM (1999) A meta-analytic review of experiments examining the effects of extrinsic rewards on intrinsic motivation. Psychological Bulletin 125 (6), 627–668.
DeLone WH (2003) The DeLone and McLean model of information systems success: a ten-year update. Journal of Management Information Systems 19 (4), 9–30.
Dixon MR (2000) Manipulating the illusion of control: variations in gambling as a function of received control over chance outcomes. The Psychological Record 50 (4), 705–719.
Dudezert A and Leidner DE (2011) Illusions of control and social domination strategies in knowledge mapping system use. European Journal of Information Systems 20 (5), 574–588.
Ehrlinger J and Dunning D (2003) How chronic self-views influence (and potentially mislead) estimates of performance. Journal of Personality and Social Psychology 84 (1), 5–17.
Elie-Dit-Cosaque C, Pallud J and Kalika M (2011) The influence of individual, contextual, and social factors on perceived behavioral control of information technology: a field theory approach. Journal of Management Information Systems 28 (3), 201–234.
Fazlollahi B and Vahidov R (2001) A method for generation of alternatives by decision support systems. Journal of Management Information Systems 18 (2), 229–250.
Fenton‐O’Creevy M, Nicholson N, Soane E and Willman P (2003) Trading on illusions: unrealistic perceptions of control and trading performance. Journal of Occupational and Organizational Psychology 76 (1), 53–68.
Festinger L (1954) A theory of social comparison processes. Human Relations 7 (2), 117–140.
Gallivan MJ, Spitler VK and Koufaris M (2003) Does information technology training really matter? A social information processing analysis of coworkers’ influence on it usage in the workplace. Journal of Management Information Systems 22 (1), 153–192.
Goodwin P, Fildes R, Lawrence M and Stephens G (2011) Restrictiveness and guidance in support systems. Omega 39 (3), 242–253.
Hamari J (2013) Transforming homo economicus into homo ludens: a field experiment on gamification in a utilitarian peer-to-peer trading service. Electronic Commerce Research and Applications 12 (4), 236–245.
Hayward MLA and Hambrick DC (1997) Explaining the premiums paid for large acquisitions: evidence of CEO hubris. Administrative Science Quarterly 42 (1), 103–127.
Heimeriks KH (2010) Confident or competent? How to avoid superstitious learning in alliance portfolios. Long Range Planning 43 (1), 57–84.
Henry RA (1994) The effects of choice and incentives on the overestimation of future performance. Organizational Behavior and Human Decision Processes 57 (2), 210–225.
Hilmer KM and Dennis AR (2000) Stimulating thinking: cultivating better decisions with groupware through categorization. Journal of Management Information Systems 17 (3), 93–114.
Hoorens V (1993) Self-enhancement and superiority biases in social comparision. European Review of Social Psychology 4 (1), 113–139.
Huang H-H, Hsu JS-C and Ku C-Y (2012) Understanding the role of computer-mediated counter-argument in countering confirmation bias. Decision Support Systems 53 (3), 438–447.
Huberman BA, Loch CH and Önçüler A (2004) Status as a valued resource. Social Psychology Quarterly 67 (1), 103–114.
Igbaria M, Zinatelli N, Cragg P and Cavaye AL (1997) Personal computing acceptance factors in small firms: a structural equation model. MIS Quarterly 21 (3), 279–305.
Jiang Z and Benbasat I (2004) Virtual product experience: effects of visual and functional control of products on perceived diagnosticity and flow in electronic shopping. Journal of Management Information Systems 21 (3), 111–147.
Kahai SS, Solieri SA and Felo AJ (1998) Active involvement, familiarity, framing, and the illusion of control during decision support system use. Decision Support Systems 23 (2), 133–148.
Kamis A, Koufaris M and Stern T (2008) Using an attribute-based decision support system for user-customized roducts online: an experimental investigation. MIS Quarterly 32 (1), 159–177.
Kapp KM (2012) The Gamification of Learning and Instruction: Game-Based Methods and Strategies for Training and Education. John Wiley & Sons, San Francisco, CA.
Kasper GM (1996) A theory of decision support system design for user calibration. Information Systems Research 7 (2), 215–232.
Kosfeld M and Neckermann S (2011) Getting more work for nothing? Symbolic awards and worker performance. American Economic Journal: Microeconomics 3 (3), 86–99.
Kottemann JE, Davis FD and Remus WE (1994) Computer-assisted decision making: performance, beliefs, and the illusion of control. Organizational Behavior and Hu8man Decision Processes 57 (1), 26–37.
Koufaris M (2002) Applying the technology acceptance model and flow theory to online consumer behavior. Information Systems Research 13 (2), 205–223.
Kruger J and Dunning D (1999) Unskilled and unaware of it: how difficulties in recognizing one’s own incompetence lead to inflated self-assessments. Journal of Personality and Social Psychology 77 (6), 1121.
Ladouceur R (2004) Gambling: the hidden addiction. The Canadian Journal of Psychiatry 49 (8), 501–503.
Lam SS (1997) The effects of group decision support systems and task structures on group communication and decision quality. Journal of Management Information Systems 13 (4), 193–215.
Langer EJ (1975) The illusion of control. Journal of Personality and Social Psychology 32 (2), 311–328.
Lee Z, Wagner C and Shin HK (2008) The effect of decision support system expertise on system use behavior and performance. Information & Management 45 (6), 349–358.
Lejarraga J, Lejarraga T and Gaston-Breton C (2010) I will do it better than you because I have done it before: how experiece breeds illusion of conrtol. In Opening Up Innovation: Strategy, Organization and Technology. Imperial College London Business School, London.
Lilien GL, Rangaswamy A, Van Bruggen GH and Starke K (2004) DSS effectiveness in marketing resource allocation decisions: reality vs. perception. Information Systems Research 15 (3), 216–235.
Lim L-H and Benbasat I (1997) The debiasing role of group support systems: an experimental investigation of the representativeness bias. International Journal of Human-Computer Studies 47 (3), 453–471.
Looney CA and Hardin AM (2009) Decision support for retirement portfolio management: overcoming myopic loss aversion via technology design. Management Science 55 (10), 1688–1703.
Malmendier U and Tate G (2005) CEO overconfidence and corporate investment. The Journal of Finance 60 (6), 2661–2700.
Marsden JR and Mathiyalakan S (1997) An empirical investigation into the relation between performance and perception of users with a what-if facility. Journal of Organizational Computing and Electronic Commerce 7 (4), 305–326.
Marteau TM, Johnston M, Wynne G and Evans TR (1989) Cognitive factors in the explanation of the mismatch between confidence and competence in performing basic life support. Psychology and Health 3 (3), 173–182.
Mathiyalakan S (2008) An examination of decision confidence and illusion of control in a group setting. Issues in Information Systems 9 (2), 37–44.
McKenzie CR, Liersch MJ and Yaniv I (2008) Overconfidence in interval estimates: what does expertise buy you? Organizational Behavior and Human Decision Processes 107 (2), 179–191.
McLain DL and Aldag RJ (2009) Complexity and familiarity with computer assistance when making ill-structured business decisions. International Journal of Information Technology & Decision Making 8 (3), 407–426.
Mohan K and Jain R (2008) Using traceability to mitigate cognitive biases in software development. Communications of the ACM 51 (9), 110–114.
Moore DA and Cain DM (2007) Overconfidence and underconfidence: when and why people underestimate (and overestimate) the competition. Organizational Behavior and Human Decision Processes 103 (2), 197–213.
Nakatsu RT and Benbasat I (2006) Designing intelligent systems to handle system failures: enhancing explanatory power with less restrictive user interfaces and deep explanations. International Journal of Human‐Computer Interaction 21 (1), 55–72.
Ng BD and Wiemer-Hastings P (2005) Addiction to the internet and online gaming. CyberPsychology and Behavior 8 (2), 110–113.
Odean T (1998) Volume, volatility, price, and profit when all traders are above average. The Journal of Finance 53 (6), 1887–1934.
Paradice DB and Courtney Jr. JF (1986) Controlling bias in user assertions in expert decision support systems for problem formulation. Journal of Management Information Systems 3 (1), 52–64.
Park J, Konana P, Gu B, Kumar A and Raghunathan R (2013) Information valuation and confirmation bias in virtual communities: evidence from stock message boards. Information Systems Research 24 (4), 1050–1067.
Pedhazur EJ and Schmelkin LP (1991) Measurement, Design, and Analysis: An Integrated Approach. Lawrence Erlbaum Associates, Hillsdale, NJ.
Petter S, Straub D and Rai A (2007) Specifying formative constructs in information systems research. MIS Quarterly 31 (4), 623–656.
Podsakoff PM, MacKenzie SB, Lee J-Y and Podsakoff NP (2003) Common method biases in behavioral research: a critical review of the literature and recommended remedies. Journal of Applied Psychology 88 (5), 879–903.
Presson PK and Benassi VA (1996) Illusion of control: a meta-analytic review. Journal of Social Behavior & Personality 11 (3), 493–510.
Puhakainen P and Siponen M (2010) Improving employees’ compliance through information systems security training: an action research study. MIS Quarterly 34 (4), 757–778.
Ringle CM, Wende S and Will A (2005) SmartPLS–Version 2.0. Universitat Hamburg, Hamburg.
Reeve J and Deci EL (1996) Elements of the competitive situation that affect intrinsic motivation. Personality and Social Psychology Bulletin 22 (1), 24–33.
Rhee H-S, Ryu Y and Kim C-T (2005) I am fine but you are not optimistic bias and illusion of control on information security. In Proceedings of International Conference on Information Systems, Las Vegas, NE, USA.
Saga VL and Zmud RW (1993) The nature and determinants of it acceptance, routinization, and infusion. In Proceedings of the IFIP TC8 Working Conference on Diffusion, Transfer and Implementation of Information Technology, pp. 67–86, Elsevier Science Inc., North Holland, New York.
Shepherd DA, Zacharakis A and Baron RA (2003) VCs’ decision processes: evidence suggesting more experience may not always be better. Journal of Business Venturing 18 (3), 381–401.
Silver MS (1990) Decision support systems: directed and nondirected change. Information Systems Research 1 (1), 47–70.
Silver MS (1991) Decisional guidance for computer-based decision support. MIS Quarterly 15 (1), 105–122.
Smith VL and Walker JM (1993) Monetary rewards and decision cost in experimental economics. Economic Inquiry 31 (2), 245–261.
Sniezek JA, Wilkins DC, Wadlington PL and Baumann MR (2002) Training for crisis decision-making: psychological issues and computer-based solutions. Journal of Management Information Systems 18 (4), 147–168.
Speier C and Morris MG (2003) The influence of query interface design on decision-making performance. MIS Quarterly 27 (3), 397–423.
Sun H (2013) A longitudinal study of herd behavior in the adoption and continued use of technology. MIS Quarterly 37 (4), 1013–1041.
Sweeney JC, Soutar GN and Johnson LW (1996) Are satisfaction and dissonance the same construct? A preliminary analysis. Journal of Consumer Satisfaction, Dissatisfaction and Complaining Behaviour 9, 138–143.
Tan W-K, Tan C-H and Teo H-H (2012) Consumer-based decision aid that explains which to buy: decision confirmation or overconfidence bias? Decision Support Systems 53 (1), 127–141.
Tarafdar M, Tu Q, Ragu-Nathan BS and Ragu-Nathan T (2007) The impact of technostress on role stress and productivity. Journal of Management Information Systems 24 (1), 301–328.
Thatcher JB and Perrewe PL (2002) An empirical examination of individual traits as antecedents to computer anxiety and computer self-efficacy. MIS Quarterly 26 (4), 381–396.
Thompson SC (1999) Illusions of control: how we overestimate our personal influence. Current Directions in Psychological Science 8 (6), 187–190.
Thompson RL, Higgins CA and Howell JM (1994) Influence of experience on personal computer utilization: testing a conceptual model. Journal of Management Information Systems 11 (1), 167–187.
Todd P and Benbasat I (1999) Evaluating the impact of DSS, cognitive effort, and incentives on strategy selection. Information Systems Research 10 (4), 356–374.
Tversky A and Kahneman D (1974) Judgment under uncertainty: heuristics and biases. Science 185 (4157), 1124–1131.
Van De Venter G and Michayluk D (2008) An insight into overconfidence in the forecasting abilities of financial advisors. Australian Journal of Management 32 (3), 545–557.
Vetter J, Benlian A and Hess T (2011) Overconfidence in it investment dcisions: why knowledge can be a boon and bane at the same time. In Proceedings of International Conference on Information Systems. Shanghai, China.
Wheeler BC and Valacich JS (1996) Facilitation, GSS, and training as sources of process restrictiveness and guidance for structured group decision-making: an empirical assessment. Information Systems Research 7 (4), 429–450.
Worchel S (1974) The effect of three types of arbitrary thwarting on the instigation to aggression. Journal of Personality 42 (2), 300–318.
Worchel S and Brehm JW (1971) Direct and implied social restoration of freedom. Journal of Personality and Social Psychology 18 (3), 294–304.
Zajac EJ and Bazerman MH (1991) Blind spots in industry and competitor analysis: implications of interfirm (mis) perceptions for strategic decisions. Academy of Management Review 16 (1), 37–56.
Zollo M (2009) Superstitious learning with rare strategic decisions: theory and evidence from corporate acquisitions. Organization Science 20 (5), 894–908.
Zollo M and Reuer JJ (2010) Experience spillovers across corporate development activities. Organization Science 21 (6), 1195–1212.
Author information
Authors and Affiliations
Corresponding author
Appendices
Appendix A
Instructions
First, in order to help you make the best investment decisions in this study, we would like to provide you with some information on financial theories on how stock prices change in financial markets.
The random walk hypothesis is a financial theory that states that stock market prices evolve according to a random walk, which means that they increase or decrease randomly. According to this theory, past stock prices are of no value in forecasting future prices because past, current, and future prices merely reflect market responses to information that comes into the market at random. In short, price movements are no more predictable than the pattern of the walk of a drunk.
There are also other theories that state that stock prices may be predicted to some degree, based on knowing specific information from the past, such as the changes in stock prices in the prior 5 years, earnings announcements over the prior 6 months, or market volatility. However, there is no single accepted theory on how stock prices evolve in markets.
Now that you understand a little more about stock price behavior in markets, please click on Next’ to start your investment task.
Appendix B
IOC (Adapted from Kahai et al (1998))
-
1
Please tell us how confident you feel about the investment decision that you just made (7-point scale ranging from ‘Not at all confident’ to ‘Absolutely confident’)
-
2
How certain are you that your stock price prediction is accurate? (7-point scale ranging from ‘Not at all certain’ to ‘Absolutely certain’)
-
3
How likely do you think that your investment decision will result in maximizing your earnings? (7-point scale ranging from ‘Not at all likely’ to ‘Absolutely likely’)
-
4
What do you think the price of the stock you invested in will be in the next month?
Satisfaction (Adapted from Kahai et al (1998)) (7-point scale ranging from ‘Strongly disagree’ to ‘Strongly agree’)
-
1
I was satisfied with the decisions I made in this investment task
-
2
I was satisfied with the decision-making process during this investment task
-
3
Overall, I was satisfied with my performance in this investment task
Appendix C
Rights and permissions
About this article
Cite this article
Chen, CW., Koufaris, M. The impact of decision support system features on user overconfidence and risky behavior. Eur J Inf Syst 24, 607–623 (2015). https://doi.org/10.1057/ejis.2014.30
Received:
Revised:
Accepted:
Published:
Issue Date:
DOI: https://doi.org/10.1057/ejis.2014.30