Skip to main content
Log in

The impact of decision support system features on user overconfidence and risky behavior

  • Empirical Research
  • Published:
European Journal of Information Systems

Abstract

There is considerable research on how Decision Support Systems (DSSs) enable users to make better decisions. However, there is less focus on the possibility that some of their features may introduce biases and encourage suboptimal user behavior. We report on an experimental study that examines three DSS features that are generally considered beneficial to the user: the degree of choice the system provides to the user, the presence of competition among concurrent users, and the use of training to increase system familiarity. We hypothesize that the three DSS features may increase risky behavior (measured as the amount invested in a stock investment task with random outcomes) and overconfidence, conceptualized as the illusion of control, the phenomenon whereby people believe their chances of success at a task are greater than would be warranted by objective analysis. Our results confirm the effects of the three DSS features on risky behavior but only degree of choice impacts overconfidence. Moreover, overconfidence does not appear to mediate the impact of the DSS features on risky behavior. Finally, we hypothesize and confirm that, controlling for the effect of actual performance, overconfidence increases user satisfaction with the decision-making process and outcome.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Figure 1
Figure 2
Figure 3

Similar content being viewed by others

References

  • Adipat B, Zhang D and Zhou L (2011) The effects of tree-view based presentation adaptation on mobile web browsing. MIS Quarterly 35 (1), 99–122.

    Google Scholar 

  • Allen G and Parsons J (2010) Is query reuse potentially harmful? Anchoring and adjustment in adapting existing database queries. Information Systems Research 21 (1), 56–77.

    Article  Google Scholar 

  • Alloy LB and Abramson LY (1979) Judgment of contingency in depressed and nondepressed students: sadder but wiser? Journal of Experimental Psychology: General 108 (4), 441–485.

    Article  Google Scholar 

  • Anderson CL and Agarwal R (2011) The digitization of healthcare: boundary risks, emotion, and consumer willingness to disclose personal health information. Information Systems Research 22 (3), 469–490.

    Article  Google Scholar 

  • Arnott D (2006) Cognitive biases and decision support systems development: a design science approach. Information Systems Journal 16 (1), 55–78.

    Article  Google Scholar 

  • Barkhi R (2002) The effects of decision guidance and problem modeling on group decision-making. Journal of Management Information Systems 18 (3), 259–282.

    Article  Google Scholar 

  • Barr SH and Sharda R (1997) Effectiveness of decision support systems: development or reliance effect? Decision Support Systems 21 (2), 133–146.

    Article  Google Scholar 

  • Beaudry A and Pinsonneault A (2005) Understanding user responses to information technology: a coping model of user adaptation. MIS Quarterly 29 (3), 493–524.

    Google Scholar 

  • Beemer BA and Gregg DG (2013) Dynamic interaction in decision support: effects on perceived diagnosticity and confidence in unstructured domains. Systems, Man, and Cybernetics: Systems, IEEE Transactions on 43 (1), 74–84.

    Google Scholar 

  • Bernile G, Bhagwat V and Rau PR (2014) What doesn’t kill you will only make you more risk-loving: early-life disasters and CEO behavior. Available at SSRN, [WWW document] http://ssrn.com/abstract=2423044 (accessed 23 January 2013).

  • Bhandari G, Hassanein K and Deaves R (2008) Debiasing investors with decision support systems: an experimental investigation. Decision Support Systems 46 (1), 399–410.

    Article  Google Scholar 

  • Bhattacherjee A (2001) Understanding information systems continuance: an expectation-confirmation model. MIS Quarterly 25 (3), 351–370.

    Article  Google Scholar 

  • Burger JM (1986) Desire for control and the illusion of control: the effects of familiarity and sequence of outcomes. Journal of Research in Personality 20 (1), 66–76.

    Article  Google Scholar 

  • Camerer C and Lovallo D (1999) Overconfidence and excess entry: an experimental approach. The American Economic Review 89 (1), 306–318.

    Article  Google Scholar 

  • Cohen J (1988) Statistical Power Analysis for the Behavioral Sciences. Lawrence Erlbaum, Hillsdale, NJ.

    Google Scholar 

  • Cooper AC, Woo CY and Dunkelberg WC (1988) Entrepreneurs’ perceived chances for success. Journal of Business Venturing 3 (2), 97–108.

    Article  Google Scholar 

  • Cronan TP and Douglas DE (1990) End-user training and computing effectiveness in public agencies: an empirical study. Journal of Management Information Systems 6 (4), 21–39.

    Article  Google Scholar 

  • Davidson EJ (2002) Technology frames and framing: a socio-cognitive investigation of requirements determination. MIS Quarterly 26 (4), 329–358.

    Article  Google Scholar 

  • Deci EL, Koestner R and Ryan RM (1999) A meta-analytic review of experiments examining the effects of extrinsic rewards on intrinsic motivation. Psychological Bulletin 125 (6), 627–668.

    Article  Google Scholar 

  • DeLone WH (2003) The DeLone and McLean model of information systems success: a ten-year update. Journal of Management Information Systems 19 (4), 9–30.

    Article  Google Scholar 

  • Dixon MR (2000) Manipulating the illusion of control: variations in gambling as a function of received control over chance outcomes. The Psychological Record 50 (4), 705–719.

    Article  Google Scholar 

  • Dudezert A and Leidner DE (2011) Illusions of control and social domination strategies in knowledge mapping system use. European Journal of Information Systems 20 (5), 574–588.

    Article  Google Scholar 

  • Ehrlinger J and Dunning D (2003) How chronic self-views influence (and potentially mislead) estimates of performance. Journal of Personality and Social Psychology 84 (1), 5–17.

    Article  Google Scholar 

  • Elie-Dit-Cosaque C, Pallud J and Kalika M (2011) The influence of individual, contextual, and social factors on perceived behavioral control of information technology: a field theory approach. Journal of Management Information Systems 28 (3), 201–234.

    Article  Google Scholar 

  • Fazlollahi B and Vahidov R (2001) A method for generation of alternatives by decision support systems. Journal of Management Information Systems 18 (2), 229–250.

    Article  Google Scholar 

  • Fenton‐O’Creevy M, Nicholson N, Soane E and Willman P (2003) Trading on illusions: unrealistic perceptions of control and trading performance. Journal of Occupational and Organizational Psychology 76 (1), 53–68.

    Article  Google Scholar 

  • Festinger L (1954) A theory of social comparison processes. Human Relations 7 (2), 117–140.

    Article  Google Scholar 

  • Gallivan MJ, Spitler VK and Koufaris M (2003) Does information technology training really matter? A social information processing analysis of coworkers’ influence on it usage in the workplace. Journal of Management Information Systems 22 (1), 153–192.

    Article  Google Scholar 

  • Goodwin P, Fildes R, Lawrence M and Stephens G (2011) Restrictiveness and guidance in support systems. Omega 39 (3), 242–253.

    Article  Google Scholar 

  • Hamari J (2013) Transforming homo economicus into homo ludens: a field experiment on gamification in a utilitarian peer-to-peer trading service. Electronic Commerce Research and Applications 12 (4), 236–245.

    Article  Google Scholar 

  • Hayward MLA and Hambrick DC (1997) Explaining the premiums paid for large acquisitions: evidence of CEO hubris. Administrative Science Quarterly 42 (1), 103–127.

    Article  Google Scholar 

  • Heimeriks KH (2010) Confident or competent? How to avoid superstitious learning in alliance portfolios. Long Range Planning 43 (1), 57–84.

    Article  Google Scholar 

  • Henry RA (1994) The effects of choice and incentives on the overestimation of future performance. Organizational Behavior and Human Decision Processes 57 (2), 210–225.

    Article  Google Scholar 

  • Hilmer KM and Dennis AR (2000) Stimulating thinking: cultivating better decisions with groupware through categorization. Journal of Management Information Systems 17 (3), 93–114.

    Article  Google Scholar 

  • Hoorens V (1993) Self-enhancement and superiority biases in social comparision. European Review of Social Psychology 4 (1), 113–139.

    Article  Google Scholar 

  • Huang H-H, Hsu JS-C and Ku C-Y (2012) Understanding the role of computer-mediated counter-argument in countering confirmation bias. Decision Support Systems 53 (3), 438–447.

    Article  Google Scholar 

  • Huberman BA, Loch CH and Önçüler A (2004) Status as a valued resource. Social Psychology Quarterly 67 (1), 103–114.

    Article  Google Scholar 

  • Igbaria M, Zinatelli N, Cragg P and Cavaye AL (1997) Personal computing acceptance factors in small firms: a structural equation model. MIS Quarterly 21 (3), 279–305.

    Article  Google Scholar 

  • Jiang Z and Benbasat I (2004) Virtual product experience: effects of visual and functional control of products on perceived diagnosticity and flow in electronic shopping. Journal of Management Information Systems 21 (3), 111–147.

    Article  Google Scholar 

  • Kahai SS, Solieri SA and Felo AJ (1998) Active involvement, familiarity, framing, and the illusion of control during decision support system use. Decision Support Systems 23 (2), 133–148.

    Article  Google Scholar 

  • Kamis A, Koufaris M and Stern T (2008) Using an attribute-based decision support system for user-customized roducts online: an experimental investigation. MIS Quarterly 32 (1), 159–177.

    Google Scholar 

  • Kapp KM (2012) The Gamification of Learning and Instruction: Game-Based Methods and Strategies for Training and Education. John Wiley & Sons, San Francisco, CA.

    Google Scholar 

  • Kasper GM (1996) A theory of decision support system design for user calibration. Information Systems Research 7 (2), 215–232.

    Article  Google Scholar 

  • Kosfeld M and Neckermann S (2011) Getting more work for nothing? Symbolic awards and worker performance. American Economic Journal: Microeconomics 3 (3), 86–99.

    Google Scholar 

  • Kottemann JE, Davis FD and Remus WE (1994) Computer-assisted decision making: performance, beliefs, and the illusion of control. Organizational Behavior and Hu8man Decision Processes 57 (1), 26–37.

    Article  Google Scholar 

  • Koufaris M (2002) Applying the technology acceptance model and flow theory to online consumer behavior. Information Systems Research 13 (2), 205–223.

    Article  Google Scholar 

  • Kruger J and Dunning D (1999) Unskilled and unaware of it: how difficulties in recognizing one’s own incompetence lead to inflated self-assessments. Journal of Personality and Social Psychology 77 (6), 1121.

    Article  Google Scholar 

  • Ladouceur R (2004) Gambling: the hidden addiction. The Canadian Journal of Psychiatry 49 (8), 501–503.

    Article  Google Scholar 

  • Lam SS (1997) The effects of group decision support systems and task structures on group communication and decision quality. Journal of Management Information Systems 13 (4), 193–215.

    Article  Google Scholar 

  • Langer EJ (1975) The illusion of control. Journal of Personality and Social Psychology 32 (2), 311–328.

    Article  Google Scholar 

  • Lee Z, Wagner C and Shin HK (2008) The effect of decision support system expertise on system use behavior and performance. Information & Management 45 (6), 349–358.

    Article  Google Scholar 

  • Lejarraga J, Lejarraga T and Gaston-Breton C (2010) I will do it better than you because I have done it before: how experiece breeds illusion of conrtol. In Opening Up Innovation: Strategy, Organization and Technology. Imperial College London Business School, London.

    Google Scholar 

  • Lilien GL, Rangaswamy A, Van Bruggen GH and Starke K (2004) DSS effectiveness in marketing resource allocation decisions: reality vs. perception. Information Systems Research 15 (3), 216–235.

    Article  Google Scholar 

  • Lim L-H and Benbasat I (1997) The debiasing role of group support systems: an experimental investigation of the representativeness bias. International Journal of Human-Computer Studies 47 (3), 453–471.

    Article  Google Scholar 

  • Looney CA and Hardin AM (2009) Decision support for retirement portfolio management: overcoming myopic loss aversion via technology design. Management Science 55 (10), 1688–1703.

    Article  Google Scholar 

  • Malmendier U and Tate G (2005) CEO overconfidence and corporate investment. The Journal of Finance 60 (6), 2661–2700.

    Article  Google Scholar 

  • Marsden JR and Mathiyalakan S (1997) An empirical investigation into the relation between performance and perception of users with a what-if facility. Journal of Organizational Computing and Electronic Commerce 7 (4), 305–326.

    Article  Google Scholar 

  • Marteau TM, Johnston M, Wynne G and Evans TR (1989) Cognitive factors in the explanation of the mismatch between confidence and competence in performing basic life support. Psychology and Health 3 (3), 173–182.

    Article  Google Scholar 

  • Mathiyalakan S (2008) An examination of decision confidence and illusion of control in a group setting. Issues in Information Systems 9 (2), 37–44.

    Google Scholar 

  • McKenzie CR, Liersch MJ and Yaniv I (2008) Overconfidence in interval estimates: what does expertise buy you? Organizational Behavior and Human Decision Processes 107 (2), 179–191.

    Article  Google Scholar 

  • McLain DL and Aldag RJ (2009) Complexity and familiarity with computer assistance when making ill-structured business decisions. International Journal of Information Technology & Decision Making 8 (3), 407–426.

    Article  Google Scholar 

  • Mohan K and Jain R (2008) Using traceability to mitigate cognitive biases in software development. Communications of the ACM 51 (9), 110–114.

    Article  Google Scholar 

  • Moore DA and Cain DM (2007) Overconfidence and underconfidence: when and why people underestimate (and overestimate) the competition. Organizational Behavior and Human Decision Processes 103 (2), 197–213.

    Article  Google Scholar 

  • Nakatsu RT and Benbasat I (2006) Designing intelligent systems to handle system failures: enhancing explanatory power with less restrictive user interfaces and deep explanations. International Journal of Human‐Computer Interaction 21 (1), 55–72.

    Article  Google Scholar 

  • Ng BD and Wiemer-Hastings P (2005) Addiction to the internet and online gaming. CyberPsychology and Behavior 8 (2), 110–113.

    Article  Google Scholar 

  • Odean T (1998) Volume, volatility, price, and profit when all traders are above average. The Journal of Finance 53 (6), 1887–1934.

    Article  Google Scholar 

  • Paradice DB and Courtney Jr. JF (1986) Controlling bias in user assertions in expert decision support systems for problem formulation. Journal of Management Information Systems 3 (1), 52–64.

    Article  Google Scholar 

  • Park J, Konana P, Gu B, Kumar A and Raghunathan R (2013) Information valuation and confirmation bias in virtual communities: evidence from stock message boards. Information Systems Research 24 (4), 1050–1067.

    Article  Google Scholar 

  • Pedhazur EJ and Schmelkin LP (1991) Measurement, Design, and Analysis: An Integrated Approach. Lawrence Erlbaum Associates, Hillsdale, NJ.

    Google Scholar 

  • Petter S, Straub D and Rai A (2007) Specifying formative constructs in information systems research. MIS Quarterly 31 (4), 623–656.

    Google Scholar 

  • Podsakoff PM, MacKenzie SB, Lee J-Y and Podsakoff NP (2003) Common method biases in behavioral research: a critical review of the literature and recommended remedies. Journal of Applied Psychology 88 (5), 879–903.

    Article  Google Scholar 

  • Presson PK and Benassi VA (1996) Illusion of control: a meta-analytic review. Journal of Social Behavior & Personality 11 (3), 493–510.

    Google Scholar 

  • Puhakainen P and Siponen M (2010) Improving employees’ compliance through information systems security training: an action research study. MIS Quarterly 34 (4), 757–778.

    Google Scholar 

  • Ringle CM, Wende S and Will A (2005) SmartPLS–Version 2.0. Universitat Hamburg, Hamburg.

    Google Scholar 

  • Reeve J and Deci EL (1996) Elements of the competitive situation that affect intrinsic motivation. Personality and Social Psychology Bulletin 22 (1), 24–33.

    Article  Google Scholar 

  • Rhee H-S, Ryu Y and Kim C-T (2005) I am fine but you are not optimistic bias and illusion of control on information security. In Proceedings of International Conference on Information Systems, Las Vegas, NE, USA.

    Google Scholar 

  • Saga VL and Zmud RW (1993) The nature and determinants of it acceptance, routinization, and infusion. In Proceedings of the IFIP TC8 Working Conference on Diffusion, Transfer and Implementation of Information Technology, pp. 67–86, Elsevier Science Inc., North Holland, New York.

  • Shepherd DA, Zacharakis A and Baron RA (2003) VCs’ decision processes: evidence suggesting more experience may not always be better. Journal of Business Venturing 18 (3), 381–401.

    Article  Google Scholar 

  • Silver MS (1990) Decision support systems: directed and nondirected change. Information Systems Research 1 (1), 47–70.

    Article  Google Scholar 

  • Silver MS (1991) Decisional guidance for computer-based decision support. MIS Quarterly 15 (1), 105–122.

    Article  Google Scholar 

  • Smith VL and Walker JM (1993) Monetary rewards and decision cost in experimental economics. Economic Inquiry 31 (2), 245–261.

    Article  Google Scholar 

  • Sniezek JA, Wilkins DC, Wadlington PL and Baumann MR (2002) Training for crisis decision-making: psychological issues and computer-based solutions. Journal of Management Information Systems 18 (4), 147–168.

    Article  Google Scholar 

  • Speier C and Morris MG (2003) The influence of query interface design on decision-making performance. MIS Quarterly 27 (3), 397–423.

    Google Scholar 

  • Sun H (2013) A longitudinal study of herd behavior in the adoption and continued use of technology. MIS Quarterly 37 (4), 1013–1041.

    Google Scholar 

  • Sweeney JC, Soutar GN and Johnson LW (1996) Are satisfaction and dissonance the same construct? A preliminary analysis. Journal of Consumer Satisfaction, Dissatisfaction and Complaining Behaviour 9, 138–143.

    Google Scholar 

  • Tan W-K, Tan C-H and Teo H-H (2012) Consumer-based decision aid that explains which to buy: decision confirmation or overconfidence bias? Decision Support Systems 53 (1), 127–141.

    Article  Google Scholar 

  • Tarafdar M, Tu Q, Ragu-Nathan BS and Ragu-Nathan T (2007) The impact of technostress on role stress and productivity. Journal of Management Information Systems 24 (1), 301–328.

    Article  Google Scholar 

  • Thatcher JB and Perrewe PL (2002) An empirical examination of individual traits as antecedents to computer anxiety and computer self-efficacy. MIS Quarterly 26 (4), 381–396.

    Article  Google Scholar 

  • Thompson SC (1999) Illusions of control: how we overestimate our personal influence. Current Directions in Psychological Science 8 (6), 187–190.

    Article  Google Scholar 

  • Thompson RL, Higgins CA and Howell JM (1994) Influence of experience on personal computer utilization: testing a conceptual model. Journal of Management Information Systems 11 (1), 167–187.

    Article  Google Scholar 

  • Todd P and Benbasat I (1999) Evaluating the impact of DSS, cognitive effort, and incentives on strategy selection. Information Systems Research 10 (4), 356–374.

    Article  Google Scholar 

  • Tversky A and Kahneman D (1974) Judgment under uncertainty: heuristics and biases. Science 185 (4157), 1124–1131.

    Article  Google Scholar 

  • Van De Venter G and Michayluk D (2008) An insight into overconfidence in the forecasting abilities of financial advisors. Australian Journal of Management 32 (3), 545–557.

    Article  Google Scholar 

  • Vetter J, Benlian A and Hess T (2011) Overconfidence in it investment dcisions: why knowledge can be a boon and bane at the same time. In Proceedings of International Conference on Information Systems. Shanghai, China.

    Google Scholar 

  • Wheeler BC and Valacich JS (1996) Facilitation, GSS, and training as sources of process restrictiveness and guidance for structured group decision-making: an empirical assessment. Information Systems Research 7 (4), 429–450.

    Article  Google Scholar 

  • Worchel S (1974) The effect of three types of arbitrary thwarting on the instigation to aggression. Journal of Personality 42 (2), 300–318.

    Article  Google Scholar 

  • Worchel S and Brehm JW (1971) Direct and implied social restoration of freedom. Journal of Personality and Social Psychology 18 (3), 294–304.

    Article  Google Scholar 

  • Zajac EJ and Bazerman MH (1991) Blind spots in industry and competitor analysis: implications of interfirm (mis) perceptions for strategic decisions. Academy of Management Review 16 (1), 37–56.

    Article  Google Scholar 

  • Zollo M (2009) Superstitious learning with rare strategic decisions: theory and evidence from corporate acquisitions. Organization Science 20 (5), 894–908.

    Article  Google Scholar 

  • Zollo M and Reuer JJ (2010) Experience spillovers across corporate development activities. Organization Science 21 (6), 1195–1212.

    Article  Google Scholar 

Download references

Author information

Authors and Affiliations

Authors

Corresponding author

Correspondence to Marios Koufaris.

Appendices

Appendix A

Instructions

First, in order to help you make the best investment decisions in this study, we would like to provide you with some information on financial theories on how stock prices change in financial markets.

The random walk hypothesis is a financial theory that states that stock market prices evolve according to a random walk, which means that they increase or decrease randomly. According to this theory, past stock prices are of no value in forecasting future prices because past, current, and future prices merely reflect market responses to information that comes into the market at random. In short, price movements are no more predictable than the pattern of the walk of a drunk.

There are also other theories that state that stock prices may be predicted to some degree, based on knowing specific information from the past, such as the changes in stock prices in the prior 5 years, earnings announcements over the prior 6 months, or market volatility. However, there is no single accepted theory on how stock prices evolve in markets.

Now that you understand a little more about stock price behavior in markets, please click on Next’ to start your investment task.

Appendix B

IOC (Adapted from Kahai et al (1998))

  1. 1

    Please tell us how confident you feel about the investment decision that you just made (7-point scale ranging from ‘Not at all confident’ to ‘Absolutely confident’)

  2. 2

    How certain are you that your stock price prediction is accurate? (7-point scale ranging from ‘Not at all certain’ to ‘Absolutely certain’)

  3. 3

    How likely do you think that your investment decision will result in maximizing your earnings? (7-point scale ranging from ‘Not at all likely’ to ‘Absolutely likely’)

  4. 4

    What do you think the price of the stock you invested in will be in the next month?

Satisfaction (Adapted from Kahai et al (1998)) (7-point scale ranging from ‘Strongly disagree’ to ‘Strongly agree’)

  1. 1

    I was satisfied with the decisions I made in this investment task

  2. 2

    I was satisfied with the decision-making process during this investment task

  3. 3

    Overall, I was satisfied with my performance in this investment task

Appendix C

Figure C1

Figure C1
figure 4

PLS model results.Note: Only significant relationships are shown. Interaction effects were tested and none were significant.

Rights and permissions

Reprints and permissions

About this article

Check for updates. Verify currency and authenticity via CrossMark

Cite this article

Chen, CW., Koufaris, M. The impact of decision support system features on user overconfidence and risky behavior. Eur J Inf Syst 24, 607–623 (2015). https://doi.org/10.1057/ejis.2014.30

Download citation

  • Received:

  • Revised:

  • Accepted:

  • Published:

  • Issue Date:

  • DOI: https://doi.org/10.1057/ejis.2014.30

Keywords

Navigation