Skip to main content
Log in

Experiences in using a contingency factor-based validation methodology for spreadsheet DSS

  • Case-Oriented Paper
  • Published:
Journal of the Operational Research Society

Abstract

The use of spreadsheets has become routine in all aspects of business with usage growing across a range of functional areas and a continuing trend towards end user spreadsheet development. However, several studies have raised concerns about the accuracy of spreadsheet models in general, and of end user developed applications in particular, raising the risk element for users. High error rates have been discovered, even though the users/developers were confident that their spreadsheets were correct. The lack of an easy to use, context-sensitive validation methodology has been highlighted as a significant contributor to the problems of accuracy. This paper describes experiences in using a practical, contingency factor-based methodology for validation of spreadsheet-based DSS. Because the end user is often both the system developer and a stakeholder, the contingency factor-based validation methodology may need to be used in more than one way. The methodology can also be extended to encompass other DSS.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Figure 1

Similar content being viewed by others

References

  • Alavi M, Nelson R and Weiss IR (1987). Strategies for end-user computing: An integrative framework. J Mngt Inform Syst 4(3): 28–49.

    Article  Google Scholar 

  • Brown PS and Gould JD (1987). An experimental study of people creating spreadsheets. ACM Trans Info Syst 5: 258–272.

    Article  Google Scholar 

  • Edberg DT and Bowman BJ (1996). User-developed applications: An empirical study of application quality and developer productivity. J Mngt Inform Syst 13(1): 167–185.

    Article  Google Scholar 

  • Edge and WR, Wilson EJG (1990). Avoiding the hazards of microcomputer spreadsheets. Internal Auditor, April, pp 35–39.

  • Finlay PN and Wilson JM (1987). The paucity of model validation in operational research projects. J Opl Res Soc 38: 303–308.

    Article  Google Scholar 

  • Finlay PN and Wilson JM (1997). Validity of decision support systems: Towards a validation methodology. Syst Res Behav Sci 14: 169–182.

    Article  Google Scholar 

  • Finlay PN and Wilson JM (2000). A survey of contingency factors affecting the validation of end-user spreadsheet-based decision support systems. J Opl Res Soc 51: 949–958.

    Article  Google Scholar 

  • Galletta DF, Hartzel KS, Johnson S and Joseph JL (1997). Spreadsheet presentation and error detection: An experimental study. J Mngt Inform Syst 13(2): 45–63.

    Google Scholar 

  • George V and Vaughn R (2003). Application of lightweight formal methods in requirement engineering. Crosstalk. J Defense Soft Eng. Available online.

  • Hall MJJ (1996). A risk and control oriented study of the practices of spreadsheet application developers. Proceedings of the 29th Hawaii International Conference on System Sciences 2: p 364, IEEE, Washington, DC.

  • ISO 13407 (1999). Human Centred Design Processes for Interactive Systems. International Standards Organisation: Geneva.

  • Janvrin D and Morrison J (2000). Using a structured design approach to reduce risks in end user spreadsheet development. Inform Mngt 37: 1–12.

    Google Scholar 

  • Kreie J, Cronan TP, Pendley J and Renwick JS (2000). Applications development by end-users: Can quality be improved? Decis Support Syst 29: 143–152.

    Article  Google Scholar 

  • Krull A (1989). Computer rip-offs and foul-ups: Is management to blame? EDPACS – the EDP Audit, Control and Security Newsletter 16 (11): 10–14.

    Google Scholar 

  • Olphert CW and Wilson JM (2004). Validation of decision-aiding spreadsheets: The influence of contingency factors. J Opl Res Soc 55: 12–22.

    Article  Google Scholar 

  • Panko RR (2000). What we know about spreadsheet errors. Available online.

  • Panko RR and Halverson RP Jr . (1997). Are two heads better than one? (at reducing errors in spreadsheet modeling?). Office Syst Res J 15: 21–32.

    Google Scholar 

  • Panko RR and Sprague RH (1998). Hitting the wall: Errors in developing and code inspecting a ‘simple' spreadsheet model. Decis Support Syst 22: 337–353.

    Article  Google Scholar 

  • Rajalingham K, Chadwick D, Knight B and Edwards D (2000). Quality control in spreadsheets: A software engineering-based approach to spreadsheet development. Proceedings of the 33rd Hawaii International Conference on System Sciences 4: p 4006, IEEE, Washington, DC.

  • Rothermel G, Burnett M, Li L, Dupuis C and Sheretov A (2001). A methodology for testing spreadsheets. ACM Trans Software Eng Methodol (TOSEM) 10: 110–147.

    Article  Google Scholar 

  • Schultheis R and Sumner M (1994). The relationship of application risks to application controls: A study of microcomputer-based spreadsheet applications. J End User Comput 6(2): 11–18.

    Article  Google Scholar 

  • Seal K, Przasnyski Z and Leon L (2000). A literature survey of spreadsheet based MS/OR applications 1985–1999. OR Insight 13(4): 21–31.

    Article  Google Scholar 

Download references

Acknowledgements

We gratefully acknowledge the financial support of the Economic and Social Research Council (Grant R000339292) for the research described in this paper. We also thank colleagues who provided material for the case studies.

Author information

Authors and Affiliations

Authors

Corresponding author

Correspondence to J M Wilson.

Rights and permissions

Reprints and permissions

About this article

Cite this article

Anastasakis, L., Olphert, C. & Wilson, J. Experiences in using a contingency factor-based validation methodology for spreadsheet DSS. J Oper Res Soc 59, 756–761 (2008). https://doi.org/10.1057/palgrave.jors.2602391

Download citation

  • Received:

  • Accepted:

  • Published:

  • Issue Date:

  • DOI: https://doi.org/10.1057/palgrave.jors.2602391

Keywords

Navigation