Abstract
A survey was used to obtain information on the processes and methods used by simulation experts in real projects. The 102 survey respondents answered questions about their most recent simulation project. This paper presents some of the survey results, focussing mainly on conceptual modelling and the pattern of time allocation to different topics. There are a wide range of findings that include the modellers making changes to the initial conceptual model during subsequent tasks in most of the projects usually by adding complexity, model coding taking on average about twice the time of other topics, and the topics generally occurring in single blocks of time (at the resolution of the survey data collection) but with considerable overlaps. The results give an insight into the way experts approach simulation projects and their problem solving strategies. A potential application is in training novice modellers, particularly in developing ‘craft skills’. The results also provide an empirical basis for further research, especially in conceptual modelling.
Similar content being viewed by others
References
Aitchison J (1986). The Statistical Analysis of Compositional Data. Chapman and Hall: London.
Balci O (1994). Validation, verification, and testing techniques throughout the life cycle of a simulation study. Annals of Operations Research 53 (1): 121–173.
Bell PC, Anderson CK, Staples DS and Elder M (1999). Decision-makers’ perceptions of the value and impact of visual interactive modelling. Omega, the International Journal of Management Science 27 (2): 155–165.
Brooks RJ (2011). Complexity, level of detail, and model performance. In: Robinson S, Brooks RJ, Kotiadis K and van der Zee D-J (eds). Conceptual Modeling for Discrete-Event Simulation, CRC Press, Taylor and Francis Group: Boca Raton, pp 31–56.
Brooks RJ and Robinson S (2001). Simulation, with Inventory Control. (author C. Lewis), Operational Research Series. Palgrave Macmillan: Basingstoke.
Brooks RJ and Tobias AM (1996). Choosing the best model: Level of detail, complexity, and model performance. Mathematical and Computer Modelling 24 (4): 1–14.
Chwif L, Banks J, de Moura Filho JP and Santini B (2013). A framework for specifying a discrete-event simulation Conceptual model. Journal of Simulation 7 (1): 50–60.
Chwif L, Barretto MRP and Paul RJ (2000). On simulation model complexity. In: Joines JA, Barton RR, Kang K and Fishwick PA (eds). Proceedings of the 2000 Winter Simulation Conference, IEEE, Piscataway, New Jersey, pp 449–455.
Cochran JK, Mackulak GT and Savory PA (1995). Simulation project characteristics in industrial settings. Interfaces 25 (4): 104–113.
Davies I, Green P, Rosemann M, Indulska M and Gallo S (2006). How do practitioners use conceptual modelling in practice. Data and Knowledge Engineering 58 (3): 358–380.
Gass SI (1987). Managing the modeling process: A personal reflection. European Journal of Operational Research 31 (1): 1–8.
Guizzardi G and Wagner G (2012). Tutorial: Conceptual simulation modeling with Onto-UML. In: Laroque C, Himmelspach J, Pasupathy R, Rose O, and Uhrmacher AM (eds). Proceedings of the 2012 Winter Simulation Conference, IEEE, Piscataway, New Jersey, pp 52–66.
Melao N and Pidd M (2003). Use of business simulation: A survey of practitioners. Journal of the Operational Research Society 54 (1): 2–10.
Nance RE (1994). The conical methodology and the evolution of simulation model development. Annals of Operations Research 53 (1): 1–45.
O’Brien F (2011). Supporting the strategy process: A survey of UK OR/MS practitioners. Journal of the Operational Research Society 62 (5): 900–920.
Pace DK (2000). Ideas about simulation conceptual model development. Johns Hopkins APL Technical Digest 21 (3): 327–336.
Pace DK (2004). Modeling and simulation verification and validation challenges. Johns Hopkins APL Technical Digest 25 (2): 163–172.
Pace DK (2011). Conceptual modeling evolution within US Defense communities: The view from the simulation interoperability workshop. In: Robinson S, Brooks RJ, Kotiadis K and van der Zee D-J (eds). Conceptual Modeling for Discrete-Event Simulation. CRC Press, Taylor & Francis Group: Boca Raton, pp 423–449.
Pidd M (1999). Just modeling through: A rough guide to modeling. Interfaces 29 (2): 118–132.
Powell SG and Willemain TR (2007). How novices formulate models. Part I: Qualitative insights and implications for teaching. Journal of the Operational Research Society 58 (8): 983–995.
Pritsker AAB (1986). Introduction to Simulation and Slam II. Systems Publishing Corporation: West Lafayette, IN.
Robinson S (2002). Modes of simulation practice: Approaches to business and military simulation. Simulation Modelling Practice and Theory 10 (8): 513–523.
Robinson S (2006). Conceptual modeling for simulation: Issues and research requirements. In: Perrone LF, Wieland FP, Lawson BG, Nicol DM and Fujimoto RM (eds). Proceedings of the 2006 Winter Simulation Conference, IEEE, Piscataway, New Jersey, pp 792–800.
Robinson S (2008). Conceptual modelling for simulation Part I: Definition and requirements. Journal of the Operational Research Society 59 (3): 278–290.
Robinson S (2010). Conceptual modelling: Who needs It? SCS M&S Magazine I(2), April, http://www.scs.org/magazines/2010-04/index_file/Files/Robinson.pdf, accessed 13 October 2013.
Robinson S (2012). Tutorial: Choosing what to model—Conceptual modeling for simulation. In: Laroque C, Himmelspach J, Pasupathy R, Rose O, and Uhrmacher AM (eds). Proceedings of the 2012 Winter Simulation Conference, IEEE, Piscataway, New Jersey, pp 1909–1920.
Robinson S (2014). Simulation: The Practice of Model Development and Use. 2nd edn. Palgrave Macmillan: Basingstoke, Hampshire.
Robinson S, Brooks RJ, Kotiadis K and van der Zee D-J (2011). Conceptual Modeling for Discrete-Event Simulation. CRC Press, Taylor & Francis Group: Boca Raton.
Salt JD (1993). Keynote address: Simulation should be easy and fun! In: Evans GW, Mollaghasemi M, Russell EC, and Biles WE (eds). Proceedings of the 1993 Winter Simulation Conference, IEEE, Piscataway, New Jersey, pp 1–5.
Tilanus CB (1985). Failures and successes of quantitative methods in management. European Journal of Operational Research 19 (2): 170–175.
Van der Zee D-J, Brooks RJ, Robinson S and Kotiadis K (2011). Conceptual modeling: Past, present and future. In: Robinson S, Brooks RJ, Kotiadis K and van der Zee D-J (eds). Conceptual Modeling for Discrete-Event Simulation. CRC Press, Taylor & Francis Group: Boca Raton, pp 473–490.
Waisel LB, Wallace WA and Willemain TR (2008). Visualization and model formulation: An analysis of the sketches of expert modellers. Journal of the Operational Research Society 59 (3): 353–361.
Wang W and Brooks RJ (2007a). Improving the understanding of conceptual modelling. Journal of Simulation 1 (3): 153–158.
Wang W and Brooks RJ (2007b). Empirical investigations of conceptual modeling and the modeling process. In: Henderson SG, Biller B, Hsieh M-H, Shortle J, Tew JD and Barton RR (eds). Proceedings of the 2007 Winter Simulation Conference. IEEE, pp 762–770.
Wang W and Brooks RJ (2008). Conceptual modelling and the modelling process in simulation projects: A survey of simulation modellers. In: Kotiadis K, Currie C, Robinson S and Taylor S (eds). Proceedings of the 2008 OR Society Simulation Workshop, pp 107–115.
Ward SC (1989). Arguments for constructively simple models. Journal of the Operational Research Society 40 (2): 141–153.
Willemain TR (1994). Insights on modeling from a dozen experts. Operations Research 42 (2): 213–222.
Willemain TR (1995). Model formulation: What experts think about and when. Operations Research 43 (6): 916–932.
Willemain TR and Powell SG (2007). How novices formulate models. Part II: A quantitative description of behaviour. Journal of the Operational Research Society 58 (10): 1271–1283.
Acknowledgements
We are very grateful to all the questionnaire respondents for their assistance. Thanks also to the referees for their helpful comments. Some of the text and results in this paper were previously included in two conference papers: Wang and Brooks (2007b, 2008).
Author information
Authors and Affiliations
Corresponding author
Rights and permissions
About this article
Cite this article
Brooks, R., Wang, W. Conceptual modelling and the project process in real simulation projects: a survey of simulation modellers. J Oper Res Soc 66, 1669–1685 (2015). https://doi.org/10.1057/jors.2014.128
Received:
Accepted:
Published:
Issue Date:
DOI: https://doi.org/10.1057/jors.2014.128