Towards a measurement tool for verification and validation of simulation models

Model deficiencies, despite their negative influences on assessment of modeling and simulation (M&S) applications, carry a large amount of insightful information, which can be used to measure different aspects of the M&S development process and its verification and validation (V&V). Although there already exist various categorizations of model deficiencies, none of which can be used as a measurement tool to classify and analyze deficiency data collected in practice. This paper describes a framework for developing model deficiency classifications and the pilot application of the established classification scheme as a quantitative method to measure and control the V&V process being conducted. Investigations indicate that the proposed approach is capable of providing process diagnoses reflecting the real problems and identifying the improvement potentials. Based on the findings achieved in practice, a planning and tailoring concept is being developed for efficiently applying different V&V techniques in a simulation study.