{"title":"An experimental comparison of fault and error injection","authors":"J. Christmansson, M. Hiller, M. Rimén","doi":"10.1109/ISSRE.1998.730903","DOIUrl":"https://doi.org/10.1109/ISSRE.1998.730903","url":null,"abstract":"The complex interactions between faults, errors, failures and fault handling mechanisms can be studied via injection experiments. This paper presents an investigation of both fault and error injection techniques for emulating software faults. For evaluation, 1600 software faults and 5400 time-triggered errors were injected into an embedded real-time system. The cost-related results are: (i) the time required to create a fault set for fault injection was about 120 times longer than the time required to create an error set for time-triggered injection, and (ii) the execution time for the time-triggered error injection experiments was four times shorter than for the fault injection experiments. However, the error injection would be only 1.3 times faster if another strategy for fault injection had been used. Furthermore, failure symptom-related results are: (i) the test case had a greater influence than the fault type on the failure symptoms for fault injections, (ii) the error type had a greater influence on the failure symptoms for time-triggered error injections than had the test case, and (iii) the error type had a larger impact on the failure symptoms than the fault type.","PeriodicalId":289604,"journal":{"name":"Proceedings Ninth International Symposium on Software Reliability Engineering (Cat. No.98TB100257)","volume":"120 1","pages":"0"},"PeriodicalIF":0.0,"publicationDate":"1998-11-04","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"114656154","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
{"title":"Comparing the effectiveness of testing methods in improving programs: the effect of variations in program quality","authors":"M. Pizza, L. Strigini","doi":"10.1109/ISSRE.1998.730873","DOIUrl":"https://doi.org/10.1109/ISSRE.1998.730873","url":null,"abstract":"We compare the efficacy of different testing methods for improving the reliability of software. Specifically, we use modelling to compare \"operational\" testing, in which test cases are chosen according to their probability of occurring in actual use of the software, against \"debug\" testing methods, in which the testers look for test cases which they consider likely to cause failure, or that satisfy some coverage criterion. We base our comparisons on the reliability reached by the program at the end of testing. Differently from previous studies, we consider the probability distribution of the achieved reliability, and thus the probability of satisfying specific requirements, rather than just the average reliability achieved. We take account of two sources of variation. The variation between the actual test histories that are possible for a given program and a given test method: and the fact that different programs start testing with different faults and initial reliability levels. By necessity, we use very simplified models of reality. Yet, we can show some interesting conclusions with important practical consequences. In general, there are stronger arguments in favor of operational testing than previous studies have shown.","PeriodicalId":289604,"journal":{"name":"Proceedings Ninth International Symposium on Software Reliability Engineering (Cat. No.98TB100257)","volume":"19 1","pages":"0"},"PeriodicalIF":0.0,"publicationDate":"1998-11-04","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"116132998","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
L. Briand, J. Daly, Victor Porter, J. Wüst, Fraunhofer
{"title":"Predicting fault-prone classes with design measures in object-oriented systems","authors":"L. Briand, J. Daly, Victor Porter, J. Wüst, Fraunhofer","doi":"10.1109/ISSRE.1998.730898","DOIUrl":"https://doi.org/10.1109/ISSRE.1998.730898","url":null,"abstract":"The paper aims at empirically exploring the relationships between existing object oriented coupling, cohesion, and inheritance measures and the probability of fault detection in system classes during testing. The underlying goal of such a study is to better understand the relationship between existing product measurement in OO systems and the quality of the software developed. It is shown that by using a subset of existing measures, accurate models can be built to predict in which classes most of the faults are likely to lie in. By inspecting 48% of the classes, it is possible to find 95% of the faults. Besides the size of classes, the frequency of method invocations and the depth of inheritance hierarchies seem to be the main driving factors of fault proneness.","PeriodicalId":289604,"journal":{"name":"Proceedings Ninth International Symposium on Software Reliability Engineering (Cat. No.98TB100257)","volume":"30 1","pages":"0"},"PeriodicalIF":0.0,"publicationDate":"1998-11-04","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"129943463","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
{"title":"To maintain a reliable software specification","authors":"J. J. Li, J. R. Horgan","doi":"10.1109/ISSRE.1998.730774","DOIUrl":"https://doi.org/10.1109/ISSRE.1998.730774","url":null,"abstract":"To maintain a reliable software specification, i.e. keeping software specification and design document synchronized with its implementation is always a difficult task because of the time constraints on software developers. Under such pressure, software developers often view finishing implementation as the end of their duty and updating documentation as tedious, time consuming and without payoff. The paper presents a methodology and its accompanying tool set, Workflow-Implementation-Synchronization (WIS), for automatic synchronization of specification and implementation. The idea is to have the implementation and specification running in parallel during regression testing. Inconsistencies are discovered when the two versions generate different results. The inconsistency will lead to the automatic update of the specification documents. To illustrate this approach, the authors use software architecture description as an example of software specification document. They applied the WIS method to specific telecommunication control software. The experimental results show that WIS method is able to detect inconsistencies and synchronize the software architecture document with the software implementation. This line of research promises to reduce human involvement in keeping specification and implementation synchronized and thus improve the efficiency and reliability of software maintenance.","PeriodicalId":289604,"journal":{"name":"Proceedings Ninth International Symposium on Software Reliability Engineering (Cat. No.98TB100257)","volume":"10 1","pages":"0"},"PeriodicalIF":0.0,"publicationDate":"1998-11-04","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"132383413","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
{"title":"Software reliability predictions for distributed software","authors":"H. Pant, D. Jeske","doi":"10.1109/ISSRE.1998.730762","DOIUrl":"https://doi.org/10.1109/ISSRE.1998.730762","url":null,"abstract":"The software reliability literature contains several models for estimating software reliability at the end of system test. However, to enable better planning, project management often needs reliability predictions prior to system test. The paper presents a software reliability prediction model that extends the known results on software predictions to the case of a distributed software architecture. The model predictions are based on software code characteristics and the size of code as distributed on the system processors. In particular, the implications of having overlapping code executing on multiple processors are examined. It is shown that the predictions, under suitable assumptions on reliability growth during system test, can be used by project management to plan their test and release time intervals. To illustrate the ideas, the prediction model is applied to a telecommunications software project. The paper explains different methods of obtaining the values of software characteristics that are needed as input to the model.","PeriodicalId":289604,"journal":{"name":"Proceedings Ninth International Symposium on Software Reliability Engineering (Cat. No.98TB100257)","volume":"30 1","pages":"0"},"PeriodicalIF":0.0,"publicationDate":"1998-11-04","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"134506990","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
{"title":"Applying testability to reliability estimation","authors":"M. Yang, W. E. Wong, A. Pasquini","doi":"10.1109/ISSRE.1998.730848","DOIUrl":"https://doi.org/10.1109/ISSRE.1998.730848","url":null,"abstract":"The purpose of the article is to implement the idea of using testability to estimate software reliability. The basic steps involve estimating testability, evaluating how well software was written, and assessing the effectiveness of testing. Results from these steps along with operational profiles are used to estimate software reliability. The paper describes an application of this method to evaluate the reliability of a real software system of about 6000 lines of executable code and discusses the results of such an estimation. The results are also compared with those obtained by using two reliability growth models.","PeriodicalId":289604,"journal":{"name":"Proceedings Ninth International Symposium on Software Reliability Engineering (Cat. No.98TB100257)","volume":"42 1","pages":"0"},"PeriodicalIF":0.0,"publicationDate":"1998-11-04","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"121094323","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
{"title":"Industrial application of criticality predictions in software development","authors":"C. Ebert, E. Baisch","doi":"10.1109/ISSRE.1998.730845","DOIUrl":"https://doi.org/10.1109/ISSRE.1998.730845","url":null,"abstract":"Cost-effective software project management has the serious need to focus resources on areas where they have biggest impact. Criticality predictions are typically applied for finding out such high-impact areas in terms of most effective defect detection. The paper investigates two related questions in the context of real projects, namely the selection of the best classification technique and the use of its results in directing management decisions. Results from a current large-scale switching project are included to show practical benefits. Fuzzy classification yielded best results and is in a second study enhanced with genetic algorithms to improve overall prediction effectiveness.","PeriodicalId":289604,"journal":{"name":"Proceedings Ninth International Symposium on Software Reliability Engineering (Cat. No.98TB100257)","volume":"1 1","pages":"0"},"PeriodicalIF":0.0,"publicationDate":"1998-11-04","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"128222711","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
{"title":"Derivation of an integrated operational profile and use case model","authors":"P. Runeson, B. Regnell","doi":"10.1109/ISSRE.1998.730843","DOIUrl":"https://doi.org/10.1109/ISSRE.1998.730843","url":null,"abstract":"Requirements engineering and software reliability engineering both involve model building related to the usage of the intended system; requirements models and test case models respectively are built. Use case modelling for requirements engineering and operational profile testing for software reliability engineering are techniques which are evolving into software engineering practice. Approaches towards integration of the use case model and the operational profile model are proposed. By integrating the derivation of the models, effort may be saved in both development and maintenance of software artifacts. Two integration approaches are presented, transformation and extension. It is concluded that the use case model structure can be transformed into an operational profile model adding the profile information. As a next step, the use case model can be extended to include the information necessary for the operational profile. Through both approaches, modelling and maintenance effort as well as risks for inconsistencies can be reduced. A positive spin-off effect is that quantitative information on usage frequencies is available in the requirements, enabling planning and prioritizing based on that information.","PeriodicalId":289604,"journal":{"name":"Proceedings Ninth International Symposium on Software Reliability Engineering (Cat. No.98TB100257)","volume":"1 1","pages":"0"},"PeriodicalIF":0.0,"publicationDate":"1998-11-04","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"129310636","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
{"title":"Reliability simulation of component-based software systems","authors":"S. Gokhale, Michael R. Lyu, Kishor S. Trivedi","doi":"10.1109/ISSRE.1998.730882","DOIUrl":"https://doi.org/10.1109/ISSRE.1998.730882","url":null,"abstract":"Prevalent Markovian and semi Markovian methods to predict the reliability and performance of component based heterogeneous systems suffer from several limitations: they are subject to an intractably large state space for more complex scenarios, and they cannot take into account the influence of various parameters such as reliability growth of individual components, dependencies among components, etc., in a single model. Discrete event simulation offers an alternative to analytical models as it can capture a detailed system structure, and can be used to study the influence of different factors separately as well as in a combined fashion on dependability measures. We demonstrate the flexibility offered by discrete event simulation to analyze such complex systems through two case studies, one of a terminating application, and the other of a real time application with feedback control. We simulate the failure behavior of the terminating application with instantaneous as well as explicit repair. We also study the effect of having fault tolerant configurations for some of the components on the failure behavior of the application. In the second case of the real time application, we initially simulate the failure behavior of a single version taking into account its reliability growth. We also study the failure behavior of three fault tolerant systems: DRB, NVP and NSCP which are built from the individual versions of the real time application. Results demonstrate the flexibility offered by simulation to study the influence of various factors on the failure behavior of the applications for single as well as fault tolerant configurations.","PeriodicalId":289604,"journal":{"name":"Proceedings Ninth International Symposium on Software Reliability Engineering (Cat. No.98TB100257)","volume":"38 1","pages":"0"},"PeriodicalIF":0.0,"publicationDate":"1998-11-04","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"126776487","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
{"title":"Software reliability modeling by concatenating failure rates","authors":"N. Singpurwalla","doi":"10.1109/ISSRE.1998.730860","DOIUrl":"https://doi.org/10.1109/ISSRE.1998.730860","url":null,"abstract":"The concatenation of failure rate functions results in point process models that need not possess independent increments, or lack memory features of Poisson processes. Processes having a memory are more realistic as compared to those that do not, and as a consequence provide a credible framework for tracking reliability and predicting failure times. The purpose of the paper is to propose and describe a model for software reliability based on this paradigm. The proposed model is adaptive, can explain empirically observed phenomena, and outperforms the predictive ability of its competitors. The model and its inferential mechanism are complex, but software to implement it with ease, is available.","PeriodicalId":289604,"journal":{"name":"Proceedings Ninth International Symposium on Software Reliability Engineering (Cat. No.98TB100257)","volume":"PP 1","pages":"0"},"PeriodicalIF":0.0,"publicationDate":"1998-11-04","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"126407740","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}