{"title":"Stabilization Time - A Quality Metric for Software Products","authors":"V. Sharma, P. Jalote","doi":"10.1109/ISSRE.2006.44","DOIUrl":"https://doi.org/10.1109/ISSRE.2006.44","url":null,"abstract":"In software products, often the failure rate decreases after installation, eventually reaching a steady state. The time it takes for a product to reach its steady state reliability depends on different product parameters. In this paper we propose a new metric for software products called stabilization time which is the time taken after installation for the reliability of the product to stabilize. This metric can be used for comparing products, and can be useful for organizations and individuals using the product as well as for the product vendor. We also present an approach for determining the stabilization time of a product from its failure and sales data. We apply the approach to three real life products using their failure and sales data after release","PeriodicalId":373353,"journal":{"name":"2006 17th International Symposium on Software Reliability Engineering","volume":"5 1","pages":"0"},"PeriodicalIF":0.0,"publicationDate":"2006-11-07","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"116980402","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
Jun Yan, Zhong Jie Li, Yuan Yuan, Wei Sun, Jian Zhang
{"title":"BPEL4WS Unit Testing: Test Case Generation Using a Concurrent Path Analysis Approach","authors":"Jun Yan, Zhong Jie Li, Yuan Yuan, Wei Sun, Jian Zhang","doi":"10.1109/ISSRE.2006.16","DOIUrl":"https://doi.org/10.1109/ISSRE.2006.16","url":null,"abstract":"BPEL is a language that could express complex concurrent behaviors. This paper presents a novel method of BPEL test case generation, which is based on concurrent path analysis. This method first uses an extended control flow graph (XCFG) to represent a BPEL program, and generates all the sequential test paths from XCFG. These sequential test paths are then combined to form concurrent test paths. Finally a constraint solver BoNuS is used to solve the constraints of these test paths and generate feasible test cases. Some techniques are proposed to reduce the number of combined concurrent test paths. Some test criteria derived from traditional sequential program testing are also presented to reduce the number of test cases. This method is modularized so that many test techniques such as various test criteria and complex constraint solvers can be applied. This method is tested sound and efficient in experiments. It is also applicable to the testing of other business process languages with possible extension and adaptation","PeriodicalId":373353,"journal":{"name":"2006 17th International Symposium on Software Reliability Engineering","volume":"25 1","pages":"0"},"PeriodicalIF":0.0,"publicationDate":"2006-11-07","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"121401400","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
{"title":"DevCOP: A Software Certificate Management System for Eclipse","authors":"Mark Sherriff, L. Williams","doi":"10.1109/ISSRE.2006.22","DOIUrl":"https://doi.org/10.1109/ISSRE.2006.22","url":null,"abstract":"During the course of software development, developers will employ several different verification and validation (V&V) practices with their software. However, these efforts might not be recorded or maintained in an effective manner. We have built defect estimation with V&V Certificates on Programming (DevCOP), a software certificate management system. With DevCOP, developers can automatically track and maintain a persistent record of the V&V practices used during development via certificates. With this V&V information, developers and managers can better manage their V&V efforts within a system. Detailed information such as coverage of particular V&V techniques over the system or the amount of V&V performed on a single function can be provided. Developers can also use this V&V information post hoc to see which techniques were more effective at removing defects. In our future work, we are researching a parametric model which utilizes these certificates to estimate defect density as development proceeds","PeriodicalId":373353,"journal":{"name":"2006 17th International Symposium on Software Reliability Engineering","volume":"70 1","pages":"0"},"PeriodicalIF":0.0,"publicationDate":"2006-11-07","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"133602855","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
{"title":"Model Simulation for Test Execution Capacity Estimation","authors":"E. Aranha, Paulo Borba, J. Lima","doi":"10.1109/ISSRE.2006.30","DOIUrl":"https://doi.org/10.1109/ISSRE.2006.30","url":null,"abstract":"It is important for a company to know if it is able to attend the clients' requests on time and according to their expectations, mainly in competitive markets. A usual activity performed to ensure quality is the test activity. Software testing is been considered so important that organizations can allocate teams exclusively for test activities. In this context, it is important that test managers know the capacity of their test team. This paper defines a capacity model for test execution teams and presents the use of simulation technique for estimating teams' capacities for executing tests in mobile applications. We also report our experiences using this model in an organizational setting","PeriodicalId":373353,"journal":{"name":"2006 17th International Symposium on Software Reliability Engineering","volume":"93 1","pages":"0"},"PeriodicalIF":0.0,"publicationDate":"2006-11-07","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"134486562","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
{"title":"Probe Distribution Techniques to Profile Events in Deployed Software","authors":"Madeline Diep, Myra B. Cohen, Sebastian G. Elbaum","doi":"10.1109/ISSRE.2006.36","DOIUrl":"https://doi.org/10.1109/ISSRE.2006.36","url":null,"abstract":"Profiling deployed software provides valuable insights for quality improvement activities. The probes required for profiling, however, can cause an unacceptable performance overhead for users. In previous work we have shown that significant overhead reduction can be achieved, with limited information loss, through the distribution of probes across deployed instances. However, existing techniques for probe distribution are designed to profile simple events. In this paper we present a set of techniques for probe distribution to enable the profiling of complex events that require multiple probes and that share probes with other events. Our evaluation of the new techniques indicates that, for tight overhead bounds, techniques that produce a balanced event allocation can retain significantly more field information","PeriodicalId":373353,"journal":{"name":"2006 17th International Symposium on Software Reliability Engineering","volume":"149 1","pages":"0"},"PeriodicalIF":0.0,"publicationDate":"2006-11-07","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"122418974","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
M. Fisher, G. Rothermel, Tyler Creelan, M. Burnett
{"title":"Scaling a Dataflow Testing Methodology to the MultiparadigmWorld of Commercial Spreadsheets","authors":"M. Fisher, G. Rothermel, Tyler Creelan, M. Burnett","doi":"10.1109/ISSRE.2006.40","DOIUrl":"https://doi.org/10.1109/ISSRE.2006.40","url":null,"abstract":"Spreadsheets are widely used but often contain faults. Thus, in prior work we presented a dataflow testing methodology for use with spreadsheets, which studies have shown can be used cost-effectively by end-user programmers. To date, however, the methodology has been investigated across a limited set of spreadsheet language features. Commercial spreadsheet environments are multiparadigm languages, utilizing features not accommodated by our prior approaches. In addition, most spreadsheets contain large numbers of replicated formulas that severely limit the efficiency of dataflow testing approaches. We show how to handle these two issues with a new dataflow adequacy criterion and automated detection of areas of replicated formulas, and report results of a controlled experiment investigating the feasibility of our approach","PeriodicalId":373353,"journal":{"name":"2006 17th International Symposium on Software Reliability Engineering","volume":"46 1","pages":"0"},"PeriodicalIF":0.0,"publicationDate":"2006-11-07","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"121011481","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
K. Goseva-Popstojanova, Margaret Hamill, Xuan Wang
{"title":"Adequacy, Accuracy, Scalability, and Uncertainty of Architecture-based Software Reliability: Lessons Learned from Large Empirical Case Studies","authors":"K. Goseva-Popstojanova, Margaret Hamill, Xuan Wang","doi":"10.1109/ISSRE.2006.11","DOIUrl":"https://doi.org/10.1109/ISSRE.2006.11","url":null,"abstract":"Our earlier research work on applying architecture-based software reliability models on a large scale case study allowed us to test how and when they work, to understand their limitations, and to outline the issues that need future research. In this paper we first present an additional case study which confirms our earlier findings. Then, we present uncertainty analysis of architecture-based software reliability for both case studies. The results show that Monte Carlo method scales better than the method of moments. The sensitivity analysis based on Monte Carlo method shows that (1) small number of parameters contribute to the most of the variation in system reliability and (2) given an operational profile, components' reliabilities have more significant impact on system reliability than transition probabilities. Finally, we summarize the lessons learned from conducting large scale empirical case studies for the purpose of architecture-based reliability assessment and uncertainty analysis","PeriodicalId":373353,"journal":{"name":"2006 17th International Symposium on Software Reliability Engineering","volume":"4 1","pages":"0"},"PeriodicalIF":0.0,"publicationDate":"2006-11-07","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"134221346","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
{"title":"\"Tail-Splitting\" to Predict Failing Software Modules - with a Case Study on an Operating Systems Product","authors":"R. Chillarege, P. Santhanam","doi":"10.1109/ISSRE.2006.1","DOIUrl":"https://doi.org/10.1109/ISSRE.2006.1","url":null,"abstract":"\"Tail-splitting\" is a new technique to identify defect prone modules by enhancing the focus of the Pareto distribution by a development process factor. The simple yet powerful influence of a varying tail membership as a function of development process phases is captured by the tail-split-string which tags each module. The case studies on an operating systems product demonstrate that the tail-split-string identifies a small set of modules with a high probability of field failure. The tail-boundary in the algorithm provides for a natural tuning parameter to control the size of the identified set to suit the resources available for rework. Release managers have found that the method is particularly useful to sift modules, with low false positive, for late stage rework","PeriodicalId":373353,"journal":{"name":"2006 17th International Symposium on Software Reliability Engineering","volume":"46 1","pages":"0"},"PeriodicalIF":0.0,"publicationDate":"2006-11-07","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"127930213","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
{"title":"Building Phase-Type Software Reliability Models","authors":"H. Okamura, T. Dohi","doi":"10.1109/ISSRE.2006.17","DOIUrl":"https://doi.org/10.1109/ISSRE.2006.17","url":null,"abstract":"This paper presents a unified framework for software reliability modeling with non-homogeneous Poisson processes, where each software fault-detection time obeys the phase-type distribution and the initial number of inherent faults is given by a Poisson distributed random variable. However, it is worth noting that the resulting software reliability models, called phase-type software reliability models, generalize the existing models but may involve a number of model parameters in the phase-type software reliability model, so that the usual maximum likelihood estimation based on the Newton's method or quasi-Newton's method does not often function well. In this paper, we develop EM (expectation-maximization) algorithms for the phase-type software reliability models with two types of fault data: fault-detection time data and grouped data with arbitrary time intervals. In numerical examples, we compare the EM algorithms with the quasi-Newton's method and illustrate the effectiveness on our unified model and parameter estimation method","PeriodicalId":373353,"journal":{"name":"2006 17th International Symposium on Software Reliability Engineering","volume":"22 1","pages":"0"},"PeriodicalIF":0.0,"publicationDate":"2006-11-07","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"134365679","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
{"title":"A Novel SOAP Attachment-Oriented Security Model","authors":"Xiaoling Cui, Lei Li, Jun Wei","doi":"10.1109/ISSRE.2006.7","DOIUrl":"https://doi.org/10.1109/ISSRE.2006.7","url":null,"abstract":"Security is playing an increasingly important role in nowadays business. However, at present there isn't an effective method to secure SOAP attachments. This paper proposes a novel security model for SOAP attachments, which encrypts the attachments and provides digital signature without changing client's and server's implementations. In the multi-intermediaries scenario, the whole message is divided into two parts and sent respectively: the primary part goes through as the original message path via intermediaries, while the attachments are sent directly from client to server via no intermediary. Therefore, it improves the efficiency of services and reduces the probability of the attachments' being attacked. A prototype of this security model is implemented on the Web application server and the experiment results show the feasibility of secure attachments in enterprise applications","PeriodicalId":373353,"journal":{"name":"2006 17th International Symposium on Software Reliability Engineering","volume":"15 1","pages":"0"},"PeriodicalIF":0.0,"publicationDate":"2006-11-07","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"114294413","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}