{"title":"On the Automation of Software Fault Prediction","authors":"T. Ostrand, E. Weyuker","doi":"10.1109/TAIC-PART.2006.19","DOIUrl":"https://doi.org/10.1109/TAIC-PART.2006.19","url":null,"abstract":"This paper discusses the issues involved in building a practical automated tool to predict the incidence of software faults in future releases of a large software system. The possibility of creating such a tool is based on the authors' experience in analyzing the fault history of several large industrial software projects, and constructing statistical models that are capable of accurately predicting the most fault-prone software entities in an industrial environment. The emphasis of this paper is on the issues involved in the tool design and construction and an assessment of the extent to which the entire process can be automated so that it can be widely deployed and used by practitioners who do not necessarily have any particular statistical or modeling expertise","PeriodicalId":441264,"journal":{"name":"Testing: Academic & Industrial Conference - Practice And Research Techniques (TAIC PART'06)","volume":"1 1","pages":"0"},"PeriodicalIF":0.0,"publicationDate":"2006-08-29","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"128887589","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
S. Counsell, R. Hierons, R. Najjar, G. Loizou, Y. Hassoun
{"title":"The Effectiveness of Refactoring, Based on a Compatibility Testing Taxonomy and a Dependency Graph","authors":"S. Counsell, R. Hierons, R. Najjar, G. Loizou, Y. Hassoun","doi":"10.1109/TAIC-PART.2006.33","DOIUrl":"https://doi.org/10.1109/TAIC-PART.2006.33","url":null,"abstract":"In this paper, we describe and then appraise a testing taxonomy proposed by van Deursen and Moonen (VD&M) based on the post-refactoring repeatability of tests. Four categories of refactoring are identified by VD&M ranging from semantic-preserving to incompatible, where, for the former, no new tests are required and for the latter, a completely new test set has to be developed. In our appraisal of the taxonomy, we heavily stress the need for the inter-dependence of the refactoring categories to be considered when making refactoring decisions and we base that need on a refactoring dependency graph developed as part of the research. We demonstrate that while incompatible refactorings may be harmful and time-consuming from a testing perspective, semantic-preserving refactorings can have equally unpleasant hidden ramifications despite their advantages. In fact, refactorings which fall into neither category have the most interesting properties. We support our results with empirical refactoring data drawn from seven Java open-source systems (OSS) and from the same analysis form a tentative categorization of code smells","PeriodicalId":441264,"journal":{"name":"Testing: Academic & Industrial Conference - Practice And Research Techniques (TAIC PART'06)","volume":"1 1","pages":"0"},"PeriodicalIF":0.0,"publicationDate":"2006-08-29","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"130701832","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
{"title":"Use Case-Based Acceptance Testing of a Large Industrial System: Approach and Experience Report","authors":"S. Roubtsov, P. Heck","doi":"10.1109/TAIC-PART.2006.36","DOIUrl":"https://doi.org/10.1109/TAIC-PART.2006.36","url":null,"abstract":"The paper describes the preparation and execution of the site acceptance testing of a large scale industrial system. A use case based approach to testing is developed. The approach introduces three-level test artifact specifications. At the highest level test scenarios are used to validate system use cases. The lower levels are presented by test scripts and test cases, which unfold test scenarios into test procedures with corresponding test data. A proposed requirements traceability model joins all the test artifacts to each other and to the requirements allowing testers to maintain control over requirements coverage during the entire testing process. The paper also describes successful practical experience in application of the approach as well as our observations regarding usage of modern testing techniques and tools in industry","PeriodicalId":441264,"journal":{"name":"Testing: Academic & Industrial Conference - Practice And Research Techniques (TAIC PART'06)","volume":"7 1","pages":"0"},"PeriodicalIF":0.0,"publicationDate":"2006-08-29","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"114839847","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
{"title":"AutoAbstract: Problem Statement and Hypothetical Solutions","authors":"Shaukat Ali","doi":"10.1109/TAIC-PART.2006.4","DOIUrl":"https://doi.org/10.1109/TAIC-PART.2006.4","url":null,"abstract":"Automated abstraction of code into state-based specification and test generation (AutoAbstract) is a project funded by EPSRC. The aim of the project is to devise methods and a tool to abstract out specifications from the code using some hints from the developer. These specifications will be in the form of X-machines. It is assumed that these hints are available in the form of incomplete specifications and are refined using reverse-engineered X-machines. Finally, a method will be developed to generate concrete test cases from the refined X-machines and the tool will be updated accordingly. The main theme of my PhD lies within the AutoAbstract project. This PhD extended abstract will contain the technical challenges involved in the project followed by the parts of the work involved in the project that are linked to my interests. The proposed solutions to these parts will also be discussed","PeriodicalId":441264,"journal":{"name":"Testing: Academic & Industrial Conference - Practice And Research Techniques (TAIC PART'06)","volume":"os-35 1","pages":"0"},"PeriodicalIF":0.0,"publicationDate":"2006-08-29","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"127776648","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
{"title":"Extending Software Integration Testing Using Aspects in Symbian OS","authors":"Jani Pesonen","doi":"10.1109/TAIC-PART.2006.9","DOIUrl":"https://doi.org/10.1109/TAIC-PART.2006.9","url":null,"abstract":"A properly designed test harness is an important part of the quality verification of any software system. However, selection of the most important test cases for the harness is often difficult, since capturing the key characteristics related to the most important functionalities is not obvious. Aspect-oriented programming provides means for capturing such cross-cutting issues in systems and promising means for implementing test harnesses for embedded software. This paper studies an example of weaving testing aspects into existing Symbian OS software running on a mobile device. Proposed solution provides a cost-effective, scalable, easily adaptable, and non-tangling tool for testing certain system functionalities","PeriodicalId":441264,"journal":{"name":"Testing: Academic & Industrial Conference - Practice And Research Techniques (TAIC PART'06)","volume":"47 1","pages":"0"},"PeriodicalIF":0.0,"publicationDate":"2006-08-29","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"116110577","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
{"title":"Integration Testing of Components Guided by Incremental State Machine Learning","authors":"Keqin Li, Roland Groz, Muzammil Shahbaz","doi":"10.1109/TAIC-PART.2006.15","DOIUrl":"https://doi.org/10.1109/TAIC-PART.2006.15","url":null,"abstract":"The design of complex systems, e.g., telecom services, is nowadays usually based on the integration of components (COTS), loosely coupled in distributed architectures. When components come from third party sources, their internal structure is usually unknown and the documentation is insufficient. Therefore, the system integrator faces the problem of providing a required system assembling COTS whose behaviour is barely specified and for which no model is usually available. In this paper, we address the problem of integration testing of COTS. It combines test generation techniques with machine learning algorithms. State-based models of components are built from observed behaviours. The models are alternatively used to generate tests and extended to take into account observed behaviour. This process is iterated until a satisfactory level of confidence in testing is achieved","PeriodicalId":441264,"journal":{"name":"Testing: Academic & Industrial Conference - Practice And Research Techniques (TAIC PART'06)","volume":"23 1","pages":"0"},"PeriodicalIF":0.0,"publicationDate":"2006-08-29","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"131028076","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
{"title":"On the Testing Maturity of Software Producing Organizations","authors":"M. Grindal, A. Offutt, Jonas Mellin","doi":"10.1109/TAIC-PART.2006.20","DOIUrl":"https://doi.org/10.1109/TAIC-PART.2006.20","url":null,"abstract":"This paper presents data from a study of the current state of practice of software testing. Test managers from twelve different software organizations were interviewed. The interviews focused on the amount of resources spent on testing, how the testing is conducted, and the knowledge of the personnel in the test organizations. The data indicate that the overall test maturity is low. Test managers are aware of this but have trouble improving. One problem is that the organizations are commercially successful, suggesting that products must already be \"good enough\". Also, the current lack of structured testing in practice makes it difficult to quantify the current level of maturity and thereby articulate the potential gain from increasing testing maturity to upper management and developers","PeriodicalId":441264,"journal":{"name":"Testing: Academic & Industrial Conference - Practice And Research Techniques (TAIC PART'06)","volume":"86 1","pages":"0"},"PeriodicalIF":0.0,"publicationDate":"2006-08-29","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"116286316","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
{"title":"Empirical Assessment of Test-First Approach","authors":"Liang Huang, M. Holcombe","doi":"10.1109/TAIC-PART.2006.7","DOIUrl":"https://doi.org/10.1109/TAIC-PART.2006.7","url":null,"abstract":"The test-first approach, which is based on an iterative process of \"setting up test cases, implementing the functionality, and having all test cases passed\", has been put forward for decades however knowledge on test-first approach is limited. This research abstract states the limitations that previous studies in this area have, describes a controlled experiment with undergraduate students in the context of Sheffield Software Engineering Observatory (SSEO) environment to investigate the distinction between test-first and test-last approach (traditional approach), presents research questions and hypotheses set up before the experiment from the quality and productivity perspective, and expounds methods of data collection and validation","PeriodicalId":441264,"journal":{"name":"Testing: Academic & Industrial Conference - Practice And Research Techniques (TAIC PART'06)","volume":"72 1","pages":"0"},"PeriodicalIF":0.0,"publicationDate":"2006-08-29","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"121619345","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
{"title":"Delayed Failures in Software Using High Volume Automated Testing","authors":"J. Gardiner","doi":"10.1109/TAIC-PART.2006.6","DOIUrl":"https://doi.org/10.1109/TAIC-PART.2006.6","url":null,"abstract":"The research described studies delayed failures in software using high volume automated testing (HVAT) and investigates the effectiveness of different HVAT techniques; such techniques include genetic algorithms, model-based testing, penetration testing, robustness testing, and random (stochastic) testing. A delayed failure is a failure that occurs some time after the conditions that lead to the failure are applied. There appear to be no studies of delayed failures of software in the literature and no comparative studies of the effectiveness of different HVAT techniques; therefore research in this area can make an important contribution. Delayed failures in software are unlikely to be revealed by conventional testing techniques; a HVAT technique that systematically reveals delayed failures could lead to improved reliability of software and reduced costs. Experimental work is in progress using the MySQL database server as the software under test","PeriodicalId":441264,"journal":{"name":"Testing: Academic & Industrial Conference - Practice And Research Techniques (TAIC PART'06)","volume":"97 1","pages":"0"},"PeriodicalIF":0.0,"publicationDate":"2006-08-29","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"127671324","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
P. Baker, Dominic Evans, J. Grabowski, Helmut Neukirchen, Benjamin Zeiss
{"title":"TRex - The Refactoring and Metrics Tool for TTCN-3 Test Specifications","authors":"P. Baker, Dominic Evans, J. Grabowski, Helmut Neukirchen, Benjamin Zeiss","doi":"10.1109/TAIC-PART.2006.35","DOIUrl":"https://doi.org/10.1109/TAIC-PART.2006.35","url":null,"abstract":"Comprehensive testing of modern communication systems often requires large and complex test suites which then have to be maintained throughout the system life-cycle. Industrial experience, with those written in the standardised testing and test control notation (TTCN-3), has shown that this maintenance is a non-trivial task and its burden could be reduced if appropriate tool support existed. To this aim, Motorola has collaborated with the University of Gottingen to develop TRex, a TTCN-3 development environment published under the Eclipse Public License, which notably provides suitable metrics and refactorings to enable the assessment and automatic restructuring of test suites. In this paper we present the TRex tool, which will make it far easier to construct and maintain TTCN-3 tests that are concise and optimally balanced with respect to readability, usability, and maintainability","PeriodicalId":441264,"journal":{"name":"Testing: Academic & Industrial Conference - Practice And Research Techniques (TAIC PART'06)","volume":"15 1","pages":"0"},"PeriodicalIF":0.0,"publicationDate":"2006-08-29","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"134200875","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}