{"title":"Bogor: A Flexible Framework for Creating Software Model Checkers","authors":"Robby, Matthew B. Dwyer, J. Hatcliff","doi":"10.1109/TAIC-PART.2006.5","DOIUrl":"https://doi.org/10.1109/TAIC-PART.2006.5","url":null,"abstract":"Model checking has proven to be an effective technology for verification and debugging in hardware and more recently in software domains. With the proliferation of multi-core architectures and a greater emphasis on distributed computing, model checking is an increasingly important software quality assurance technique that can complement existing testing and inspection methods. We believe that recent trends in both the requirements for software systems and the processes by which systems are developed suggests that domain-specific model checking engines may be more effective than general purpose model checking tools. To overcome limitations of existing tools which tend to be monolithic and non-extensible, we have developed an extensible and customizable model checking framework called Bogor. In this article, we summarize how Bogor provides direct support for modeling object-oriented designs and implementations, how its modeling language and algorithms can be extended and customized to create domain-specific model checking engines, and how Bogor can be deployed in broader software development contexts in conjunction with complementary quality assurance techniques","PeriodicalId":441264,"journal":{"name":"Testing: Academic & Industrial Conference - Practice And Research Techniques (TAIC PART'06)","volume":"128 1","pages":"0"},"PeriodicalIF":0.0,"publicationDate":"2006-08-29","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"117220458","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
{"title":"Improving Testing Efficiency using Cumulative Test Analysis","authors":"Ian Holden, D. Dalton","doi":"10.1109/TAIC-PART.2006.13","DOIUrl":"https://doi.org/10.1109/TAIC-PART.2006.13","url":null,"abstract":"It can be impossible to thoroughly test complex software projects with a large library of tests to be run in many environments and configurations. The cumulative test analysis (CTA) technique described reduces the time to find defects by prioritising and minimising the testing. Tests are chosen to target the product areas having the highest risk of defects. Test effectiveness, test code coverage, product code changes and changes to dependencies are monitored and analysed to prioritise the testing. Test results from build to build are accumulated. Build reports clearly identify areas at risk, test results, and the tests that must be run. Experiences with a prototype tool are discussed and conclusions drawn from the use of CTA show that defects are found sooner, more time is available for writing new tests and the focus of test execution moves towards product quality instead of simply test results","PeriodicalId":441264,"journal":{"name":"Testing: Academic & Industrial Conference - Practice And Research Techniques (TAIC PART'06)","volume":"84 1","pages":"0"},"PeriodicalIF":0.0,"publicationDate":"2006-08-29","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"115031476","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
{"title":"Generating a Test Strategy with Bayesian Networks and Common Sense","authors":"J. Gras, Rishabh Gupta, Elena Pérez-Miñana","doi":"10.1109/TAIC-PART.2006.10","DOIUrl":"https://doi.org/10.1109/TAIC-PART.2006.10","url":null,"abstract":"Testing still represents an important share of the overall development effort and, coming late in the software life cycle, it is on the critical path both from a schedule and quality perspective. In an effort to conduct smarter software testing, Motorola Labs have developed the Bayesian test assistant (BTA), an advanced decision support tool to optimize all verification and validation activities, in development and system testing. With Bayesian networks, the theory underlying BTA, Motorola Labs built a library of causal models to predict, from key process, people and product factors, the quality of artefacts at each step of the software development. In this paper we present how BTA links the predictions from development models by mapping dependencies between components or subsystems to predict the level of risk in each system feature. As a result, and well before system testing starts, BTA generates a test strategy that optimizes the writing of test cases. During system test, BTA scores test cases to select an optimum set for each test step, leading to a faster discovery of defects. We also describe how BTA was deployed on large telecomm system releases in several Motorola organizations and the improvement driven so far in system testing","PeriodicalId":441264,"journal":{"name":"Testing: Academic & Industrial Conference - Practice And Research Techniques (TAIC PART'06)","volume":"69 1","pages":"0"},"PeriodicalIF":0.0,"publicationDate":"2006-08-29","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"123803104","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
Taweesup Apiwattanapong, Raúl A. Santelices, Pavan Kumar Chittimalli, A. Orso, M. J. Harrold
{"title":"MATRIX: Maintenance-Oriented Testing Requirements Identifier and Examiner","authors":"Taweesup Apiwattanapong, Raúl A. Santelices, Pavan Kumar Chittimalli, A. Orso, M. J. Harrold","doi":"10.1109/TAIC-PART.2006.18","DOIUrl":"https://doi.org/10.1109/TAIC-PART.2006.18","url":null,"abstract":"This paper presents a new test-suite augmentation technique for use in regression testing of software. Our technique combines dependence analysis and symbolic evaluation and uses information about the changes between two versions of a program to (1) identify parts of the program affected by the changes, (2) compute the conditions under which the effects of the changes are propagated to such parts, and (3) create a set of testing requirements based on the computed information. Testers can use these requirements to assess the effectiveness of the regression testing performed so far and to guide the selection of new test cases. The paper also presents MATRIX, a tool that partially implements our technique, and its integration into a regression-testing environment. Finally, the paper presents a preliminary empirical study performed on two small programs. The study provides initial evidence of both the effectiveness of our technique and the shortcomings of previous techniques in assessing the adequacy of a test suite with respect to exercising the effect of program changes","PeriodicalId":441264,"journal":{"name":"Testing: Academic & Industrial Conference - Practice And Research Techniques (TAIC PART'06)","volume":"100 1","pages":"0"},"PeriodicalIF":0.0,"publicationDate":"2006-08-29","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"116881228","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
{"title":"Using Program Data-State Diversity in Test Data Search","authors":"M. Alshraideh, L. Bottaci","doi":"10.1109/TAIC-PART.2006.37","DOIUrl":"https://doi.org/10.1109/TAIC-PART.2006.37","url":null,"abstract":"Search-based automatic software test data generation for structural testing depends on the instrumentation of the test goal to construct a many-valued function which is then optimised. The method encounters difficulty when the search is in a region in which the function is not able to discriminate between different candidate test cases because it returns a constant value. A typical example of this problem arises in the instrumentation of branch predicates that depend on the value of a Boolean-valued (flag) variable. Existing transformation techniques can solve many cases of the problem but there are situations for which transformation techniques are inadequate. This paper presents a technique for directing the search when the function that instruments the test goal is not able to discriminate candidate test inputs. The new technique depends on introducing program data-state diversity as an additional search goal. The search is guided by a new evaluation (cost) function made up of two parts, one depends on the conventional instrumentation of the test goal, the other depends on the diversity of the data-states produced during execution of the program under test. The method is demonstrated for a number of example programs for which existing methods are inadequate","PeriodicalId":441264,"journal":{"name":"Testing: Academic & Industrial Conference - Practice And Research Techniques (TAIC PART'06)","volume":"10 1","pages":"0"},"PeriodicalIF":0.0,"publicationDate":"2006-08-29","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"117338387","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
{"title":"Incremental Inference of Black-Box Components to Support Integration Testing","authors":"Muzammil Shahbaz","doi":"10.1109/TAIC-PART.2006.14","DOIUrl":"https://doi.org/10.1109/TAIC-PART.2006.14","url":null,"abstract":"Model based testing relies on the availability of formal models that are indispensable in analyzing the complete system's behavior and testing of the key functionalities. On the other hand, the system designers of the industry are mostly relying on the integration of readymade software components (COTS) to build complex applications e.g. telecom services. Unfortunately, they are not provided with formal models or with reasonable documentation. The spirit of the thesis is to devise techniques to build formal models of black-box components, and to adopt test-generation strategies based upon the learned models to support integration testing. As a first step, we are modifying previous learning method, i.e., Angluin's algorithm to work with (extended) FSM models, which incorporates input/output parameters and predicates as well. Our framework from telecom industry focuses on methods that will be applied to large-scale components. That's why we are gradually moving towards richer models such as EFSMs","PeriodicalId":441264,"journal":{"name":"Testing: Academic & Industrial Conference - Practice And Research Techniques (TAIC PART'06)","volume":"30 1","pages":"0"},"PeriodicalIF":0.0,"publicationDate":"2006-08-29","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"130648852","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
James Miller, Michael R. Smith, Steven Daeninck, Jingwen Chen, Juan Qiao, Fang Huang, Andrew K. C. Kwan, M. Roper
{"title":"An XP Inspired Test-Oriented Life-Cycle Production Strategy for Building Embedded Biomedical Applications","authors":"James Miller, Michael R. Smith, Steven Daeninck, Jingwen Chen, Juan Qiao, Fang Huang, Andrew K. C. Kwan, M. Roper","doi":"10.1109/TAIC-PART.2006.2","DOIUrl":"https://doi.org/10.1109/TAIC-PART.2006.2","url":null,"abstract":"The construction of embedded biomedical applications is an under explored topic. The status quo is for practitioners to utilize a production process which possesses no specific focus; meanwhile, the marketplace requires highly demanding characteristics from these products. The principal requirement is that most of these products need to be effectively defect free. This demands that the production process be directed towards this objective; and hence the focus of this paper is our initial attempts at designing and implementing such a process. Our new process is developed around transforming a subset of extreme programming from the world of desktop applications into a methodology for this new domain. The paper also discusses our experiences in developing test frameworks to support the domain and our objectives. Finally, the paper provides some pointers on our future plans for tackling the many unresolved issues that still exist in attempting to fully realize and support this new development process","PeriodicalId":441264,"journal":{"name":"Testing: Academic & Industrial Conference - Practice And Research Techniques (TAIC PART'06)","volume":"77 1","pages":"0"},"PeriodicalIF":0.0,"publicationDate":"2006-08-29","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"121193791","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
{"title":"Enabling Run-Time System Verification through Built-In Testing","authors":"D. Brenner","doi":"10.1109/TAIC-PART.2006.8","DOIUrl":"https://doi.org/10.1109/TAIC-PART.2006.8","url":null,"abstract":"Today component-based technologies play an important role in system development. However, although the technologies used to define, implement, and assemble components and systems of components have improved significantly over recent years, verification techniques have not yet caught up. Correctness and reliability of component-based systems are still often checked using traditional testing techniques. These techniques are unable to use the knowledge about the structure of the systems and its components. Therefore, an approach is needed to reduce the effort involved in system testing. Clearly, the best would be to automate large parts of the testing process. Built-in tests - tests that are packaged with components - are a good basis for such an approach","PeriodicalId":441264,"journal":{"name":"Testing: Academic & Industrial Conference - Practice And Research Techniques (TAIC PART'06)","volume":"49 1","pages":"0"},"PeriodicalIF":0.0,"publicationDate":"2006-08-29","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"125235982","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
{"title":"Testing a Datawarehouse - An Industrial Challenge","authors":"H. Sneed","doi":"10.1109/TAIC-PART.2006.27","DOIUrl":"https://doi.org/10.1109/TAIC-PART.2006.27","url":null,"abstract":"This contribution is an experience report on system testing and in particular on the testing of a datawarehouse system. Datawarehouses are large databases used solely for querying and reporting purposes. The datawarehouse in question here was dedicated to fulfilling the reporting requirements of the BASEL-II agreement on the provision of auditing data by the banks, the European equivalent of the Sarbane-Oxley Act. The purpose of the testing project was to prove that the contents of the datawarehouse are correct in accordance with the rules specified to fill them. In the end, the only way to achieve this was to rewrite the rule specifications in a machine readable form and to transform them into post assertions, which could be interpreted by a data verification tool for comparison of the actual data contents with the expected data contents. The testing project was never fully completed, since not all of the rules could be properly transformed","PeriodicalId":441264,"journal":{"name":"Testing: Academic & Industrial Conference - Practice And Research Techniques (TAIC PART'06)","volume":"17 1","pages":"0"},"PeriodicalIF":0.0,"publicationDate":"2006-08-29","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"114727166","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
Mika Katara, Antti Kervinen, Mika Maunumaa, Tuula Pääkkönen, Mikko Satama
{"title":"Towards Deploying Model-Based Testing with a Domain-Specific Modeling Approach","authors":"Mika Katara, Antti Kervinen, Mika Maunumaa, Tuula Pääkkönen, Mikko Satama","doi":"10.1109/TAIC-PART.2006.34","DOIUrl":"https://doi.org/10.1109/TAIC-PART.2006.34","url":null,"abstract":"Model-based testing, automating the generation of test cases is technically superior to conventional scripted testing. However, there have been difficulties in deploying the methodology in large scale industrial context. In this paper we present a domain-specific approach to model-based GUI testing that should be easier to adopt than more generic solutions. The method is based on keywords and action words that are considered as best practices in conventional GUI test automation. The basic idea is to record GUI events just like in capture/replay tools, but instead of producing scripts that can be hard to maintain, we produce sequences of keywords. These sequences are further transformed semi-automatically into labeled transition systems where action words are used as transition labels. The action words model user behavior at a high level of abstraction while the keywords correspond to the GUI navigation. We also describe the associated tool set that we are developing and an example of using the approach","PeriodicalId":441264,"journal":{"name":"Testing: Academic & Industrial Conference - Practice And Research Techniques (TAIC PART'06)","volume":"39 1","pages":"0"},"PeriodicalIF":0.0,"publicationDate":"2006-08-29","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"131727063","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}