{"title":"Dynamic Analysis of Algebraic Structure to Optimize Test Generation and Test Case Selection","authors":"A. Simons, Wenwen Zhao","doi":"10.1109/TAICPART.2009.28","DOIUrl":"https://doi.org/10.1109/TAICPART.2009.28","url":null,"abstract":"Where no independent specification is available, object-oriented unit testing is limited to exercising all interleaved method paths, seeking unexpected failures. A recent trend in unit testing, that interleaves dynamic analysis between each test cycle, has brought useful reductions in test-set sizes by pruning redundant prefix paths. This paper describes a dynamic approach to analyzing the algebraic structure of test objects, such that prefix paths ending in observer or transformer operations yielding unchanged, or derived states may be detected and pruned on-the-fly during testing. The fewer retained test cases are so close to the ideal algebraic specification cases that a tester can afford to confirm or reject these cases interactively, which are then used as a test oracle to predict many further test outcomes during automated testing. The algebra-inspired algorithms are incorporated in the latest version of the JWalk lazy systematic unit testing tool suite, which discovers key test cases, while pruning many thousands of redundant test cases.","PeriodicalId":339626,"journal":{"name":"2009 Testing: Academic and Industrial Conference - Practice and Research Techniques","volume":"35 1","pages":"0"},"PeriodicalIF":0.0,"publicationDate":"2009-09-04","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"124012953","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
{"title":"Runtime Integration and Testing for Highly Dynamic Service Oriented ICT Solutions -- An Industry Challenges Report","authors":"Michaela Greiler, H. Groß, Khalid Adam Nasr","doi":"10.1109/TAICPART.2009.16","DOIUrl":"https://doi.org/10.1109/TAICPART.2009.16","url":null,"abstract":"Modern Information and Communications Technology (ICT) solutions are often widely distributed and highly dynamic service oriented architectures (SOA) with stringent availability requirements. Availability implies that SOA must be reconfigured, updated and maintained during runtime, while retaining their overall operational integrity. This requires that much of the adaptation, integration, configuration and testing activities typically performed offline, during development time, now have to be done online, during runtime. Current component-based runtime platforms such as SOA realize the technological foundations for runtime reconfiguration and maintenance.However, because software engineering methodology has not kept pace with the rapid leap forward in platform technology, adequate methods, techniques and tools for dealing with runtime integration and testing are not yet available.This paper discusses the industry challenges and open issues of integrating and testing SOA infrastructures during runtime.","PeriodicalId":339626,"journal":{"name":"2009 Testing: Academic and Industrial Conference - Practice and Research Techniques","volume":"59 1","pages":"0"},"PeriodicalIF":0.0,"publicationDate":"2009-09-04","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"133037139","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
{"title":"What Makes Testing Work: Nine Case Studies of Software Development Teams","authors":"Chistopher David Thomson, M. Holcombe, A. Simons","doi":"10.1109/TAICPART.2009.12","DOIUrl":"https://doi.org/10.1109/TAICPART.2009.12","url":null,"abstract":"Recently there has been a focus on test first and test driven development; several empirical studies have tried to assess the advantage that these methods give over testing after development. The results have been mixed. In this paper we investigate nine teams who tested during coding to examine the effect it had on the external quality of their code. Of the top three performing teams two used a documented testing strategy and the other an ad-hoc approach to testing. We conclude that their success appears to be related to a testing culture where the teams proactively test rather than carry out only what is required in a mechanical fashion.","PeriodicalId":339626,"journal":{"name":"2009 Testing: Academic and Industrial Conference - Practice and Research Techniques","volume":"140 1","pages":"0"},"PeriodicalIF":0.0,"publicationDate":"2009-09-04","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"132794078","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
{"title":"A Real-Time Test and Simulation Environment Based on Standard FPGA Hardware","authors":"R. Duelks, F. Salewski, S. Kowalewski","doi":"10.1109/TAICPART.2009.24","DOIUrl":"https://doi.org/10.1109/TAICPART.2009.24","url":null,"abstract":"Hardware-in-the-Loop (HiL) testing can be veryexpensive because of the high acquisition costs of the requiredhard- and software. In this paper an alternative low-costrealisation for building up a HiL Testing system is introduced.This solution is based on a standard FPGA together with anormal desktop personal computer (PC). It will be shown thatalmost all of the required features of a HiL Testing system canbe fulfilled. Furthermore, an evaluation between existing HiLsolutions and the presented low-cost solution is given whichshows that the FPGA-PC solution fulfills all requirements forcomponent tests. In conclusion, the FPGA-PC HiL solution iswell suited for component tests for electronic control units.","PeriodicalId":339626,"journal":{"name":"2009 Testing: Academic and Industrial Conference - Practice and Research Techniques","volume":"11 1","pages":"0"},"PeriodicalIF":0.0,"publicationDate":"2009-09-04","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"115805270","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
{"title":"Testing Production Systems Safely: Common Precautions in Penetration Testing","authors":"Sven Türpe, Jörn Eichler","doi":"10.1109/TAICPART.2009.17","DOIUrl":"https://doi.org/10.1109/TAICPART.2009.17","url":null,"abstract":"Unlike testing in a laboratory or test bed situation, the testing of production systems requires precautions to avoid side effects that might damage or disturb the system, its environment, or its users. This paper outlines safety precautions to be taken when testing production systems. Specifically we discuss precautions for penetration testing aiming at identifying security vulnerabilities. We generalize and document experience we gained as penetration testers, describing how the risks of testing can be mitigated through selection of test cases and techniques, partial isolation of subsystems and organizational measures. Though some of the precautions are specific to security testing, our experience might be helpful to anyone testing production systems","PeriodicalId":339626,"journal":{"name":"2009 Testing: Academic and Industrial Conference - Practice and Research Techniques","volume":"21 1","pages":"0"},"PeriodicalIF":0.0,"publicationDate":"2009-09-04","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"128649091","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}