{"title":"Actionable = Cluster + Contrast?","authors":"R. Krishna, T. Menzies","doi":"10.1109/ASEW.2015.23","DOIUrl":"https://doi.org/10.1109/ASEW.2015.23","url":null,"abstract":"There are many algorithms for data classification such as C4.5, Naive Bayes, etc. Are these enough for learning actionable analytics? Or should we be supporting another kind of reasoning? This paper explores two approaches for learning minimal, yet effective, changes to software project artifacts.","PeriodicalId":300686,"journal":{"name":"2015 30th IEEE/ACM International Conference on Automated Software Engineering Workshop (ASEW)","volume":"32 1","pages":"0"},"PeriodicalIF":0.0,"publicationDate":"2015-11-09","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"133971566","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
{"title":"Towards Automatic Constraint Elicitation in Test Design: Preliminary Evaluation Based on Collective Intelligence","authors":"Hiroyuki Nakagawa, Tatsuhiro Tsuchiya","doi":"10.1109/ASEW.2015.13","DOIUrl":"https://doi.org/10.1109/ASEW.2015.13","url":null,"abstract":"Constraint elicitation is an important process in test design since constraints determine the test space, however, the constraint elicitation process, which is known as a daunting task, has not been well studied. It usually requires manual capturing and precise definition of constraints. In this paper, we try to automate a part of the constraint elicitation process in combinatorial test design. Pair-wise testing, a common combinatorial testing approach, is an effective test planning technique for finding interaction faults using a small set of test cases. We propose a collective intelligence approach to determining which value combinations are potential constraints. We conduct preliminary experiments on two examples, a traditional cross-browser testing example and an ATM system example, and evaluate the feasibility of our approach.","PeriodicalId":300686,"journal":{"name":"2015 30th IEEE/ACM International Conference on Automated Software Engineering Workshop (ASEW)","volume":"33 1","pages":"0"},"PeriodicalIF":0.0,"publicationDate":"2015-11-09","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"133073320","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
{"title":"Which of My Failures are Real? Using Relevance Ranking to Raise True Failures to the Top","authors":"Zebao Gao, A. Memon","doi":"10.1109/ASEW.2015.7","DOIUrl":"https://doi.org/10.1109/ASEW.2015.7","url":null,"abstract":"GUI reference testing is performed to detect regression errors in a modified or patched GUI software. Test cases are executed on the original and modified GUIs, differences in the states of GUI widgets across versions indicate potential defects. However, various factors (e.g., position, flakiness, resolution) create problems for accurate GUI state collection, leading to spurious state mismatches, and hence false positives, these need to be weeded out manually. In this paper, we show that the problem of false positives is significant, often inundating the tester with a large number of false bug reports, requiring a disproportionate amount of manual effort. We develop an entropy-based approach to rank each GUI widget property, and use it to determine whether a state mismatch (indicative of a bug) is real or a false positive. Our empirical evaluation shows that this ranking helps to percolate real bugs to the top of a set of reported bugs, thereby helping to economize tester time.","PeriodicalId":300686,"journal":{"name":"2015 30th IEEE/ACM International Conference on Automated Software Engineering Workshop (ASEW)","volume":"34 1","pages":"0"},"PeriodicalIF":0.0,"publicationDate":"2015-11-09","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"134433699","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
{"title":"A Method to Evaluate Estimates Produced by the Capture-Recapture Model","authors":"Guoping Rong, He Zhang, Dong Shao, Ou Wu","doi":"10.1109/ASEW.2015.26","DOIUrl":"https://doi.org/10.1109/ASEW.2015.26","url":null,"abstract":"The capture-recapture techniques could be used for post-inspection estimation of residual defects in the inspected software artifacts. However, adoption this approach in real world software inspections may still face several challenges. On one hand, most of the capture-recapture estimators could easily produce extreme estimates on residual defects, on the other, there are very limited studies on the evaluation on the estimates so as to identify these extreme estimates. As a result, quality management decisions(e.g., whether a re-inspection is required) rely on the estimates produced by the capture-recapture techniques may possess high risk of mistakes. In this paper, we propose and verify an approach to evaluate the capture-recapture estimates, which could help practitioners identify extreme estimates to a certain degree.","PeriodicalId":300686,"journal":{"name":"2015 30th IEEE/ACM International Conference on Automated Software Engineering Workshop (ASEW)","volume":"33 1","pages":"0"},"PeriodicalIF":0.0,"publicationDate":"2015-11-09","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"124143224","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
Ryan Serva, Zachary R. Senzer, L. Pollock, K. Vijay-Shanker, vijay pollock
{"title":"Automatically Mining Negative Code Examples from Software Developer Q & A Forums","authors":"Ryan Serva, Zachary R. Senzer, L. Pollock, K. Vijay-Shanker, vijay pollock","doi":"10.1109/ASEW.2015.10","DOIUrl":"https://doi.org/10.1109/ASEW.2015.10","url":null,"abstract":"In addition to learning good practices and reusing code from mining code examples, programmers can be supported in their learning and code improvement processes through negative, or poorly written, code examples. While it is challenging to identify negative code examples automatically from within source code, we leverage a key insight that the natural language in questions that include code examples posted on forums can provide adequate clues. In this paper, we describe an automatic sentiment analysis-based technique for mining negative code examples from developer question and answer forums along with a technique to automatically mine negative sentiment indicators commonly used by developers, which are used to drive the sentiment-based technique.","PeriodicalId":300686,"journal":{"name":"2015 30th IEEE/ACM International Conference on Automated Software Engineering Workshop (ASEW)","volume":"37 1","pages":"0"},"PeriodicalIF":0.0,"publicationDate":"2015-11-09","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"116788684","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
{"title":"Software Development Analytics: Experiences and the Way Forward","authors":"Vikrant S. Kaulgud, V. Sharma","doi":"10.1109/ASEW.2015.25","DOIUrl":"https://doi.org/10.1109/ASEW.2015.25","url":null,"abstract":"Software development analytics plays an important role in bridging the gap between purely process-centric software development management and the on-ground realities resulting from the inherent complexities of software development. Lack of high-fidelity data, potential data manipulation by humans, absence of real-time / near real-time analysis and sub-optimal insights design causes issues in governing software development. We have worked with development projects to understand the gaps, and design insights and tools for offering early warnings to different project stakeholders. In this paper, we discuss our approach to designing a insights framework and learning from pilots with industrial software development projects. Going forward our work is influenced by changes in technology and new workforce models. We present them, as they would have a significant impact on the future actionable insights research.","PeriodicalId":300686,"journal":{"name":"2015 30th IEEE/ACM International Conference on Automated Software Engineering Workshop (ASEW)","volume":"155 1","pages":"0"},"PeriodicalIF":0.0,"publicationDate":"2015-11-09","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"114797607","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
{"title":"Empirical Analysis on Parallel Tasks in Crowdsourcing Software Development","authors":"R. Saremi, Ye Yang","doi":"10.1109/ASEW.2015.22","DOIUrl":"https://doi.org/10.1109/ASEW.2015.22","url":null,"abstract":"Crowdsourcing has become a popular option for rapid acquisition, with reported benefits such as shortened schedule due to mass parallel development, innovative solutions based on the \"wisdom of crowds\", and reduced cost due to the pre-pricing and bidding effects. However, most of existing studies on software crowdsourcing are focusing on individual task level, providing limited insights on the practice as well as outcomes at overall project level. To develop better understanding of crowdsourcing-based software projects, this paper reports an empirical study on analyzing four largest projects on Topcoder platform that intensively leverage crowdsourcing throughout the product implementation, testing, and assembly phases. The analysis results conclude that: (1) crowdsourcing task scheduling follows typical patterns including prototyping, component development, bug hunt, and assembly and coding (2) budget phase distribution patterns does not following traditional patterns, and uploading task rate is not representing same budget rate associated with them as about 75% of uploaded tasks would price under 67% of total project budget, (3) Higher degree of parallelism would lead to higher demand for competing on tasks and shorter planning schedule to complete the project consequently better resource allocation.","PeriodicalId":300686,"journal":{"name":"2015 30th IEEE/ACM International Conference on Automated Software Engineering Workshop (ASEW)","volume":"12 1","pages":"0"},"PeriodicalIF":0.0,"publicationDate":"2015-11-09","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"126928601","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
{"title":"Probabilistic Quality Models to Improve Communication and Actionability","authors":"Morgan Ericsson, Welf Löwe, Anna Wingkvist","doi":"10.1109/ASEW.2015.16","DOIUrl":"https://doi.org/10.1109/ASEW.2015.16","url":null,"abstract":"We need to aggregate metric values to make quality assessment actionable. However, due to properties of metric values, i.e., unknown distributions and different measurement scales, they are difficult to aggregate. We present and evaluate a method to aggregate metric values based on observed numerical distributions that are converted into cumulative density functions. We use these to determine the probability of each metric and file, and aggregate these. Our limited study suggests that the method improves correctness, communication, and the ability to take action. However, more evaluation is required.","PeriodicalId":300686,"journal":{"name":"2015 30th IEEE/ACM International Conference on Automated Software Engineering Workshop (ASEW)","volume":"96 1","pages":"0"},"PeriodicalIF":0.0,"publicationDate":"2015-11-09","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"132702285","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
Domenico Amalfitano, Nicola Amatucci, A. R. Fasolino, Porfirio Tramontana
{"title":"A Conceptual Framework for the Comparison of Fully Automated GUI Testing Techniques","authors":"Domenico Amalfitano, Nicola Amatucci, A. R. Fasolino, Porfirio Tramontana","doi":"10.1109/ASEW.2015.19","DOIUrl":"https://doi.org/10.1109/ASEW.2015.19","url":null,"abstract":"Fully automated GUI testing techniques play an important role in the modern software development life cycles. These techniques are implemented by algorithms that automatically traverse the GUI by interacting with it, like robots discovering unexplored spaces. These algorithms are able to define and run test cases on the fly, while the application is in execution. Testing adequacy, performance or costs of such techniques may differ on the basis of different factors. In this paper we will propose an approach for comparing fully automated GUI testing techniques in a systematic manner. The approach is based on a generalized parametric algorithm that abstracts the key aspects of these techniques and provides a conceptual framework that can be used to define and compare different testing approaches. To validate the framework, we exploit it to compare the testing adequacy and the GUI models inferred by 9 fully automated testing techniques obtained by varying the configuration of the algorithm. The experiment is performed on a real Android application.","PeriodicalId":300686,"journal":{"name":"2015 30th IEEE/ACM International Conference on Automated Software Engineering Workshop (ASEW)","volume":"101 1","pages":"0"},"PeriodicalIF":0.0,"publicationDate":"2015-11-09","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"125797301","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
{"title":"Testing Approach for Mobile Applications through Reverse Engineering of UI Patterns","authors":"Ines Coimbra Morgado, A. C. Paiva","doi":"10.1109/ASEW.2015.11","DOIUrl":"https://doi.org/10.1109/ASEW.2015.11","url":null,"abstract":"It is increasingly important to assess and ensure the correct behaviour of mobile applications as their importance in everyday life keeps increasing. This paper presents an automatic testing approach combining reverse engineering with testing. The algorithm tries to identify existing User Interface (UI) patterns on a mobile application under test through a reverse engineering process and then tests them using generic test strategies called Test Patterns. The overall testing approach was implemented in the iMPAcT (Mobile PAttern Testing) tool and is illustrated in a case study performed over some mobile applications as a proof-of-concept.","PeriodicalId":300686,"journal":{"name":"2015 30th IEEE/ACM International Conference on Automated Software Engineering Workshop (ASEW)","volume":"16 1","pages":"0"},"PeriodicalIF":0.0,"publicationDate":"2015-11-09","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"130482066","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}