{"title":"Predicting good requirements for in-house development projects","authors":"J. Verner, Karl Cox, S. Bleistein","doi":"10.1145/1159733.1159758","DOIUrl":"https://doi.org/10.1145/1159733.1159758","url":null,"abstract":"We surveyed software practitioners regarding software development practices used during recent projects. Five categories of questions broadly related to requirements were asked: the sponsor, customer/users, requirements issues, the project manager and project management, and the development process. Relationships between project factors and good requirements were investigated. We developed requirements prediction equations by dividing our response data into two data sets. Using binary logistic regression on each set we tested the equations developed. Such analysis provides us with insight into which variables are significant predictors of good requirements. The best predictors were 1) the customers/users had a high level of confidence in the development team, with 2) risks were controlled and managed by the project manager.","PeriodicalId":201305,"journal":{"name":"International Symposium on Empirical Software Engineering","volume":"34 1","pages":"0"},"PeriodicalIF":0.0,"publicationDate":"2006-09-21","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"133646909","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
{"title":"Is there a future for empirical software engineering?","authors":"V. Basili","doi":"10.1145/1159733.1159735","DOIUrl":"https://doi.org/10.1145/1159733.1159735","url":null,"abstract":"This talk provides a personal perspective on the evolution of empirical software engineering. The evolution has included the focus of the studies, e.g., from attempting to demonstrate the effectiveness of various processes to the building of knowledge around a domain or a set of processes. The study designs have changed from strictly quantitative studies to all forms of controlled experiments, quasi-experiments, preexperimental designs, case studies, field studies, and focus group activities. There has been recognition of the importance and influence of context variables and the domain in interpreting the results of studies. The issue of meta-analysis has become more important and is still an elusive goal. A community of empiricists has evolved that allows for the replication of studies leading to the identification of context variables.But there still does not exist a community consensus on the right ways to build bodies of knowledge or a \"blessed\" set of approaches. We argue over what is appropriate evidence when we review papers. We struggle with the concept of experimental replication. We do not know how to break an empirical study into significant small enough chunks for publication in the various standard forums. We have not convinced the software engineering community that empirical study is a necessary or even valuable research paradigm for the field.What other problems that remain? How can they be solved? What will the future hold for empirical study? This talk will address these issues and propose a possible path towards a mature empirical software engineering discipline.","PeriodicalId":201305,"journal":{"name":"International Symposium on Empirical Software Engineering","volume":"1 1","pages":"0"},"PeriodicalIF":0.0,"publicationDate":"2006-09-21","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"130947788","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
Odd Petter N. Slyngstad, Anita Gupta, R. Conradi, Parastoo Mohagheghi, Harald Rønneberg, E. Landre
{"title":"An empirical study of developers views on software reuse in statoil ASA","authors":"Odd Petter N. Slyngstad, Anita Gupta, R. Conradi, Parastoo Mohagheghi, Harald Rønneberg, E. Landre","doi":"10.1145/1159733.1159770","DOIUrl":"https://doi.org/10.1145/1159733.1159770","url":null,"abstract":"In this article, we describe the results from our survey in the ITdepartment of a large Oil and Gas company in Norway (Statoil ASA), in order to characterize developers' views on software reuse. We have used a survey followed by semi-structured interviews, investigating software reuse in relation to requirements (re)negotiation, value of component information repository, component understanding and quality attribute specifications. All 16 developers participated in the survey and filled in the questionnaire based on their experience and views on software reuse. Our study focuses on components built and reused in-house. The results show that reuse benefits from the developers view include lower costs, shorter development time, higher quality of the reusable components and a standardized architecture. Component information repositories can contribute to successful software reuse However, we found no relation between reuse and increased rework. Component understanding was generally sufficient, but documentation could be improved. A key point here is dynamic and interactive documents. Finally, quality attribute specifications were trusted for the applications using reusable components in new development, but not for the reusable components themselves.","PeriodicalId":201305,"journal":{"name":"International Symposium on Empirical Software Engineering","volume":"12 1","pages":"0"},"PeriodicalIF":0.0,"publicationDate":"2006-09-21","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"114393171","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
{"title":"An empirical comparison between pair development and software inspection in Thailand","authors":"Monvorath Phongpaibul, B. Boehm","doi":"10.1145/1159733.1159749","DOIUrl":"https://doi.org/10.1145/1159733.1159749","url":null,"abstract":"Although pair programming and software inspection have the common aim of minimizing the defects of the software product, each practice has its strengths and weaknesses. We need to understand their costs and benefits under given conditions to be able to select a practice to execute in a development project. The objective of this study is to compare the commonalities and differences between pair development and software inspection as verification techniques in Thailand. One classroom experiment and one industry experiment were conducted. The development effort and effect of quality were investigated with some additional calendar time comparisons. The classroom results showed that average development effort of the pair development group was 24% less than inspection group with the improved product quality. The industry experiment showed pair development to have about 4% more effort but about 40% fewer major defects. In addition, the impacts of cultural differences to the adoption of pair programming or software inspection in Thailand are discussed.","PeriodicalId":201305,"journal":{"name":"International Symposium on Empirical Software Engineering","volume":"242 1","pages":"0"},"PeriodicalIF":0.0,"publicationDate":"2006-09-21","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"121330781","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
{"title":"Eliciting better quality architecture evaluation scenarios: a controlled experiment on top-down vs. bottom-up","authors":"M. Babar, S. Biffl","doi":"10.1145/1159733.1159779","DOIUrl":"https://doi.org/10.1145/1159733.1159779","url":null,"abstract":"Scenarios are extensively used in software architecture evaluation. These scenarios are elicited from stakeholders using either a topdown or bottom-up approach. The former approach uses categorization schemes to focus stakeholders on developing scenarios for each required category. The latter approach uses brainstorming without any explicit categories of scenarios. It is claimed that top-down approach can result in improved quality of scenarios. However, there has been no empirical evidence on the relative effectiveness of the scenario elicitation techniques. In this paper we report on a controlled experiment with 24 subjects (postgraduate and final year undergraduate students with industry experience) in an academic context with the goal to assess the relative effectiveness of the two scenario elicitation approaches. Two groups developed scenarios to characterize quality attributes: the treatment group was given software change categories, the control group was not. The outcome variable was the quality of the scenarios produced by each participant. The average quality score for individual scenario profiles in the treatment group was significantly greater than the control group. All participants using the change categories reported that the knowledge of change categories helped them develop better quality scenarios. Our results support the claim that the provision of domainspecific software change categories helps generate better quality scenarios.","PeriodicalId":201305,"journal":{"name":"International Symposium on Empirical Software Engineering","volume":"10 1","pages":"0"},"PeriodicalIF":0.0,"publicationDate":"2006-09-21","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"122758721","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
{"title":"The evolution of FreeBSD and linux","authors":"C. Izurieta, J. Bieman","doi":"10.1145/1159733.1159765","DOIUrl":"https://doi.org/10.1145/1159733.1159765","url":null,"abstract":"Is the nature of Open Source Software (OSS) evolution fundamentally different from that of the traditional and commercially available software systems? Lehman and others conducted a series of empirical studies that found that traditional systems grow at a linear or sub-linear rate. A prior case study of the Linux OSS system suggests that OSS may evolve in a unique manner. Godfrey and Tu found that some aspects of Linux are growing at a super-linear rate rather than a sub-linear rate. Additional studies are necessary before drawing conclusions. Thus, we examine the evolution of FreeBSD and re-analyze the evolution of Linux, and find evidence that the growth of both systems has a linear upper bound, and thus appear to grow at similar rates to that of commercial systems. These results do not support the hypothesis that OSS systems grow at rates that exceed that of traditional systems.","PeriodicalId":201305,"journal":{"name":"International Symposium on Empirical Software Engineering","volume":"79 1","pages":"0"},"PeriodicalIF":0.0,"publicationDate":"2006-09-21","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"131444551","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
{"title":"Predicting fault-prone components in a java legacy system","authors":"E. Arisholm, L. Briand","doi":"10.1145/1159733.1159738","DOIUrl":"https://doi.org/10.1145/1159733.1159738","url":null,"abstract":"This paper reports on the construction and validation of faultproneness prediction models in the context of an object-oriented, evolving, legacy system. The goal is to help QA engineers focus their limited verification resources on parts of the system likely to contain faults. A number of measures including code quality, class structure, changes in class structure, and the history of class-level changes and faults are included as candidate predictors of class fault-proneness. A cross-validated classification analysis shows that the obtained model has less than 20% of false positives and false negatives, respectively. However, as shown in this paper, statistics regarding the classification accuracy tend to inflate the potential usefulness of the fault-proneness prediction models. We thus propose a simple and pragmatic methodology for assessing the costeffectiveness of the predictions to focus verification effort. On the basis of the cost-effectiveness analysis we show that change and fault data from previous releases is paramount to developing a practically useful prediction model. When our model is applied to predict faults in a new release, the estimated potential savings in verification effort is about 29%. In contrast, the estimated savings in verification effort drops to 0% when history data is not included.","PeriodicalId":201305,"journal":{"name":"International Symposium on Empirical Software Engineering","volume":"405 1","pages":"0"},"PeriodicalIF":0.0,"publicationDate":"2006-09-21","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"128934888","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
{"title":"Successful software project and products: An empirical investigation","authors":"Richard Berntsson-Svensson, A. Aurum","doi":"10.1145/1159733.1159757","DOIUrl":"https://doi.org/10.1145/1159733.1159757","url":null,"abstract":"The circumstances surrounding the success and failure of software projects have been a topic of discussion among both practitioners and researchers for many years. A classical definition of project success is one that is within budget and on time. Some of the most common factors identified in the literature as leading to software project success are user involvement, management support and realistic requirements. Studies have indicated that managers have different perceptions from software practitioners when it comes to defining a successful software project. The observation of this difference of opinions has led us to the question: Could there be different perceptions about what effect various factors have on software project success among different industries? This paper presents an empirical study. Firstly, it begins with a detailed investigation of software product and project success factors. Secondly, it examines success factors for software projects and products across a selection of different industries, based on data collected from companies in Sweden and Australia. Thirdly, it studies how practitioners in industry define success factors for software projects and products.","PeriodicalId":201305,"journal":{"name":"International Symposium on Empirical Software Engineering","volume":"456 1","pages":"0"},"PeriodicalIF":0.0,"publicationDate":"2006-09-21","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"125794943","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
{"title":"Comparing the fault-proneness of new and modified code: an industrial case study","authors":"Piotr Tomaszewski, Lars-Ola Damm","doi":"10.1145/1159733.1159737","DOIUrl":"https://doi.org/10.1145/1159733.1159737","url":null,"abstract":"Faults are considered as one of the important factors affecting the cost of software development projects. To be able to efficiently handle faults, we must increase our understanding of the factors that make the code fault-prone. A majority of large software systems evolve during their lifetime. In each new release of the system the functionality can be added by writing new classes or/and by modifying already existing ones. In this study we compared the fault-proneness of new and modified classes in such systems. Our study is based on two releases of two large telecommunication systems developed at Ericsson. The major finding of the study is that the risk of introducing faults (the number of faults in the class /the number of new or modified lines of code in the class) is 20 to 40 times as high in modified classes compared to new ones. In the systems which we analyzed a small modification (a few percent) of the class resulted in as many faults as we would expect when the same class was written from scratch. Previous research on this relationship does not appear to exist. Partly in conflict with related research, we found that there is no statistically significant difference between the average number of faults in modified and new classes, and that the average fault-densities (the number of faults/the size of the entire class) in new and in modified classes are very similar. Finally, we also suggest how our findings can be used in practice.","PeriodicalId":201305,"journal":{"name":"International Symposium on Empirical Software Engineering","volume":"1 1","pages":"0"},"PeriodicalIF":0.0,"publicationDate":"2006-09-21","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"125843402","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
{"title":"Why People Believe Weird Things: Science, Pseudoscience, and Critical Thinking","authors":"M. Shermer","doi":"10.1109/ISESE.2004.1334888","DOIUrl":"https://doi.org/10.1109/ISESE.2004.1334888","url":null,"abstract":"Dr. Michael Shermer, publisher of Skeptic magazine and a monthly columnist for Scientific American, presents his most popular lecture on science, pseudoscience, and superstitions, explaining mysteries and exploring the psychology of why people believe them. In the process, Dr. Shermer will consider how science works by looking at how it does not work. Dr. Michael Shermer is the Founding Publisher of Skeptic magazine, he Director of the Skeptics Society, a monthly columnist for Scientific American, the host of the Skeptics Distinguished Science Lecture Series at the California Institute of Technology (Caltech), and the co-host and producer of the 13-hour Fox Family television series, Exploring the Unknown. He is the author of The Science of Good and Evil: Why People Cheat, Gossip, Share Care, and Follow the Golden Rule on the evolutionary origins of morality and how to be good without God. He wrote a biography, In Darwins Shadow, about the life and science of the codiscoverer of natural selection, Alfred Russel Wallace. He also wrote The Borderlands of Science, about the fuzzy land between science and pseudoscience, and Denying History, on Holocaust denial and other forms of pseudohistory. His book How We Believe: Science, Skepticism, and the Search for God, presents his theory on the origins of religion and why people believe in God. He is also the author of Why People Believe Weird Things on pseudoscience, superstitions, and other confusions of our time.","PeriodicalId":201305,"journal":{"name":"International Symposium on Empirical Software Engineering","volume":"51 1","pages":"0"},"PeriodicalIF":0.0,"publicationDate":"1900-01-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"126573359","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}