{"title":"经验软件工程有未来吗?","authors":"V. Basili","doi":"10.1145/1159733.1159735","DOIUrl":null,"url":null,"abstract":"This talk provides a personal perspective on the evolution of empirical software engineering. The evolution has included the focus of the studies, e.g., from attempting to demonstrate the effectiveness of various processes to the building of knowledge around a domain or a set of processes. The study designs have changed from strictly quantitative studies to all forms of controlled experiments, quasi-experiments, preexperimental designs, case studies, field studies, and focus group activities. There has been recognition of the importance and influence of context variables and the domain in interpreting the results of studies. The issue of meta-analysis has become more important and is still an elusive goal. A community of empiricists has evolved that allows for the replication of studies leading to the identification of context variables.But there still does not exist a community consensus on the right ways to build bodies of knowledge or a \"blessed\" set of approaches. We argue over what is appropriate evidence when we review papers. We struggle with the concept of experimental replication. We do not know how to break an empirical study into significant small enough chunks for publication in the various standard forums. We have not convinced the software engineering community that empirical study is a necessary or even valuable research paradigm for the field.What other problems that remain? How can they be solved? What will the future hold for empirical study? This talk will address these issues and propose a possible path towards a mature empirical software engineering discipline.","PeriodicalId":201305,"journal":{"name":"International Symposium on Empirical Software Engineering","volume":"1 1","pages":"0"},"PeriodicalIF":0.0000,"publicationDate":"2006-09-21","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":"12","resultStr":"{\"title\":\"Is there a future for empirical software engineering?\",\"authors\":\"V. Basili\",\"doi\":\"10.1145/1159733.1159735\",\"DOIUrl\":null,\"url\":null,\"abstract\":\"This talk provides a personal perspective on the evolution of empirical software engineering. The evolution has included the focus of the studies, e.g., from attempting to demonstrate the effectiveness of various processes to the building of knowledge around a domain or a set of processes. The study designs have changed from strictly quantitative studies to all forms of controlled experiments, quasi-experiments, preexperimental designs, case studies, field studies, and focus group activities. There has been recognition of the importance and influence of context variables and the domain in interpreting the results of studies. The issue of meta-analysis has become more important and is still an elusive goal. A community of empiricists has evolved that allows for the replication of studies leading to the identification of context variables.But there still does not exist a community consensus on the right ways to build bodies of knowledge or a \\\"blessed\\\" set of approaches. We argue over what is appropriate evidence when we review papers. We struggle with the concept of experimental replication. We do not know how to break an empirical study into significant small enough chunks for publication in the various standard forums. We have not convinced the software engineering community that empirical study is a necessary or even valuable research paradigm for the field.What other problems that remain? How can they be solved? What will the future hold for empirical study? This talk will address these issues and propose a possible path towards a mature empirical software engineering discipline.\",\"PeriodicalId\":201305,\"journal\":{\"name\":\"International Symposium on Empirical Software Engineering\",\"volume\":\"1 1\",\"pages\":\"0\"},\"PeriodicalIF\":0.0000,\"publicationDate\":\"2006-09-21\",\"publicationTypes\":\"Journal Article\",\"fieldsOfStudy\":null,\"isOpenAccess\":false,\"openAccessPdf\":\"\",\"citationCount\":\"12\",\"resultStr\":null,\"platform\":\"Semanticscholar\",\"paperid\":null,\"PeriodicalName\":\"International Symposium on Empirical Software Engineering\",\"FirstCategoryId\":\"1085\",\"ListUrlMain\":\"https://doi.org/10.1145/1159733.1159735\",\"RegionNum\":0,\"RegionCategory\":null,\"ArticlePicture\":[],\"TitleCN\":null,\"AbstractTextCN\":null,\"PMCID\":null,\"EPubDate\":\"\",\"PubModel\":\"\",\"JCR\":\"\",\"JCRName\":\"\",\"Score\":null,\"Total\":0}","platform":"Semanticscholar","paperid":null,"PeriodicalName":"International Symposium on Empirical Software Engineering","FirstCategoryId":"1085","ListUrlMain":"https://doi.org/10.1145/1159733.1159735","RegionNum":0,"RegionCategory":null,"ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"","JCRName":"","Score":null,"Total":0}
Is there a future for empirical software engineering?
This talk provides a personal perspective on the evolution of empirical software engineering. The evolution has included the focus of the studies, e.g., from attempting to demonstrate the effectiveness of various processes to the building of knowledge around a domain or a set of processes. The study designs have changed from strictly quantitative studies to all forms of controlled experiments, quasi-experiments, preexperimental designs, case studies, field studies, and focus group activities. There has been recognition of the importance and influence of context variables and the domain in interpreting the results of studies. The issue of meta-analysis has become more important and is still an elusive goal. A community of empiricists has evolved that allows for the replication of studies leading to the identification of context variables.But there still does not exist a community consensus on the right ways to build bodies of knowledge or a "blessed" set of approaches. We argue over what is appropriate evidence when we review papers. We struggle with the concept of experimental replication. We do not know how to break an empirical study into significant small enough chunks for publication in the various standard forums. We have not convinced the software engineering community that empirical study is a necessary or even valuable research paradigm for the field.What other problems that remain? How can they be solved? What will the future hold for empirical study? This talk will address these issues and propose a possible path towards a mature empirical software engineering discipline.