Hye-young Lee, Ho-Won Jung, Chang-shin Chung, Jong Moo Lee, Kyung Whan Lee, Hack Jong Jeong
{"title":"基于ISO/IEC 15504的软件过程评估中互解释器一致性分析","authors":"Hye-young Lee, Ho-Won Jung, Chang-shin Chung, Jong Moo Lee, Kyung Whan Lee, Hack Jong Jeong","doi":"10.1109/APAQS.2001.990039","DOIUrl":null,"url":null,"abstract":"The emerging ISO/IEC 15504 standard provides a framework and a model for software process assessment and improvement. There are two requirements for reliable process assessment: internal reliability and external reliability. The objective of the study is to provide an empirical case of external reliability, i.e. the interrater agreement in ISO/IEC 15504-based software process assessment. Interrater agreement implies the extent to which independent assessors agree in their ratings of software process attributes. Our dataset was from two assessments conducted using the ISO/IEC 15504 standard. The results showed \"substantial\" to \"excellent\" agreement. This implies that the two assessments acquired external reliability.","PeriodicalId":145151,"journal":{"name":"Proceedings Second Asia-Pacific Conference on Quality Software","volume":"193 1","pages":"0"},"PeriodicalIF":0.0000,"publicationDate":"2001-12-10","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":"24","resultStr":"{\"title\":\"Analysis of interrater agreement in ISO/IEC 15504-based software process assessment\",\"authors\":\"Hye-young Lee, Ho-Won Jung, Chang-shin Chung, Jong Moo Lee, Kyung Whan Lee, Hack Jong Jeong\",\"doi\":\"10.1109/APAQS.2001.990039\",\"DOIUrl\":null,\"url\":null,\"abstract\":\"The emerging ISO/IEC 15504 standard provides a framework and a model for software process assessment and improvement. There are two requirements for reliable process assessment: internal reliability and external reliability. The objective of the study is to provide an empirical case of external reliability, i.e. the interrater agreement in ISO/IEC 15504-based software process assessment. Interrater agreement implies the extent to which independent assessors agree in their ratings of software process attributes. Our dataset was from two assessments conducted using the ISO/IEC 15504 standard. The results showed \\\"substantial\\\" to \\\"excellent\\\" agreement. This implies that the two assessments acquired external reliability.\",\"PeriodicalId\":145151,\"journal\":{\"name\":\"Proceedings Second Asia-Pacific Conference on Quality Software\",\"volume\":\"193 1\",\"pages\":\"0\"},\"PeriodicalIF\":0.0000,\"publicationDate\":\"2001-12-10\",\"publicationTypes\":\"Journal Article\",\"fieldsOfStudy\":null,\"isOpenAccess\":false,\"openAccessPdf\":\"\",\"citationCount\":\"24\",\"resultStr\":null,\"platform\":\"Semanticscholar\",\"paperid\":null,\"PeriodicalName\":\"Proceedings Second Asia-Pacific Conference on Quality Software\",\"FirstCategoryId\":\"1085\",\"ListUrlMain\":\"https://doi.org/10.1109/APAQS.2001.990039\",\"RegionNum\":0,\"RegionCategory\":null,\"ArticlePicture\":[],\"TitleCN\":null,\"AbstractTextCN\":null,\"PMCID\":null,\"EPubDate\":\"\",\"PubModel\":\"\",\"JCR\":\"\",\"JCRName\":\"\",\"Score\":null,\"Total\":0}","platform":"Semanticscholar","paperid":null,"PeriodicalName":"Proceedings Second Asia-Pacific Conference on Quality Software","FirstCategoryId":"1085","ListUrlMain":"https://doi.org/10.1109/APAQS.2001.990039","RegionNum":0,"RegionCategory":null,"ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"","JCRName":"","Score":null,"Total":0}
Analysis of interrater agreement in ISO/IEC 15504-based software process assessment
The emerging ISO/IEC 15504 standard provides a framework and a model for software process assessment and improvement. There are two requirements for reliable process assessment: internal reliability and external reliability. The objective of the study is to provide an empirical case of external reliability, i.e. the interrater agreement in ISO/IEC 15504-based software process assessment. Interrater agreement implies the extent to which independent assessors agree in their ratings of software process attributes. Our dataset was from two assessments conducted using the ISO/IEC 15504 standard. The results showed "substantial" to "excellent" agreement. This implies that the two assessments acquired external reliability.