Metamorphic Testing of Classification Program for the COVID-19 Intelligent Diagnosis

Yue Ma, Ya Pan, Yong Fan
{"title":"Metamorphic Testing of Classification Program for the COVID-19 Intelligent Diagnosis","authors":"Yue Ma, Ya Pan, Yong Fan","doi":"10.1109/DSA56465.2022.00031","DOIUrl":null,"url":null,"abstract":"The application of machine learning classification algorithms to COVID-19 for CT images assisted diagnosis not only reduces the workload of radiologists in reviewing films, but also improves the accuracy and efficiency of the assisted diagnosis results. However the instability of such machine learning models may lead to misclassification of results, and the expected output of the models may not be available due to the lack of transparency, which make the obtaining of test oracle difficultly. Thus in this paper, the metamorphic testing technique is applied to test the intelligent diagnosis classification program of COVID-19. The metamorphic relation is constructed by analyzing the characteristics of the lesion areas in the CT images of COVID-19, and compare consistency of the follow up test cases with the original test cases, that is how the failure detection rate of the program can be verified. The experimental results show that this method can detect the inconsistency of this program and it can be extended to test intelligent diagnosis classification programs of different diseases, thus further improving the accuracy of diagnosis classification programs.","PeriodicalId":208148,"journal":{"name":"2022 9th International Conference on Dependable Systems and Their Applications (DSA)","volume":"1 11","pages":"0"},"PeriodicalIF":0.0000,"publicationDate":"2022-08-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":"1","resultStr":null,"platform":"Semanticscholar","paperid":null,"PeriodicalName":"2022 9th International Conference on Dependable Systems and Their Applications (DSA)","FirstCategoryId":"1085","ListUrlMain":"https://doi.org/10.1109/DSA56465.2022.00031","RegionNum":0,"RegionCategory":null,"ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"","JCRName":"","Score":null,"Total":0}
引用次数: 1

Abstract

The application of machine learning classification algorithms to COVID-19 for CT images assisted diagnosis not only reduces the workload of radiologists in reviewing films, but also improves the accuracy and efficiency of the assisted diagnosis results. However the instability of such machine learning models may lead to misclassification of results, and the expected output of the models may not be available due to the lack of transparency, which make the obtaining of test oracle difficultly. Thus in this paper, the metamorphic testing technique is applied to test the intelligent diagnosis classification program of COVID-19. The metamorphic relation is constructed by analyzing the characteristics of the lesion areas in the CT images of COVID-19, and compare consistency of the follow up test cases with the original test cases, that is how the failure detection rate of the program can be verified. The experimental results show that this method can detect the inconsistency of this program and it can be extended to test intelligent diagnosis classification programs of different diseases, thus further improving the accuracy of diagnosis classification programs.
新型冠状病毒智能诊断分类程序的变形试验
将机器学习分类算法应用到COVID-19 CT图像辅助诊断中,不仅减少了放射科医师审查影像的工作量,而且提高了辅助诊断结果的准确性和效率。然而,这种机器学习模型的不稳定性可能导致对结果的错误分类,并且由于缺乏透明度,模型的预期输出可能无法获得,这使得测试oracle的获取变得困难。为此,本文采用变质检测技术对新型冠状病毒智能诊断分类程序进行测试。通过分析COVID-19 CT图像中病变区域的特征,构建变质关系,并比较后续测试用例与原始测试用例的一致性,从而验证程序的失败率。实验结果表明,该方法可以检测出程序的不一致性,并且可以扩展到对不同疾病的智能诊断分类程序进行测试,从而进一步提高诊断分类程序的准确性。
本文章由计算机程序翻译,如有差异,请以英文原文为准。
求助全文
约1分钟内获得全文 求助全文
来源期刊
自引率
0.00%
发文量
0
×
引用
GB/T 7714-2015
复制
MLA
复制
APA
复制
导出至
BibTeX EndNote RefMan NoteFirst NoteExpress
×
提示
您的信息不完整,为了账户安全,请先补充。
现在去补充
×
提示
您因"违规操作"
具体请查看互助需知
我知道了
×
提示
确定
请完成安全验证×
copy
已复制链接
快去分享给好友吧!
我知道了
右上角分享
点击右上角分享
0
联系我们:info@booksci.cn Book学术提供免费学术资源搜索服务,方便国内外学者检索中英文文献。致力于提供最便捷和优质的服务体验。 Copyright © 2023 布克学术 All rights reserved.
京ICP备2023020795号-1
ghs 京公网安备 11010802042870号
Book学术文献互助
Book学术文献互助群
群 号:604180095
Book学术官方微信