医学图像分类模型的变形检验

Yue Ma, Ya Pan, Yong Fan
{"title":"医学图像分类模型的变形检验","authors":"Yue Ma, Ya Pan, Yong Fan","doi":"10.1109/QRS-C57518.2022.00057","DOIUrl":null,"url":null,"abstract":"The existing studies have applied metamorphic testing technique to testing the medical image classification models, effectively alleviating the test oracle problem and reducing the testing difficulty. However, existing methods mainly focus on constructing metamorphic relations by using general image transformation methods, without combining the knowledge characteristics of medical imaging domain, resulting in problems such as low validity of metamorphic relations. According to the above problems, this paper based on the premise of conforming to the real scenario of image diagnosis, combining the key information of medical image semantics, and constructing general metamorphic relations in this field from three dimensions: the characteristics of medical images in real environment, the regular changes of lesion stage in images and the motion artifacts produced by patients in the process of filming. The medical images classification models of COVID-19 were also selected for instance validation, and the metamorphic relations were quantitatively analyzed to detect inconsistency in the classification results of different models and to assess the robustness of the model. The experimental results show that the constructed metamorphic relations by the key information of medical image semantics are able to detect inconsistencies in the models with a high detection capability, with the inconsistency percentage reaching up to 38.05%. This method can also be extended to test different types of medical image classification models.","PeriodicalId":183728,"journal":{"name":"2022 IEEE 22nd International Conference on Software Quality, Reliability, and Security Companion (QRS-C)","volume":"114 1","pages":"0"},"PeriodicalIF":0.0000,"publicationDate":"2022-12-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":"0","resultStr":"{\"title\":\"Metamorphic Testing for the Medical Image Classification Model\",\"authors\":\"Yue Ma, Ya Pan, Yong Fan\",\"doi\":\"10.1109/QRS-C57518.2022.00057\",\"DOIUrl\":null,\"url\":null,\"abstract\":\"The existing studies have applied metamorphic testing technique to testing the medical image classification models, effectively alleviating the test oracle problem and reducing the testing difficulty. However, existing methods mainly focus on constructing metamorphic relations by using general image transformation methods, without combining the knowledge characteristics of medical imaging domain, resulting in problems such as low validity of metamorphic relations. According to the above problems, this paper based on the premise of conforming to the real scenario of image diagnosis, combining the key information of medical image semantics, and constructing general metamorphic relations in this field from three dimensions: the characteristics of medical images in real environment, the regular changes of lesion stage in images and the motion artifacts produced by patients in the process of filming. The medical images classification models of COVID-19 were also selected for instance validation, and the metamorphic relations were quantitatively analyzed to detect inconsistency in the classification results of different models and to assess the robustness of the model. The experimental results show that the constructed metamorphic relations by the key information of medical image semantics are able to detect inconsistencies in the models with a high detection capability, with the inconsistency percentage reaching up to 38.05%. This method can also be extended to test different types of medical image classification models.\",\"PeriodicalId\":183728,\"journal\":{\"name\":\"2022 IEEE 22nd International Conference on Software Quality, Reliability, and Security Companion (QRS-C)\",\"volume\":\"114 1\",\"pages\":\"0\"},\"PeriodicalIF\":0.0000,\"publicationDate\":\"2022-12-01\",\"publicationTypes\":\"Journal Article\",\"fieldsOfStudy\":null,\"isOpenAccess\":false,\"openAccessPdf\":\"\",\"citationCount\":\"0\",\"resultStr\":null,\"platform\":\"Semanticscholar\",\"paperid\":null,\"PeriodicalName\":\"2022 IEEE 22nd International Conference on Software Quality, Reliability, and Security Companion (QRS-C)\",\"FirstCategoryId\":\"1085\",\"ListUrlMain\":\"https://doi.org/10.1109/QRS-C57518.2022.00057\",\"RegionNum\":0,\"RegionCategory\":null,\"ArticlePicture\":[],\"TitleCN\":null,\"AbstractTextCN\":null,\"PMCID\":null,\"EPubDate\":\"\",\"PubModel\":\"\",\"JCR\":\"\",\"JCRName\":\"\",\"Score\":null,\"Total\":0}","platform":"Semanticscholar","paperid":null,"PeriodicalName":"2022 IEEE 22nd International Conference on Software Quality, Reliability, and Security Companion (QRS-C)","FirstCategoryId":"1085","ListUrlMain":"https://doi.org/10.1109/QRS-C57518.2022.00057","RegionNum":0,"RegionCategory":null,"ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"","JCRName":"","Score":null,"Total":0}
引用次数: 0

摘要

已有研究将变质测试技术应用于医学图像分类模型的测试,有效缓解了测试oracle问题,降低了测试难度。然而,现有的方法主要是利用一般的图像变换方法构造变形关系,没有结合医学成像领域的知识特点,导致变形关系的有效性低等问题。针对上述问题,本文在符合影像诊断真实场景的前提下,结合医学影像语义的关键信息,从真实环境下医学影像的特征、影像中病变阶段的规律变化、患者在拍摄过程中产生的运动伪影三个维度构建该领域的一般变质关系。选取新冠肺炎医学图像分类模型进行实例验证,定量分析变质关系,检测不同模型分类结果的不一致性,评估模型的鲁棒性。实验结果表明,利用医学图像语义关键信息构建的变形关系能够检测出模型中的不一致,检测能力较高,不一致率高达38.05%。该方法还可以扩展到测试不同类型的医学图像分类模型。
本文章由计算机程序翻译,如有差异,请以英文原文为准。
Metamorphic Testing for the Medical Image Classification Model
The existing studies have applied metamorphic testing technique to testing the medical image classification models, effectively alleviating the test oracle problem and reducing the testing difficulty. However, existing methods mainly focus on constructing metamorphic relations by using general image transformation methods, without combining the knowledge characteristics of medical imaging domain, resulting in problems such as low validity of metamorphic relations. According to the above problems, this paper based on the premise of conforming to the real scenario of image diagnosis, combining the key information of medical image semantics, and constructing general metamorphic relations in this field from three dimensions: the characteristics of medical images in real environment, the regular changes of lesion stage in images and the motion artifacts produced by patients in the process of filming. The medical images classification models of COVID-19 were also selected for instance validation, and the metamorphic relations were quantitatively analyzed to detect inconsistency in the classification results of different models and to assess the robustness of the model. The experimental results show that the constructed metamorphic relations by the key information of medical image semantics are able to detect inconsistencies in the models with a high detection capability, with the inconsistency percentage reaching up to 38.05%. This method can also be extended to test different types of medical image classification models.
求助全文
通过发布文献求助,成功后即可免费获取论文全文。 去求助
来源期刊
自引率
0.00%
发文量
0
×
引用
GB/T 7714-2015
复制
MLA
复制
APA
复制
导出至
BibTeX EndNote RefMan NoteFirst NoteExpress
×
提示
您的信息不完整,为了账户安全,请先补充。
现在去补充
×
提示
您因"违规操作"
具体请查看互助需知
我知道了
×
提示
确定
请完成安全验证×
copy
已复制链接
快去分享给好友吧!
我知道了
右上角分享
点击右上角分享
0
联系我们:info@booksci.cn Book学术提供免费学术资源搜索服务,方便国内外学者检索中英文文献。致力于提供最便捷和优质的服务体验。 Copyright © 2023 布克学术 All rights reserved.
京ICP备2023020795号-1
ghs 京公网安备 11010802042870号
Book学术文献互助
Book学术文献互助群
群 号:481959085
Book学术官方微信