兽用抗生素处方监控系统(IS ABV)中的异常检测。

IF 2.2 2区 农林科学 Q1 VETERINARY SCIENCES
Guy-Alain Schnidrig , Anaïs Léger , Heinzpeter Schwermer , Rebecca Furtado Jost , Dagmar Heim , Gertraud Schüpbach-Regula
{"title":"兽用抗生素处方监控系统(IS ABV)中的异常检测。","authors":"Guy-Alain Schnidrig ,&nbsp;Anaïs Léger ,&nbsp;Heinzpeter Schwermer ,&nbsp;Rebecca Furtado Jost ,&nbsp;Dagmar Heim ,&nbsp;Gertraud Schüpbach-Regula","doi":"10.1016/j.prevetmed.2024.106291","DOIUrl":null,"url":null,"abstract":"<div><p>Antibiotic resistance is one of the major concerns in veterinary and human medicine and poses a considerable threat to both human and animal health. It has been shown that over- or misuse of antibiotics is one of the primary drivers of antibiotic resistance. To develop the surveillance of antibiotic use, Switzerland introduced the \"Informationssystem Antibiotika in der Veterinärmedizin\" (IS ABV) in 2019, mandating electronic registration of antibiotic prescriptions by all veterinarians in Switzerland. However, initial data analysis revealed a considerable amount of implausible data entries, potentially compromising data quality and reliability. These anomalies may be caused by input errors, inaccuracies, incorrect or aberrant master data or data transmission and make analysis impossible. To address this issue efficiently, we propose a two-stage anomaly detection framework utilizing machine learning algorithms. In this study, our primary focus was on cattle treatments with either single or group therapy, as they were the species with the highest prescription volume. However, not all outliers are necessarily incorrect; some may be legitimate but unusual antibiotic treatments. Thus, expert review plays a crucial role in distinguishing outliers, that are correct from actual errors. Initially, relevant prescription variables were extracted and pre-processed with a custom-built scaler. A set of unsupervised algorithms calculated the probability of each data point and identified the most likely outliers. In collaboration with experts, we annotated anomalies and established anomaly thresholds for each production type and active substance. These expert-annotated labels were then used to fine-tune the final supervised classification algorithms. With this methodology, we identified 22,816 anomalies from a total of 1,994,170 prescriptions in cattle (1.1 %). Cattle with no further specified production type had the most (2 %) anomalies with 7758 out of 379,995. The anomalies were consistently identified and comprised prescriptions with too high and too low dosages. Random Forest achieved a ROC-AUC score of 0.994, (95 % CI: 0.992, 0.995) and a F1-Score of 0.962 (95 % CI: 0.958, 0.966) for single treatments. The versatility of this framework allows its adaptation to other species within IS ABV and potentially to other prescription-based surveillance systems. If applied regularly to uploaded prescriptions, it should reduce input errors over time, improving the validity of the data in the long term.</p></div>","PeriodicalId":20413,"journal":{"name":"Preventive veterinary medicine","volume":"230 ","pages":"Article 106291"},"PeriodicalIF":2.2000,"publicationDate":"2024-07-19","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://www.sciencedirect.com/science/article/pii/S0167587724001776/pdfft?md5=077212aad8197338c7504fd96fb710bb&pid=1-s2.0-S0167587724001776-main.pdf","citationCount":"0","resultStr":"{\"title\":\"Anomaly detection in the veterinary antibiotic prescription surveillance system (IS ABV)\",\"authors\":\"Guy-Alain Schnidrig ,&nbsp;Anaïs Léger ,&nbsp;Heinzpeter Schwermer ,&nbsp;Rebecca Furtado Jost ,&nbsp;Dagmar Heim ,&nbsp;Gertraud Schüpbach-Regula\",\"doi\":\"10.1016/j.prevetmed.2024.106291\",\"DOIUrl\":null,\"url\":null,\"abstract\":\"<div><p>Antibiotic resistance is one of the major concerns in veterinary and human medicine and poses a considerable threat to both human and animal health. It has been shown that over- or misuse of antibiotics is one of the primary drivers of antibiotic resistance. To develop the surveillance of antibiotic use, Switzerland introduced the \\\"Informationssystem Antibiotika in der Veterinärmedizin\\\" (IS ABV) in 2019, mandating electronic registration of antibiotic prescriptions by all veterinarians in Switzerland. However, initial data analysis revealed a considerable amount of implausible data entries, potentially compromising data quality and reliability. These anomalies may be caused by input errors, inaccuracies, incorrect or aberrant master data or data transmission and make analysis impossible. To address this issue efficiently, we propose a two-stage anomaly detection framework utilizing machine learning algorithms. In this study, our primary focus was on cattle treatments with either single or group therapy, as they were the species with the highest prescription volume. However, not all outliers are necessarily incorrect; some may be legitimate but unusual antibiotic treatments. Thus, expert review plays a crucial role in distinguishing outliers, that are correct from actual errors. Initially, relevant prescription variables were extracted and pre-processed with a custom-built scaler. A set of unsupervised algorithms calculated the probability of each data point and identified the most likely outliers. In collaboration with experts, we annotated anomalies and established anomaly thresholds for each production type and active substance. These expert-annotated labels were then used to fine-tune the final supervised classification algorithms. With this methodology, we identified 22,816 anomalies from a total of 1,994,170 prescriptions in cattle (1.1 %). Cattle with no further specified production type had the most (2 %) anomalies with 7758 out of 379,995. The anomalies were consistently identified and comprised prescriptions with too high and too low dosages. Random Forest achieved a ROC-AUC score of 0.994, (95 % CI: 0.992, 0.995) and a F1-Score of 0.962 (95 % CI: 0.958, 0.966) for single treatments. The versatility of this framework allows its adaptation to other species within IS ABV and potentially to other prescription-based surveillance systems. If applied regularly to uploaded prescriptions, it should reduce input errors over time, improving the validity of the data in the long term.</p></div>\",\"PeriodicalId\":20413,\"journal\":{\"name\":\"Preventive veterinary medicine\",\"volume\":\"230 \",\"pages\":\"Article 106291\"},\"PeriodicalIF\":2.2000,\"publicationDate\":\"2024-07-19\",\"publicationTypes\":\"Journal Article\",\"fieldsOfStudy\":null,\"isOpenAccess\":false,\"openAccessPdf\":\"https://www.sciencedirect.com/science/article/pii/S0167587724001776/pdfft?md5=077212aad8197338c7504fd96fb710bb&pid=1-s2.0-S0167587724001776-main.pdf\",\"citationCount\":\"0\",\"resultStr\":null,\"platform\":\"Semanticscholar\",\"paperid\":null,\"PeriodicalName\":\"Preventive veterinary medicine\",\"FirstCategoryId\":\"97\",\"ListUrlMain\":\"https://www.sciencedirect.com/science/article/pii/S0167587724001776\",\"RegionNum\":2,\"RegionCategory\":\"农林科学\",\"ArticlePicture\":[],\"TitleCN\":null,\"AbstractTextCN\":null,\"PMCID\":null,\"EPubDate\":\"\",\"PubModel\":\"\",\"JCR\":\"Q1\",\"JCRName\":\"VETERINARY SCIENCES\",\"Score\":null,\"Total\":0}","platform":"Semanticscholar","paperid":null,"PeriodicalName":"Preventive veterinary medicine","FirstCategoryId":"97","ListUrlMain":"https://www.sciencedirect.com/science/article/pii/S0167587724001776","RegionNum":2,"RegionCategory":"农林科学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"Q1","JCRName":"VETERINARY SCIENCES","Score":null,"Total":0}
引用次数: 0

摘要

抗生素耐药性是兽医和人类医学关注的主要问题之一,对人类和动物的健康都构成了相当大的威胁。研究表明,过度或滥用抗生素是产生抗生素耐药性的主要原因之一。为加强对抗生素使用情况的监控,瑞士于 2019 年引入了 "兽医抗生素信息系统"(IS ABV),强制要求瑞士所有兽医对抗生素处方进行电子注册。然而,初步数据分析显示,有相当多的数据条目难以置信,可能会影响数据质量和可靠性。这些异常可能由输入错误、不准确、不正确或异常的主数据或数据传输造成,导致无法进行分析。为有效解决这一问题,我们提出了一个利用机器学习算法的两阶段异常检测框架。在这项研究中,我们主要关注的是采用单一疗法或集体疗法的牛治疗,因为它们是处方量最高的品种。然而,并非所有异常值都是错误的;有些可能是合法但不寻常的抗生素治疗。因此,专家审查在区分异常值(正确与实际错误)方面起着至关重要的作用。最初,相关处方变量被提取出来,并通过定制的标度器进行预处理。一套无监督算法计算出每个数据点的概率,并识别出最有可能的异常值。通过与专家合作,我们对异常情况进行了标注,并为每种生产类型和活性物质设定了异常阈值。这些由专家标注的标签随后被用于微调最终的监督分类算法。通过这种方法,我们从总共 1,994,170 份牛处方中识别出 22,816 个异常点(1.1%)。没有进一步指定生产类型的牛的异常情况最多(2%),在 379,995 份处方中发现了 7758 份。异常情况被一致识别出来,包括剂量过高和过低的处方。随机森林的 ROC-AUC 得分为 0.994(95 % CI:0.992,0.995),单一疗法的 F1 得分为 0.962(95 % CI:0.958,0.966)。该框架的多功能性使其适用于 IS ABV 中的其他物种,并有可能适用于其他基于处方的监控系统。如果定期对上传的处方进行应用,随着时间的推移,它应该会减少输入错误,从而提高数据的长期有效性。
本文章由计算机程序翻译,如有差异,请以英文原文为准。
Anomaly detection in the veterinary antibiotic prescription surveillance system (IS ABV)

Antibiotic resistance is one of the major concerns in veterinary and human medicine and poses a considerable threat to both human and animal health. It has been shown that over- or misuse of antibiotics is one of the primary drivers of antibiotic resistance. To develop the surveillance of antibiotic use, Switzerland introduced the "Informationssystem Antibiotika in der Veterinärmedizin" (IS ABV) in 2019, mandating electronic registration of antibiotic prescriptions by all veterinarians in Switzerland. However, initial data analysis revealed a considerable amount of implausible data entries, potentially compromising data quality and reliability. These anomalies may be caused by input errors, inaccuracies, incorrect or aberrant master data or data transmission and make analysis impossible. To address this issue efficiently, we propose a two-stage anomaly detection framework utilizing machine learning algorithms. In this study, our primary focus was on cattle treatments with either single or group therapy, as they were the species with the highest prescription volume. However, not all outliers are necessarily incorrect; some may be legitimate but unusual antibiotic treatments. Thus, expert review plays a crucial role in distinguishing outliers, that are correct from actual errors. Initially, relevant prescription variables were extracted and pre-processed with a custom-built scaler. A set of unsupervised algorithms calculated the probability of each data point and identified the most likely outliers. In collaboration with experts, we annotated anomalies and established anomaly thresholds for each production type and active substance. These expert-annotated labels were then used to fine-tune the final supervised classification algorithms. With this methodology, we identified 22,816 anomalies from a total of 1,994,170 prescriptions in cattle (1.1 %). Cattle with no further specified production type had the most (2 %) anomalies with 7758 out of 379,995. The anomalies were consistently identified and comprised prescriptions with too high and too low dosages. Random Forest achieved a ROC-AUC score of 0.994, (95 % CI: 0.992, 0.995) and a F1-Score of 0.962 (95 % CI: 0.958, 0.966) for single treatments. The versatility of this framework allows its adaptation to other species within IS ABV and potentially to other prescription-based surveillance systems. If applied regularly to uploaded prescriptions, it should reduce input errors over time, improving the validity of the data in the long term.

求助全文
通过发布文献求助,成功后即可免费获取论文全文。 去求助
来源期刊
Preventive veterinary medicine
Preventive veterinary medicine 农林科学-兽医学
CiteScore
5.60
自引率
7.70%
发文量
184
审稿时长
3 months
期刊介绍: Preventive Veterinary Medicine is one of the leading international resources for scientific reports on animal health programs and preventive veterinary medicine. The journal follows the guidelines for standardizing and strengthening the reporting of biomedical research which are available from the CONSORT, MOOSE, PRISMA, REFLECT, STARD, and STROBE statements. The journal focuses on: Epidemiology of health events relevant to domestic and wild animals; Economic impacts of epidemic and endemic animal and zoonotic diseases; Latest methods and approaches in veterinary epidemiology; Disease and infection control or eradication measures; The "One Health" concept and the relationships between veterinary medicine, human health, animal-production systems, and the environment; Development of new techniques in surveillance systems and diagnosis; Evaluation and control of diseases in animal populations.
×
引用
GB/T 7714-2015
复制
MLA
复制
APA
复制
导出至
BibTeX EndNote RefMan NoteFirst NoteExpress
×
提示
您的信息不完整,为了账户安全,请先补充。
现在去补充
×
提示
您因"违规操作"
具体请查看互助需知
我知道了
×
提示
确定
请完成安全验证×
copy
已复制链接
快去分享给好友吧!
我知道了
右上角分享
点击右上角分享
0
联系我们:info@booksci.cn Book学术提供免费学术资源搜索服务,方便国内外学者检索中英文文献。致力于提供最便捷和优质的服务体验。 Copyright © 2023 布克学术 All rights reserved.
京ICP备2023020795号-1
ghs 京公网安备 11010802042870号
Book学术文献互助
Book学术文献互助群
群 号:481959085
Book学术官方微信