Jackie Ma, Eva Weicken, Frederik Pahde, Katharina Weitz, Sebastian Lapuschkin, Wojciech Samek, Thomas Wiegand
{"title":"[Artificial intelligence under scrutiny: requirements, quality criteria, and testing tools for medical applications].","authors":"Jackie Ma, Eva Weicken, Frederik Pahde, Katharina Weitz, Sebastian Lapuschkin, Wojciech Samek, Thomas Wiegand","doi":"10.1007/s00103-025-04101-w","DOIUrl":null,"url":null,"abstract":"<p><p>The use of artificial intelligence (AI) in medicine has great potential to improve quality and efficiency. At the same time, its use is associated with risks. In order to prevent harm, experts from research and politics are developing requirements, testing tools, and guidelines to identify and control these risks.This article first describes the requirements for AI in medicine. It then follows with a presentation of how concrete quality criteria and testing tools can be derived from those requirements. A deeper demonstration of \"explainability\" as a key criterion is presented as an example. A testing framework for the use of AI in medicine is also presented. Finally, the article provides an outlook on standardization of quality criteria.The development of AI, especially in medicine, is progressing quickly. Suitable testing procedures can help to minimize risks and strengthen trust in the technology. However, for the successful implementation of such testing procedures, continuous research efforts are necessary.</p>","PeriodicalId":9562,"journal":{"name":"Bundesgesundheitsblatt, Gesundheitsforschung, Gesundheitsschutz","volume":" ","pages":""},"PeriodicalIF":1.7000,"publicationDate":"2025-07-14","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":"0","resultStr":null,"platform":"Semanticscholar","paperid":null,"PeriodicalName":"Bundesgesundheitsblatt, Gesundheitsforschung, Gesundheitsschutz","FirstCategoryId":"3","ListUrlMain":"https://doi.org/10.1007/s00103-025-04101-w","RegionNum":4,"RegionCategory":"医学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"Q3","JCRName":"PUBLIC, ENVIRONMENTAL & OCCUPATIONAL HEALTH","Score":null,"Total":0}
引用次数: 0
Abstract
The use of artificial intelligence (AI) in medicine has great potential to improve quality and efficiency. At the same time, its use is associated with risks. In order to prevent harm, experts from research and politics are developing requirements, testing tools, and guidelines to identify and control these risks.This article first describes the requirements for AI in medicine. It then follows with a presentation of how concrete quality criteria and testing tools can be derived from those requirements. A deeper demonstration of "explainability" as a key criterion is presented as an example. A testing framework for the use of AI in medicine is also presented. Finally, the article provides an outlook on standardization of quality criteria.The development of AI, especially in medicine, is progressing quickly. Suitable testing procedures can help to minimize risks and strengthen trust in the technology. However, for the successful implementation of such testing procedures, continuous research efforts are necessary.
期刊介绍:
Die Monatszeitschrift Bundesgesundheitsblatt - Gesundheitsforschung - Gesundheitsschutz - umfasst alle Fragestellungen und Bereiche, mit denen sich das öffentliche Gesundheitswesen und die staatliche Gesundheitspolitik auseinandersetzen.
Ziel ist es, zum einen über wesentliche Entwicklungen in der biologisch-medizinischen Grundlagenforschung auf dem Laufenden zu halten und zum anderen über konkrete Maßnahmen zum Gesundheitsschutz, über Konzepte der Prävention, Risikoabwehr und Gesundheitsförderung zu informieren. Wichtige Themengebiete sind die Epidemiologie übertragbarer und nicht übertragbarer Krankheiten, der umweltbezogene Gesundheitsschutz sowie gesundheitsökonomische, medizinethische und -rechtliche Fragestellungen.