这个测试符合目的吗?在体外诊断(IVD)监管的新时代,评估测试临床性能的原则和清单。

IF 6.6 2区 医学 Q1 MEDICAL LABORATORY TECHNOLOGY
S J Lord, A R Horvath, S Sandberg, P J Monaghan, C M Cobbaert, M Reim, A Tolios, R Mueller, P M Bossuyt
{"title":"这个测试符合目的吗?在体外诊断(IVD)监管的新时代,评估测试临床性能的原则和清单。","authors":"S J Lord, A R Horvath, S Sandberg, P J Monaghan, C M Cobbaert, M Reim, A Tolios, R Mueller, P M Bossuyt","doi":"10.1080/10408363.2025.2453148","DOIUrl":null,"url":null,"abstract":"<p><p>Recent changes in the regulatory assessment of <i>in vitro</i> medical tests reflect a growing recognition of the need for more stringent clinical evidence requirements to protect patient safety and health. Under current regulations in the United States and Europe, when needed for regulatory approval, clinical performance reports must provide clinical evidence tailored to the intended purpose of the test and allow assessment of whether the test will achieve the intended clinical benefit. The quality of evidence must be proportionate to the risk for the patient and/or public health. These requirements now cover both commercial and laboratory developed tests (LDT) and demand a sound understanding of the fundamentals of clinical performance measures and study design to develop and appraise the study plan and interpret the study results. However, there is a lack of harmonized guidance for the laboratory profession, industry, regulatory agencies and notified bodies on how the clinical performance of tests should be measured. The Working Group on Test Evaluation (WG-TE) of the European Federation of Clinical Chemistry and Laboratory Medicine (EFLM) is a multidisciplinary group of laboratory professionals, clinical epidemiologists, health technology assessment experts, and representatives of the <i>in vitro</i> diagnostic (IVD) industry. This guidance paper aims to promote a shared understanding of the principles of clinical performance measures and study design. Measures of classification performance, also referred to as discrimination, such as sensitivity and specificity are firmly established as the primary measures for evaluating the clinical performance for screening and diagnostic tests. We explain these measures are just as relevant for other purposes of testing. We outline the importance of defining the most clinically meaningful classification of disease so the clinical benefits of testing can be explicitly inferred for those correctly classified, and harm for those incorrectly classified. We introduce the key principles and a checklist for formulating the research objective and study design to estimate clinical performance: (1) the purpose of a test e.g. diagnosis, screening, risk stratification, prognosis, prediction of treatment benefit, and corresponding research objective for assessing clinical performance; (2) the target condition for clinically meaningful classification; (3) clinical performance measures to assess whether the test is fit-for-purpose; and (4) study design types. Laboratory professionals, industry, and researchers can use this checklist to help identify relevant published studies and primary datasets, and to liaise with clinicians and methodologists when developing a study plan for evaluating clinical performance, where needed, to apply for regulatory approval.</p>","PeriodicalId":10760,"journal":{"name":"Critical reviews in clinical laboratory sciences","volume":" ","pages":"182-197"},"PeriodicalIF":6.6000,"publicationDate":"2025-05-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":"0","resultStr":"{\"title\":\"Is this test fit-for-purpose? Principles and a checklist for evaluating the clinical performance of a test in the new era of <i>in vitro</i> diagnostic (IVD) regulation.\",\"authors\":\"S J Lord, A R Horvath, S Sandberg, P J Monaghan, C M Cobbaert, M Reim, A Tolios, R Mueller, P M Bossuyt\",\"doi\":\"10.1080/10408363.2025.2453148\",\"DOIUrl\":null,\"url\":null,\"abstract\":\"<p><p>Recent changes in the regulatory assessment of <i>in vitro</i> medical tests reflect a growing recognition of the need for more stringent clinical evidence requirements to protect patient safety and health. Under current regulations in the United States and Europe, when needed for regulatory approval, clinical performance reports must provide clinical evidence tailored to the intended purpose of the test and allow assessment of whether the test will achieve the intended clinical benefit. The quality of evidence must be proportionate to the risk for the patient and/or public health. These requirements now cover both commercial and laboratory developed tests (LDT) and demand a sound understanding of the fundamentals of clinical performance measures and study design to develop and appraise the study plan and interpret the study results. However, there is a lack of harmonized guidance for the laboratory profession, industry, regulatory agencies and notified bodies on how the clinical performance of tests should be measured. The Working Group on Test Evaluation (WG-TE) of the European Federation of Clinical Chemistry and Laboratory Medicine (EFLM) is a multidisciplinary group of laboratory professionals, clinical epidemiologists, health technology assessment experts, and representatives of the <i>in vitro</i> diagnostic (IVD) industry. This guidance paper aims to promote a shared understanding of the principles of clinical performance measures and study design. Measures of classification performance, also referred to as discrimination, such as sensitivity and specificity are firmly established as the primary measures for evaluating the clinical performance for screening and diagnostic tests. We explain these measures are just as relevant for other purposes of testing. We outline the importance of defining the most clinically meaningful classification of disease so the clinical benefits of testing can be explicitly inferred for those correctly classified, and harm for those incorrectly classified. We introduce the key principles and a checklist for formulating the research objective and study design to estimate clinical performance: (1) the purpose of a test e.g. diagnosis, screening, risk stratification, prognosis, prediction of treatment benefit, and corresponding research objective for assessing clinical performance; (2) the target condition for clinically meaningful classification; (3) clinical performance measures to assess whether the test is fit-for-purpose; and (4) study design types. Laboratory professionals, industry, and researchers can use this checklist to help identify relevant published studies and primary datasets, and to liaise with clinicians and methodologists when developing a study plan for evaluating clinical performance, where needed, to apply for regulatory approval.</p>\",\"PeriodicalId\":10760,\"journal\":{\"name\":\"Critical reviews in clinical laboratory sciences\",\"volume\":\" \",\"pages\":\"182-197\"},\"PeriodicalIF\":6.6000,\"publicationDate\":\"2025-05-01\",\"publicationTypes\":\"Journal Article\",\"fieldsOfStudy\":null,\"isOpenAccess\":false,\"openAccessPdf\":\"\",\"citationCount\":\"0\",\"resultStr\":null,\"platform\":\"Semanticscholar\",\"paperid\":null,\"PeriodicalName\":\"Critical reviews in clinical laboratory sciences\",\"FirstCategoryId\":\"3\",\"ListUrlMain\":\"https://doi.org/10.1080/10408363.2025.2453148\",\"RegionNum\":2,\"RegionCategory\":\"医学\",\"ArticlePicture\":[],\"TitleCN\":null,\"AbstractTextCN\":null,\"PMCID\":null,\"EPubDate\":\"2025/2/6 0:00:00\",\"PubModel\":\"Epub\",\"JCR\":\"Q1\",\"JCRName\":\"MEDICAL LABORATORY TECHNOLOGY\",\"Score\":null,\"Total\":0}","platform":"Semanticscholar","paperid":null,"PeriodicalName":"Critical reviews in clinical laboratory sciences","FirstCategoryId":"3","ListUrlMain":"https://doi.org/10.1080/10408363.2025.2453148","RegionNum":2,"RegionCategory":"医学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"2025/2/6 0:00:00","PubModel":"Epub","JCR":"Q1","JCRName":"MEDICAL LABORATORY TECHNOLOGY","Score":null,"Total":0}
引用次数: 0

摘要

最近对体外医学试验的监管评估发生了变化,这反映出人们日益认识到需要更严格的临床证据要求,以保护患者的安全和健康。根据美国和欧洲的现行法规,当需要获得监管部门批准时,临床表现报告必须提供针对测试预期目的的临床证据,并允许评估测试是否能达到预期的临床效益。证据的质量必须与患者和/或公共卫生的风险成比例。这些要求现在涵盖商业和实验室开发的测试(LDT),并要求对临床表现测量和研究设计的基本原理有充分的了解,以制定和评估研究计划并解释研究结果。然而,在如何衡量检测的临床表现方面,实验室专业、工业、监管机构和通知机构缺乏统一的指导。欧洲临床化学和实验室医学联合会(EFLM)的测试评估工作组(WG-TE)是一个由实验室专业人员、临床流行病学家、卫生技术评估专家和体外诊断(IVD)行业代表组成的多学科小组。本指导文件旨在促进对临床表现测量和研究设计原则的共同理解。分类性能的度量,也称为鉴别,如敏感性和特异性,已牢固地确立为评估筛选和诊断试验临床性能的主要度量。我们解释说,这些措施同样适用于其他测试目的。我们概述了定义最具临床意义的疾病分类的重要性,以便可以明确推断出正确分类的疾病的临床益处,以及错误分类的疾病的危害。我们介绍了制定研究目标和评估临床表现的研究设计的关键原则和清单:(1)试验的目的,如诊断、筛查、风险分层、预后、治疗获益预测,以及评估临床表现的相应研究目标;(2)有临床意义的分类目标条件;(3)评估测试是否符合目的的临床表现指标;(4)研究设计类型。实验室专业人员,行业和研究人员可以使用此清单来帮助识别相关的已发表的研究和主要数据集,并在制定评估临床表现的研究计划时与临床医生和方法学家联系,在需要时申请监管批准。
本文章由计算机程序翻译,如有差异,请以英文原文为准。
Is this test fit-for-purpose? Principles and a checklist for evaluating the clinical performance of a test in the new era of in vitro diagnostic (IVD) regulation.

Recent changes in the regulatory assessment of in vitro medical tests reflect a growing recognition of the need for more stringent clinical evidence requirements to protect patient safety and health. Under current regulations in the United States and Europe, when needed for regulatory approval, clinical performance reports must provide clinical evidence tailored to the intended purpose of the test and allow assessment of whether the test will achieve the intended clinical benefit. The quality of evidence must be proportionate to the risk for the patient and/or public health. These requirements now cover both commercial and laboratory developed tests (LDT) and demand a sound understanding of the fundamentals of clinical performance measures and study design to develop and appraise the study plan and interpret the study results. However, there is a lack of harmonized guidance for the laboratory profession, industry, regulatory agencies and notified bodies on how the clinical performance of tests should be measured. The Working Group on Test Evaluation (WG-TE) of the European Federation of Clinical Chemistry and Laboratory Medicine (EFLM) is a multidisciplinary group of laboratory professionals, clinical epidemiologists, health technology assessment experts, and representatives of the in vitro diagnostic (IVD) industry. This guidance paper aims to promote a shared understanding of the principles of clinical performance measures and study design. Measures of classification performance, also referred to as discrimination, such as sensitivity and specificity are firmly established as the primary measures for evaluating the clinical performance for screening and diagnostic tests. We explain these measures are just as relevant for other purposes of testing. We outline the importance of defining the most clinically meaningful classification of disease so the clinical benefits of testing can be explicitly inferred for those correctly classified, and harm for those incorrectly classified. We introduce the key principles and a checklist for formulating the research objective and study design to estimate clinical performance: (1) the purpose of a test e.g. diagnosis, screening, risk stratification, prognosis, prediction of treatment benefit, and corresponding research objective for assessing clinical performance; (2) the target condition for clinically meaningful classification; (3) clinical performance measures to assess whether the test is fit-for-purpose; and (4) study design types. Laboratory professionals, industry, and researchers can use this checklist to help identify relevant published studies and primary datasets, and to liaise with clinicians and methodologists when developing a study plan for evaluating clinical performance, where needed, to apply for regulatory approval.

求助全文
通过发布文献求助,成功后即可免费获取论文全文。 去求助
来源期刊
CiteScore
20.00
自引率
0.00%
发文量
25
审稿时长
>12 weeks
期刊介绍: Critical Reviews in Clinical Laboratory Sciences publishes comprehensive and high quality review articles in all areas of clinical laboratory science, including clinical biochemistry, hematology, microbiology, pathology, transfusion medicine, genetics, immunology and molecular diagnostics. The reviews critically evaluate the status of current issues in the selected areas, with a focus on clinical laboratory diagnostics and latest advances. The adjective “critical” implies a balanced synthesis of results and conclusions that are frequently contradictory and controversial.
×
引用
GB/T 7714-2015
复制
MLA
复制
APA
复制
导出至
BibTeX EndNote RefMan NoteFirst NoteExpress
×
提示
您的信息不完整,为了账户安全,请先补充。
现在去补充
×
提示
您因"违规操作"
具体请查看互助需知
我知道了
×
提示
确定
请完成安全验证×
copy
已复制链接
快去分享给好友吧!
我知道了
右上角分享
点击右上角分享
0
联系我们:info@booksci.cn Book学术提供免费学术资源搜索服务,方便国内外学者检索中英文文献。致力于提供最便捷和优质的服务体验。 Copyright © 2023 布克学术 All rights reserved.
京ICP备2023020795号-1
ghs 京公网安备 11010802042870号
Book学术文献互助
Book学术文献互助群
群 号:481959085
Book学术官方微信