Susannah Fleming, Lazaro Mwandigha, Thomas R Fanshawe
{"title":"Practical and analytical considerations when performing interim analyses in diagnostic test accuracy studies.","authors":"Susannah Fleming, Lazaro Mwandigha, Thomas R Fanshawe","doi":"10.1186/s41512-024-00174-4","DOIUrl":null,"url":null,"abstract":"<p><p>Interim analysis is a common methodology in randomised clinical trials but has received less attention in studies of diagnostic test accuracy. In such studies, early termination for futility may be beneficial if early evidence indicates that a diagnostic test is unlikely to achieve a clinically useful level of diagnostic performance, as measured by the sensitivity and specificity. In this paper, we describe relevant practical and analytical considerations when planning and performing interim analysis in diagnostic accuracy studies, focusing on stopping rules for futility. We present an adaptation of the exact group sequential method for diagnostic testing, with R code provided for implementing this method in practice. The method is illustrated using two simulated data sets and data from a published diagnostic accuracy study for point-of-care testing for SARS-CoV-2. The considerations described in this paper can be used to guide decisions as to when an interim analysis in a diagnostic accuracy study is suitable and highlight areas for further methodological development.</p>","PeriodicalId":72800,"journal":{"name":"Diagnostic and prognostic research","volume":"8 1","pages":"12"},"PeriodicalIF":0.0000,"publicationDate":"2024-08-20","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://www.ncbi.nlm.nih.gov/pmc/articles/PMC11334588/pdf/","citationCount":"0","resultStr":null,"platform":"Semanticscholar","paperid":null,"PeriodicalName":"Diagnostic and prognostic research","FirstCategoryId":"1085","ListUrlMain":"https://doi.org/10.1186/s41512-024-00174-4","RegionNum":0,"RegionCategory":null,"ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"","JCRName":"","Score":null,"Total":0}
引用次数: 0
Abstract
Interim analysis is a common methodology in randomised clinical trials but has received less attention in studies of diagnostic test accuracy. In such studies, early termination for futility may be beneficial if early evidence indicates that a diagnostic test is unlikely to achieve a clinically useful level of diagnostic performance, as measured by the sensitivity and specificity. In this paper, we describe relevant practical and analytical considerations when planning and performing interim analysis in diagnostic accuracy studies, focusing on stopping rules for futility. We present an adaptation of the exact group sequential method for diagnostic testing, with R code provided for implementing this method in practice. The method is illustrated using two simulated data sets and data from a published diagnostic accuracy study for point-of-care testing for SARS-CoV-2. The considerations described in this paper can be used to guide decisions as to when an interim analysis in a diagnostic accuracy study is suitable and highlight areas for further methodological development.
中期分析是随机临床试验的常用方法,但在诊断测试准确性研究中却较少受到关注。在此类研究中,如果早期证据表明诊断测试不太可能达到临床有用的诊断水平(以灵敏度和特异性衡量),则因无效而提前终止可能是有益的。在本文中,我们介绍了在诊断准确性研究中规划和执行中期分析时的相关实践和分析注意事项,重点是无效性的终止规则。我们介绍了一种用于诊断测试的精确分组顺序法,并提供了在实践中实施该方法的 R 代码。我们使用两个模拟数据集和已发表的 SARS-CoV-2 护理点检测诊断准确性研究的数据对该方法进行了说明。本文所述的考虑因素可用于指导诊断准确性研究中何时适合进行中期分析的决策,并突出了方法学进一步发展的领域。