David N. Soleimani-Meigooni, Stefania Pezzoli, Ganna Blazhenets, Renaud La Joie, Zoe Lin, Carol L. Soppe, Derek R. Johnson, Mary Ellen I. Koran, Jonathan E. McConathy, Ilya M. Nasrallah, Maria Rosana Ponisio, Jeremy A. Tanner, Victor L. Villemagne, Charles C. Windon, Michael Zeineh, Sarah Biber, Walter A. Kukull, Heather O'Connell, Daniel J. Peterson, Elizabeth C. Mormino, Sterling C. Johnson, Gil D. Rabinovici, for the LEADS Consortium, The PREVENT-AD Research Group, Alzheimer's Disease Neuroimaging Initiative
{"title":"淀粉样蛋白PET扫描前瞻性视觉读数的多位点评分器校准。","authors":"David N. Soleimani-Meigooni, Stefania Pezzoli, Ganna Blazhenets, Renaud La Joie, Zoe Lin, Carol L. Soppe, Derek R. Johnson, Mary Ellen I. Koran, Jonathan E. McConathy, Ilya M. Nasrallah, Maria Rosana Ponisio, Jeremy A. Tanner, Victor L. Villemagne, Charles C. Windon, Michael Zeineh, Sarah Biber, Walter A. Kukull, Heather O'Connell, Daniel J. Peterson, Elizabeth C. Mormino, Sterling C. Johnson, Gil D. Rabinovici, for the LEADS Consortium, The PREVENT-AD Research Group, Alzheimer's Disease Neuroimaging Initiative","doi":"10.1002/alz.70732","DOIUrl":null,"url":null,"abstract":"<div>\n \n \n <section>\n \n <h3> INTRODUCTION</h3>\n \n <p>In multicenter Alzheimer's disease studies, amyloid positron emission tomography (PET) visual reads are typically performed centrally by a few experts. Incorporating a broader reader network enhances scalability and generalizability.</p>\n </section>\n \n <section>\n \n <h3> METHODS</h3>\n \n <p>Ten neuroimaging experts from eight Alzheimer's Disease Research Centers (ADRCs) visually read 180 amyloid PET scans (30 scans and 15 duplicate scans for each of four tracers, imaged across a wide variety of scanners), using preferred reading software without anatomical imaging or quantitation. Scans were classified as elevated or non-elevated per tracer-specific criteria. Inter- and intra-rater agreement was assessed.</p>\n </section>\n \n <section>\n \n <h3> RESULTS</h3>\n \n <p>Inter-rater agreement was substantial (Fleiss’ <i>κ</i> = 0.78), with full consensus on 69% of scans. Inter-rater reliability was substantial to perfect across tracers (Fleiss’ <i>κ</i> = 0.70–0.87). Intra-rater agreement was substantial to perfect (Cohen's <i>κ </i>= 0.79-1). Scans with intermediate (10–40 Centiloid) quantitation had lower reader agreement.</p>\n </section>\n \n <section>\n \n <h3> DISCUSSION</h3>\n \n <p>A multicenter expert network achieved substantial agreement classifying amyloid PET scans. These scans provide a standard for reader training and reliability assurance in future studies.</p>\n </section>\n \n <section>\n \n <h3> Highlights</h3>\n \n <div>\n <ul>\n \n <li>Calibration methods ensure reliable amyloid positron emission tomography (PET) visual reads across multiple raters.</li>\n \n <li>Substantial agreement is possible across readers using their preferred tools.</li>\n \n <li>Agreement is also substantial regardless of the amyloid PET tracer used.</li>\n \n <li>Scans with intermediate (10–40 Centiloid) quantitation have lower reader agreement.</li>\n \n <li>The calibration set will become a training tool for amyloid PET visual read studies.</li>\n </ul>\n </div>\n </section>\n </div>","PeriodicalId":7471,"journal":{"name":"Alzheimer's & Dementia","volume":"21 10","pages":""},"PeriodicalIF":11.1000,"publicationDate":"2025-09-30","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://alz-journals.onlinelibrary.wiley.com/doi/epdf/10.1002/alz.70732","citationCount":"0","resultStr":"{\"title\":\"Calibration of multisite raters for prospective visual reads of amyloid PET scans\",\"authors\":\"David N. Soleimani-Meigooni, Stefania Pezzoli, Ganna Blazhenets, Renaud La Joie, Zoe Lin, Carol L. Soppe, Derek R. Johnson, Mary Ellen I. Koran, Jonathan E. McConathy, Ilya M. Nasrallah, Maria Rosana Ponisio, Jeremy A. Tanner, Victor L. Villemagne, Charles C. Windon, Michael Zeineh, Sarah Biber, Walter A. Kukull, Heather O'Connell, Daniel J. Peterson, Elizabeth C. Mormino, Sterling C. Johnson, Gil D. Rabinovici, for the LEADS Consortium, The PREVENT-AD Research Group, Alzheimer's Disease Neuroimaging Initiative\",\"doi\":\"10.1002/alz.70732\",\"DOIUrl\":null,\"url\":null,\"abstract\":\"<div>\\n \\n \\n <section>\\n \\n <h3> INTRODUCTION</h3>\\n \\n <p>In multicenter Alzheimer's disease studies, amyloid positron emission tomography (PET) visual reads are typically performed centrally by a few experts. Incorporating a broader reader network enhances scalability and generalizability.</p>\\n </section>\\n \\n <section>\\n \\n <h3> METHODS</h3>\\n \\n <p>Ten neuroimaging experts from eight Alzheimer's Disease Research Centers (ADRCs) visually read 180 amyloid PET scans (30 scans and 15 duplicate scans for each of four tracers, imaged across a wide variety of scanners), using preferred reading software without anatomical imaging or quantitation. Scans were classified as elevated or non-elevated per tracer-specific criteria. Inter- and intra-rater agreement was assessed.</p>\\n </section>\\n \\n <section>\\n \\n <h3> RESULTS</h3>\\n \\n <p>Inter-rater agreement was substantial (Fleiss’ <i>κ</i> = 0.78), with full consensus on 69% of scans. Inter-rater reliability was substantial to perfect across tracers (Fleiss’ <i>κ</i> = 0.70–0.87). Intra-rater agreement was substantial to perfect (Cohen's <i>κ </i>= 0.79-1). Scans with intermediate (10–40 Centiloid) quantitation had lower reader agreement.</p>\\n </section>\\n \\n <section>\\n \\n <h3> DISCUSSION</h3>\\n \\n <p>A multicenter expert network achieved substantial agreement classifying amyloid PET scans. These scans provide a standard for reader training and reliability assurance in future studies.</p>\\n </section>\\n \\n <section>\\n \\n <h3> Highlights</h3>\\n \\n <div>\\n <ul>\\n \\n <li>Calibration methods ensure reliable amyloid positron emission tomography (PET) visual reads across multiple raters.</li>\\n \\n <li>Substantial agreement is possible across readers using their preferred tools.</li>\\n \\n <li>Agreement is also substantial regardless of the amyloid PET tracer used.</li>\\n \\n <li>Scans with intermediate (10–40 Centiloid) quantitation have lower reader agreement.</li>\\n \\n <li>The calibration set will become a training tool for amyloid PET visual read studies.</li>\\n </ul>\\n </div>\\n </section>\\n </div>\",\"PeriodicalId\":7471,\"journal\":{\"name\":\"Alzheimer's & Dementia\",\"volume\":\"21 10\",\"pages\":\"\"},\"PeriodicalIF\":11.1000,\"publicationDate\":\"2025-09-30\",\"publicationTypes\":\"Journal Article\",\"fieldsOfStudy\":null,\"isOpenAccess\":false,\"openAccessPdf\":\"https://alz-journals.onlinelibrary.wiley.com/doi/epdf/10.1002/alz.70732\",\"citationCount\":\"0\",\"resultStr\":null,\"platform\":\"Semanticscholar\",\"paperid\":null,\"PeriodicalName\":\"Alzheimer's & Dementia\",\"FirstCategoryId\":\"3\",\"ListUrlMain\":\"https://alz-journals.onlinelibrary.wiley.com/doi/10.1002/alz.70732\",\"RegionNum\":1,\"RegionCategory\":\"医学\",\"ArticlePicture\":[],\"TitleCN\":null,\"AbstractTextCN\":null,\"PMCID\":null,\"EPubDate\":\"\",\"PubModel\":\"\",\"JCR\":\"Q1\",\"JCRName\":\"CLINICAL NEUROLOGY\",\"Score\":null,\"Total\":0}","platform":"Semanticscholar","paperid":null,"PeriodicalName":"Alzheimer's & Dementia","FirstCategoryId":"3","ListUrlMain":"https://alz-journals.onlinelibrary.wiley.com/doi/10.1002/alz.70732","RegionNum":1,"RegionCategory":"医学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"Q1","JCRName":"CLINICAL NEUROLOGY","Score":null,"Total":0}
Calibration of multisite raters for prospective visual reads of amyloid PET scans
INTRODUCTION
In multicenter Alzheimer's disease studies, amyloid positron emission tomography (PET) visual reads are typically performed centrally by a few experts. Incorporating a broader reader network enhances scalability and generalizability.
METHODS
Ten neuroimaging experts from eight Alzheimer's Disease Research Centers (ADRCs) visually read 180 amyloid PET scans (30 scans and 15 duplicate scans for each of four tracers, imaged across a wide variety of scanners), using preferred reading software without anatomical imaging or quantitation. Scans were classified as elevated or non-elevated per tracer-specific criteria. Inter- and intra-rater agreement was assessed.
RESULTS
Inter-rater agreement was substantial (Fleiss’ κ = 0.78), with full consensus on 69% of scans. Inter-rater reliability was substantial to perfect across tracers (Fleiss’ κ = 0.70–0.87). Intra-rater agreement was substantial to perfect (Cohen's κ = 0.79-1). Scans with intermediate (10–40 Centiloid) quantitation had lower reader agreement.
DISCUSSION
A multicenter expert network achieved substantial agreement classifying amyloid PET scans. These scans provide a standard for reader training and reliability assurance in future studies.
期刊介绍：
Alzheimer's & Dementia is a peer-reviewed journal that aims to bridge knowledge gaps in dementia research by covering the entire spectrum, from basic science to clinical trials to social and behavioral investigations. It provides a platform for rapid communication of new findings and ideas, optimal translation of research into practical applications, increasing knowledge across diverse disciplines for early detection, diagnosis, and intervention, and identifying promising new research directions. In July 2008, Alzheimer's & Dementia was accepted for indexing by MEDLINE, recognizing its scientific merit and contribution to Alzheimer's research.
求助内容：
应助结果提醒方式：
京公网安备 11010802042870号
