Validation of Inter-Reader Agreement/Consistency for Quantification of Ellipsoid Zone Integrity and Sub-RPE Compartmental Features Across Retinal Diseases.

IF 3 3区医学 Q1 MEDICINE, GENERAL & INTERNAL

Diagnostics Pub Date : 2024-10-27 DOI:10.3390/diagnostics14212395

Jordan Bell, Jon Whitney, Hasan Cetin, Thuy Le, Nicole Cardwell, Sunil K Srivasatava, Justis P Ehlers

{"title":"Validation of Inter-Reader Agreement/Consistency for Quantification of Ellipsoid Zone Integrity and Sub-RPE Compartmental Features Across Retinal Diseases.","authors":"Jordan Bell, Jon Whitney, Hasan Cetin, Thuy Le, Nicole Cardwell, Sunil K Srivasatava, Justis P Ehlers","doi":"10.3390/diagnostics14212395","DOIUrl":null,"url":null,"abstract":"Background: An unmet need exists when clinically assessing retinal and layer-based features of retinal diseases. Therefore, quantification of retinal-layer-thicknesses/fluid volumes using deep-learning-augmented platforms to reproduce human-obtained clinical measurements is needed.Methods: In this analysis, 210 spectral-domain optical coherence tomography (SD-OCT) scans (30 without pathology, 60 dry age-related macular degeneration [AMD], 60 wet AMD, and 60 diabetic macular edema [total 23,625 B-scans]) were included. A fully automated segmentation platform segmented four retinal layers for compartmental assessment (internal limiting membrane, ellipsoid zone [EZ], retinal pigment epithelium [RPE], and Bruch's membrane). Two certified OCT readers independently completed manual segmentation and B-scan level validation of automated segmentation, with segmentation correction when needed (semi-automated). Certified reader metrics were compared to gold standard metrics using intraclass correlation coefficients (ICCs) to assess overall agreement. Across different diseases, several metrics generated from automated segmentations approached or matched human readers performance.Results: Absolute ICCs for retinal mean thickness measurements showed excellent agreement (range 0.980-0.999) across four cohorts. EZ-RPE thickness values and sub-RPE compartment ICCs demonstrated excellent agreement (ranges of 0.953-0.987 and 0.944-0.997, respectively) for full dataset, dry-AMD, and wet-AMD cohorts.Conclusions: Analyses demonstrated high reliability and consistency of segmentation of outer retinal compartmental features using a completely human/manual approach or a semi-automated approach to segmentation. These results support the critical role that measuring features, such as photoreceptor preservation through EZ integrity, in future clinical trials may optimize clinical care.","PeriodicalId":11225,"journal":{"name":"Diagnostics","volume":"14 21","pages":""},"PeriodicalIF":3.0000,"publicationDate":"2024-10-27","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://www.ncbi.nlm.nih.gov/pmc/articles/PMC11545794/pdf/","citationCount":"0","resultStr":null,"platform":"Semanticscholar","paperid":null,"PeriodicalName":"Diagnostics","FirstCategoryId":"3","ListUrlMain":"https://doi.org/10.3390/diagnostics14212395","RegionNum":3,"RegionCategory":"医学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"Q1","JCRName":"MEDICINE, GENERAL & INTERNAL","Score":null,"Total":0}

引用次数: 0

Abstract

Background: An unmet need exists when clinically assessing retinal and layer-based features of retinal diseases. Therefore, quantification of retinal-layer-thicknesses/fluid volumes using deep-learning-augmented platforms to reproduce human-obtained clinical measurements is needed.

Methods: In this analysis, 210 spectral-domain optical coherence tomography (SD-OCT) scans (30 without pathology, 60 dry age-related macular degeneration [AMD], 60 wet AMD, and 60 diabetic macular edema [total 23,625 B-scans]) were included. A fully automated segmentation platform segmented four retinal layers for compartmental assessment (internal limiting membrane, ellipsoid zone [EZ], retinal pigment epithelium [RPE], and Bruch's membrane). Two certified OCT readers independently completed manual segmentation and B-scan level validation of automated segmentation, with segmentation correction when needed (semi-automated). Certified reader metrics were compared to gold standard metrics using intraclass correlation coefficients (ICCs) to assess overall agreement. Across different diseases, several metrics generated from automated segmentations approached or matched human readers performance.

Results: Absolute ICCs for retinal mean thickness measurements showed excellent agreement (range 0.980-0.999) across four cohorts. EZ-RPE thickness values and sub-RPE compartment ICCs demonstrated excellent agreement (ranges of 0.953-0.987 and 0.944-0.997, respectively) for full dataset, dry-AMD, and wet-AMD cohorts.

Conclusions: Analyses demonstrated high reliability and consistency of segmentation of outer retinal compartmental features using a completely human/manual approach or a semi-automated approach to segmentation. These results support the critical role that measuring features, such as photoreceptor preservation through EZ integrity, in future clinical trials may optimize clinical care.

查看原文本刊更多论文

验证不同视网膜疾病椭球带完整性和视网膜下区特征定量的读取器间一致性/一致性。

背景：在临床上评估视网膜疾病的视网膜和视网膜层特征时，存在着未满足的需求。因此，需要使用深度学习增强平台量化视网膜层厚/流体体积，以重现人类获得的临床测量结果：在这项分析中，纳入了 210 个光谱域光学相干断层扫描（SD-OCT）扫描（30 个无病变、60 个干性年龄相关性黄斑变性[AMD]、60 个湿性 AMD 和 60 个糖尿病性黄斑水肿[共计 23,625 B 扫描]）。全自动分割平台对四个视网膜层（内限膜、椭圆体区 [EZ]、视网膜色素上皮 [RPE] 和布鲁氏膜）进行分割，以便进行分区评估。两名经过认证的 OCT 阅读器独立完成手动分割和自动分割的 B 级扫描验证，必要时进行分割校正（半自动）。使用类内相关系数（ICC）将认证阅读器指标与金标准指标进行比较，以评估总体一致性。在不同的疾病中，自动分割生成的几个指标接近或匹配人类读者的表现：四个队列中视网膜平均厚度测量的绝对 ICC 显示出极好的一致性（范围为 0.980-0.999）。全数据集、干性-AMD 和湿性-AMD 队列的 EZ-RPE 厚度值和亚 RPE 区间 ICCs 显示出极好的一致性（范围分别为 0.953-0.987 和 0.944-0.997 ）：分析表明，采用完全人工/手动方法或半自动方法分割视网膜外区特征的可靠性和一致性很高。这些结果证明，在未来的临床试验中，通过 EZ 的完整性来测量感光细胞的保存等特征可以优化临床治疗，起到至关重要的作用。

本文章由计算机程序翻译，如有差异，请以英文原文为准。

求助全文

约1分钟内获得全文求助全文

来源期刊

Diagnostics Biochemistry, Genetics and Molecular Biology-Clinical Biochemistry

CiteScore

4.70

自引率

8.30%

发文量

2699

审稿时长

19.64 days

期刊介绍： Diagnostics (ISSN 2075-4418) is an international scholarly open access journal on medical diagnostics. It publishes original research articles, reviews, communications and short notes on the research and development of medical diagnostics. There is no restriction on the length of the papers. Our aim is to encourage scientists to publish their experimental and theoretical research in as much detail as possible. Full experimental and/or methodological details must be provided for research articles.