Carlos Dier, Sultan Alhajahjeh, Abdallah A Alqudah, Andres Gudino, Navami Shenoy, Martin A Cabarique, Elena Sagues, Sebastian Sanchez, Connor Aamot, Linder Wendt, Bruno A Policeni, Minako Hayakawa, Edgar A Samaniego
{"title":"Inter-rater reliability of atherosclerotic plaque enhancement on 7 T vessel wall MRI: Comparison with quantitative analysis.","authors":"Carlos Dier, Sultan Alhajahjeh, Abdallah A Alqudah, Andres Gudino, Navami Shenoy, Martin A Cabarique, Elena Sagues, Sebastian Sanchez, Connor Aamot, Linder Wendt, Bruno A Policeni, Minako Hayakawa, Edgar A Samaniego","doi":"10.1177/15910199251368719","DOIUrl":null,"url":null,"abstract":"<p><p>ObjectiveIntracranial plaque enhancement (IPE) is a potential biomarker of plaque vulnerability but lacks a standardized definition. While subjective assessment may be prone to observer variability, a voxel-based quantification method can detect subtle signal intensity (SI) changes. This study aimed to compare the inter-rater reliability of subjective IPE evaluation with that of a voxel-based quantification method.MethodsPatients with stroke due to intracranial atherosclerosis were prospectively imaged using 7 T vessel wall magnetic resonance imaging. Two adjudicators independently assessed IPE, with discrepancies resolved by a third, experienced neuroradiologist. IPE distribution was quantified using a semiautomated method based on SI measurements from post-contrast T1-weighted images. The mean enhancement ratio was calculated for each plaque to assess gadolinium enhancement. Inter-rater reproducibility and the concordance between subjective and objective assessments were evaluated. Regression analysis was performed to identify plaque morphological features that influenced the reliability of subjective IPE adjudication compared to the objective method.ResultsWe analyzed 75 plaques from 41 patients. Inter-rater agreement for IPE adjudication was poor (<i>κ</i> = 0.34). Following consensus, 43% of plaques (32/75) were classified as enhancing, whereas 57% (43/75) were non-enhancing. The agreement between subjective and objective IPE assessments was moderate (<i>κ</i> = 0.40, <i>p</i> < 0.001). Subjective assessment was more likely to reliably adjudicate IPE for plaques exhibiting >50% stenosis (odds ratio (OR), 1.04; <i>p</i> = 0.02) and a positive remodeling index (OR, 2.20; <i>p</i> = 0.02). In contrast, it was less reliable when evaluating posterior circulation plaques (OR, 0.23; <i>p</i> = 0.01).ConclusionSubjective assessment of IPE demonstrated poor inter-rater agreement and only moderate concordance with voxel-based quantification following consensus.</p>","PeriodicalId":49174,"journal":{"name":"Interventional Neuroradiology","volume":" ","pages":"15910199251368719"},"PeriodicalIF":2.1000,"publicationDate":"2025-08-24","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://www.ncbi.nlm.nih.gov/pmc/articles/PMC12375601/pdf/","citationCount":"0","resultStr":null,"platform":"Semanticscholar","paperid":null,"PeriodicalName":"Interventional Neuroradiology","FirstCategoryId":"3","ListUrlMain":"https://doi.org/10.1177/15910199251368719","RegionNum":4,"RegionCategory":"医学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"Q4","JCRName":"CLINICAL NEUROLOGY","Score":null,"Total":0}
引用次数: 0
Abstract
ObjectiveIntracranial plaque enhancement (IPE) is a potential biomarker of plaque vulnerability but lacks a standardized definition. While subjective assessment may be prone to observer variability, a voxel-based quantification method can detect subtle signal intensity (SI) changes. This study aimed to compare the inter-rater reliability of subjective IPE evaluation with that of a voxel-based quantification method.MethodsPatients with stroke due to intracranial atherosclerosis were prospectively imaged using 7 T vessel wall magnetic resonance imaging. Two adjudicators independently assessed IPE, with discrepancies resolved by a third, experienced neuroradiologist. IPE distribution was quantified using a semiautomated method based on SI measurements from post-contrast T1-weighted images. The mean enhancement ratio was calculated for each plaque to assess gadolinium enhancement. Inter-rater reproducibility and the concordance between subjective and objective assessments were evaluated. Regression analysis was performed to identify plaque morphological features that influenced the reliability of subjective IPE adjudication compared to the objective method.ResultsWe analyzed 75 plaques from 41 patients. Inter-rater agreement for IPE adjudication was poor (κ = 0.34). Following consensus, 43% of plaques (32/75) were classified as enhancing, whereas 57% (43/75) were non-enhancing. The agreement between subjective and objective IPE assessments was moderate (κ = 0.40, p < 0.001). Subjective assessment was more likely to reliably adjudicate IPE for plaques exhibiting >50% stenosis (odds ratio (OR), 1.04; p = 0.02) and a positive remodeling index (OR, 2.20; p = 0.02). In contrast, it was less reliable when evaluating posterior circulation plaques (OR, 0.23; p = 0.01).ConclusionSubjective assessment of IPE demonstrated poor inter-rater agreement and only moderate concordance with voxel-based quantification following consensus.
期刊介绍:
Interventional Neuroradiology (INR) is a peer-reviewed clinical practice journal documenting the current state of interventional neuroradiology worldwide. INR publishes original clinical observations, descriptions of new techniques or procedures, case reports, and articles on the ethical and social aspects of related health care. Original research published in INR is related to the practice of interventional neuroradiology...