Pierre-Olivier Comby, Tim E Darsaut, Anass Benomar, Daniela Iancu, Daniel Roy, Roland Jabre, Alain Weill, Nicolas Lecaros, Hanan Alhazmi, Francois Zhu, Thanh N Nguyen, Robert Fahed, William Boisseau, Benjamin Maïer, Johanna Eneling, David Volders, Stephanos Finitsis, Leonardo Olijnyk, Geraud Forestier, Nicolas Raynaud, Adrien Guenego, Jean-François Hak, Vincent L'Allinec, Michael M C Chow, Angélique Bernard, François Lébeaupin, Laura Baptiste, Pierre Thouant, Brivael Lemogne, Marc Lenfant, Jean Raymond
{"title":"MRA evaluation of aneurysms treated with woven endobridge (WEB) devices or coils: an inter- and intra-observer reliability study.","authors":"Pierre-Olivier Comby, Tim E Darsaut, Anass Benomar, Daniela Iancu, Daniel Roy, Roland Jabre, Alain Weill, Nicolas Lecaros, Hanan Alhazmi, Francois Zhu, Thanh N Nguyen, Robert Fahed, William Boisseau, Benjamin Maïer, Johanna Eneling, David Volders, Stephanos Finitsis, Leonardo Olijnyk, Geraud Forestier, Nicolas Raynaud, Adrien Guenego, Jean-François Hak, Vincent L'Allinec, Michael M C Chow, Angélique Bernard, François Lébeaupin, Laura Baptiste, Pierre Thouant, Brivael Lemogne, Marc Lenfant, Jean Raymond","doi":"10.1007/s00234-025-03706-x","DOIUrl":null,"url":null,"abstract":"<p><strong>Background: </strong>Magnetic resonance angiography (MRA) is a commonly used non-invasive imaging modality for the follow-up of treated intracranial aneurysms. The 3-category Montreal classification system is widely used to evaluate treatment outcomes, including aneurysms treated with Woven EndoBridge (WEB) devices or coils. This study aimed to assess the reliability and clinical implications of the Montreal scale for aneurysms imaged with MRA.</p><p><strong>Methods: </strong>An electronic portfolio of 60 aneurysms (30 treated with WEB devices and 30 with coils) was evaluated by 30 raters from diverse clinical backgrounds. Raters graded aneurysm occlusion using the Montreal classification system and provided management recommendations (delayed follow-up, close follow-up, or re-treatment). Twenty-three raters completed a second evaluation of permuted cases after one month. Reliability was assessed using Gwet's AC2 (κG) coefficients, and the correlation between occlusion grade and management recommendation was analyzed with Cramer's V.</p><p><strong>Results: </strong>Inter-rater agreement for occlusion grades was substantial (κG = 0.70; 95% CI: 0.66-0.75) and similar for WEB-treated (κG = 0.66; 95% CI: 0.59-0.74) and coiled aneurysms (κG = 0.75; 95% CI: 0.68-0.82). Management decisions showed substantial agreement overall (κG = 0.68; 95% CI: 0.60-0.76). Mean intra-rater agreement was almost perfect (κG = 0.84 ± 0.06). Strong correlations were observed between occlusion grades and management recommendations (mean Cramer's V = 0.78 ± 0.13), with consistent management strategies across treatment modalities.</p><p><strong>Conclusion: </strong>The Montreal scale demonstrated substantial reliability and clinical relevance for evaluating aneurysms treated with WEB or coils using MRA, supporting its use in non-invasive follow-up protocols.</p>","PeriodicalId":19422,"journal":{"name":"Neuroradiology","volume":" ","pages":""},"PeriodicalIF":2.4000,"publicationDate":"2025-07-22","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":"0","resultStr":null,"platform":"Semanticscholar","paperid":null,"PeriodicalName":"Neuroradiology","FirstCategoryId":"3","ListUrlMain":"https://doi.org/10.1007/s00234-025-03706-x","RegionNum":3,"RegionCategory":"医学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"Q2","JCRName":"CLINICAL NEUROLOGY","Score":null,"Total":0}
引用次数: 0
Abstract
Background: Magnetic resonance angiography (MRA) is a commonly used non-invasive imaging modality for the follow-up of treated intracranial aneurysms. The 3-category Montreal classification system is widely used to evaluate treatment outcomes, including aneurysms treated with Woven EndoBridge (WEB) devices or coils. This study aimed to assess the reliability and clinical implications of the Montreal scale for aneurysms imaged with MRA.
Methods: An electronic portfolio of 60 aneurysms (30 treated with WEB devices and 30 with coils) was evaluated by 30 raters from diverse clinical backgrounds. Raters graded aneurysm occlusion using the Montreal classification system and provided management recommendations (delayed follow-up, close follow-up, or re-treatment). Twenty-three raters completed a second evaluation of permuted cases after one month. Reliability was assessed using Gwet's AC2 (κG) coefficients, and the correlation between occlusion grade and management recommendation was analyzed with Cramer's V.
Results: Inter-rater agreement for occlusion grades was substantial (κG = 0.70; 95% CI: 0.66-0.75) and similar for WEB-treated (κG = 0.66; 95% CI: 0.59-0.74) and coiled aneurysms (κG = 0.75; 95% CI: 0.68-0.82). Management decisions showed substantial agreement overall (κG = 0.68; 95% CI: 0.60-0.76). Mean intra-rater agreement was almost perfect (κG = 0.84 ± 0.06). Strong correlations were observed between occlusion grades and management recommendations (mean Cramer's V = 0.78 ± 0.13), with consistent management strategies across treatment modalities.
Conclusion: The Montreal scale demonstrated substantial reliability and clinical relevance for evaluating aneurysms treated with WEB or coils using MRA, supporting its use in non-invasive follow-up protocols.
期刊介绍:
Neuroradiology aims to provide state-of-the-art medical and scientific information in the fields of Neuroradiology, Neurosciences, Neurology, Psychiatry, Neurosurgery, and related medical specialities. Neuroradiology as the official Journal of the European Society of Neuroradiology receives submissions from all parts of the world and publishes peer-reviewed original research, comprehensive reviews, educational papers, opinion papers, and short reports on exceptional clinical observations and new technical developments in the field of Neuroimaging and Neurointervention. The journal has subsections for Diagnostic and Interventional Neuroradiology, Advanced Neuroimaging, Paediatric Neuroradiology, Head-Neck-ENT Radiology, Spine Neuroradiology, and for submissions from Japan. Neuroradiology aims to provide new knowledge about and insights into the function and pathology of the human nervous system that may help to better diagnose and treat nervous system diseases. Neuroradiology is a member of the Committee on Publication Ethics (COPE) and follows the COPE core practices. Neuroradiology prefers articles that are free of bias, self-critical regarding limitations, transparent and clear in describing study participants, methods, and statistics, and short in presenting results. Before peer-review all submissions are automatically checked by iThenticate to assess for potential overlap in prior publication.