Pasquale Tondo, Giuseppe Antonio Palmiotti, Giancarlo D'Alagni, Terence Campanino, Giulia Scioscia, Francesco Inglese, Renato Giua, Leonardo Monteleone, Maria Cristina Colanardi, Gianluca Libero Ciliberti, Armando Leone, Antonio Notaristefano, Ruggiero Torraco, Grazia Napoli, Grazia Marangi, Michele Pirrelli, Maria Pia Foschino Barbaro, Crescenzio Gallo, Donato Lacedonia
{"title":"远程共享系统(E-ROSE)和人工智能算法(AI- rose)与金标准在肺癌诊断中的可靠性比较","authors":"Pasquale Tondo, Giuseppe Antonio Palmiotti, Giancarlo D'Alagni, Terence Campanino, Giulia Scioscia, Francesco Inglese, Renato Giua, Leonardo Monteleone, Maria Cristina Colanardi, Gianluca Libero Ciliberti, Armando Leone, Antonio Notaristefano, Ruggiero Torraco, Grazia Napoli, Grazia Marangi, Michele Pirrelli, Maria Pia Foschino Barbaro, Crescenzio Gallo, Donato Lacedonia","doi":"10.1111/resp.70104","DOIUrl":null,"url":null,"abstract":"<p><strong>Background and objective: </strong>In recent decades, artificial intelligence has seen significant development in various fields of medicine, including interventional pulmonology. The study aims to evaluate the diagnostic performance of innovative approaches to detect lung cancer on biopsy sample images (Rapid On-Site Evaluation, ROSE) compared to the diagnostic gold standard.</p><p><strong>Methods: </strong>We conducted a multicentric study, comparing remote anatomopathological evaluation (E-ROSE) and machine learning algorithms (AI-ROSE) reliability in diagnosing lung cancer, evaluating 277 biopsy sample images, 25 of which were doubtful; to compare them with the definitive histological examination performed by the pathologist.</p><p><strong>Results: </strong>E-ROSE achieved a diagnostic accuracy of 95.5%, with a sensitivity of 99.0% and specificity of 88.7%, including doubtful cases respectively 91.4%, 97.1%, and 81%. AI-ROSE showed a sensitivity of 96.4% and a specificity of 78.9%, with an accuracy of 92.5%. Including the doubtful cases, the best model achieved an accuracy of 85%, sensitivity of 97.4%, and specificity of 75.4%. The discriminative ability of the tests was compared both for positive/negative cases, showing Area Under ROC Curve (AUC) of 93.9% for E-ROSE and 87.6% for AI-ROSE; while including doubtful, AUC was 89.1% for E-ROSE and 86.4% for AI-ROSE.</p><p><strong>Conclusions: </strong>The study suggests that the application of innovative methods such as E-ROSE and AI-ROSE could provide valuable support to interventional pulmonologists in the diagnostic process.</p>","PeriodicalId":21129,"journal":{"name":"Respirology","volume":" ","pages":""},"PeriodicalIF":6.3000,"publicationDate":"2025-08-11","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":"0","resultStr":"{\"title\":\"Reliability of Rapid On-Site Evaluation Achieved by Remote Sharing Systems (E-ROSE) and AI Algorithms (AI-ROSE) Compared With the Gold Standard in the Diagnosis of Lung Cancer.\",\"authors\":\"Pasquale Tondo, Giuseppe Antonio Palmiotti, Giancarlo D'Alagni, Terence Campanino, Giulia Scioscia, Francesco Inglese, Renato Giua, Leonardo Monteleone, Maria Cristina Colanardi, Gianluca Libero Ciliberti, Armando Leone, Antonio Notaristefano, Ruggiero Torraco, Grazia Napoli, Grazia Marangi, Michele Pirrelli, Maria Pia Foschino Barbaro, Crescenzio Gallo, Donato Lacedonia\",\"doi\":\"10.1111/resp.70104\",\"DOIUrl\":null,\"url\":null,\"abstract\":\"<p><strong>Background and objective: </strong>In recent decades, artificial intelligence has seen significant development in various fields of medicine, including interventional pulmonology. The study aims to evaluate the diagnostic performance of innovative approaches to detect lung cancer on biopsy sample images (Rapid On-Site Evaluation, ROSE) compared to the diagnostic gold standard.</p><p><strong>Methods: </strong>We conducted a multicentric study, comparing remote anatomopathological evaluation (E-ROSE) and machine learning algorithms (AI-ROSE) reliability in diagnosing lung cancer, evaluating 277 biopsy sample images, 25 of which were doubtful; to compare them with the definitive histological examination performed by the pathologist.</p><p><strong>Results: </strong>E-ROSE achieved a diagnostic accuracy of 95.5%, with a sensitivity of 99.0% and specificity of 88.7%, including doubtful cases respectively 91.4%, 97.1%, and 81%. AI-ROSE showed a sensitivity of 96.4% and a specificity of 78.9%, with an accuracy of 92.5%. Including the doubtful cases, the best model achieved an accuracy of 85%, sensitivity of 97.4%, and specificity of 75.4%. The discriminative ability of the tests was compared both for positive/negative cases, showing Area Under ROC Curve (AUC) of 93.9% for E-ROSE and 87.6% for AI-ROSE; while including doubtful, AUC was 89.1% for E-ROSE and 86.4% for AI-ROSE.</p><p><strong>Conclusions: </strong>The study suggests that the application of innovative methods such as E-ROSE and AI-ROSE could provide valuable support to interventional pulmonologists in the diagnostic process.</p>\",\"PeriodicalId\":21129,\"journal\":{\"name\":\"Respirology\",\"volume\":\" \",\"pages\":\"\"},\"PeriodicalIF\":6.3000,\"publicationDate\":\"2025-08-11\",\"publicationTypes\":\"Journal Article\",\"fieldsOfStudy\":null,\"isOpenAccess\":false,\"openAccessPdf\":\"\",\"citationCount\":\"0\",\"resultStr\":null,\"platform\":\"Semanticscholar\",\"paperid\":null,\"PeriodicalName\":\"Respirology\",\"FirstCategoryId\":\"3\",\"ListUrlMain\":\"https://doi.org/10.1111/resp.70104\",\"RegionNum\":2,\"RegionCategory\":\"医学\",\"ArticlePicture\":[],\"TitleCN\":null,\"AbstractTextCN\":null,\"PMCID\":null,\"EPubDate\":\"\",\"PubModel\":\"\",\"JCR\":\"Q1\",\"JCRName\":\"RESPIRATORY SYSTEM\",\"Score\":null,\"Total\":0}","platform":"Semanticscholar","paperid":null,"PeriodicalName":"Respirology","FirstCategoryId":"3","ListUrlMain":"https://doi.org/10.1111/resp.70104","RegionNum":2,"RegionCategory":"医学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"Q1","JCRName":"RESPIRATORY SYSTEM","Score":null,"Total":0}
Reliability of Rapid On-Site Evaluation Achieved by Remote Sharing Systems (E-ROSE) and AI Algorithms (AI-ROSE) Compared With the Gold Standard in the Diagnosis of Lung Cancer.
Background and objective: In recent decades, artificial intelligence has seen significant development in various fields of medicine, including interventional pulmonology. The study aims to evaluate the diagnostic performance of innovative approaches to detect lung cancer on biopsy sample images (Rapid On-Site Evaluation, ROSE) compared to the diagnostic gold standard.
Methods: We conducted a multicentric study, comparing remote anatomopathological evaluation (E-ROSE) and machine learning algorithms (AI-ROSE) reliability in diagnosing lung cancer, evaluating 277 biopsy sample images, 25 of which were doubtful; to compare them with the definitive histological examination performed by the pathologist.
Results: E-ROSE achieved a diagnostic accuracy of 95.5%, with a sensitivity of 99.0% and specificity of 88.7%, including doubtful cases respectively 91.4%, 97.1%, and 81%. AI-ROSE showed a sensitivity of 96.4% and a specificity of 78.9%, with an accuracy of 92.5%. Including the doubtful cases, the best model achieved an accuracy of 85%, sensitivity of 97.4%, and specificity of 75.4%. The discriminative ability of the tests was compared both for positive/negative cases, showing Area Under ROC Curve (AUC) of 93.9% for E-ROSE and 87.6% for AI-ROSE; while including doubtful, AUC was 89.1% for E-ROSE and 86.4% for AI-ROSE.
Conclusions: The study suggests that the application of innovative methods such as E-ROSE and AI-ROSE could provide valuable support to interventional pulmonologists in the diagnostic process.
期刊介绍:
Respirology is a journal of international standing, publishing peer-reviewed articles of scientific excellence in clinical and clinically-relevant experimental respiratory biology and disease. Fields of research include immunology, intensive and critical care, epidemiology, cell and molecular biology, pathology, pharmacology, physiology, paediatric respiratory medicine, clinical trials, interventional pulmonology and thoracic surgery.
The Journal aims to encourage the international exchange of results and publishes papers in the following categories: Original Articles, Editorials, Reviews, and Correspondences.
Respirology is the preferred journal of the Thoracic Society of Australia and New Zealand, has been adopted as the preferred English journal of the Japanese Respiratory Society and the Taiwan Society of Pulmonary and Critical Care Medicine and is an official journal of the World Association for Bronchology and Interventional Pulmonology.