Mayo Clinic Proceedings. Digital health最新文献

{"title":"Appropriateness of Ophthalmology Recommendations From an Online Chat-Based Artificial Intelligence Model","authors":"Prashant D. Tailor MD ,&nbsp;Timothy T. Xu MD ,&nbsp;Blake H. Fortes MD ,&nbsp;Raymond Iezzi MD ,&nbsp;Timothy W. Olsen MD ,&nbsp;Matthew R. Starr MD ,&nbsp;Sophie J. Bakri MD ,&nbsp;Brittni A. Scruggs MD, PhD ,&nbsp;Andrew J. Barkmeier MD ,&nbsp;Sanjay V. Patel MD ,&nbsp;Keith H. Baratz MD ,&nbsp;Ashlie A. Bernhisel MD ,&nbsp;Lilly H. Wagner MD ,&nbsp;Andrea A. Tooley MD ,&nbsp;Gavin W. Roddy MD, PhD ,&nbsp;Arthur J. Sit MD ,&nbsp;Kristi Y. Wu MD ,&nbsp;Erick D. Bothun MD ,&nbsp;Sasha A. Mansukhani MBBS ,&nbsp;Brian G. Mohney MD ,&nbsp;Lauren A. Dalvin MD","doi":"10.1016/j.mcpdig.2024.01.003","DOIUrl":"https://doi.org/10.1016/j.mcpdig.2024.01.003","url":null,"abstract":"<div><h3>Objective</h3><p>To determine the appropriateness of ophthalmology recommendations from an online chat-based artificial intelligence model to ophthalmology questions.</p></div><div><h3>Patients and Methods</h3><p>Cross-sectional qualitative study from April 1, 2023, to April 30, 2023. A total of 192 questions were generated spanning all ophthalmic subspecialties. Each question was posed to a large language model (LLM) 3 times. The responses were graded by appropriate subspecialists as appropriate, inappropriate, or unreliable in 2 grading contexts. The first grading context was if the information was presented on a patient information site. The second was an LLM-generated draft response to patient queries sent by the electronic medical record (EMR). Appropriate was defined as accurate and specific enough to serve as a surrogate for physician-approved information. Main outcome measure was percentage of appropriate responses per subspecialty.</p></div><div><h3>Results</h3><p>For patient information site-related questions, the LLM provided an overall average of 79% appropriate responses. Variable rates of average appropriateness were observed across ophthalmic subspecialties for patient information site information ranging from 56% to 100%: cataract or refractive (92%), cornea (56%), glaucoma (72%), neuro-ophthalmology (67%), oculoplastic or orbital surgery (80%), ocular oncology (100%), pediatrics (89%), vitreoretinal diseases (86%), and uveitis (65%). For draft responses to patient questions via EMR, the LLM provided an overall average of 74% appropriate responses and varied by subspecialty: cataract or refractive (85%), cornea (54%), glaucoma (77%), neuro-ophthalmology (63%), oculoplastic or orbital surgery (62%), ocular oncology (90%), pediatrics (94%), vitreoretinal diseases (88%), and uveitis (55%). Stratifying grades across health information categories (disease and condition, risk and prevention, surgery-related, and treatment and management) showed notable but insignificant variations, with disease and condition often rated highest (72% and 69%) for appropriateness and surgery-related (55% and 51%) lowest, in both contexts.</p></div><div><h3>Conclusion</h3><p>This LLM reported mostly appropriate responses across multiple ophthalmology subspecialties in the context of both patient information sites and EMR-related responses to patient questions. Current LLM offerings require optimization and improvement before widespread clinical use.</p></div>","PeriodicalId":74127,"journal":{"name":"Mayo Clinic Proceedings. Digital health","volume":"2 1","pages":"Pages 119-128"},"PeriodicalIF":0.0,"publicationDate":"2024-02-15","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://www.sciencedirect.com/science/article/pii/S294976122400004X/pdfft?md5=5523855f19c376cfc730f0de31cbe918&pid=1-s2.0-S294976122400004X-main.pdf","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"139738261","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"OA","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}

{"title":"Artificial Intelligence Detection and Segmentation Models: A Systematic Review and Meta-Analysis of Brain Tumors in Magnetic Resonance Imaging","authors":"Ting-Wei Wang MD, PhD ,&nbsp;Yu-Chieh Shiao MD ,&nbsp;Jia-Sheng Hong PhD ,&nbsp;Wei-Kai Lee PhD ,&nbsp;Ming-Sheng Hsu MD ,&nbsp;Hao-Min Cheng MD, PhD ,&nbsp;Huai-Che Yang MD, PhD ,&nbsp;Cheng-Chia Lee MD, PhD ,&nbsp;Hung-Chuan Pan MD, PhD ,&nbsp;Weir Chiang You MD, PhD ,&nbsp;Jiing-Feng Lirng MD ,&nbsp;Wan-Yuo Guo MD, PhD ,&nbsp;Yu-Te Wu PhD","doi":"10.1016/j.mcpdig.2024.01.002","DOIUrl":"https://doi.org/10.1016/j.mcpdig.2024.01.002","url":null,"abstract":"<div><h3>Objective</h3><p>To thoroughly analyze factors affecting the generalization ability of deep learning algorithms on brain tumor detection and segmentation models.</p></div><div><h3>Patients and Methods</h3><p>We searched PubMed, Embase, Web of Science, Cochrane Library, and IEEE from inception to July 25, 2023, and 19 studies with 12,000 patients were identified. The criteria required studies to use magnetic resonance imaging (MRI) for brain tumor detection and segmentation, offer clear performance metrics, and use external validation data sets. The study focused on outcomes such as sensitivity and Dice score. Study quality was assessed using QUADAS-2 and CLAIM tools. The meta-analysis evaluated varying algorithms and their performance across different validation data sets.</p></div><div><h3>Results</h3><p>MRI hardware as the manufacturer may contribute to data set diversity, impacting AI model generalizability. The study found that the best algorithms had a pooled lesion-wise Dice score of 84%, with pooled sensitivities of 87% (patient-wise) and 86% (lesion-wise). Post-2022 methodologies highlighted evolving artificial intelligence techniques. Performance differences were evident among tumor types, likely due to size disparities. 3D models outperformed their 2D and ensemble counterparts in detection. Although specific preprocessing techniques improved segmentation outcomes, some hindered detection.</p></div><div><h3>Conclusion</h3><p>The study underscores the potential of deep learning in improving brain tumor diagnostics and treatment planning. We also identify the need for further research, including developing a comprehensive diversity index, expanded meta-analyses, and using generative adversarial networks for data diversification, paving the way for AI-driven advancements in oncological patient care.</p></div><div><h3>Trial Registration</h3><p>PROPERO (CRD42023459108).</p></div>","PeriodicalId":74127,"journal":{"name":"Mayo Clinic Proceedings. Digital health","volume":"2 1","pages":"Pages 75-91"},"PeriodicalIF":0.0,"publicationDate":"2024-02-04","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://www.sciencedirect.com/science/article/pii/S2949761224000038/pdfft?md5=462accb0c195aebed809efe8ef0de1df&pid=1-s2.0-S2949761224000038-main.pdf","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"139675998","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"OA","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}

{"title":"Thyroid Ultrasound Appropriateness Identification Through Natural Language Processing of Electronic Health Records","authors":"Cristian Soto Jacome MD ,&nbsp;Danny Segura Torres MD ,&nbsp;Jungwei W. Fan PhD ,&nbsp;Ricardo Loor-Torres MD ,&nbsp;Mayra Duran MD ,&nbsp;Misk Al Zahidy MS ,&nbsp;Esteban Cabezas MD ,&nbsp;Mariana Borras-Osorio MD ,&nbsp;David Toro-Tobon MD ,&nbsp;Yuqi Wu PhD ,&nbsp;Yonghui Wu PhD ,&nbsp;Naykky Singh Ospina MD, MS ,&nbsp;Juan P. Brito MD, MS","doi":"10.1016/j.mcpdig.2024.01.001","DOIUrl":"https://doi.org/10.1016/j.mcpdig.2024.01.001","url":null,"abstract":"<div><h3>Objective</h3><p>To address thyroid cancer overdiagnosis, we aim to develop a natural language processing (NLP) algorithm to determine the appropriateness of thyroid ultrasounds (TUS).</p></div><div><h3>Patients and Methods</h3><p>Between 2017 and 2021, we identified 18,000 TUS patients at Mayo Clinic and selected 628 for chart review to create a ground truth dataset based on consensus. We developed a rule-based NLP pipeline to identify TUS as appropriate TUS (aTUS) or inappropriate TUS (iTUS) using patients’ clinical notes and additional meta information. In addition, we designed an abbreviated NLP pipeline (aNLP) solely focusing on labels from TUS order requisitions to facilitate deployment at other health care systems. Our dataset was split into a training set of 468 (75%) and a test set of 160 (25%), using the former for rule development and the latter for performance evaluation.</p></div><div><h3>Results</h3><p>There were 449 (95.9%) patients identified as aTUS and 19 (4.06%) as iTUS in the training set; there are 155 (96.88%) patients identified as aTUS and 5 (3.12%) were iTUS in the test set. In the training set, the pipeline achieved a sensitivity of 0.99, specificity of 0.95, and positive predictive value of 1.0 for detecting aTUS. The testing cohort revealed a sensitivity of 0.96, specificity of 0.80, and positive predictive value of 0.99. Similar performance metrics were observed in the aNLP pipeline.</p></div><div><h3>Conclusion</h3><p>The NLP models can accurately identify the appropriateness of a thyroid ultrasound from clinical documentation and order requisition information, a critical initial step toward evaluating the drivers and outcomes of TUS use and subsequent thyroid cancer overdiagnosis.</p></div>","PeriodicalId":74127,"journal":{"name":"Mayo Clinic Proceedings. Digital health","volume":"2 1","pages":"Pages 67-74"},"PeriodicalIF":0.0,"publicationDate":"2024-02-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://www.sciencedirect.com/science/article/pii/S2949761224000014/pdfft?md5=b25e9a7547bfbd148935d7e81234eadb&pid=1-s2.0-S2949761224000014-main.pdf","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"139674437","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"OA","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}

{"title":"From 0-50 in Pandemic, and Then Back? A Case Study of Virtual Care in Ontario Pre–COVID-19, During, and Post–COVID-19","authors":"Marisa L. Kfrerer MSc ,&nbsp;Kelly Zhang Zheng MSc ,&nbsp;Laurel C. Austin PhD","doi":"10.1016/j.mcpdig.2023.07.004","DOIUrl":"https://doi.org/10.1016/j.mcpdig.2023.07.004","url":null,"abstract":"<div><p>We review the evolution of virtual care (VC) in Ontario. Pre–COVID-19, the primary focus was on patients in remote and underserved areas who went to host sites for care. Ontario’s vision pre-pandemic was for a gradual increase in VC by physicians registered with the Ontario Telemedicine Network (OTN), using OTN-approved video technologies; some accommodated patients and doctors wherever they were. Less than 1% of care was virtual pre-pandemic. We discuss how policies that altered access to in-person care (pandemic lockdowns and guidelines to seek and provide care virtually), compensation policy changes (allowing any Ontario physician to be compensated for VC), and policies allowing common technologies not previously allowed (including, importantly, the telephone), drove and enabled a rapid shift to &gt;50% of care being virtual at the start of the pandemic, leveling off to ∼30% over time. We review policy changes in late 2022 and predict these will result in a drop in VC compared with the policies during the pandemic, particularly for walk-in clinic patients, in a province where 2.2-4.6 million people do not have a primary care doctor and presumably use walk-in clinics. This is because, going forward, physicians will be compensated less for telephone care than for in-person or video care for rostered patients, and because compensation will be less still for telephone or video care provided to walk-in patients. Through this case study we develop a visual model of how these key policy and technology factors influence the provision of VC.</p></div>","PeriodicalId":74127,"journal":{"name":"Mayo Clinic Proceedings. Digital health","volume":"2 1","pages":"Pages 57-66"},"PeriodicalIF":0.0,"publicationDate":"2024-01-19","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://www.sciencedirect.com/science/article/pii/S2949761223000640/pdfft?md5=7020db9c8c949d3fcbbfdc8245eee591&pid=1-s2.0-S2949761223000640-main.pdf","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"139493761","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"OA","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}

{"title":"Growth of the Medical Chat Bot—The Teething Problems of Childhood","authors":"Hemanth Asirvatham,&nbsp;Samuel J. Asirvatham MD","doi":"10.1016/j.mcpdig.2023.12.001","DOIUrl":"https://doi.org/10.1016/j.mcpdig.2023.12.001","url":null,"abstract":"","PeriodicalId":74127,"journal":{"name":"Mayo Clinic Proceedings. Digital health","volume":"2 1","pages":"Pages 53-56"},"PeriodicalIF":0.0,"publicationDate":"2024-01-16","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://www.sciencedirect.com/science/article/pii/S2949761223001050/pdfft?md5=72922f819b9c2bca879675f20cf28dd7&pid=1-s2.0-S2949761223001050-main.pdf","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"139480091","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"OA","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}

{"title":"Long-Term Survival and CANARY-Based Artificial Intelligence for Multifocal Lung Adenocarcinoma","authors":"Sahar A. Saddoughi MD, PhD ,&nbsp;Chelsea Powell MD ,&nbsp;Gregory R. Stroh MD ,&nbsp;Srinivasan Rajagopalan PhD ,&nbsp;Brian J. Bartholmai MD ,&nbsp;Jennifer M. Boland MD ,&nbsp;Marie Christine Aubry MD ,&nbsp;William S. Harmsen MS ,&nbsp;Shanda H. Blackmon MD, MPH ,&nbsp;Stephen D. Cassivi MD ,&nbsp;Francis C. Nichols MD ,&nbsp;Janani S. Reisenauer MD ,&nbsp;K. Robert Shen MD ,&nbsp;Aaron S. Mansfield MD ,&nbsp;Fabien Maldonado MD ,&nbsp;Tobias Peikert MD ,&nbsp;Dennis A. Wigle MD, PhD","doi":"10.1016/j.mcpdig.2023.10.006","DOIUrl":"https://doi.org/10.1016/j.mcpdig.2023.10.006","url":null,"abstract":"<div><h3>Objective</h3><p>To investigate whether an artificial intelligence (AI)–based model can predict tumor invasiveness in patients with multifocal lung adenocarcinoma (MFLA).</p></div><div><h3>Patients and Methods</h3><p>Patients with MFLA who underwent surgical resection were enrolled to a prospective registry trial (NCT01946100). Each identified nodule underwent retrospective computer-aided nodule assessment and risk yield (CANARY)–based AI to determine a quantitative degree of invasiveness. Data regarding age, sex, medical and surgical management, and survival were collected and analyzed. Pathologic review was performed by a pulmonary pathologist with comprehensive histologic subtyping.</p></div><div><h3>Results</h3><p>From January 1, 2013, through December 31, 2018, 68 patients with MFLA underwent at least 1 surgical resection. Five-year survival for the cohort was 91%, and 10-year survival was 73.6%. No significant differences in survival were observed when separated by sex, number, or size of the nodules. A 10-year survival trend was seen when comparing patients with unilateral (100% survival) vs bilateral disease (66%). Retrospective CANARY-based AI analysis demonstrated that the majority of the nodules present at the time of diagnosis (229/302; 75.8%) were classified good, with an average score of 0.19, suggesting indolent clinical behavior and noninvasive pathology. However, AI-CANARY scores of the surgically removed nodules were significantly higher compared with those of the nonresected nodules (<em>P</em>=.001).</p></div><div><h3>Conclusion</h3><p>The long-term survival for patients with N0, M0 MFLA who have undergone surgical resection may approach those of stage I non–small cell lung cancer. CANARY-based AI has the potential to stratify individual nodules to help guide surgical intervention versus observation of nodules.</p></div><div><h3>Trial Registration</h3><p>clinicaltrials.gov Identifier: <span>NCT01946100</span><svg><path></path></svg></p></div>","PeriodicalId":74127,"journal":{"name":"Mayo Clinic Proceedings. Digital health","volume":"2 1","pages":"Pages 44-52"},"PeriodicalIF":0.0,"publicationDate":"2024-01-11","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://www.sciencedirect.com/science/article/pii/S2949761223000962/pdfft?md5=01a99d51f5cb3c82901fc8e3f9c673f6&pid=1-s2.0-S2949761223000962-main.pdf","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"139419382","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"OA","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}

{"title":"As Suicide Prediction With Artificial Intelligence Moves Forward, Barriers to Implementation Remain","authors":"Krisda H. Chaiyachati MD, MPH, MSHP","doi":"10.1016/j.mcpdig.2023.11.009","DOIUrl":"https://doi.org/10.1016/j.mcpdig.2023.11.009","url":null,"abstract":"","PeriodicalId":74127,"journal":{"name":"Mayo Clinic Proceedings. Digital health","volume":"2 1","pages":"Pages 41-43"},"PeriodicalIF":0.0,"publicationDate":"2023-12-26","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://www.sciencedirect.com/science/article/pii/S2949761223001001/pdfft?md5=c2e289d2bac344149c01c0e62b7de591&pid=1-s2.0-S2949761223001001-main.pdf","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"139100995","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"OA","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}

{"title":"Response to In-Home Virtual Reality Program for Chronic Lower Back Pain: A Randomized Sham-Controlled Effectiveness Trial in a Clinically Severe and Diverse Sample","authors":"Jesper Knoop PhD,&nbsp;Syl Slatman MSc,&nbsp;Bart Staal PhD","doi":"10.1016/j.mcpdig.2023.11.010","DOIUrl":"https://doi.org/10.1016/j.mcpdig.2023.11.010","url":null,"abstract":"","PeriodicalId":74127,"journal":{"name":"Mayo Clinic Proceedings. Digital health","volume":"2 1","pages":"Pages 38-40"},"PeriodicalIF":0.0,"publicationDate":"2023-12-26","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://www.sciencedirect.com/science/article/pii/S2949761223001013/pdfft?md5=321080370c2e270aafcb07775a7dd897&pid=1-s2.0-S2949761223001013-main.pdf","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"139100994","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"OA","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}

{"title":"Can Technology Solve the Problem of Medication Nonadherence?","authors":"Lisa Gualtieri PhD, ScM ,&nbsp;Sandra Rosenbluth MS","doi":"10.1016/j.mcpdig.2023.11.008","DOIUrl":"https://doi.org/10.1016/j.mcpdig.2023.11.008","url":null,"abstract":"","PeriodicalId":74127,"journal":{"name":"Mayo Clinic Proceedings. Digital health","volume":"2 1","pages":"Pages 34-37"},"PeriodicalIF":0.0,"publicationDate":"2023-12-22","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://www.sciencedirect.com/science/article/pii/S2949761223000998/pdfft?md5=56155066407cec488eb7ed42b47c40a7&pid=1-s2.0-S2949761223000998-main.pdf","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"139033789","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"OA","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}

{"title":"Holes in the Armor: Addressing the Gaps in Health Care Cybersecurity in the Philippines and Beyond","authors":"Vergil de Claro MPM, MScPH ,&nbsp;Apple de Claro BSM","doi":"10.1016/j.mcpdig.2023.11.007","DOIUrl":"https://doi.org/10.1016/j.mcpdig.2023.11.007","url":null,"abstract":"","PeriodicalId":74127,"journal":{"name":"Mayo Clinic Proceedings. Digital health","volume":"2 1","pages":"Pages 32-33"},"PeriodicalIF":0.0,"publicationDate":"2023-12-20","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://www.sciencedirect.com/science/article/pii/S2949761223000986/pdfft?md5=fbe90892a31f2df87830abd8ec4b0866&pid=1-s2.0-S2949761223000986-main.pdf","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"138839870","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"OA","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}