Yawen Guo, Jiayuan Wang, Di Hu, Steven Tam, Charles Gilman, Emilie Chow, Danielle Perret, Deepti Pandita, Kai Zheng
{"title":"Evaluating ambient artificial intelligence documentation: effects on work efficiency, documentation burden, and patient-centered care.","authors":"Yawen Guo, Jiayuan Wang, Di Hu, Steven Tam, Charles Gilman, Emilie Chow, Danielle Perret, Deepti Pandita, Kai Zheng","doi":"10.1093/jamia/ocaf180","DOIUrl":null,"url":null,"abstract":"<p><strong>Background and significance: </strong>Ambient listening tools powered by generative artificial intelligence (GenAI) offer real-time, scribe-like support that reduce documentation burden and may help alleviate burnout. This study assesses physician-perceived benefits and challenges of ambient AI implementation through surveys and evaluates its effectiveness in clinical workflows using automatically recorded electronic health record (EHR) time-efficiency metrics.</p><p><strong>Method and materials: </strong>A quality improvement pilot has been underway at UCI Health since December 2023. Epic EHR Signal metrics were analyzed to assess changes in note length, documentation time, and same-day encounter closure rates. Matched pre- and post-implementation surveys evaluated physician-perceived changes in documentation burden, clinical efficiency, and care quality. We also examined open-ended survey responses using thematic analysis to supplement quantitative findings.</p><p><strong>Results: </strong>Analysis on EHR usage data from 167 physicians showed significant reductions in note-writing time, despite an increase in note length. Survey responses (n = 65) also indicated statistically significant improvements across multiple domains. Physicians reported reduced cognitive demand (P = .031) and documentation effort (P = .014), alongside perceptions of enhanced clinical efficiency, patient-centered care, and EHR system usability. Thematic analysis confirmed these quantitative findings and identified opportunities for improvement, including specialty-specific customization and expanded AI functionality.</p><p><strong>Discussion: </strong>Ambient AI tools demonstrated improved documentation efficiency, perceived care quality, and reduced cognitive workload. These benefits suggest potential to alleviate key burdens in clinical documentation.</p><p><strong>Conclusion: </strong>Future development should prioritize customization for specialty-specific and individual physician needs, ensure the reliability and accuracy of AI-generated content, and integrate ethical and legal considerations to facilitate safe and scalable implementation in patient-centered care contexts.</p>","PeriodicalId":50016,"journal":{"name":"Journal of the American Medical Informatics Association","volume":" ","pages":""},"PeriodicalIF":4.6000,"publicationDate":"2025-10-16","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":"0","resultStr":null,"platform":"Semanticscholar","paperid":null,"PeriodicalName":"Journal of the American Medical Informatics Association","FirstCategoryId":"91","ListUrlMain":"https://doi.org/10.1093/jamia/ocaf180","RegionNum":2,"RegionCategory":"医学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"Q1","JCRName":"COMPUTER SCIENCE, INFORMATION SYSTEMS","Score":null,"Total":0}
引用次数: 0
Abstract
Background and significance: Ambient listening tools powered by generative artificial intelligence (GenAI) offer real-time, scribe-like support that reduce documentation burden and may help alleviate burnout. This study assesses physician-perceived benefits and challenges of ambient AI implementation through surveys and evaluates its effectiveness in clinical workflows using automatically recorded electronic health record (EHR) time-efficiency metrics.
Method and materials: A quality improvement pilot has been underway at UCI Health since December 2023. Epic EHR Signal metrics were analyzed to assess changes in note length, documentation time, and same-day encounter closure rates. Matched pre- and post-implementation surveys evaluated physician-perceived changes in documentation burden, clinical efficiency, and care quality. We also examined open-ended survey responses using thematic analysis to supplement quantitative findings.
Results: Analysis on EHR usage data from 167 physicians showed significant reductions in note-writing time, despite an increase in note length. Survey responses (n = 65) also indicated statistically significant improvements across multiple domains. Physicians reported reduced cognitive demand (P = .031) and documentation effort (P = .014), alongside perceptions of enhanced clinical efficiency, patient-centered care, and EHR system usability. Thematic analysis confirmed these quantitative findings and identified opportunities for improvement, including specialty-specific customization and expanded AI functionality.
Discussion: Ambient AI tools demonstrated improved documentation efficiency, perceived care quality, and reduced cognitive workload. These benefits suggest potential to alleviate key burdens in clinical documentation.
Conclusion: Future development should prioritize customization for specialty-specific and individual physician needs, ensure the reliability and accuracy of AI-generated content, and integrate ethical and legal considerations to facilitate safe and scalable implementation in patient-centered care contexts.
期刊介绍:
JAMIA is AMIA''s premier peer-reviewed journal for biomedical and health informatics. Covering the full spectrum of activities in the field, JAMIA includes informatics articles in the areas of clinical care, clinical research, translational science, implementation science, imaging, education, consumer health, public health, and policy. JAMIA''s articles describe innovative informatics research and systems that help to advance biomedical science and to promote health. Case reports, perspectives and reviews also help readers stay connected with the most important informatics developments in implementation, policy and education.