David Fraile Navarro, A Baki Kocaballi, Shlomo Berkovsky
{"title":"了解临床医生对基因ai的看法:临床文献任务的混合方法分析。","authors":"David Fraile Navarro, A Baki Kocaballi, Shlomo Berkovsky","doi":"10.1007/s10916-025-02234-8","DOIUrl":null,"url":null,"abstract":"<p><p>This mixed-methods study evaluated clinicians' user experience (UX) with Generative AI (GenAI) in Electronic Health Record (EHR) systems across three clinical documentation tasks (Information Extraction, Summarization, and Speech-to-Text) at varying levels of user supervision (low, medium, high), focusing on workflow improvements, safety, and acceptable automation levels. Using conceptual prototyping in a usability study framework, we evaluated how incorporating GenAI into EHR could support the three documentation tasks at varying automation levels. A total of 38 clinicians interacted with the prototype and completed a questionnaire on task relevance, perceived importance, desired automation level, and EHR satisfaction. Both quantitative (descriptive statistics, Kruskal-Wallis tests, Spearman correlations) and qualitative (thematic) analyses were conducted with equal priority to explore preferences, perceived safety, and practical requirements. Clinicians showed positive reception to GenAI integration, particularly for streamlining documentation. While task relevance and importance were strongly correlated, EHR satisfaction did not significantly predict automation acceptance. Medium automation emerged as the preferred level, considered \"safe with caution\". Five key themes emerged from qualitative analysis: efficiency and quality benefits; system reliability concerns; safety and medico-legal considerations; automation bias and loss of nuance; and deployment requirements including adjustable settings and oversight. While clinicians welcome GenAI-driven documentation, they prefer moderate automation to balance efficiency with clinical control. Successful integration requires addressing safety concerns, conducting real-world trials, and mitigating potential biases and medico-legal challenges. These findings suggest a cautious but optimistic path forward for AI integration in EHR systems, emphasizing the importance of maintaining clinician oversight while leveraging automation benefits.</p>","PeriodicalId":16338,"journal":{"name":"Journal of Medical Systems","volume":"49 1","pages":"101"},"PeriodicalIF":5.7000,"publicationDate":"2025-08-02","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://www.ncbi.nlm.nih.gov/pmc/articles/PMC12317912/pdf/","citationCount":"0","resultStr":"{\"title\":\"Understanding Clinician Perceptions of GenAI: A Mixed Methods Analysis of Clinical Documentation Tasks.\",\"authors\":\"David Fraile Navarro, A Baki Kocaballi, Shlomo Berkovsky\",\"doi\":\"10.1007/s10916-025-02234-8\",\"DOIUrl\":null,\"url\":null,\"abstract\":\"<p><p>This mixed-methods study evaluated clinicians' user experience (UX) with Generative AI (GenAI) in Electronic Health Record (EHR) systems across three clinical documentation tasks (Information Extraction, Summarization, and Speech-to-Text) at varying levels of user supervision (low, medium, high), focusing on workflow improvements, safety, and acceptable automation levels. Using conceptual prototyping in a usability study framework, we evaluated how incorporating GenAI into EHR could support the three documentation tasks at varying automation levels. A total of 38 clinicians interacted with the prototype and completed a questionnaire on task relevance, perceived importance, desired automation level, and EHR satisfaction. Both quantitative (descriptive statistics, Kruskal-Wallis tests, Spearman correlations) and qualitative (thematic) analyses were conducted with equal priority to explore preferences, perceived safety, and practical requirements. Clinicians showed positive reception to GenAI integration, particularly for streamlining documentation. While task relevance and importance were strongly correlated, EHR satisfaction did not significantly predict automation acceptance. Medium automation emerged as the preferred level, considered \\\"safe with caution\\\". Five key themes emerged from qualitative analysis: efficiency and quality benefits; system reliability concerns; safety and medico-legal considerations; automation bias and loss of nuance; and deployment requirements including adjustable settings and oversight. While clinicians welcome GenAI-driven documentation, they prefer moderate automation to balance efficiency with clinical control. Successful integration requires addressing safety concerns, conducting real-world trials, and mitigating potential biases and medico-legal challenges. These findings suggest a cautious but optimistic path forward for AI integration in EHR systems, emphasizing the importance of maintaining clinician oversight while leveraging automation benefits.</p>\",\"PeriodicalId\":16338,\"journal\":{\"name\":\"Journal of Medical Systems\",\"volume\":\"49 1\",\"pages\":\"101\"},\"PeriodicalIF\":5.7000,\"publicationDate\":\"2025-08-02\",\"publicationTypes\":\"Journal Article\",\"fieldsOfStudy\":null,\"isOpenAccess\":false,\"openAccessPdf\":\"https://www.ncbi.nlm.nih.gov/pmc/articles/PMC12317912/pdf/\",\"citationCount\":\"0\",\"resultStr\":null,\"platform\":\"Semanticscholar\",\"paperid\":null,\"PeriodicalName\":\"Journal of Medical Systems\",\"FirstCategoryId\":\"3\",\"ListUrlMain\":\"https://doi.org/10.1007/s10916-025-02234-8\",\"RegionNum\":3,\"RegionCategory\":\"医学\",\"ArticlePicture\":[],\"TitleCN\":null,\"AbstractTextCN\":null,\"PMCID\":null,\"EPubDate\":\"\",\"PubModel\":\"\",\"JCR\":\"Q1\",\"JCRName\":\"HEALTH CARE SCIENCES & SERVICES\",\"Score\":null,\"Total\":0}","platform":"Semanticscholar","paperid":null,"PeriodicalName":"Journal of Medical Systems","FirstCategoryId":"3","ListUrlMain":"https://doi.org/10.1007/s10916-025-02234-8","RegionNum":3,"RegionCategory":"医学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"Q1","JCRName":"HEALTH CARE SCIENCES & SERVICES","Score":null,"Total":0}
Understanding Clinician Perceptions of GenAI: A Mixed Methods Analysis of Clinical Documentation Tasks.
This mixed-methods study evaluated clinicians' user experience (UX) with Generative AI (GenAI) in Electronic Health Record (EHR) systems across three clinical documentation tasks (Information Extraction, Summarization, and Speech-to-Text) at varying levels of user supervision (low, medium, high), focusing on workflow improvements, safety, and acceptable automation levels. Using conceptual prototyping in a usability study framework, we evaluated how incorporating GenAI into EHR could support the three documentation tasks at varying automation levels. A total of 38 clinicians interacted with the prototype and completed a questionnaire on task relevance, perceived importance, desired automation level, and EHR satisfaction. Both quantitative (descriptive statistics, Kruskal-Wallis tests, Spearman correlations) and qualitative (thematic) analyses were conducted with equal priority to explore preferences, perceived safety, and practical requirements. Clinicians showed positive reception to GenAI integration, particularly for streamlining documentation. While task relevance and importance were strongly correlated, EHR satisfaction did not significantly predict automation acceptance. Medium automation emerged as the preferred level, considered "safe with caution". Five key themes emerged from qualitative analysis: efficiency and quality benefits; system reliability concerns; safety and medico-legal considerations; automation bias and loss of nuance; and deployment requirements including adjustable settings and oversight. While clinicians welcome GenAI-driven documentation, they prefer moderate automation to balance efficiency with clinical control. Successful integration requires addressing safety concerns, conducting real-world trials, and mitigating potential biases and medico-legal challenges. These findings suggest a cautious but optimistic path forward for AI integration in EHR systems, emphasizing the importance of maintaining clinician oversight while leveraging automation benefits.
期刊介绍:
Journal of Medical Systems provides a forum for the presentation and discussion of the increasingly extensive applications of new systems techniques and methods in hospital clinic and physician''s office administration; pathology radiology and pharmaceutical delivery systems; medical records storage and retrieval; and ancillary patient-support systems. The journal publishes informative articles essays and studies across the entire scale of medical systems from large hospital programs to novel small-scale medical services. Education is an integral part of this amalgamation of sciences and selected articles are published in this area. Since existing medical systems are constantly being modified to fit particular circumstances and to solve specific problems the journal includes a special section devoted to status reports on current installations.