JAMIA Open最新文献

筛选
英文 中文
Reproducible generative artificial intelligence evaluation for health care: a clinician-in-the-loop approach. 医疗保健的可再生生成人工智能评估:临床医生在循环中的方法。
IF 2.5
JAMIA Open Pub Date : 2025-06-16 eCollection Date: 2025-06-01 DOI: 10.1093/jamiaopen/ooaf054
Leah Livingston, Amber Featherstone-Uwague, Amanda Barry, Kenneth Barretto, Tara Morey, Drahomira Herrmannova, Venkatesh Avula
{"title":"Reproducible generative artificial intelligence evaluation for health care: a clinician-in-the-loop approach.","authors":"Leah Livingston, Amber Featherstone-Uwague, Amanda Barry, Kenneth Barretto, Tara Morey, Drahomira Herrmannova, Venkatesh Avula","doi":"10.1093/jamiaopen/ooaf054","DOIUrl":"10.1093/jamiaopen/ooaf054","url":null,"abstract":"<p><strong>Objectives: </strong>To develop and apply a reproducible methodology for evaluating generative artificial intelligence (AI) powered systems in health care, addressing the gap between theoretical evaluation frameworks and practical implementation guidance.</p><p><strong>Materials and methods: </strong>A 5-dimension evaluation framework was developed to assess query comprehension and response helpfulness, correctness, completeness, and potential clinical harm. The framework was applied to evaluate ClinicalKey AI using queries drawn from user logs, a benchmark dataset, and subject matter expert curated queries. Forty-one board-certified physicians and pharmacists were recruited to independently evaluate query-response pairs. An agreement protocol using the mode and modified Delphi method resolved disagreements in evaluation scores.</p><p><strong>Results: </strong>Of 633 queries, 614 (96.99%) produced evaluable responses, with subject matter experts completing evaluations of 426 query-response pairs. Results demonstrated high rates of response correctness (95.5%) and query comprehension (98.6%), with 94.4% of responses rated as helpful. Two responses (0.47%) received scores indicating potential clinical harm. Pairwise consensus occurred in 60.6% of evaluations, with remaining cases requiring third tie-breaker review.</p><p><strong>Discussion: </strong>The framework demonstrated effectiveness in quantifying performance through comprehensive evaluation dimensions and structured scoring resolution methods. Key strengths included representative query sampling, standardized rating scales, and robust subject matter expert agreement protocols. Challenges emerged in managing subjective assessments of open-ended responses and achieving consensus on potential harm classification.</p><p><strong>Conclusion: </strong>This framework offers a reproducible methodology for evaluating health-care generative AI systems, establishing foundational processes that can inform future efforts while supporting the implementation of generative AI applications in clinical settings.</p>","PeriodicalId":36278,"journal":{"name":"JAMIA Open","volume":"8 3","pages":"ooaf054"},"PeriodicalIF":2.5,"publicationDate":"2025-06-16","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://www.ncbi.nlm.nih.gov/pmc/articles/PMC12169418/pdf/","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"144310458","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"OA","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 0
Computerized diagnostic decision support systems-Isabel Pro versus ChatGPT-4 part II. 计算机诊断决策支持系统- isabel Pro与ChatGPT-4第二部分。
IF 2.5
JAMIA Open Pub Date : 2025-06-16 eCollection Date: 2025-06-01 DOI: 10.1093/jamiaopen/ooaf048
Joe M Bridges, Xiaoqian Jiang, Michael Ige, Oluwatoniloba Toyobo
{"title":"Computerized diagnostic decision support systems-Isabel Pro versus ChatGPT-4 part II.","authors":"Joe M Bridges, Xiaoqian Jiang, Michael Ige, Oluwatoniloba Toyobo","doi":"10.1093/jamiaopen/ooaf048","DOIUrl":"10.1093/jamiaopen/ooaf048","url":null,"abstract":"<p><strong>Objective: </strong>Does a Tree-of-Thought prompt and reconsideration of Isabel Pro's differential improve ChatGPT-4's accuracy; does increasing expert panel size improve ChatGPT-4's accuracy; does ChatGPT-4 produce consistent outputs in sequential requests; what is the frequency of fabricated references?</p><p><strong>Materials and methods: </strong>Isabel Pro, a computerized diagnostic decision support system, and ChatGPT-4, a large language model. Using 201 cases from the New England Journal of Medicine, each system produced a differential diagnosis ranked by likelihood. Statistics were Mean Reciprocal Rank, Recall at Rank, Average Rank, Number of Correct Diagnoses, and Rank Improvement. For reproducibility, the study compared the initial expert panel run to each subsequent run, using the r-squared calculation from a scatter plot of each run.</p><p><strong>Results: </strong>ChatGPT-4 improved MRR and Recall at 10 to 0.72 but produced fewer correct diagnoses and lower average rank. Reconsideration of the Isabel Pro differential produced an improvement in Recall at 10 of 11%. The expert panel size of two produced the best result. The reproducibility runs were within 4% on average for Recall at 10, but the scatterplots showed an r-squared ranging from 0.44 to 034, suggesting poor reproducibility. Reference accuracy was 34.8% for citations and 37.8% for DOIs.</p><p><strong>Discussion: </strong>ChatGPT-4 performs well with images and electrocardiography and in administrative practice management, but diagnosis has not proven as promising.</p><p><strong>Conclusions: </strong>As noted above, the results demonstrate concerns for diagnostic accuracy, reproducibility, and reference citation accuracy. Until these issues are resolved, clinical usage for diagnosis will be minimal, if at all.</p>","PeriodicalId":36278,"journal":{"name":"JAMIA Open","volume":"8 3","pages":"ooaf048"},"PeriodicalIF":2.5,"publicationDate":"2025-06-16","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://www.ncbi.nlm.nih.gov/pmc/articles/PMC12169417/pdf/","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"144310457","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"OA","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 0
Complexities and approaches for deriving longitudinal daily morphine milligram equivalents using electronic health record prescription data. 利用电子健康记录处方数据获得纵向每日吗啡毫克当量的复杂性和方法。
IF 2.5
JAMIA Open Pub Date : 2025-06-16 eCollection Date: 2025-06-01 DOI: 10.1093/jamiaopen/ooaf053
Samantha H Chang, Shawn C Hirsch, Sonia M Thomas, Mark J Edlund, Rowena J Dolor, Timothy J Ives, Charlene M Dewey, Padma Gulur, Paul R Chelminski, Kristin R Archer, Li-Tzy Wu, Janis Curtis, Adam O Goldstein, Lauren A McCormack
{"title":"Complexities and approaches for deriving longitudinal daily morphine milligram equivalents using electronic health record prescription data.","authors":"Samantha H Chang, Shawn C Hirsch, Sonia M Thomas, Mark J Edlund, Rowena J Dolor, Timothy J Ives, Charlene M Dewey, Padma Gulur, Paul R Chelminski, Kristin R Archer, Li-Tzy Wu, Janis Curtis, Adam O Goldstein, Lauren A McCormack","doi":"10.1093/jamiaopen/ooaf053","DOIUrl":"10.1093/jamiaopen/ooaf053","url":null,"abstract":"<p><strong>Objective: </strong>To describe challenges and solutions for calculating longitudinal daily opioid dose in morphine milligram equivalents from electronic health record prescriptions for a clinical trial of voluntary opioid reduction in patients with chronic non-cancer pain.</p><p><strong>Materials and methods: </strong>Researchers obtained opioid prescriptions for 525 participants from the National Patient-Centered Clinical Research Network datamart at three health systems. Daily opioid dose was calculated using dose conversions and summing across prescriptions after applying assumptions, reviewing suspect prescribing patterns, and removing spurious prescriptions.</p><p><strong>Results: </strong>Out of 16 071 extracted prescriptions, 1207 (8%) were unusable, and 14 864 (92%) were analyzed.</p><p><strong>Discussion: </strong>Numerous challenges were identified related to incomplete data, inaccurate refill dates, and overlapping or duplicate prescriptions.</p><p><strong>Conclusion: </strong>Using electronic prescription data to calculate daily doses of opioid consumption is challenging and requires significant cleaning prior to use in research. This paper recommends steps to review and clean electronic opioid prescription data.</p>","PeriodicalId":36278,"journal":{"name":"JAMIA Open","volume":"8 3","pages":"ooaf053"},"PeriodicalIF":2.5,"publicationDate":"2025-06-16","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://www.ncbi.nlm.nih.gov/pmc/articles/PMC12169419/pdf/","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"144310456","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"OA","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 0
Real-time automated billing for tobacco treatment: developing and validating a scalable machine learning approach. 烟草治疗的实时自动计费:开发和验证可扩展的机器学习方法。
IF 2.5
JAMIA Open Pub Date : 2025-06-12 eCollection Date: 2025-06-01 DOI: 10.1093/jamiaopen/ooaf039
Derek J Baughman, Layth Qassem, Lina Sulieman, Michael E Matheny, Daniel Fabbri, Hilary A Tindle, Aubrey Cole Goodman, Scott D Nelson, Adam Wright
{"title":"Real-time automated billing for tobacco treatment: developing and validating a scalable machine learning approach.","authors":"Derek J Baughman, Layth Qassem, Lina Sulieman, Michael E Matheny, Daniel Fabbri, Hilary A Tindle, Aubrey Cole Goodman, Scott D Nelson, Adam Wright","doi":"10.1093/jamiaopen/ooaf039","DOIUrl":"10.1093/jamiaopen/ooaf039","url":null,"abstract":"<p><strong>Objectives: </strong>To develop CigStopper, a real-time, automated medical billing prototype designed to identify eligible tobacco cessation care codes, thereby reducing administrative workload while improving billing accuracy.</p><p><strong>Materials and methods: </strong>ChatGPT prompt engineering generated a synthetic corpus of physician-style clinical notes categorized for CPT codes 99406/99407. Practicing clinicians annotated the dataset to train multiple machine learning (ML) models focused on accurately predicting billing code eligibility.</p><p><strong>Results: </strong>Decision tree and random forest models performed best. Mean performance across all models: PRC AUC = 0.857, F1 score = 0.835. Generalizability testing on deidentified notes confirmed that tree-based models performed best.</p><p><strong>Discussion: </strong>CigStopper shows promise for streamlining manual billing inefficiencies that hinder tobacco cessation care. ML methods lay the groundwork for clinical implementation based on good performance using synthetic data. Automating high-volume, low-value tasks simplify complexities in a multi-payer system and promote financial sustainability for healthcare practices.</p><p><strong>Conclusion: </strong>CigStopper validates foundational methods for automating the discernment of appropriate billing codes for eligible smoking cessation counseling care.</p>","PeriodicalId":36278,"journal":{"name":"JAMIA Open","volume":"8 3","pages":"ooaf039"},"PeriodicalIF":2.5,"publicationDate":"2025-06-12","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://www.ncbi.nlm.nih.gov/pmc/articles/PMC12161450/pdf/","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"144286691","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"OA","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 0
Comparative analysis of large language models in clinical diagnosis: performance evaluation across common and complex medical cases. 大型语言模型在临床诊断中的比较分析:跨常见和复杂医疗病例的绩效评估。
IF 2.5
JAMIA Open Pub Date : 2025-06-12 eCollection Date: 2025-06-01 DOI: 10.1093/jamiaopen/ooaf055
Mehmed T Dinc, Ali E Bardak, Furkan Bahar, Craig Noronha
{"title":"Comparative analysis of large language models in clinical diagnosis: performance evaluation across common and complex medical cases.","authors":"Mehmed T Dinc, Ali E Bardak, Furkan Bahar, Craig Noronha","doi":"10.1093/jamiaopen/ooaf055","DOIUrl":"10.1093/jamiaopen/ooaf055","url":null,"abstract":"<p><strong>Objectives: </strong>This study aimed to systematically evaluate and compare the diagnostic performance of leading large language models (LLMs) in common and complex clinical scenarios, assessing their potential for enhancing clinical reasoning and diagnostic accuracy in authentic clinical decision-making processes.</p><p><strong>Materials and methods: </strong>Diagnostic capabilities of advanced LLMs (Anthropic's Claude, OpenAI's GPT variants, Google's Gemini) were assessed using 60 common cases and 104 complex, real-world cases from Clinical Problem Solvers' morning rounds. Clinical details were disclosed in stages, mirroring authentic clinical decision-making. Models were evaluated on primary and differential diagnosis accuracy at each stage.</p><p><strong>Results: </strong>Advanced LLMs showed high diagnostic accuracy (>90%) in common scenarios, with Claude 3.7 achieving perfect accuracy (100%) in certain conditions. In complex cases, Claude 3.7 achieved the highest accuracy (83.3%) at the final diagnostic stage, significantly outperforming smaller models. Smaller models notably performed well in common scenarios, matching the performance of larger models.</p><p><strong>Discussion: </strong>This study evaluated leading LLMs for diagnostic accuracy using staged information disclosure, mirroring real-world practice. Notably, Claude 3.7 Sonnet was the top performer. Employing a novel LLM-based evaluation method for large-scale analysis, the research highlights artificial intelligence's (AI's) potential to enhance diagnostics. It underscores the need for useful frameworks to translate accuracy into clinical impact and integrate AI into medical education.</p><p><strong>Conclusion: </strong>Leading LLMs show remarkable diagnostic accuracy in diverse clinical cases. To fully realize their potential for improving patient care, we must now focus on creating practical implementation frameworks and translational research to integrate these powerful AI tools into medicine.</p>","PeriodicalId":36278,"journal":{"name":"JAMIA Open","volume":"8 3","pages":"ooaf055"},"PeriodicalIF":2.5,"publicationDate":"2025-06-12","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://www.ncbi.nlm.nih.gov/pmc/articles/PMC12161448/pdf/","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"144286665","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"OA","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 0
Case Report: A health system's experience using clinical decision support to promote note sharing after the 21st Century Cures Act. 案例报告:《21世纪治愈法案》实施后,卫生系统利用临床决策支持促进病历共享的经验。
IF 2.5
JAMIA Open Pub Date : 2025-06-12 eCollection Date: 2025-06-01 DOI: 10.1093/jamiaopen/ooaf051
Mark Iscoe, Arjun K Venkatesh, Emily M Powers, Nitu Kashyap, Allen L Hsiao, Hun Millard, Rohit B Sangal
{"title":"Case Report: A health system's experience using clinical decision support to promote note sharing after the 21st Century Cures Act.","authors":"Mark Iscoe, Arjun K Venkatesh, Emily M Powers, Nitu Kashyap, Allen L Hsiao, Hun Millard, Rohit B Sangal","doi":"10.1093/jamiaopen/ooaf051","DOIUrl":"10.1093/jamiaopen/ooaf051","url":null,"abstract":"<p><strong>Objective: </strong>We used clinical decision support (CDS) to promote compliance with the 21st Century Cures Act's mandate that, with few exceptions, patients be granted timely access to their clinical notes.</p><p><strong>Materials and methods: </strong>We conducted an observational analysis of note sharing rates in a large regional health system from February 2, 2021 to October 3, 2023. Throughout the study period, notes were shared with patients by default with the option not to grant note access; starting week 10, clinicians not sharing notes were presented with \"hard-stop\" CDS requiring selection of an allowable exception reason. Trends were examined with forward step-segmented linear regression.</p><p><strong>Results: </strong>0.7% of all notes were unshared; rates of unshared notes were highest in pediatrics (4.9%) and psychiatry (2.2%). Rates dropped substantially following hard-stop CDS introduction (downward step of 0.96%; 95% CI -1.17 to -0.024). Despite high portal access (72.6%), few notes were viewed by patients/proxies (17.0%).</p><p><strong>Discussion: </strong>We found very low overall rates of unshared notes; the significant drop in the rates of unshared notes following the introduction of hard-stop CDS is consistent with prior research showing that hard-stop CDS can be an effective tool. The higher rates of unshared notes in pediatrics and psychiatry likely reflect considerations around sensitive information that are inherent to these fields.</p><p><strong>Conclusions: </strong>CDS effectively promoted note sharing, but patient engagement remained low.</p>","PeriodicalId":36278,"journal":{"name":"JAMIA Open","volume":"8 3","pages":"ooaf051"},"PeriodicalIF":2.5,"publicationDate":"2025-06-12","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://www.ncbi.nlm.nih.gov/pmc/articles/PMC12161449/pdf/","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"144286664","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"OA","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 0
Meaningfully meeting the interoperability mandate: a review of the Assistant Secretary for Technology Policy Real World Testing practices. 有意义地实现互操作性任务:对技术政策助理部长真实世界测试实践的审查。
IF 2.5
JAMIA Open Pub Date : 2025-06-11 eCollection Date: 2025-06-01 DOI: 10.1093/jamiaopen/ooaf044
Jessica L Handley, Alicia Farlese, Sophia Lager, Ajit A Dhavle, Shahzad Ahmad, Anna Mathias, Raj M Ratwani
{"title":"Meaningfully meeting the interoperability mandate: a review of the Assistant Secretary for Technology Policy Real World Testing practices.","authors":"Jessica L Handley, Alicia Farlese, Sophia Lager, Ajit A Dhavle, Shahzad Ahmad, Anna Mathias, Raj M Ratwani","doi":"10.1093/jamiaopen/ooaf044","DOIUrl":"10.1093/jamiaopen/ooaf044","url":null,"abstract":"<p><strong>Objectives: </strong>We analyzed interoperability-related Real World Testing results to identify whether developers are providing meaningful results with the appropriate context to enable stakeholders to understand the Certified Health IT conformance and interoperability when deployed in production environments.</p><p><strong>Materials and methods: </strong>This qualitative study analyzed components of the Assistant Secretary for Technology Policy's transitions of care criterion Real World Testing results of 5 inpatient and 5 ambulatory health IT developers with the largest market share.</p><p><strong>Results: </strong>Developers provided interoperability measures; however, none of the developers' presented results in a meaningful way with the appropriate context to understand product interoperability.</p><p><strong>Discussion: </strong>Our results suggest that developers with ASTP/Office of the National Coordinator (ONC) Certified Health IT modules are not providing interoperability transparency through Real World Testing as required by the ONC Health IT Certification Program and intended by the 21st Century Cures Act.</p><p><strong>Conclusion: </strong>Clearer developer guidance and actual metric requirements on Real World Testing may be required and the authorized certification bodies, who review developer results, may need to more closely inspect reports to look at the quality of reported results.</p>","PeriodicalId":36278,"journal":{"name":"JAMIA Open","volume":"8 3","pages":"ooaf044"},"PeriodicalIF":2.5,"publicationDate":"2025-06-11","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://www.ncbi.nlm.nih.gov/pmc/articles/PMC12153719/pdf/","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"144276193","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"OA","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 0
A community-engaged approach to developing common data elements: a case study from the RADx-UP Long COVID common data elements Task Force. 社区参与的公共数据要素开发方法:RADx-UP Long COVID公共数据要素工作组的案例研究。
IF 2.5
JAMIA Open Pub Date : 2025-06-04 eCollection Date: 2025-06-01 DOI: 10.1093/jamiaopen/ooaf046
Helena L Pike Welch, Gregory Guest, Halima Garba, Gabriel A Carrillo, Allyn M Damman, Warren A Kibbe
{"title":"A community-engaged approach to developing common data elements: a case study from the RADx-UP Long COVID common data elements Task Force.","authors":"Helena L Pike Welch, Gregory Guest, Halima Garba, Gabriel A Carrillo, Allyn M Damman, Warren A Kibbe","doi":"10.1093/jamiaopen/ooaf046","DOIUrl":"10.1093/jamiaopen/ooaf046","url":null,"abstract":"<p><strong>Objectives: </strong>In response to requests from several Rapid Acceleration of Diagnostics-Underserved Populations (RADx-UP) community-engaged research projects to include Long COVID common data elements (CDEs) in the existing RADx-UP CDEs, the RADx-UP Coordination and Data Collection Center (CDCC) leadership formed the Long COVID CDEs Task Force.</p><p><strong>Materials and methods: </strong>The Task Force, composed mainly of community partners and RADx-UP project members, participated in various activities to evaluate the Long COVID CDEs fit for purpose from the Researching COVID to Enhance Recovery (RECOVER) program for RADx-UP use.</p><p><strong>Results and discussion: </strong>The Task Force's efforts led to a compilation of lessons learned and the creation of a novel set of 28 CDEs that are appropriate for community-engaged research in Long COVID.</p><p><strong>Conclusion: </strong>Utilization of standardized CDEs does not always work for the communities involved in the research, but creation of a community-involved task force can lead to a meaningful, rich set of CDEs.</p>","PeriodicalId":36278,"journal":{"name":"JAMIA Open","volume":"8 3","pages":"ooaf046"},"PeriodicalIF":2.5,"publicationDate":"2025-06-04","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://www.ncbi.nlm.nih.gov/pmc/articles/PMC12136053/pdf/","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"144226951","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"OA","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 0
Help us document what we already do: pilot study of clinical decision support tools targeting social risk-informed care. 帮助我们记录我们已经在做的事情:针对社会风险知情护理的临床决策支持工具的试点研究。
IF 2.5
JAMIA Open Pub Date : 2025-05-30 eCollection Date: 2025-06-01 DOI: 10.1093/jamiaopen/ooaf045
Maura Pisciotta, Suzanne Morrissey, Arwen Bunce, Laura M Gottlieb, Jenna Donovan, Shelby L Watkins, Mary Middendorf, Christina R Sheppler, Anna C Edelmann, Rachel Gold
{"title":"Help us document what we already do: pilot study of clinical decision support tools targeting social risk-informed care.","authors":"Maura Pisciotta, Suzanne Morrissey, Arwen Bunce, Laura M Gottlieb, Jenna Donovan, Shelby L Watkins, Mary Middendorf, Christina R Sheppler, Anna C Edelmann, Rachel Gold","doi":"10.1093/jamiaopen/ooaf045","DOIUrl":"10.1093/jamiaopen/ooaf045","url":null,"abstract":"<p><strong>Objective: </strong>Little is known about how clinical decision support (CDS) tools can support care teams in changing clinical decisions to account for patients' social risks. We piloted a suite of electronic health record (EHR)-based CDS tools designed to facilitate social risk-informed care decisions to assess how the tools were used in practice and how they could be improved.</p><p><strong>Materials and methods: </strong>After developing CDS tools through a process involving clinic staff and patient engagement, the tools were implemented in three community health center clinics. Data from staff interviews, observations of meetings with clinic staff, and the EHR were used to understand tool use patterns, and to yield insights that were then used to inform tool revisions.</p><p><strong>Results: </strong>The overarching suggestion derived from the study data was that the tools should shift from making care recommendations to instead supporting documentation of social risk-related actions that clinical team members had already taken. Other revisions were guided by four additional insights: the CDS tools should: (1) facilitate documentation in standardized, short formats, (2) make documentation easy and consistent, (3) support work distribution across care team members, and (4) ensure documentation could serve multiple purposes.</p><p><strong>Discussion: </strong>The CDS tools were revised to improve usefulness and acceptability for primary care teams in community clinics that serve patients with social risks. Numerous challenges exist in designing tools that can accommodate diverse clinics and workflows.</p><p><strong>Conclusion: </strong>These findings provide insights on how CDS tools can be optimized for social risk-informed care while minimizing care team burdens.</p>","PeriodicalId":36278,"journal":{"name":"JAMIA Open","volume":"8 3","pages":"ooaf045"},"PeriodicalIF":2.5,"publicationDate":"2025-05-30","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://www.ncbi.nlm.nih.gov/pmc/articles/PMC12124400/pdf/","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"144200322","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"OA","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 0
Multimorbidity patterns and early signals of diabetes in online communities. 网络社区中糖尿病的多病模式和早期信号。
IF 2.5
JAMIA Open Pub Date : 2025-05-30 eCollection Date: 2025-06-01 DOI: 10.1093/jamiaopen/ooaf049
Ching Jin, Zhen Zhu
{"title":"Multimorbidity patterns and early signals of diabetes in online communities.","authors":"Ching Jin, Zhen Zhu","doi":"10.1093/jamiaopen/ooaf049","DOIUrl":"10.1093/jamiaopen/ooaf049","url":null,"abstract":"<p><strong>Objectives: </strong>This study aims to explore multimorbidity patterns associated with diabetes by analyzing user engagement in online diabetes support communities and their interactions with other disease-related communities. Additionally, it seeks to assess whether early signals of diabetes can be detected through online engagement data.</p><p><strong>Materials and methods: </strong>We collected Reddit data for 3 primary diabetes-related subreddits (\"diabetes,\" \"diabetes_t1,\" and \"diabetes_t2\") and 88 other disease-related subreddits from 2008 to 2024. A bipartite network was constructed linking users to subreddits, which was then transformed into a weighted multimorbidity network. Significant links were identified using a statistical threshold to ensure meaningful connections between subreddits. Additionally, we analyzed user engagement timelines to identify potential early signals of diabetes.</p><p><strong>Results: </strong>Diabetes is strongly linked to mental health conditions (such as depression, anxiety, and ADHD) and weight management discussions. Other notable associations include autoimmune diseases, chronic pain, gastrointestinal disorders, and reproductive health issues. Early signals of type 2 diabetes were detected in mental health, obesity, and pregnancy conditions, but no significant early indicators were found for type 1 diabetes.</p><p><strong>Discussion: </strong>This study is the first large-scale empirical analysis of multimorbidity patterns and early signals of diabetes in online communities. The findings reinforce the known multimorbidity of diabetes, particularly its ties to mental health and obesity. The presence of early signals suggests that social media data could help identify individuals at risk before diagnosis, offering opportunities for early intervention.</p><p><strong>Conclusion: </strong>Our findings demonstrate that social media data can reveal both multimorbidity patterns and early signals of diabetes, offering insights beyond traditional health records. As digital health data continue to grow, effectively leveraging these resources will become increasingly important for advancing diabetes prevention and management.</p>","PeriodicalId":36278,"journal":{"name":"JAMIA Open","volume":"8 3","pages":"ooaf049"},"PeriodicalIF":2.5,"publicationDate":"2025-05-30","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://www.ncbi.nlm.nih.gov/pmc/articles/PMC12124401/pdf/","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"144200323","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"OA","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 0
0
×
引用
GB/T 7714-2015
复制
MLA
复制
APA
复制
导出至
BibTeX EndNote RefMan NoteFirst NoteExpress
×
提示
您的信息不完整,为了账户安全,请先补充。
现在去补充
×
提示
您因"违规操作"
具体请查看互助需知
我知道了
×
提示
确定
请完成安全验证×
相关产品
×
本文献相关产品
联系我们:info@booksci.cn Book学术提供免费学术资源搜索服务,方便国内外学者检索中英文文献。致力于提供最便捷和优质的服务体验。 Copyright © 2023 布克学术 All rights reserved.
京ICP备2023020795号-1
ghs 京公网安备 11010802042870号
Book学术文献互助
Book学术文献互助群
群 号:604180095
Book学术官方微信