Collecting and Sharing Person-Centered AI Clinical Summaries Across Frailty Services Provided by the National Health Service and Voluntary, Community, and Social Enterprise: Protocol for a Co-Design and Feasibility Study.

IF 1.5 Q3 HEALTH CARE SCIENCES & SERVICES
Kieran Green, Sheena Asthana, Oscar Josue Ponce-Ponte, John Downey, Joanne Watson
{"title":"Collecting and Sharing Person-Centered AI Clinical Summaries Across Frailty Services Provided by the National Health Service and Voluntary, Community, and Social Enterprise: Protocol for a Co-Design and Feasibility Study.","authors":"Kieran Green, Sheena Asthana, Oscar Josue Ponce-Ponte, John Downey, Joanne Watson","doi":"10.2196/68511","DOIUrl":null,"url":null,"abstract":"<p><strong>Background: </strong>Due to its association with multimorbidity, frailty gives rise to multidimensional needs for different services. Too often, patient preferences and service encounter information are not adequately shared.</p><p><strong>Objective: </strong>This developmental study aims to co-design, collect, and analyze encounter data from multiple community and primary-based multidisciplinary teams (MDTs) providing services for people with frailty to develop prototype large language models that can generate clinical and person-centered care summaries.</p><p><strong>Methods: </strong>Engaging stakeholders in 2 primary care networks, we will co-design the large language model to ensure it meets local needs and preferences as well as infrastructure, information governance, and regulation requirements. General practitioners will identify 50 patients with frailty requiring MDT engagement. Three consecutive encounters between the patients and different members of MDTs will then be audio-recorded. Recordings will be transcribed into text for concept design and model pretraining. These data combine stakeholder engagement insights to develop sensitive artificial intelligence (AI) models responding to stakeholders' needs, workflows, and preferences. To generate the person-centered summaries, we will test 2 approaches to modeling the encounter data: graph-based modeling and hierarchical transformers. The AI-generated summaries will be compared to human-written summaries of the same encounter data and assessed for accuracy, quality, fluency, and person-centeredness. They will also be shared with the original MDT members for validation. We will capture inputs, processes, and outcomes across all key phases of the implementation journey to identify capability requirements, determinants of implementation (including key challenges and best practices to overcome them), and the value added by the technology.</p><p><strong>Results: </strong>This protocol aims to review implementation evidence and engage stakeholders in co-design. This work package will aid the development of contextually sensitive, longitudinal, and AI-generated person-centered summarization tools. Model development will aim to achieve longitudinal person-centered summaries tested against MDT standards. If deemed suitable for deployment, optimum ways of integrating these summaries into shared care records will be explored with local key system leaders. Model evaluations will provide conclusive insights into such technologies' benefits and risks. As of August 2025, this study has not yet been funded, nor has ethical approval for the project been obtained. Consequently, dates of data collection and numbers of recruited participants are not applicable at this time.</p><p><strong>Conclusions: </strong>Our protocol provides a robust method of co-designing, evaluating, and implementing a longitudinal AI medical summary tool. Including key stakeholders at multiple stages facilitates an iterative development strategy that is designed to solve implementation challenges as they emerge. This project fits within our long-term vision to deliver a multimodal AI tool that saves clinicians time and deepens the health care professional-patient relationship. Future studies should include a larger patient sample, video-recorded health care professional-patient encounters, and a more extensive longitudinal evaluation.</p><p><strong>International registered report identifier (irrid): </strong>PRR1-10.2196/68511.</p>","PeriodicalId":14755,"journal":{"name":"JMIR Research Protocols","volume":"14 ","pages":"e68511"},"PeriodicalIF":1.5000,"publicationDate":"2025-09-17","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://www.ncbi.nlm.nih.gov/pmc/articles/PMC12489409/pdf/","citationCount":"0","resultStr":null,"platform":"Semanticscholar","paperid":null,"PeriodicalName":"JMIR Research Protocols","FirstCategoryId":"1085","ListUrlMain":"https://doi.org/10.2196/68511","RegionNum":0,"RegionCategory":null,"ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"Q3","JCRName":"HEALTH CARE SCIENCES & SERVICES","Score":null,"Total":0}
引用次数: 0

Abstract

Background: Due to its association with multimorbidity, frailty gives rise to multidimensional needs for different services. Too often, patient preferences and service encounter information are not adequately shared.

Objective: This developmental study aims to co-design, collect, and analyze encounter data from multiple community and primary-based multidisciplinary teams (MDTs) providing services for people with frailty to develop prototype large language models that can generate clinical and person-centered care summaries.

Methods: Engaging stakeholders in 2 primary care networks, we will co-design the large language model to ensure it meets local needs and preferences as well as infrastructure, information governance, and regulation requirements. General practitioners will identify 50 patients with frailty requiring MDT engagement. Three consecutive encounters between the patients and different members of MDTs will then be audio-recorded. Recordings will be transcribed into text for concept design and model pretraining. These data combine stakeholder engagement insights to develop sensitive artificial intelligence (AI) models responding to stakeholders' needs, workflows, and preferences. To generate the person-centered summaries, we will test 2 approaches to modeling the encounter data: graph-based modeling and hierarchical transformers. The AI-generated summaries will be compared to human-written summaries of the same encounter data and assessed for accuracy, quality, fluency, and person-centeredness. They will also be shared with the original MDT members for validation. We will capture inputs, processes, and outcomes across all key phases of the implementation journey to identify capability requirements, determinants of implementation (including key challenges and best practices to overcome them), and the value added by the technology.

Results: This protocol aims to review implementation evidence and engage stakeholders in co-design. This work package will aid the development of contextually sensitive, longitudinal, and AI-generated person-centered summarization tools. Model development will aim to achieve longitudinal person-centered summaries tested against MDT standards. If deemed suitable for deployment, optimum ways of integrating these summaries into shared care records will be explored with local key system leaders. Model evaluations will provide conclusive insights into such technologies' benefits and risks. As of August 2025, this study has not yet been funded, nor has ethical approval for the project been obtained. Consequently, dates of data collection and numbers of recruited participants are not applicable at this time.

Conclusions: Our protocol provides a robust method of co-designing, evaluating, and implementing a longitudinal AI medical summary tool. Including key stakeholders at multiple stages facilitates an iterative development strategy that is designed to solve implementation challenges as they emerge. This project fits within our long-term vision to deliver a multimodal AI tool that saves clinicians time and deepens the health care professional-patient relationship. Future studies should include a larger patient sample, video-recorded health care professional-patient encounters, and a more extensive longitudinal evaluation.

International registered report identifier (irrid): PRR1-10.2196/68511.

Abstract Image

Abstract Image

在国家卫生服务和志愿、社区和社会企业提供的衰弱服务中收集和共享以人为中心的人工智能临床摘要:共同设计和可行性研究方案。
背景:由于虚弱与多种疾病有关,因此对不同的服务产生多方面的需求。通常情况下,患者的偏好和服务信息没有充分共享。目的:本发展性研究旨在共同设计、收集和分析来自多个社区和以初级为基础的多学科团队(MDTs)为脆弱人群提供服务的遭遇数据,以开发原型大型语言模型,从而生成临床和以人为本的护理摘要。方法:与2个初级保健网络的利益相关者合作,共同设计大语言模型,以确保其满足当地需求和偏好,以及基础设施、信息治理和监管要求。全科医生将确定50名需要MDT治疗的虚弱患者。然后,患者与mdt不同成员之间的三次连续接触将被录音。录音将转录成文本用于概念设计和模型预训练。这些数据结合了利益相关者参与的见解,以开发敏感的人工智能(AI)模型,响应利益相关者的需求、工作流程和偏好。为了生成以人为中心的摘要,我们将测试两种方法来对遭遇数据进行建模:基于图的建模和分层转换。人工智能生成的摘要将与人类编写的相同遭遇数据的摘要进行比较,并评估其准确性、质量、流畅性和以人为本。它们还将与原始MDT成员共享以进行验证。我们将在实现旅程的所有关键阶段捕获输入、过程和结果,以确定能力需求、实现的决定因素(包括关键挑战和克服它们的最佳实践),以及技术增加的价值。结果:本协议旨在审查实施证据并让利益相关者参与共同设计。该工作包将有助于开发上下文敏感、纵向和人工智能生成的以人为中心的摘要工具。模型开发的目标是实现纵向的以人为中心的总结,并对MDT标准进行测试。如果认为适合部署,将与当地关键系统领导探讨将这些摘要整合到共享护理记录中的最佳方法。模型评估将为这些技术的利益和风险提供结论性的见解。截至2025年8月,本研究尚未获得资助,也未获得该项目的伦理批准。因此,收集数据的日期和招募参与者的人数目前不适用。结论:我们的方案为共同设计、评估和实施纵向人工智能医疗总结工具提供了一种可靠的方法。在多个阶段包括关键的涉众可以促进迭代开发策略,该策略旨在解决出现的实现挑战。该项目符合我们的长期愿景,即提供多模式人工智能工具,节省临床医生的时间,加深医疗保健专业人员与患者的关系。未来的研究应该包括更大的患者样本,视频记录医疗保健专业人员与患者的接触,以及更广泛的纵向评估。国际注册报告标识符(irrid): PRR1-10.2196/68511。
本文章由计算机程序翻译,如有差异,请以英文原文为准。
求助全文
约1分钟内获得全文 求助全文
来源期刊
CiteScore
2.40
自引率
5.90%
发文量
414
审稿时长
12 weeks
×
引用
GB/T 7714-2015
复制
MLA
复制
APA
复制
导出至
BibTeX EndNote RefMan NoteFirst NoteExpress
×
提示
您的信息不完整,为了账户安全,请先补充。
现在去补充
×
提示
您因"违规操作"
具体请查看互助需知
我知道了
×
提示
确定
请完成安全验证×
copy
已复制链接
快去分享给好友吧!
我知道了
右上角分享
点击右上角分享
0
联系我们:info@booksci.cn Book学术提供免费学术资源搜索服务,方便国内外学者检索中英文文献。致力于提供最便捷和优质的服务体验。 Copyright © 2023 布克学术 All rights reserved.
京ICP备2023020795号-1
ghs 京公网安备 11010802042870号
Book学术文献互助
Book学术文献互助群
群 号:604180095
Book学术官方微信