Qingyang Shen , Xiaozhi Zhang , Haomin Ren , Quan Guo , Zhang Yi
{"title":"用于紧急分类的知识嵌入式大型语言模型","authors":"Qingyang Shen , Xiaozhi Zhang , Haomin Ren , Quan Guo , Zhang Yi","doi":"10.1016/j.knosys.2025.113431","DOIUrl":null,"url":null,"abstract":"<div><div>Emergency departments (EDs) are crucial to healthcare but face persistent overcrowding. The Emergency Severity Index (ESI) triage system is vital for prioritizing patients based on acuity and resource needs but relies heavily on the subjective judgment of medical staff, leading to inconsistencies. This study developed a Sequential Domain and Task Adaptation (SDTA) framework for enhancing ED triage accuracy and consistency using large language models (LLMs). By training LLMs on clinical data and ESI-specific tasks, we significantly improved their performance compared to traditional prompt-engineered models, achieving accuracy levels comparable to or exceeding those of experienced emergency physicians. Notably, the fine-tuned models achieved high accuracy and perfect recall for high-risk cases. These findings highlight the potential of adapted LLMs to standardize triage decisions and reduce variability, thus offering a solution to alleviate overcrowding and enhance patient care outcomes.</div></div>","PeriodicalId":49939,"journal":{"name":"Knowledge-Based Systems","volume":"318 ","pages":"Article 113431"},"PeriodicalIF":7.2000,"publicationDate":"2025-04-11","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":"0","resultStr":"{\"title\":\"Knowledge-embedded large language models for emergency triage\",\"authors\":\"Qingyang Shen , Xiaozhi Zhang , Haomin Ren , Quan Guo , Zhang Yi\",\"doi\":\"10.1016/j.knosys.2025.113431\",\"DOIUrl\":null,\"url\":null,\"abstract\":\"<div><div>Emergency departments (EDs) are crucial to healthcare but face persistent overcrowding. The Emergency Severity Index (ESI) triage system is vital for prioritizing patients based on acuity and resource needs but relies heavily on the subjective judgment of medical staff, leading to inconsistencies. This study developed a Sequential Domain and Task Adaptation (SDTA) framework for enhancing ED triage accuracy and consistency using large language models (LLMs). By training LLMs on clinical data and ESI-specific tasks, we significantly improved their performance compared to traditional prompt-engineered models, achieving accuracy levels comparable to or exceeding those of experienced emergency physicians. Notably, the fine-tuned models achieved high accuracy and perfect recall for high-risk cases. These findings highlight the potential of adapted LLMs to standardize triage decisions and reduce variability, thus offering a solution to alleviate overcrowding and enhance patient care outcomes.</div></div>\",\"PeriodicalId\":49939,\"journal\":{\"name\":\"Knowledge-Based Systems\",\"volume\":\"318 \",\"pages\":\"Article 113431\"},\"PeriodicalIF\":7.2000,\"publicationDate\":\"2025-04-11\",\"publicationTypes\":\"Journal Article\",\"fieldsOfStudy\":null,\"isOpenAccess\":false,\"openAccessPdf\":\"\",\"citationCount\":\"0\",\"resultStr\":null,\"platform\":\"Semanticscholar\",\"paperid\":null,\"PeriodicalName\":\"Knowledge-Based Systems\",\"FirstCategoryId\":\"94\",\"ListUrlMain\":\"https://www.sciencedirect.com/science/article/pii/S0950705125004782\",\"RegionNum\":1,\"RegionCategory\":\"计算机科学\",\"ArticlePicture\":[],\"TitleCN\":null,\"AbstractTextCN\":null,\"PMCID\":null,\"EPubDate\":\"\",\"PubModel\":\"\",\"JCR\":\"Q1\",\"JCRName\":\"COMPUTER SCIENCE, ARTIFICIAL INTELLIGENCE\",\"Score\":null,\"Total\":0}","platform":"Semanticscholar","paperid":null,"PeriodicalName":"Knowledge-Based Systems","FirstCategoryId":"94","ListUrlMain":"https://www.sciencedirect.com/science/article/pii/S0950705125004782","RegionNum":1,"RegionCategory":"计算机科学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"Q1","JCRName":"COMPUTER SCIENCE, ARTIFICIAL INTELLIGENCE","Score":null,"Total":0}
引用次数: 0
摘要
急诊科(ED)对医疗保健至关重要,但却面临着长期过度拥挤的问题。急诊严重程度指数(ESI)分诊系统对于根据患者的严重程度和资源需求确定患者的优先次序至关重要,但该系统严重依赖医务人员的主观判断,导致分诊结果不一致。本研究开发了一个序列领域和任务适应(SDTA)框架,利用大型语言模型(LLMs)提高急诊室分诊的准确性和一致性。通过对 LLMs 进行临床数据和 ESI 特定任务的训练,与传统的提示设计模型相比,我们显著提高了 LLMs 的性能,使其准确性达到或超过了经验丰富的急诊医生的水平。值得注意的是,经过微调的模型对高风险病例具有很高的准确性和完美的召回能力。这些研究结果凸显了经过调整的 LLMs 在标准化分诊决策和减少变异性方面的潜力,从而为缓解过度拥挤和提高病人护理效果提供了一种解决方案。
Knowledge-embedded large language models for emergency triage
Emergency departments (EDs) are crucial to healthcare but face persistent overcrowding. The Emergency Severity Index (ESI) triage system is vital for prioritizing patients based on acuity and resource needs but relies heavily on the subjective judgment of medical staff, leading to inconsistencies. This study developed a Sequential Domain and Task Adaptation (SDTA) framework for enhancing ED triage accuracy and consistency using large language models (LLMs). By training LLMs on clinical data and ESI-specific tasks, we significantly improved their performance compared to traditional prompt-engineered models, achieving accuracy levels comparable to or exceeding those of experienced emergency physicians. Notably, the fine-tuned models achieved high accuracy and perfect recall for high-risk cases. These findings highlight the potential of adapted LLMs to standardize triage decisions and reduce variability, thus offering a solution to alleviate overcrowding and enhance patient care outcomes.
期刊介绍:
Knowledge-Based Systems, an international and interdisciplinary journal in artificial intelligence, publishes original, innovative, and creative research results in the field. It focuses on knowledge-based and other artificial intelligence techniques-based systems. The journal aims to support human prediction and decision-making through data science and computation techniques, provide a balanced coverage of theory and practical study, and encourage the development and implementation of knowledge-based intelligence models, methods, systems, and software tools. Applications in business, government, education, engineering, and healthcare are emphasized.