Weimin Zhang , Mengfei Wu , Luyao Zhou , Min Shao , Cui Wang , Yu Wang
{"title":"A sepsis diagnosis method based on Chain-of-Thought reasoning using Large Language Models","authors":"Weimin Zhang , Mengfei Wu , Luyao Zhou , Min Shao , Cui Wang , Yu Wang","doi":"10.1016/j.bbe.2025.04.002","DOIUrl":null,"url":null,"abstract":"<div><div>Sepsis is a severe infectious disease with high incidence and mortality rates globally. Early diagnosis of sepsis is crucial for improving patient outcomes. Previous diagnostic methods heavily relied on subjective clinical experience, while the machine learning-based methods can only learn knowledge from a specific dataset. Recently, the rapid development of Large Language Models (LLMs) has significantly enhanced various downstream dialogue tasks by leveraging prior semantic knowledge. Therefore, it is of great interest to explore the potential of LLMs in sepsis diagnosis. This study proposed an early sepsis diagnosis method based on the Chain of Thought (CoT) reasoning using LLMs. First, the clinical data of a patients were transformed into a textual representation to form the prompt. Subsequently, a CoT was created to simulate the reasoning process of human medical experts and utilized the prior semantic knowledge in LLMs to achieve sepsis diagnosis. The proposed method was validated using real clinical data, demonstrating high classification performance with an accuracy of 0.87, recall of 0.98, and F1 score of 0.88. These metrics showed an improvement in F1 score by 7 to 8 percentage points compared to commonly used machine learning classifiers. The experimental results indicated that the proposed method can enhance the performance of early sepsis diagnosis, and the introduction of CoT enhanced the interpretability of diagnostic results, contributing to the application of LLMs in clinical diagnosis.</div></div>","PeriodicalId":55381,"journal":{"name":"Biocybernetics and Biomedical Engineering","volume":"45 2","pages":"Pages 269-277"},"PeriodicalIF":5.3000,"publicationDate":"2025-04-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":"0","resultStr":null,"platform":"Semanticscholar","paperid":null,"PeriodicalName":"Biocybernetics and Biomedical Engineering","FirstCategoryId":"5","ListUrlMain":"https://www.sciencedirect.com/science/article/pii/S0208521625000269","RegionNum":2,"RegionCategory":"医学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"Q1","JCRName":"ENGINEERING, BIOMEDICAL","Score":null,"Total":0}
引用次数: 0
Abstract
Sepsis is a severe infectious disease with high incidence and mortality rates globally. Early diagnosis of sepsis is crucial for improving patient outcomes. Previous diagnostic methods heavily relied on subjective clinical experience, while the machine learning-based methods can only learn knowledge from a specific dataset. Recently, the rapid development of Large Language Models (LLMs) has significantly enhanced various downstream dialogue tasks by leveraging prior semantic knowledge. Therefore, it is of great interest to explore the potential of LLMs in sepsis diagnosis. This study proposed an early sepsis diagnosis method based on the Chain of Thought (CoT) reasoning using LLMs. First, the clinical data of a patients were transformed into a textual representation to form the prompt. Subsequently, a CoT was created to simulate the reasoning process of human medical experts and utilized the prior semantic knowledge in LLMs to achieve sepsis diagnosis. The proposed method was validated using real clinical data, demonstrating high classification performance with an accuracy of 0.87, recall of 0.98, and F1 score of 0.88. These metrics showed an improvement in F1 score by 7 to 8 percentage points compared to commonly used machine learning classifiers. The experimental results indicated that the proposed method can enhance the performance of early sepsis diagnosis, and the introduction of CoT enhanced the interpretability of diagnostic results, contributing to the application of LLMs in clinical diagnosis.
期刊介绍:
Biocybernetics and Biomedical Engineering is a quarterly journal, founded in 1981, devoted to publishing the results of original, innovative and creative research investigations in the field of Biocybernetics and biomedical engineering, which bridges mathematical, physical, chemical and engineering methods and technology to analyse physiological processes in living organisms as well as to develop methods, devices and systems used in biology and medicine, mainly in medical diagnosis, monitoring systems and therapy. The Journal''s mission is to advance scientific discovery into new or improved standards of care, and promotion a wide-ranging exchange between science and its application to humans.