Yaxuan Ren, Xufei Luo, Ye Wang, Haodong Li, Hairong Zhang, Zeming Li, Honghao Lai, Xuanlin Li, Long Ge, Janne Estill, Lu Zhang, Shu Yang, Yaolong Chen, Chengping Wen, Zhaoxiang Bian
{"title":"中医药大语言模型:范围综述。","authors":"Yaxuan Ren, Xufei Luo, Ye Wang, Haodong Li, Hairong Zhang, Zeming Li, Honghao Lai, Xuanlin Li, Long Ge, Janne Estill, Lu Zhang, Shu Yang, Yaolong Chen, Chengping Wen, Zhaoxiang Bian","doi":"10.1111/jebm.12658","DOIUrl":null,"url":null,"abstract":"<p><strong>Background: </strong>The application of large language models (LLMs) in medicine has received increasing attention, showing significant potential in teaching, research, and clinical practice, especially in knowledge extraction, management, and understanding. However, the use of LLMs in Traditional Chinese Medicine (TCM) has not been thoroughly studied. This study aims to provide a comprehensive overview of the status and challenges of LLM applications in TCM.</p><p><strong>Methods: </strong>A systematic search of five electronic databases and Google Scholar was conducted between November 2022 and April 2024, using the Arksey and O'Malley five-stage framework to identify relevant studies. Data from eligible studies were comprehensively extracted and organized to describe LLM applications in TCM and assess their performance accuracy.</p><p><strong>Results: </strong>A total of 29 studies were identified: 24 peer-reviewed articles, 1 review, and 4 preprints. Two core application areas were found: the extraction, management, and understanding of TCM knowledge, and assisted diagnosis and treatment. LLMs developed specifically for TCM achieved 70% accuracy in the TCM Practitioner Exam, while general-purpose Chinese LLMs achieved 60% accuracy. Common international LLMs did not pass the exam. Models like EpidemicCHAT and MedChatZH, trained on customized TCM corpora, outperformed general LLMs in TCM consultation.</p><p><strong>Conclusion: </strong>Despite their potential, LLMs in TCM face challenges such as data quality and security issues, the specificity and complexity of TCM data, and the nonquantitative nature of TCM diagnosis and treatment. Future efforts should focus on interdisciplinary talent cultivation, enhanced data standardization and protection, and exploring LLM potential in multimodal interaction and intelligent diagnosis and treatment.</p>","PeriodicalId":16090,"journal":{"name":"Journal of Evidence‐Based Medicine","volume":" ","pages":"e12658"},"PeriodicalIF":3.6000,"publicationDate":"2024-12-09","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":"0","resultStr":"{\"title\":\"Large Language Models in Traditional Chinese Medicine: A Scoping Review.\",\"authors\":\"Yaxuan Ren, Xufei Luo, Ye Wang, Haodong Li, Hairong Zhang, Zeming Li, Honghao Lai, Xuanlin Li, Long Ge, Janne Estill, Lu Zhang, Shu Yang, Yaolong Chen, Chengping Wen, Zhaoxiang Bian\",\"doi\":\"10.1111/jebm.12658\",\"DOIUrl\":null,\"url\":null,\"abstract\":\"<p><strong>Background: </strong>The application of large language models (LLMs) in medicine has received increasing attention, showing significant potential in teaching, research, and clinical practice, especially in knowledge extraction, management, and understanding. However, the use of LLMs in Traditional Chinese Medicine (TCM) has not been thoroughly studied. This study aims to provide a comprehensive overview of the status and challenges of LLM applications in TCM.</p><p><strong>Methods: </strong>A systematic search of five electronic databases and Google Scholar was conducted between November 2022 and April 2024, using the Arksey and O'Malley five-stage framework to identify relevant studies. Data from eligible studies were comprehensively extracted and organized to describe LLM applications in TCM and assess their performance accuracy.</p><p><strong>Results: </strong>A total of 29 studies were identified: 24 peer-reviewed articles, 1 review, and 4 preprints. Two core application areas were found: the extraction, management, and understanding of TCM knowledge, and assisted diagnosis and treatment. LLMs developed specifically for TCM achieved 70% accuracy in the TCM Practitioner Exam, while general-purpose Chinese LLMs achieved 60% accuracy. Common international LLMs did not pass the exam. Models like EpidemicCHAT and MedChatZH, trained on customized TCM corpora, outperformed general LLMs in TCM consultation.</p><p><strong>Conclusion: </strong>Despite their potential, LLMs in TCM face challenges such as data quality and security issues, the specificity and complexity of TCM data, and the nonquantitative nature of TCM diagnosis and treatment. Future efforts should focus on interdisciplinary talent cultivation, enhanced data standardization and protection, and exploring LLM potential in multimodal interaction and intelligent diagnosis and treatment.</p>\",\"PeriodicalId\":16090,\"journal\":{\"name\":\"Journal of Evidence‐Based Medicine\",\"volume\":\" \",\"pages\":\"e12658\"},\"PeriodicalIF\":3.6000,\"publicationDate\":\"2024-12-09\",\"publicationTypes\":\"Journal Article\",\"fieldsOfStudy\":null,\"isOpenAccess\":false,\"openAccessPdf\":\"\",\"citationCount\":\"0\",\"resultStr\":null,\"platform\":\"Semanticscholar\",\"paperid\":null,\"PeriodicalName\":\"Journal of Evidence‐Based Medicine\",\"FirstCategoryId\":\"3\",\"ListUrlMain\":\"https://doi.org/10.1111/jebm.12658\",\"RegionNum\":2,\"RegionCategory\":\"医学\",\"ArticlePicture\":[],\"TitleCN\":null,\"AbstractTextCN\":null,\"PMCID\":null,\"EPubDate\":\"\",\"PubModel\":\"\",\"JCR\":\"Q1\",\"JCRName\":\"MEDICINE, GENERAL & INTERNAL\",\"Score\":null,\"Total\":0}","platform":"Semanticscholar","paperid":null,"PeriodicalName":"Journal of Evidence‐Based Medicine","FirstCategoryId":"3","ListUrlMain":"https://doi.org/10.1111/jebm.12658","RegionNum":2,"RegionCategory":"医学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"Q1","JCRName":"MEDICINE, GENERAL & INTERNAL","Score":null,"Total":0}
引用次数: 0
摘要
背景:大语言模型(large language models, LLMs)在医学领域的应用越来越受到关注,在教学、研究和临床实践中,特别是在知识提取、管理和理解方面显示出巨大的潜力。然而,llm在中医中的应用尚未得到深入的研究。本研究旨在全面概述法学硕士在中医领域应用的现状和面临的挑战。方法:采用Arksey和O'Malley五阶段框架,对2022年11月至2024年4月期间的5个电子数据库和谷歌Scholar进行系统检索,识别相关研究。从符合条件的研究中全面提取和组织数据,以描述LLM在中医中的应用并评估其性能准确性。结果:共确定了29项研究:24篇同行评议文章,1篇综述和4篇预印本。发现了两个核心应用领域:中医知识的提取、管理和理解,以及辅助诊断和治疗。专门为中医开发的法学硕士在中医执业医师考试中准确率达到70%,而中国通用法学硕士的准确率为60%。一般的国际法学硕士不通过考试。EpidemicCHAT和MedChatZH等模型在定制中医语料库上进行了培训,在中医咨询方面的表现优于普通法学硕士。结论:尽管具有潜力,但中医法学硕士仍面临数据质量和安全问题、中医数据的特异性和复杂性、中医诊疗的非定量化等挑战。未来应注重跨学科人才培养,加强数据标准化和保护,挖掘法学硕士在多模态交互和智能诊疗方面的潜力。
Large Language Models in Traditional Chinese Medicine: A Scoping Review.
Background: The application of large language models (LLMs) in medicine has received increasing attention, showing significant potential in teaching, research, and clinical practice, especially in knowledge extraction, management, and understanding. However, the use of LLMs in Traditional Chinese Medicine (TCM) has not been thoroughly studied. This study aims to provide a comprehensive overview of the status and challenges of LLM applications in TCM.
Methods: A systematic search of five electronic databases and Google Scholar was conducted between November 2022 and April 2024, using the Arksey and O'Malley five-stage framework to identify relevant studies. Data from eligible studies were comprehensively extracted and organized to describe LLM applications in TCM and assess their performance accuracy.
Results: A total of 29 studies were identified: 24 peer-reviewed articles, 1 review, and 4 preprints. Two core application areas were found: the extraction, management, and understanding of TCM knowledge, and assisted diagnosis and treatment. LLMs developed specifically for TCM achieved 70% accuracy in the TCM Practitioner Exam, while general-purpose Chinese LLMs achieved 60% accuracy. Common international LLMs did not pass the exam. Models like EpidemicCHAT and MedChatZH, trained on customized TCM corpora, outperformed general LLMs in TCM consultation.
Conclusion: Despite their potential, LLMs in TCM face challenges such as data quality and security issues, the specificity and complexity of TCM data, and the nonquantitative nature of TCM diagnosis and treatment. Future efforts should focus on interdisciplinary talent cultivation, enhanced data standardization and protection, and exploring LLM potential in multimodal interaction and intelligent diagnosis and treatment.
期刊介绍:
The Journal of Evidence-Based Medicine (EMB) is an esteemed international healthcare and medical decision-making journal, dedicated to publishing groundbreaking research outcomes in evidence-based decision-making, research, practice, and education. Serving as the official English-language journal of the Cochrane China Centre and West China Hospital of Sichuan University, we eagerly welcome editorials, commentaries, and systematic reviews encompassing various topics such as clinical trials, policy, drug and patient safety, education, and knowledge translation.