Ariana Genovese, Srinivasagam Prabha, Sahar Borna, Cesar A Gomez-Cabello, Syed Ali Haider, Maissa Trabilsy, Cui Tao, Antonio Jorge Forte
{"title":"从数据到决策:利用检索增强生成来平衡烧伤管理文献中的引文偏倚。","authors":"Ariana Genovese, Srinivasagam Prabha, Sahar Borna, Cesar A Gomez-Cabello, Syed Ali Haider, Maissa Trabilsy, Cui Tao, Antonio Jorge Forte","doi":"10.3390/ebj6020028","DOIUrl":null,"url":null,"abstract":"<p><p>(1) Burn injuries demand multidisciplinary, evidence-based care, yet the extensive literature complicates timely decision making. Retrieval-augmented generation (RAG) synthesizes research while addressing inaccuracies in pretrained models. However, citation bias in sourcing for RAG often prioritizes highly cited studies, overlooking less-cited but valuable research. This study examines RAG's performance in burn management, comparing citation levels to enhance evidence synthesis, reduce selection bias, and guide decisions. (2) Two burn management datasets were assembled: 30 highly cited (mean: 303) and 30 less-cited (mean: 21). The Gemini-1.0-Pro-002 RAG model addressed 30 questions, ranging from foundational principles to advanced surgical approaches. Responses were evaluated for accuracy (5-point scale), readability (Flesch-Kincaid metrics), and response time with Wilcoxon rank sum tests (<i>p</i> < 0.05). (3) RAG achieved comparable accuracy (4.6 vs. 4.2, <i>p</i> = 0.49), readability (Flesch Reading Ease: 42.8 vs. 46.5, <i>p</i> = 0.26; Grade Level: 9.9 vs. 9.5, <i>p</i> = 0.29), and response time (2.8 vs. 2.5 s, <i>p</i> = 0.39) for the highly and less-cited datasets. (4) Less-cited research performed similarly to highly cited sources. This equivalence broadens clinicians' access to novel, diverse insights without sacrificing quality. As plastic surgery evolves, RAG's inclusive approach fosters innovation, improves patient care, and reduces cognitive burden by integrating underutilized studies. Embracing RAG could propel the field toward dynamic, forward-thinking care.</p>","PeriodicalId":72961,"journal":{"name":"European burn journal","volume":"6 2","pages":""},"PeriodicalIF":1.0000,"publicationDate":"2025-06-02","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://www.ncbi.nlm.nih.gov/pmc/articles/PMC12191722/pdf/","citationCount":"0","resultStr":"{\"title\":\"From Data to Decisions: Leveraging Retrieval-Augmented Generation to Balance Citation Bias in Burn Management Literature.\",\"authors\":\"Ariana Genovese, Srinivasagam Prabha, Sahar Borna, Cesar A Gomez-Cabello, Syed Ali Haider, Maissa Trabilsy, Cui Tao, Antonio Jorge Forte\",\"doi\":\"10.3390/ebj6020028\",\"DOIUrl\":null,\"url\":null,\"abstract\":\"<p><p>(1) Burn injuries demand multidisciplinary, evidence-based care, yet the extensive literature complicates timely decision making. Retrieval-augmented generation (RAG) synthesizes research while addressing inaccuracies in pretrained models. However, citation bias in sourcing for RAG often prioritizes highly cited studies, overlooking less-cited but valuable research. This study examines RAG's performance in burn management, comparing citation levels to enhance evidence synthesis, reduce selection bias, and guide decisions. (2) Two burn management datasets were assembled: 30 highly cited (mean: 303) and 30 less-cited (mean: 21). The Gemini-1.0-Pro-002 RAG model addressed 30 questions, ranging from foundational principles to advanced surgical approaches. Responses were evaluated for accuracy (5-point scale), readability (Flesch-Kincaid metrics), and response time with Wilcoxon rank sum tests (<i>p</i> < 0.05). (3) RAG achieved comparable accuracy (4.6 vs. 4.2, <i>p</i> = 0.49), readability (Flesch Reading Ease: 42.8 vs. 46.5, <i>p</i> = 0.26; Grade Level: 9.9 vs. 9.5, <i>p</i> = 0.29), and response time (2.8 vs. 2.5 s, <i>p</i> = 0.39) for the highly and less-cited datasets. (4) Less-cited research performed similarly to highly cited sources. This equivalence broadens clinicians' access to novel, diverse insights without sacrificing quality. As plastic surgery evolves, RAG's inclusive approach fosters innovation, improves patient care, and reduces cognitive burden by integrating underutilized studies. Embracing RAG could propel the field toward dynamic, forward-thinking care.</p>\",\"PeriodicalId\":72961,\"journal\":{\"name\":\"European burn journal\",\"volume\":\"6 2\",\"pages\":\"\"},\"PeriodicalIF\":1.0000,\"publicationDate\":\"2025-06-02\",\"publicationTypes\":\"Journal Article\",\"fieldsOfStudy\":null,\"isOpenAccess\":false,\"openAccessPdf\":\"https://www.ncbi.nlm.nih.gov/pmc/articles/PMC12191722/pdf/\",\"citationCount\":\"0\",\"resultStr\":null,\"platform\":\"Semanticscholar\",\"paperid\":null,\"PeriodicalName\":\"European burn journal\",\"FirstCategoryId\":\"1085\",\"ListUrlMain\":\"https://doi.org/10.3390/ebj6020028\",\"RegionNum\":0,\"RegionCategory\":null,\"ArticlePicture\":[],\"TitleCN\":null,\"AbstractTextCN\":null,\"PMCID\":null,\"EPubDate\":\"\",\"PubModel\":\"\",\"JCR\":\"Q4\",\"JCRName\":\"CRITICAL CARE MEDICINE\",\"Score\":null,\"Total\":0}","platform":"Semanticscholar","paperid":null,"PeriodicalName":"European burn journal","FirstCategoryId":"1085","ListUrlMain":"https://doi.org/10.3390/ebj6020028","RegionNum":0,"RegionCategory":null,"ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"Q4","JCRName":"CRITICAL CARE MEDICINE","Score":null,"Total":0}
引用次数: 0
摘要
(1)烧伤需要多学科、循证护理,但大量文献使及时决策复杂化。检索增强生成(RAG)综合研究,同时解决预训练模型中的不准确性。然而,在为RAG采购时,引文偏倚往往优先考虑高被引的研究,而忽略了被引较少但有价值的研究。本研究考察了RAG在烧伤管理中的表现,比较了引文水平,以加强证据综合,减少选择偏差,并指导决策。(2)收集了两个烧伤管理数据集:30个高被引数据集(平均:303)和30个低被引数据集(平均:21)。Gemini-1.0-Pro-002 RAG模型解决了30个问题,从基本原理到先进的手术方法。采用Wilcoxon秩和检验评估反应的准确性(5分制)、可读性(Flesch-Kincaid指标)和反应时间(p < 0.05)。(3) RAG具有相当的准确性(4.6 vs. 4.2, p = 0.49),可读性(Flesch Reading Ease: 42.8 vs. 46.5, p = 0.26;等级水平:9.9 vs. 9.5, p = 0.29),响应时间(2.8 vs. 2.5 s, p = 0.39)。(4)被引次数较少的研究与被引次数较多的研究表现相似。这种等效性拓宽了临床医生在不牺牲质量的情况下获得新颖、多样化见解的途径。随着整形外科的发展,RAG的包容性方法促进了创新,改善了患者护理,并通过整合未充分利用的研究减轻了认知负担。拥抱RAG可以推动该领域走向动态的、前瞻性的护理。
From Data to Decisions: Leveraging Retrieval-Augmented Generation to Balance Citation Bias in Burn Management Literature.
(1) Burn injuries demand multidisciplinary, evidence-based care, yet the extensive literature complicates timely decision making. Retrieval-augmented generation (RAG) synthesizes research while addressing inaccuracies in pretrained models. However, citation bias in sourcing for RAG often prioritizes highly cited studies, overlooking less-cited but valuable research. This study examines RAG's performance in burn management, comparing citation levels to enhance evidence synthesis, reduce selection bias, and guide decisions. (2) Two burn management datasets were assembled: 30 highly cited (mean: 303) and 30 less-cited (mean: 21). The Gemini-1.0-Pro-002 RAG model addressed 30 questions, ranging from foundational principles to advanced surgical approaches. Responses were evaluated for accuracy (5-point scale), readability (Flesch-Kincaid metrics), and response time with Wilcoxon rank sum tests (p < 0.05). (3) RAG achieved comparable accuracy (4.6 vs. 4.2, p = 0.49), readability (Flesch Reading Ease: 42.8 vs. 46.5, p = 0.26; Grade Level: 9.9 vs. 9.5, p = 0.29), and response time (2.8 vs. 2.5 s, p = 0.39) for the highly and less-cited datasets. (4) Less-cited research performed similarly to highly cited sources. This equivalence broadens clinicians' access to novel, diverse insights without sacrificing quality. As plastic surgery evolves, RAG's inclusive approach fosters innovation, improves patient care, and reduces cognitive burden by integrating underutilized studies. Embracing RAG could propel the field toward dynamic, forward-thinking care.