{"title":"Enhancing scientific table understanding with type-guided chain-of-thought","authors":"Zhen Yin , Shenghua Wang","doi":"10.1016/j.ipm.2025.104159","DOIUrl":null,"url":null,"abstract":"<div><div>Tables in scientific papers convey essential data and insights. Traditional methods struggle with the complexity of modern table data. This study introduces the SciTable-Sowise framework, which utilizes a fine-tuned table classifier to determine the specific type of each table and uses this type information to formulate the Chain-of-Thought (CoT) prompts for large language models (LLMs), significantly enhancing the processing of table content. We constructed the Sci-Table-QA and Sci-Table-Summarization datasets, which comprise 55,000 reasoning QA samples and 5264 summarization samples across multiple disciplines in both Chinese and English. Experimental results show a 7.2 % increase in table reasoning accuracy in Chinese (81.9 %) and a 7.5 % increase in English (83.1 %), surpassing existing models. Our method also enhances summarization performance, as validated by ROUGE, BertScore, and GPT-4o model evaluation metrics (G-Eval-4). This approach demonstrates substantial real-world application potential in scientific research and business analytics, with our datasets publicly available to support future research.</div></div>","PeriodicalId":50365,"journal":{"name":"Information Processing & Management","volume":"62 4","pages":"Article 104159"},"PeriodicalIF":7.4000,"publicationDate":"2025-03-26","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":"0","resultStr":null,"platform":"Semanticscholar","paperid":null,"PeriodicalName":"Information Processing & Management","FirstCategoryId":"94","ListUrlMain":"https://www.sciencedirect.com/science/article/pii/S0306457325001001","RegionNum":1,"RegionCategory":"管理学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"Q1","JCRName":"COMPUTER SCIENCE, INFORMATION SYSTEMS","Score":null,"Total":0}
引用次数: 0
Abstract
Tables in scientific papers convey essential data and insights. Traditional methods struggle with the complexity of modern table data. This study introduces the SciTable-Sowise framework, which utilizes a fine-tuned table classifier to determine the specific type of each table and uses this type information to formulate the Chain-of-Thought (CoT) prompts for large language models (LLMs), significantly enhancing the processing of table content. We constructed the Sci-Table-QA and Sci-Table-Summarization datasets, which comprise 55,000 reasoning QA samples and 5264 summarization samples across multiple disciplines in both Chinese and English. Experimental results show a 7.2 % increase in table reasoning accuracy in Chinese (81.9 %) and a 7.5 % increase in English (83.1 %), surpassing existing models. Our method also enhances summarization performance, as validated by ROUGE, BertScore, and GPT-4o model evaluation metrics (G-Eval-4). This approach demonstrates substantial real-world application potential in scientific research and business analytics, with our datasets publicly available to support future research.
期刊介绍:
Information Processing and Management is dedicated to publishing cutting-edge original research at the convergence of computing and information science. Our scope encompasses theory, methods, and applications across various domains, including advertising, business, health, information science, information technology marketing, and social computing.
We aim to cater to the interests of both primary researchers and practitioners by offering an effective platform for the timely dissemination of advanced and topical issues in this interdisciplinary field. The journal places particular emphasis on original research articles, research survey articles, research method articles, and articles addressing critical applications of research. Join us in advancing knowledge and innovation at the intersection of computing and information science.