{"title":"LLMOverTab: Tabular data augmentation with language model-driven oversampling","authors":"Tokimasa Isomura , Ryotaro Shimizu , Goto Masayuki","doi":"10.1016/j.eswa.2024.125852","DOIUrl":null,"url":null,"abstract":"<div><div>In recent years, Large Language Model (LLM) have seen significant advancements, attracting attention for their applications in various fields. These models have shown promising results in handling tabular data, especially in cases with limited datasets, by leveraging pre-trained knowledge. However, their effectiveness in addressing imbalanced data in tabular formats is less explored. To bridge this gap, our study introduces LLMOverTab, a novel approach using LLMs for oversampling in imbalanced tabular data. We conducted comprehensive experiments on diverse tabular datasets to assess the effectiveness of LLMOverTab, demonstrating its potential in improving the handling of imbalanced data. The study also explores application of LLMOverTab in zero-shot and few-shot learning contexts, providing insights into its adaptability. Additionally, we analyze the oversampled data, offering reflections on the quality of generated samples. Our research not only showcases the utility of LLMOverTab in managing imbalanced tabular data, but also opens new avenues for the application of language models in various tasks of tabular data. This study adds to the increasing interest in applying LLMs to various task domains. It provides new perspectives for the innovative use of LLMs in structured tabular data fields, highlighting their potential in a range of applications.</div></div>","PeriodicalId":50461,"journal":{"name":"Expert Systems with Applications","volume":"264 ","pages":"Article 125852"},"PeriodicalIF":7.5000,"publicationDate":"2024-11-28","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":"0","resultStr":null,"platform":"Semanticscholar","paperid":null,"PeriodicalName":"Expert Systems with Applications","FirstCategoryId":"94","ListUrlMain":"https://www.sciencedirect.com/science/article/pii/S0957417424027192","RegionNum":1,"RegionCategory":"计算机科学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"Q1","JCRName":"COMPUTER SCIENCE, ARTIFICIAL INTELLIGENCE","Score":null,"Total":0}
引用次数: 0
Abstract
In recent years, Large Language Model (LLM) have seen significant advancements, attracting attention for their applications in various fields. These models have shown promising results in handling tabular data, especially in cases with limited datasets, by leveraging pre-trained knowledge. However, their effectiveness in addressing imbalanced data in tabular formats is less explored. To bridge this gap, our study introduces LLMOverTab, a novel approach using LLMs for oversampling in imbalanced tabular data. We conducted comprehensive experiments on diverse tabular datasets to assess the effectiveness of LLMOverTab, demonstrating its potential in improving the handling of imbalanced data. The study also explores application of LLMOverTab in zero-shot and few-shot learning contexts, providing insights into its adaptability. Additionally, we analyze the oversampled data, offering reflections on the quality of generated samples. Our research not only showcases the utility of LLMOverTab in managing imbalanced tabular data, but also opens new avenues for the application of language models in various tasks of tabular data. This study adds to the increasing interest in applying LLMs to various task domains. It provides new perspectives for the innovative use of LLMs in structured tabular data fields, highlighting their potential in a range of applications.
期刊介绍:
Expert Systems With Applications is an international journal dedicated to the exchange of information on expert and intelligent systems used globally in industry, government, and universities. The journal emphasizes original papers covering the design, development, testing, implementation, and management of these systems, offering practical guidelines. It spans various sectors such as finance, engineering, marketing, law, project management, information management, medicine, and more. The journal also welcomes papers on multi-agent systems, knowledge management, neural networks, knowledge discovery, data mining, and other related areas, excluding applications to military/defense systems.