{"title":"A multi-feature selection fused with investor sentiment for stock price prediction","authors":"Kehan Zhen , Dan Xie , Xiaochun Hu","doi":"10.1016/j.eswa.2025.127381","DOIUrl":null,"url":null,"abstract":"<div><div>The stock market data has the characteristics of high dimensionality and multiple noise, and the investment behavior of investors is easily influenced by emotions, which poses a great challenge to stock price prediction. To improve the accuracy of stock price prediction, this study proposes a combined modeling approach based on multiple feature selection algorithms and incorporating investor sentiment. First, we collected stock trading data of the Chinese A-share market from 2018 to 2022, and three types of investor sentiment data sourced from social media, Internet news and newspaper news. Then, we used five feature selection algorithms to select dozens of important features from hundreds of features in the stock trading data. Based on three types of investor sentiment data, five sentiment indicators were constructed and included in the subsequent feature selection along with the previously selected important features. Finally, five deep learning models were used to predict stock prices using feature sets with sentiment indicators. A total of 1030 stocks from 10 industries such as pharmaceutical and biological, leisure service, food and beverage were selected for the experiment. The results show that in 10 industries, LSTM-CNN-Attention model has the best effect on stock price prediction, and after incorporating the sentiment indicator constructed by the principal component, the effect of the model is significantly improved, and the performance is the best in 7 industries. This method explores a new way of stock price prediction by integrating investor sentiment, and can provide further reference for the research of stock price intelligent prediction.</div></div>","PeriodicalId":50461,"journal":{"name":"Expert Systems with Applications","volume":"278 ","pages":"Article 127381"},"PeriodicalIF":7.5000,"publicationDate":"2025-03-26","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":"0","resultStr":null,"platform":"Semanticscholar","paperid":null,"PeriodicalName":"Expert Systems with Applications","FirstCategoryId":"94","ListUrlMain":"https://www.sciencedirect.com/science/article/pii/S0957417425010036","RegionNum":1,"RegionCategory":"计算机科学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"Q1","JCRName":"COMPUTER SCIENCE, ARTIFICIAL INTELLIGENCE","Score":null,"Total":0}
引用次数: 0
Abstract
The stock market data has the characteristics of high dimensionality and multiple noise, and the investment behavior of investors is easily influenced by emotions, which poses a great challenge to stock price prediction. To improve the accuracy of stock price prediction, this study proposes a combined modeling approach based on multiple feature selection algorithms and incorporating investor sentiment. First, we collected stock trading data of the Chinese A-share market from 2018 to 2022, and three types of investor sentiment data sourced from social media, Internet news and newspaper news. Then, we used five feature selection algorithms to select dozens of important features from hundreds of features in the stock trading data. Based on three types of investor sentiment data, five sentiment indicators were constructed and included in the subsequent feature selection along with the previously selected important features. Finally, five deep learning models were used to predict stock prices using feature sets with sentiment indicators. A total of 1030 stocks from 10 industries such as pharmaceutical and biological, leisure service, food and beverage were selected for the experiment. The results show that in 10 industries, LSTM-CNN-Attention model has the best effect on stock price prediction, and after incorporating the sentiment indicator constructed by the principal component, the effect of the model is significantly improved, and the performance is the best in 7 industries. This method explores a new way of stock price prediction by integrating investor sentiment, and can provide further reference for the research of stock price intelligent prediction.
期刊介绍:
Expert Systems With Applications is an international journal dedicated to the exchange of information on expert and intelligent systems used globally in industry, government, and universities. The journal emphasizes original papers covering the design, development, testing, implementation, and management of these systems, offering practical guidelines. It spans various sectors such as finance, engineering, marketing, law, project management, information management, medicine, and more. The journal also welcomes papers on multi-agent systems, knowledge management, neural networks, knowledge discovery, data mining, and other related areas, excluding applications to military/defense systems.