{"title":"SpotV2Net: Multivariate intraday spot volatility forecasting via vol-of-vol-informed graph attention networks","authors":"Alessio Brini , Giacomo Toscano","doi":"10.1016/j.ijforecast.2024.11.004","DOIUrl":"10.1016/j.ijforecast.2024.11.004","url":null,"abstract":"<div><div>This paper introduces SpotV2Net, a multivariate intraday spot volatility forecasting model based on a graph attention network architecture. SpotV2Net represents assets as nodes within a graph and includes non-parametric high-frequency Fourier estimates of the spot volatility and co-volatility as node features. Further, it incorporates Fourier estimates of the spot volatility of volatility and co-volatility of volatility as features for node edges, to capture spillover effects. We test the forecasting accuracy of SpotV2Net in an extensive empirical exercise, conducted with the components of the Dow Jones Industrial Average index. The results we obtain suggest that SpotV2Net yields statistically significant gains in forecasting accuracy, for both single-step and multi-step forecasts, compared to a panel heterogeneous autoregressive model and alternative machine-learning models. To interpret the forecasts produced by SpotV2Net, we employ GNNExplainer (Ying et al., 2019), a model-agnostic interpretability tool, and thereby uncover subgraphs that are critical to a node’s predictions.</div></div>","PeriodicalId":14061,"journal":{"name":"International Journal of Forecasting","volume":"41 3","pages":"Pages 1093-1111"},"PeriodicalIF":6.9,"publicationDate":"2024-12-06","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"144212024","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":2,"RegionCategory":"经济学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
{"title":"Credit scoring model for fintech lending: An integration of large language models and FocalPoly loss","authors":"Yufei Xia , Zhiyin Han , Yawen Li , Lingyun He","doi":"10.1016/j.ijforecast.2024.07.005","DOIUrl":"10.1016/j.ijforecast.2024.07.005","url":null,"abstract":"<div><div>Fintech lending experiences high credit risk and needs an efficient credit scoring model, but it also faces limited data sources and severe class imbalance. We develop a novel two-stage credit scoring model (called LLM-FP-CatBoost) by solving the two issues simultaneously. Large language models (LLMs) initially extract narrative data as a supplementary credit dataset. A new FocalPoly loss is then incorporated with CatBoost to handle the class imbalance problem. Extensive comparisons demonstrate that the proposed LLM-FP-CatBoost significantly outperforms the benchmarks in most circumstances. When making pairwise comparisons between LLMs on the fintech lending dataset, we found that the Chinese-specific LLM, i.e., ERNIE 4.0, achieves the best overall performance, followed by GPT-4 and BERT-based models. The performance decomposition reveals that the superiority is mainly attributed to the new data source extracted by the LLMs. The SHAP algorithm further ensures the interpretability of LLM-FP-CatBoost. The superiority of the proposed LLM-FP-CatBoost model remains robust to hyperparameters of the loss function, specific LLMs, and other extraction methods of narrative data. Finally, we discuss some managerial implications concerning credit scoring in fintech lending.</div></div>","PeriodicalId":14061,"journal":{"name":"International Journal of Forecasting","volume":"41 3","pages":"Pages 894-919"},"PeriodicalIF":6.9,"publicationDate":"2024-12-05","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"144212028","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":2,"RegionCategory":"经济学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
{"title":"Econometric forecasting using ubiquitous news text: Text-enhanced factor model","authors":"Beomseok Seo","doi":"10.1016/j.ijforecast.2024.11.001","DOIUrl":"10.1016/j.ijforecast.2024.11.001","url":null,"abstract":"<div><div>News text is gaining increasing attention as a novel source for econometric forecasting. This paper revisits how narrative information is incorporated into econometric forecasting by effectively quantifying sector-specific textual information without requiring training data. We propose <em>Theme Frequency Indices</em> (TFIs), which utilize domain-specific subject-predicate patterns to measure public perception about the economy. TFIs for 15 sectors, including production, inflation, employment, capital investment, stock and house prices, and others, were examined and integrated into the <em>Text-enhanced Factor Model</em> (TFM), using latent factor structures. Empirical analysis based on over 18 million news articles from Korea reveals that TFM improves the accuracy of near-term GDP forecasts, demonstrating that simple text-mining techniques combined with domain knowledge can effectively leverage qualitative information in the news without costly training. The proposed method is applicable to a wide range of subjects for utilizing narrative information on the economy, offering a rapid and cost-effective approach.</div></div>","PeriodicalId":14061,"journal":{"name":"International Journal of Forecasting","volume":"41 3","pages":"Pages 1055-1072"},"PeriodicalIF":6.9,"publicationDate":"2024-12-05","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"144212022","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":2,"RegionCategory":"经济学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
{"title":"Testing for equal predictive accuracy with strong dependence","authors":"Laura Coroneo , Fabrizio Iacone","doi":"10.1016/j.ijforecast.2024.11.003","DOIUrl":"10.1016/j.ijforecast.2024.11.003","url":null,"abstract":"<div><div>We analyse the properties of the Diebold and Mariano (1995) test in the presence of autocorrelation in the loss differential. We show that the power of the Diebold and Mariano (1995) test decreases as the dependence increases, making it more difficult to obtain statistically significant evidence of superior predictive ability against less accurate benchmarks. We also find that, after a certain threshold, the test has no power, and the correct null hypothesis is spuriously rejected. These results caution us to seriously consider the loss differential’s dependence properties before applying the Diebold and Mariano (1995) test.</div></div>","PeriodicalId":14061,"journal":{"name":"International Journal of Forecasting","volume":"41 3","pages":"Pages 1073-1092"},"PeriodicalIF":6.9,"publicationDate":"2024-12-05","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"144212023","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":2,"RegionCategory":"经济学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
Akylas Stratigakos , Salvador Pineda , Juan Miguel Morales
{"title":"Decision-focused linear pooling for probabilistic forecast combination","authors":"Akylas Stratigakos , Salvador Pineda , Juan Miguel Morales","doi":"10.1016/j.ijforecast.2024.11.006","DOIUrl":"10.1016/j.ijforecast.2024.11.006","url":null,"abstract":"<div><div>In real-world settings, decision-makers often have access to multiple forecasts for the same unknown quantity. Combining different forecasts has long been known to improve forecast quality, as measured by scoring rules in the case of probabilistic forecasting. However, improved forecast quality does not always translate into better decisions in a downstream problem that utilizes the resultant combined forecast as input. To this end, this work proposes a novel probabilistic forecast combination approach that accounts for the downstream stochastic optimization problem by which the decisions will be made. We propose a linear pool of probabilistic forecasts where the respective weights are learned by minimizing the expected decision cost of the induced combination, which we formulate as a nested optimization problem. Two methods are proposed for its solution: a gradient-based method that utilizes differential optimization layers, and a performance-based weighting method. The proposed decision-focused combination approach is validated in two integral problems associated with renewable energy integration in low-carbon power systems and compared against well-established combination methods. Namely, we examine an electricity market trading problem under stochastic solar production and a grid scheduling problem under stochastic wind production. The results illustrate that the proposed approach leads to lower expected downstream costs, while optimizing for forecast quality when estimating linear pool weights does not always translate into better decisions. Notably, optimizing for a combination of downstream cost and an accuracy-oriented scoring rule consistently leads to better decisions while also improving forecast quality.</div></div>","PeriodicalId":14061,"journal":{"name":"International Journal of Forecasting","volume":"41 3","pages":"Pages 1112-1125"},"PeriodicalIF":6.9,"publicationDate":"2024-11-30","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"144211935","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":2,"RegionCategory":"经济学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
{"title":"Interpretable water level forecaster with spatiotemporal causal attention mechanisms","authors":"Sungchul Hong , Yunjin Choi , Jong-June Jeon","doi":"10.1016/j.ijforecast.2024.10.003","DOIUrl":"10.1016/j.ijforecast.2024.10.003","url":null,"abstract":"<div><div>Accurate forecasting of river water levels is vital for effectively managing traffic flow and mitigating the risks associated with natural disasters. This task presents challenges due to the intricate factors influencing the flow of a river. Recent advances in machine learning have introduced numerous effective forecasting methods. However, these methods lack interpretability due to their complex structure, resulting in limited reliability. Addressing this issue, this study proposes a deep learning model that quantifies interpretability, with an emphasis on water level forecasting. This model focuses on generating quantitative interpretability measurements, which align with the common knowledge embedded in the input data. This is facilitated by the utilization of a transformer architecture that is purposefully designed with masking, incorporating a multi-layer network that captures spatiotemporal causation. We perform a comparative analysis on the Han River dataset obtained from Seoul, South Korea, from 2016 to 2021. The results illustrate that our approach offers enhanced interpretability consistent with common knowledge, outperforming competing methods. The approach also enhances robustness against distribution shift.</div></div>","PeriodicalId":14061,"journal":{"name":"International Journal of Forecasting","volume":"41 3","pages":"Pages 1037-1054"},"PeriodicalIF":6.9,"publicationDate":"2024-11-21","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"144212021","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":2,"RegionCategory":"经济学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
{"title":"An overview of the effects of algorithm use on judgmental biases affecting forecasting","authors":"Alvaro Chacon , Esther Kaufmann","doi":"10.1016/j.ijforecast.2024.09.007","DOIUrl":"10.1016/j.ijforecast.2024.09.007","url":null,"abstract":"<div><div>In the realm of forecasting, judgmental biases often hinder efficiency and accuracy. Algorithms present a promising avenue for decision makers to enhance their forecasting performance. In this overview, we scrutinized the occurrence of the most relevant judgmental biases affecting forecasting across 162 papers, drawing from four recent reviews and papers published in forecasting journals, specifically focusing on the use of algorithms. Thirty-three of the 162 papers (20.4%) at least briefly mentioned one of twelve judgmental biases affecting forecasting. Our comprehensive analysis suggests that algorithms can potentially mitigate the adverse impacts of biases inherent in human judgment related to forecasting. Furthermore, these algorithms can leverage biases as an advantage, enhancing forecast accuracy. Intriguing revelations have surfaced, focusing mainly on four biases. By providing timely, relevant, well-performing, and consistent algorithmic advice, people can be effectively influenced to improve their forecasts, considering anchoring, availability, inconsistency, and confirmation bias. The findings highlight the gaps in the current research landscape and provide recommendations for practitioners. They also lay the groundwork for future studies on utilizing algorithms (e.g., large language models) and overcoming judgmental biases to improve forecasting performance.</div></div>","PeriodicalId":14061,"journal":{"name":"International Journal of Forecasting","volume":"41 2","pages":"Pages 424-439"},"PeriodicalIF":6.9,"publicationDate":"2024-11-21","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"143579235","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":2,"RegionCategory":"经济学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"OA","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
{"title":"Service-level anchoring in demand forecasting: The moderating impact of retail promotions and product perishability","authors":"Ben Fahimnia , Tarkan Tan , Nail Tahirov","doi":"10.1016/j.ijforecast.2024.07.007","DOIUrl":"10.1016/j.ijforecast.2024.07.007","url":null,"abstract":"<div><div>The development of demand plans involves the integration of demand forecasts, service-level prerequisites, replenishment constraints, and revenue projections. However, empirical evidence has brought to light that forecasters often fail to distinguish between demand forecasts and demand plans. More specifically, forecasters frequently incorporate service-level requirements into their demand forecasts, even when explicitly instructed not to do so. This study endeavors to investigate the potential moderating impacts of product perishability and the presence of sales promotions on this phenomenon. Our findings reveal that sales promotions can meaningfully moderate the influence of service levels, since individuals tend to exhibit an elevated propensity for overforecasting during promotional periods when service levels are high. Surprisingly, no compelling evidence is found for the moderating effect of product perishability.</div></div>","PeriodicalId":14061,"journal":{"name":"International Journal of Forecasting","volume":"41 2","pages":"Pages 554-570"},"PeriodicalIF":6.9,"publicationDate":"2024-11-18","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"143579120","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":2,"RegionCategory":"经济学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"OA","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
{"title":"Constructing hierarchical time series through clustering: Is there an optimal way for forecasting?","authors":"Bohan Zhang , Anastasios Panagiotelis , Han Li","doi":"10.1016/j.ijforecast.2024.10.002","DOIUrl":"10.1016/j.ijforecast.2024.10.002","url":null,"abstract":"<div><div>Forecast reconciliation has attracted significant research interest in recent years, with most studies taking the hierarchy of time series as given. We extend existing work that uses time series clustering to construct hierarchies to improve forecast accuracy in three ways. First, we investigate multiple approaches to clustering, including different clustering algorithms, how time series are represented, and how the distance between time series is defined. We find that cluster-based hierarchies improve forecast accuracy relative to two-level hierarchies. Second, we devise an approach based on random permutation of hierarchies, keeping the hierarchy structure fixed while time series are randomly allocated to clusters. In doing so, we find that improvements in forecast accuracy that accrue from using clustering do not arise from grouping similar series but from the structure of the hierarchy. Third, we propose an approach based on averaging forecasts across hierarchies constructed using different clustering methods that is shown to outperform any single clustering method. All analysis is carried out on two benchmark datasets and a simulated dataset. Our findings provide new insights into the role of hierarchy construction in forecast reconciliation and offer valuable guidance on forecasting practice.</div></div>","PeriodicalId":14061,"journal":{"name":"International Journal of Forecasting","volume":"41 3","pages":"Pages 1022-1036"},"PeriodicalIF":6.9,"publicationDate":"2024-11-13","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"144212011","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":2,"RegionCategory":"经济学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
{"title":"Robust recalibration of aggregate probability forecasts using meta-beliefs","authors":"Cem Peker , Tom Wilkening","doi":"10.1016/j.ijforecast.2024.09.005","DOIUrl":"10.1016/j.ijforecast.2024.09.005","url":null,"abstract":"<div><div>Previous work suggests that aggregate probabilistic forecasts on a binary event are often conservative. Extremizing transformations that adjust the aggregate forecast away from the uninformed prior of 0.5 can improve calibration in many settings. However, such transformations may be problematic in decision problems where forecasters share a biased prior. In these problems, extremizing transformations can introduce further miscalibration. We develop a two-step algorithm where we first estimate the prior using each forecaster’s belief about the average forecast of others. We then transform away from this estimated prior in each forecasting problem. Our algorithm works in single-question forecasting problems and does not require past data. Evidence from experimental prediction tasks suggests that the resulting average probability forecast is robust to biased priors and improves calibration.</div></div>","PeriodicalId":14061,"journal":{"name":"International Journal of Forecasting","volume":"41 2","pages":"Pages 613-630"},"PeriodicalIF":6.9,"publicationDate":"2024-10-30","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"143579224","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":2,"RegionCategory":"经济学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}