{"title":"Econometric forecasting using ubiquitous news text: Text-enhanced factor model","authors":"Beomseok Seo","doi":"10.1016/j.ijforecast.2024.11.001","DOIUrl":"10.1016/j.ijforecast.2024.11.001","url":null,"abstract":"<div><div>News text is gaining increasing attention as a novel source for econometric forecasting. This paper revisits how narrative information is incorporated into econometric forecasting by effectively quantifying sector-specific textual information without requiring training data. We propose <em>Theme Frequency Indices</em> (TFIs), which utilize domain-specific subject-predicate patterns to measure public perception about the economy. TFIs for 15 sectors, including production, inflation, employment, capital investment, stock and house prices, and others, were examined and integrated into the <em>Text-enhanced Factor Model</em> (TFM), using latent factor structures. Empirical analysis based on over 18 million news articles from Korea reveals that TFM improves the accuracy of near-term GDP forecasts, demonstrating that simple text-mining techniques combined with domain knowledge can effectively leverage qualitative information in the news without costly training. The proposed method is applicable to a wide range of subjects for utilizing narrative information on the economy, offering a rapid and cost-effective approach.</div></div>","PeriodicalId":14061,"journal":{"name":"International Journal of Forecasting","volume":"41 3","pages":"Pages 1055-1072"},"PeriodicalIF":6.9,"publicationDate":"2024-12-05","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"144212022","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":2,"RegionCategory":"经济学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
{"title":"Testing for equal predictive accuracy with strong dependence","authors":"Laura Coroneo , Fabrizio Iacone","doi":"10.1016/j.ijforecast.2024.11.003","DOIUrl":"10.1016/j.ijforecast.2024.11.003","url":null,"abstract":"<div><div>We analyse the properties of the Diebold and Mariano (1995) test in the presence of autocorrelation in the loss differential. We show that the power of the Diebold and Mariano (1995) test decreases as the dependence increases, making it more difficult to obtain statistically significant evidence of superior predictive ability against less accurate benchmarks. We also find that, after a certain threshold, the test has no power, and the correct null hypothesis is spuriously rejected. These results caution us to seriously consider the loss differential’s dependence properties before applying the Diebold and Mariano (1995) test.</div></div>","PeriodicalId":14061,"journal":{"name":"International Journal of Forecasting","volume":"41 3","pages":"Pages 1073-1092"},"PeriodicalIF":6.9,"publicationDate":"2024-12-05","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"144212023","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":2,"RegionCategory":"经济学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
Spyros Makridakis , Evangelos Spiliotis , Ross Hollyman , Fotios Petropoulos , Norman Swanson , Anil Gaba
{"title":"The M6 forecasting competition: Bridging the gap between forecasting and investment decisions","authors":"Spyros Makridakis , Evangelos Spiliotis , Ross Hollyman , Fotios Petropoulos , Norman Swanson , Anil Gaba","doi":"10.1016/j.ijforecast.2024.11.002","DOIUrl":"10.1016/j.ijforecast.2024.11.002","url":null,"abstract":"<div><div>The M6 forecasting competition, the sixth in the Makridakis competition sequence, focused on financial forecasting. A key objective of the M6 competition was to contribute to the debate surrounding the Efficient Market Hypothesis by examining how and why market participants make investment decisions. To address these objectives, the M6 competition investigated forecasting accuracy and investment performance in a universe of 100 publicly traded assets. The competition employed live evaluation on real data across multiple periods, a cross-sectional setting where participants predicted asset performance relative to that of other assets, and a direct evaluation of the utility of forecasts. In this way, we were able to measure the benefits of accurate forecasting and assess the importance of forecasting when making investment decisions. Our findings highlight the challenges that participants faced when attempting to accurately forecast the relative performance of assets, the great difficulty associated with trying to consistently outperform the market, the limited connection between submitted forecasts and investment decisions, the value added by information exchange and the “wisdom of crowds”, and the value of utilizing risk models when attempting to connect prediction and investing decisions.</div></div>","PeriodicalId":14061,"journal":{"name":"International Journal of Forecasting","volume":"41 4","pages":"Pages 1315-1354"},"PeriodicalIF":7.1,"publicationDate":"2024-11-30","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"145019329","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":2,"RegionCategory":"经济学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
Akylas Stratigakos , Salvador Pineda , Juan Miguel Morales
{"title":"Decision-focused linear pooling for probabilistic forecast combination","authors":"Akylas Stratigakos , Salvador Pineda , Juan Miguel Morales","doi":"10.1016/j.ijforecast.2024.11.006","DOIUrl":"10.1016/j.ijforecast.2024.11.006","url":null,"abstract":"<div><div>In real-world settings, decision-makers often have access to multiple forecasts for the same unknown quantity. Combining different forecasts has long been known to improve forecast quality, as measured by scoring rules in the case of probabilistic forecasting. However, improved forecast quality does not always translate into better decisions in a downstream problem that utilizes the resultant combined forecast as input. To this end, this work proposes a novel probabilistic forecast combination approach that accounts for the downstream stochastic optimization problem by which the decisions will be made. We propose a linear pool of probabilistic forecasts where the respective weights are learned by minimizing the expected decision cost of the induced combination, which we formulate as a nested optimization problem. Two methods are proposed for its solution: a gradient-based method that utilizes differential optimization layers, and a performance-based weighting method. The proposed decision-focused combination approach is validated in two integral problems associated with renewable energy integration in low-carbon power systems and compared against well-established combination methods. Namely, we examine an electricity market trading problem under stochastic solar production and a grid scheduling problem under stochastic wind production. The results illustrate that the proposed approach leads to lower expected downstream costs, while optimizing for forecast quality when estimating linear pool weights does not always translate into better decisions. Notably, optimizing for a combination of downstream cost and an accuracy-oriented scoring rule consistently leads to better decisions while also improving forecast quality.</div></div>","PeriodicalId":14061,"journal":{"name":"International Journal of Forecasting","volume":"41 3","pages":"Pages 1112-1125"},"PeriodicalIF":6.9,"publicationDate":"2024-11-30","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"144211935","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":2,"RegionCategory":"经济学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
{"title":"Interpretable water level forecaster with spatiotemporal causal attention mechanisms","authors":"Sungchul Hong , Yunjin Choi , Jong-June Jeon","doi":"10.1016/j.ijforecast.2024.10.003","DOIUrl":"10.1016/j.ijforecast.2024.10.003","url":null,"abstract":"<div><div>Accurate forecasting of river water levels is vital for effectively managing traffic flow and mitigating the risks associated with natural disasters. This task presents challenges due to the intricate factors influencing the flow of a river. Recent advances in machine learning have introduced numerous effective forecasting methods. However, these methods lack interpretability due to their complex structure, resulting in limited reliability. Addressing this issue, this study proposes a deep learning model that quantifies interpretability, with an emphasis on water level forecasting. This model focuses on generating quantitative interpretability measurements, which align with the common knowledge embedded in the input data. This is facilitated by the utilization of a transformer architecture that is purposefully designed with masking, incorporating a multi-layer network that captures spatiotemporal causation. We perform a comparative analysis on the Han River dataset obtained from Seoul, South Korea, from 2016 to 2021. The results illustrate that our approach offers enhanced interpretability consistent with common knowledge, outperforming competing methods. The approach also enhances robustness against distribution shift.</div></div>","PeriodicalId":14061,"journal":{"name":"International Journal of Forecasting","volume":"41 3","pages":"Pages 1037-1054"},"PeriodicalIF":6.9,"publicationDate":"2024-11-21","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"144212021","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":2,"RegionCategory":"经济学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
{"title":"An overview of the effects of algorithm use on judgmental biases affecting forecasting","authors":"Alvaro Chacon , Esther Kaufmann","doi":"10.1016/j.ijforecast.2024.09.007","DOIUrl":"10.1016/j.ijforecast.2024.09.007","url":null,"abstract":"<div><div>In the realm of forecasting, judgmental biases often hinder efficiency and accuracy. Algorithms present a promising avenue for decision makers to enhance their forecasting performance. In this overview, we scrutinized the occurrence of the most relevant judgmental biases affecting forecasting across 162 papers, drawing from four recent reviews and papers published in forecasting journals, specifically focusing on the use of algorithms. Thirty-three of the 162 papers (20.4%) at least briefly mentioned one of twelve judgmental biases affecting forecasting. Our comprehensive analysis suggests that algorithms can potentially mitigate the adverse impacts of biases inherent in human judgment related to forecasting. Furthermore, these algorithms can leverage biases as an advantage, enhancing forecast accuracy. Intriguing revelations have surfaced, focusing mainly on four biases. By providing timely, relevant, well-performing, and consistent algorithmic advice, people can be effectively influenced to improve their forecasts, considering anchoring, availability, inconsistency, and confirmation bias. The findings highlight the gaps in the current research landscape and provide recommendations for practitioners. They also lay the groundwork for future studies on utilizing algorithms (e.g., large language models) and overcoming judgmental biases to improve forecasting performance.</div></div>","PeriodicalId":14061,"journal":{"name":"International Journal of Forecasting","volume":"41 2","pages":"Pages 424-439"},"PeriodicalIF":6.9,"publicationDate":"2024-11-21","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"143579235","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":2,"RegionCategory":"经济学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"OA","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
{"title":"Service-level anchoring in demand forecasting: The moderating impact of retail promotions and product perishability","authors":"Ben Fahimnia , Tarkan Tan , Nail Tahirov","doi":"10.1016/j.ijforecast.2024.07.007","DOIUrl":"10.1016/j.ijforecast.2024.07.007","url":null,"abstract":"<div><div>The development of demand plans involves the integration of demand forecasts, service-level prerequisites, replenishment constraints, and revenue projections. However, empirical evidence has brought to light that forecasters often fail to distinguish between demand forecasts and demand plans. More specifically, forecasters frequently incorporate service-level requirements into their demand forecasts, even when explicitly instructed not to do so. This study endeavors to investigate the potential moderating impacts of product perishability and the presence of sales promotions on this phenomenon. Our findings reveal that sales promotions can meaningfully moderate the influence of service levels, since individuals tend to exhibit an elevated propensity for overforecasting during promotional periods when service levels are high. Surprisingly, no compelling evidence is found for the moderating effect of product perishability.</div></div>","PeriodicalId":14061,"journal":{"name":"International Journal of Forecasting","volume":"41 2","pages":"Pages 554-570"},"PeriodicalIF":6.9,"publicationDate":"2024-11-18","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"143579120","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":2,"RegionCategory":"经济学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"OA","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
{"title":"Constructing hierarchical time series through clustering: Is there an optimal way for forecasting?","authors":"Bohan Zhang , Anastasios Panagiotelis , Han Li","doi":"10.1016/j.ijforecast.2024.10.002","DOIUrl":"10.1016/j.ijforecast.2024.10.002","url":null,"abstract":"<div><div>Forecast reconciliation has attracted significant research interest in recent years, with most studies taking the hierarchy of time series as given. We extend existing work that uses time series clustering to construct hierarchies to improve forecast accuracy in three ways. First, we investigate multiple approaches to clustering, including different clustering algorithms, how time series are represented, and how the distance between time series is defined. We find that cluster-based hierarchies improve forecast accuracy relative to two-level hierarchies. Second, we devise an approach based on random permutation of hierarchies, keeping the hierarchy structure fixed while time series are randomly allocated to clusters. In doing so, we find that improvements in forecast accuracy that accrue from using clustering do not arise from grouping similar series but from the structure of the hierarchy. Third, we propose an approach based on averaging forecasts across hierarchies constructed using different clustering methods that is shown to outperform any single clustering method. All analysis is carried out on two benchmark datasets and a simulated dataset. Our findings provide new insights into the role of hierarchy construction in forecast reconciliation and offer valuable guidance on forecasting practice.</div></div>","PeriodicalId":14061,"journal":{"name":"International Journal of Forecasting","volume":"41 3","pages":"Pages 1022-1036"},"PeriodicalIF":6.9,"publicationDate":"2024-11-13","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"144212011","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":2,"RegionCategory":"经济学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
Spyros Makridakis , Evangelos Spiliotis , Maria Michailidis
{"title":"Avoiding overconfidence: Evidence from the M6 financial competition","authors":"Spyros Makridakis , Evangelos Spiliotis , Maria Michailidis","doi":"10.1016/j.ijforecast.2024.10.001","DOIUrl":"10.1016/j.ijforecast.2024.10.001","url":null,"abstract":"<div><div>The M6 competition aimed to identify methods that can accurately forecast asset returns and exploit such forecasts to make efficient investments. Specifically, the forecasting track of the competition required participants to estimate the probability that each of the 100 selected assets would be ranked within the first, second, third, fourth, or fifth quintile with regards to their relative percentage returns. Overall, less than 25% of the teams managed to estimate the probabilities more precisely than a benchmark that assumed equal probabilities for all quintiles. Moreover, those that did so reported inconsistent performance across the 12 submission points and minor forecast accuracy improvements. We identify price volatility as a key driver of forecast deterioration and show that avoiding overconfidence by assuming similar probabilities for symmetric quintiles can improve both forecast accuracy and portfolio efficiency. Interestingly, our findings hold true even when simple methods are employed to estimate the base predictions and investment weights.</div></div>","PeriodicalId":14061,"journal":{"name":"International Journal of Forecasting","volume":"41 4","pages":"Pages 1395-1403"},"PeriodicalIF":7.1,"publicationDate":"2024-11-04","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"145020559","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":2,"RegionCategory":"经济学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
{"title":"Robust recalibration of aggregate probability forecasts using meta-beliefs","authors":"Cem Peker , Tom Wilkening","doi":"10.1016/j.ijforecast.2024.09.005","DOIUrl":"10.1016/j.ijforecast.2024.09.005","url":null,"abstract":"<div><div>Previous work suggests that aggregate probabilistic forecasts on a binary event are often conservative. Extremizing transformations that adjust the aggregate forecast away from the uninformed prior of 0.5 can improve calibration in many settings. However, such transformations may be problematic in decision problems where forecasters share a biased prior. In these problems, extremizing transformations can introduce further miscalibration. We develop a two-step algorithm where we first estimate the prior using each forecaster’s belief about the average forecast of others. We then transform away from this estimated prior in each forecasting problem. Our algorithm works in single-question forecasting problems and does not require past data. Evidence from experimental prediction tasks suggests that the resulting average probability forecast is robust to biased priors and improves calibration.</div></div>","PeriodicalId":14061,"journal":{"name":"International Journal of Forecasting","volume":"41 2","pages":"Pages 613-630"},"PeriodicalIF":6.9,"publicationDate":"2024-10-30","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"143579224","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":2,"RegionCategory":"经济学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}