{"title":"Factors affecting preferences between judgmental and algorithmic forecasts: Feedback, guidance and labeling effects","authors":"Nigel Harvey , Shari De Baets","doi":"10.1016/j.ijforecast.2024.08.002","DOIUrl":"10.1016/j.ijforecast.2024.08.002","url":null,"abstract":"<div><div>Previous research has shown that people prefer algorithmic to judgmental forecasts in the absence of outcome feedback but judgmental to algorithmic forecasts when feedback is provided. However, all this work has used cue-based forecasting tasks. The opposite pattern of results has been reported for time series forecasting tasks. This reversal could have arisen because cue-based forecasting studies have used preference paradigms whereas the time series forecasting studies have employed advice-taking paradigms. In a first experiment, we show that when a preference paradigm is used in time series forecasting, the difference in the conclusions about the effects of feedback in the two types of forecasting disappears. In a second experiment, we show that provision of guidance showing accuracy of algorithmic and judgmental forecasts can eliminate effects of feedback. Two further experiments reveal how choices between algorithmic and judgmental forecasts are influenced by the way in which those forecasts are labeled.</div></div>","PeriodicalId":14061,"journal":{"name":"International Journal of Forecasting","volume":"41 2","pages":"Pages 532-553"},"PeriodicalIF":6.9,"publicationDate":"2024-09-16","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"143579418","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":2,"RegionCategory":"经济学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
{"title":"Guiding supervisors in artificial intelligence-enabled forecasting: Understanding the impacts of salience and detail on decision-making","authors":"Naghmeh Khosrowabadi , Kai Hoberg , Yun Shin Lee","doi":"10.1016/j.ijforecast.2024.08.001","DOIUrl":"10.1016/j.ijforecast.2024.08.001","url":null,"abstract":"<div><div>In many real-world situations, multiple humans are involved in decision-making when interacting with machine recommendations. We investigated a setting where an artificial intelligence system creates demand forecasts that a human planner can either accept or revise, and a supervisor then makes the final decision about which forecast to select. We designed and conducted two experimental studies to understand decision-making by a supervisor. First, we provided the improvement probabilities of adjustments at an aggregated level and found evidence for overoptimism bias and mean anchoring. Second, we provided decomposed guidance based on two adjustment attributes, direction and magnitude, to investigate the role of salience based on the distance between the improvement probabilities and level of detail in guidance effectiveness. We found no significant difference in using less and more salient guidance provided that the detail level was fixed. However, revealing more details when the guidance was more salient increased the use of guidance.</div></div>","PeriodicalId":14061,"journal":{"name":"International Journal of Forecasting","volume":"41 2","pages":"Pages 716-732"},"PeriodicalIF":6.9,"publicationDate":"2024-09-02","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"143579229","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":2,"RegionCategory":"经济学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"OA","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
Liao Chen , Ning Jia , Zhixian Jiao , Hongke Zhao , Runbang Cui , Huimin Wang
{"title":"A semi-supervised reject inference framework with hierarchical heterogeneous networks for credit scoring","authors":"Liao Chen , Ning Jia , Zhixian Jiao , Hongke Zhao , Runbang Cui , Huimin Wang","doi":"10.1016/j.ijforecast.2024.07.011","DOIUrl":"10.1016/j.ijforecast.2024.07.011","url":null,"abstract":"<div><div>Credit scoring is a popular tool for loan assessment, i.e., deciding whether to accept or reject a loan application. Traditional research into learning for credit scoring has only applied historically accepted samples without rejected applicants whose true repayment performance is absent, thereby causing both sample selection bias and wasting data. Some methods have been proposed for inferring rejected samples but they are still affected by several open problems, especially for medium- and long-term loan applications with a higher rejection rate. In particular, the heterogeneous relationships between accepted and rejected applications have not been well studied. Moreover, the complex repayment behaviors resulting from long repayment terms may lead to poor learning performance. Thus, we propose a reject inference framework with <strong>S</strong>emi-supervised <strong>H</strong>ierarchical <strong>H</strong>eterogeneous <strong>N</strong>etwork (S2HN) for credit scoring. We introduce a hierarchical heterogeneous network for revealing the complex connections between accepted and rejected applications, and use prospective heterogeneous repayment patterns as auxiliary information through clustering and a two-layer prediction architecture. Extensive experiments conducted based on real-world data sets demonstrated the effectiveness of our proposed method.</div></div>","PeriodicalId":14061,"journal":{"name":"International Journal of Forecasting","volume":"41 3","pages":"Pages 920-939"},"PeriodicalIF":6.9,"publicationDate":"2024-08-31","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"144211930","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":2,"RegionCategory":"经济学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
{"title":"On memory-augmented gated recurrent unit network","authors":"Maolin Yang , Muyi Li , Guodong Li","doi":"10.1016/j.ijforecast.2024.07.008","DOIUrl":"10.1016/j.ijforecast.2024.07.008","url":null,"abstract":"<div><div>This paper addresses the challenge of forecasting multivariate long-memory time series. While statistical models such as the autoregressive fractionally integrated moving average (ARFIMA) and hyperbolic generalized autoregressive conditional heteroscedasticity (HYGARCH) can capture long-memory effects in time series data, they are often limited by dimensionality and parametric specification. Alternatively, recurrent neural networks (RNNs) are popular tools for approximating complex structures in sequential data. However, the lack of long-memory effect of these networks has been justified from a statistical perspective. In this paper, we propose a new network process called the memory-augmented gated recurrent unit (MGRU), which incorporates a fractionally integrated filter into the original GRU structure. We investigate the long-memory effect of the MGRU process, and demonstrate its effectiveness at capturing long-range dependence in real applications. Our findings illustrate that the proposed MGRU network outperforms existing models, indicating its potential as a promising tool for long-memory time series forecasting.</div></div>","PeriodicalId":14061,"journal":{"name":"International Journal of Forecasting","volume":"41 2","pages":"Pages 844-858"},"PeriodicalIF":6.9,"publicationDate":"2024-08-31","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"142190563","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":2,"RegionCategory":"经济学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
{"title":"A framework for timely and accessible long-term forecasting of shale gas production based on time series pattern matching","authors":"Yilun Dong, Youzhi Hao, Detang Lu","doi":"10.1016/j.ijforecast.2024.07.009","DOIUrl":"10.1016/j.ijforecast.2024.07.009","url":null,"abstract":"<div><div>Shale gas production forecasting is an important research topic in the gas industry. A common shale gas block includes dozens or even thousands of wells and therefore has a great number of historical production series. However, most existing methods apply single-well modelling. This cannot exploit data from other wells and requires a long production history from the target well, so the forecasting timeliness is compromised. Moreover, the parameters required by many of the existing methods are difficult to collect in practice, so the forecasting accessibility is compromised. Therefore, this study presents a shale gas production forecasting framework with improved timeliness and accessibility. To ensure timeliness, the proposed approach utilises historical data from existing wells and only requires a short production history from the target well. To ensure accessibility, the proposed approach only requires past daily production time and gas yield. The performance of the proposed method is demonstrated through a comparison with baseline methods. The results regarding cumulative gas production forecasting indicate that the proposed method has an average overall mean absolute percentage error (OMAPE) of 0.210, outperforming an artificial neural network with an average OMAPE of 0.241 and ARIMA with an average OMAPE of more than 2.</div></div>","PeriodicalId":14061,"journal":{"name":"International Journal of Forecasting","volume":"41 2","pages":"Pages 821-843"},"PeriodicalIF":6.9,"publicationDate":"2024-08-24","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"142190564","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":2,"RegionCategory":"经济学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
{"title":"Forecasting soccer matches with betting odds: A tale of two markets","authors":"Tadgh Hegarty, Karl Whelan","doi":"10.1016/j.ijforecast.2024.06.013","DOIUrl":"10.1016/j.ijforecast.2024.06.013","url":null,"abstract":"<div><div>We compare the properties of betting market odds set in two distinct markets for a large sample of European soccer matches. We confirm inefficiencies in the traditional market for bets on a home win, an away win, or a draw, as found in previous studies such as Angelini and De Angelis (2019). In particular, there is a strong pattern of favourite–longshot bias. Conversely, we document how a betting market that has emerged in recent years, the Asian handicap market, can generate efficient forecasts for the same set of matches using a new methodology for mapping its odds into probabilities.</div></div>","PeriodicalId":14061,"journal":{"name":"International Journal of Forecasting","volume":"41 2","pages":"Pages 803-820"},"PeriodicalIF":6.9,"publicationDate":"2024-08-22","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"143579233","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":2,"RegionCategory":"经济学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"OA","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
{"title":"Forecasting mail flow: A hierarchical approach for enhanced societal wellbeing","authors":"Nadine Kafa, M. Zied Babai, Walid Klibi","doi":"10.1016/j.ijforecast.2024.07.001","DOIUrl":"10.1016/j.ijforecast.2024.07.001","url":null,"abstract":"<div><div>Forecasting for Social Good has gained considerable attention for its impact on individuals, businesses, and society. This research introduces an integrated hierarchical forecasting-based decision-making approach for mail flow in a major postal organisation, presenting new social performance indicators. These indicators, including the discharge level, discharge rate, and overload rate, guide decision makers toward consistent workload planning, bridging a literature gap concerning forecast utility measures. The study evaluates three forecasting methods—exponential smoothing with error, trend, and seasonality (ETS), the autoregressive integrated moving average (ARIMA), and the light gradient boosting machine (LightGBM)—in terms of forecast accuracy and social measures, comparing them to the organisation’s current method. The empirical results confirm that the proposed approach is more accurate than the current method. Moreover, while ETS shows the highest forecast accuracy, LightGBM outperforms all methods in social measures. This indicates that a highly accurate forecasting method does not always enhance social performance, challenging traditional views on forecasting evaluation.</div></div>","PeriodicalId":14061,"journal":{"name":"International Journal of Forecasting","volume":"41 1","pages":"Pages 51-65"},"PeriodicalIF":6.9,"publicationDate":"2024-07-29","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"142704583","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":2,"RegionCategory":"经济学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
{"title":"Not feeling the buzz: Correction study of mispricing and inefficiency in online sportsbooks","authors":"Lawrence Clegg, John Cartlidge","doi":"10.1016/j.ijforecast.2024.06.012","DOIUrl":"10.1016/j.ijforecast.2024.06.012","url":null,"abstract":"<div><div>We present a replication and correction of a recent article (Ramirez et al., 2023). RRS measure profile page views on Wikipedia to generate a “buzz factor” metric for tennis players and show that it can be used to form a profitable gambling strategy by predicting bookmaker mispricing. Here, we use the same dataset as RRS to reproduce their results exactly, which confirms the robustness of RRS’ mispricing claim. However, we discover that RRS’ published out-of-sample betting results are significantly affected by a single bet (the “Hercog” bet), which returns substantial outlier profits based on erroneously long odds. When this data quality issue is resolved, the majority of reported profits disappear and only one strategy, which bets on “competitive” matches, remains significantly profitable in the original out-of-sample period. While one profitable strategy offers weaker support than the original study, it still provides an indication that market inefficiencies may exist, as originally claimed by RRS. As an extension, we continue testing after 2020. The strategy generates no further profits and model coefficients estimated over this period are no longer reliable predictors of bookmaker mispricing.</div></div>","PeriodicalId":14061,"journal":{"name":"International Journal of Forecasting","volume":"41 2","pages":"Pages 798-802"},"PeriodicalIF":6.9,"publicationDate":"2024-07-27","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"143579232","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":2,"RegionCategory":"经济学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"OA","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
{"title":"Sensitivity and uncertainty in the Lee–Carter mortality model","authors":"Wenyun Zuo , Anil Damle , Shripad Tuljapurkar","doi":"10.1016/j.ijforecast.2024.06.010","DOIUrl":"10.1016/j.ijforecast.2024.06.010","url":null,"abstract":"<div><div>The Lee–Carter model (LC) is widely used for forecasting age-specific mortality, and typically performs well regardless of the uncertainty and often limited quality of mortality data. Why? We analyze the robustness of LC using sensitivity analyses based on matrix perturbation theory, coupled with simulations that examine the effect of unavoidable randomness in mortality data. The combined effects of sensitivity and uncertainty determine the robustness of LC. We find that the sensitivity of LC and the uncertainty of death rates both have non-uniform patterns across ages and years. The sensitivities are small in general, with the largest sensitivities at both ends of the period. The uncertainties of death rates are high in young ages (5–19 years) and old ages (90+ years), rising in young ages but dropping in old ages. Our results reveal that LC is robust against random perturbation and sudden short-term changes.</div></div>","PeriodicalId":14061,"journal":{"name":"International Journal of Forecasting","volume":"41 2","pages":"Pages 781-797"},"PeriodicalIF":6.9,"publicationDate":"2024-07-26","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"143579231","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":2,"RegionCategory":"经济学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
{"title":"Skew–Brownian processes for estimating the volatility of crude oil Brent","authors":"Michele Bufalo , Brunero Liseo , Giuseppe Orlando","doi":"10.1016/j.ijforecast.2024.06.009","DOIUrl":"10.1016/j.ijforecast.2024.06.009","url":null,"abstract":"<div><div>To predict the volatility of crude oil Brent price, we propose a novel econometric model <span><span><sup>1</sup></span></span> where the explanatory variables are a combination of macroeconomic variables (<em>i.e.</em> price pressure), trade data (freight shipment index), and market sentiment (gold volatility). The model is proposed in two alternative variants: first, we assume Gaussian distributed quantities; alternatively, we consider the potential presence of skewness and adopt a Skew–Brownian process. We show that the suggested approach outperforms the selected baseline model as well as other models proposed in the literature, especially when turbulent periods occur.</div></div>","PeriodicalId":14061,"journal":{"name":"International Journal of Forecasting","volume":"41 2","pages":"Pages 763-780"},"PeriodicalIF":6.9,"publicationDate":"2024-07-20","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"141844129","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":2,"RegionCategory":"经济学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}