通过训练数据管理改进类不平衡时间序列的预测:以冻土预测为例

IF 3.1 Q2 GEOSCIENCES, MULTIDISCIPLINARY
Mousumi Ghosh , Aatish Anshuman , Mukesh Kumar
{"title":"通过训练数据管理改进类不平衡时间序列的预测:以冻土预测为例","authors":"Mousumi Ghosh ,&nbsp;Aatish Anshuman ,&nbsp;Mukesh Kumar","doi":"10.1016/j.hydroa.2025.100201","DOIUrl":null,"url":null,"abstract":"<div><div>The field of geosciences is replete with problems where the target variable to be predicted is inherently class-imbalanced, meaning the events of interest are rare and infrequent. Examples include predicting landslides, ice jam breakups, preferential flow, and frozen ground. Such imbalance poses substantial challenges for modeling approaches. Using frozen ground prediction as a case study, this research examines how the frequency of event occurrence influences its prediction performance and proposes a data curation strategy to improve predictability. To this end, a data-driven approach utilizing a Long Short-Term Memory neural network is first implemented to predict soil temperature and determine frozen periods. Application of this approach at 25 gaging sites in Michigan reveals model underperformance, particularly at sites where the frozen data fraction (FDF) or the ratio of the frozen period to the total observation period, is low. The. study further demonstrates that under-sampling of more prevalent non-frozen period in training data improves detection of frozen periods. Greater improvements are experienced at sites with lower FDFs. However, performance peaks after a threshold FDF, plateauing or declining thereafter due to increased class imbalance and reduced training data length. The presented training data curation approach can be used for predictions of other class-imbalanced time series.</div></div>","PeriodicalId":36948,"journal":{"name":"Journal of Hydrology X","volume":"27 ","pages":"Article 100201"},"PeriodicalIF":3.1000,"publicationDate":"2025-03-05","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":"0","resultStr":"{\"title\":\"Improving prediction of class-imbalanced time series through curation of training data: A case study of frozen ground prediction\",\"authors\":\"Mousumi Ghosh ,&nbsp;Aatish Anshuman ,&nbsp;Mukesh Kumar\",\"doi\":\"10.1016/j.hydroa.2025.100201\",\"DOIUrl\":null,\"url\":null,\"abstract\":\"<div><div>The field of geosciences is replete with problems where the target variable to be predicted is inherently class-imbalanced, meaning the events of interest are rare and infrequent. Examples include predicting landslides, ice jam breakups, preferential flow, and frozen ground. Such imbalance poses substantial challenges for modeling approaches. Using frozen ground prediction as a case study, this research examines how the frequency of event occurrence influences its prediction performance and proposes a data curation strategy to improve predictability. To this end, a data-driven approach utilizing a Long Short-Term Memory neural network is first implemented to predict soil temperature and determine frozen periods. Application of this approach at 25 gaging sites in Michigan reveals model underperformance, particularly at sites where the frozen data fraction (FDF) or the ratio of the frozen period to the total observation period, is low. The. study further demonstrates that under-sampling of more prevalent non-frozen period in training data improves detection of frozen periods. Greater improvements are experienced at sites with lower FDFs. However, performance peaks after a threshold FDF, plateauing or declining thereafter due to increased class imbalance and reduced training data length. The presented training data curation approach can be used for predictions of other class-imbalanced time series.</div></div>\",\"PeriodicalId\":36948,\"journal\":{\"name\":\"Journal of Hydrology X\",\"volume\":\"27 \",\"pages\":\"Article 100201\"},\"PeriodicalIF\":3.1000,\"publicationDate\":\"2025-03-05\",\"publicationTypes\":\"Journal Article\",\"fieldsOfStudy\":null,\"isOpenAccess\":false,\"openAccessPdf\":\"\",\"citationCount\":\"0\",\"resultStr\":null,\"platform\":\"Semanticscholar\",\"paperid\":null,\"PeriodicalName\":\"Journal of Hydrology X\",\"FirstCategoryId\":\"1085\",\"ListUrlMain\":\"https://www.sciencedirect.com/science/article/pii/S2589915525000021\",\"RegionNum\":0,\"RegionCategory\":null,\"ArticlePicture\":[],\"TitleCN\":null,\"AbstractTextCN\":null,\"PMCID\":null,\"EPubDate\":\"\",\"PubModel\":\"\",\"JCR\":\"Q2\",\"JCRName\":\"GEOSCIENCES, MULTIDISCIPLINARY\",\"Score\":null,\"Total\":0}","platform":"Semanticscholar","paperid":null,"PeriodicalName":"Journal of Hydrology X","FirstCategoryId":"1085","ListUrlMain":"https://www.sciencedirect.com/science/article/pii/S2589915525000021","RegionNum":0,"RegionCategory":null,"ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"Q2","JCRName":"GEOSCIENCES, MULTIDISCIPLINARY","Score":null,"Total":0}
引用次数: 0

摘要

地球科学领域充满了要预测的目标变量本质上是类不平衡的问题,这意味着感兴趣的事件是罕见和不频繁的。例子包括预测滑坡、冰塞破裂、优先流和冻土。这种不平衡对建模方法提出了实质性的挑战。本研究以冻土预测为例,探讨了事件发生频率对其预测性能的影响,并提出了一种提高可预测性的数据管理策略。为此,首先实现了利用长短期记忆神经网络的数据驱动方法来预测土壤温度并确定冻结期。该方法在密歇根州25个测量点的应用表明,模型表现不佳,特别是在冻结数据分数(FDF)或冻结期与总观测期之比较低的地点。的。研究进一步表明,训练数据中更普遍的非冻结期的欠采样提高了冻结期的检测。在fdf较低的地点有更大的改善。然而,性能在阈值FDF之后达到峰值,此后由于类不平衡增加和训练数据长度减少而趋于平稳或下降。本文提出的训练数据管理方法可用于其他类不平衡时间序列的预测。
本文章由计算机程序翻译,如有差异,请以英文原文为准。

Improving prediction of class-imbalanced time series through curation of training data: A case study of frozen ground prediction

Improving prediction of class-imbalanced time series through curation of training data: A case study of frozen ground prediction
The field of geosciences is replete with problems where the target variable to be predicted is inherently class-imbalanced, meaning the events of interest are rare and infrequent. Examples include predicting landslides, ice jam breakups, preferential flow, and frozen ground. Such imbalance poses substantial challenges for modeling approaches. Using frozen ground prediction as a case study, this research examines how the frequency of event occurrence influences its prediction performance and proposes a data curation strategy to improve predictability. To this end, a data-driven approach utilizing a Long Short-Term Memory neural network is first implemented to predict soil temperature and determine frozen periods. Application of this approach at 25 gaging sites in Michigan reveals model underperformance, particularly at sites where the frozen data fraction (FDF) or the ratio of the frozen period to the total observation period, is low. The. study further demonstrates that under-sampling of more prevalent non-frozen period in training data improves detection of frozen periods. Greater improvements are experienced at sites with lower FDFs. However, performance peaks after a threshold FDF, plateauing or declining thereafter due to increased class imbalance and reduced training data length. The presented training data curation approach can be used for predictions of other class-imbalanced time series.
求助全文
通过发布文献求助,成功后即可免费获取论文全文。 去求助
来源期刊
Journal of Hydrology X
Journal of Hydrology X Environmental Science-Water Science and Technology
CiteScore
7.00
自引率
2.50%
发文量
20
审稿时长
25 weeks
×
引用
GB/T 7714-2015
复制
MLA
复制
APA
复制
导出至
BibTeX EndNote RefMan NoteFirst NoteExpress
×
提示
您的信息不完整,为了账户安全,请先补充。
现在去补充
×
提示
您因"违规操作"
具体请查看互助需知
我知道了
×
提示
确定
请完成安全验证×
copy
已复制链接
快去分享给好友吧!
我知道了
右上角分享
点击右上角分享
0
联系我们:info@booksci.cn Book学术提供免费学术资源搜索服务,方便国内外学者检索中英文文献。致力于提供最便捷和优质的服务体验。 Copyright © 2023 布克学术 All rights reserved.
京ICP备2023020795号-1
ghs 京公网安备 11010802042870号
Book学术文献互助
Book学术文献互助群
群 号:481959085
Book学术官方微信