基于TabNet的小样本煤与瓦斯突出危险性识别的可解释迁移学习

IF 3.5 3区 工程技术 Q3 ENERGY & FUELS
Shuren Mao, Yunpei Liang, Wanjie Sun, Quangui Li
{"title":"基于TabNet的小样本煤与瓦斯突出危险性识别的可解释迁移学习","authors":"Shuren Mao,&nbsp;Yunpei Liang,&nbsp;Wanjie Sun,&nbsp;Quangui Li","doi":"10.1002/ese3.2049","DOIUrl":null,"url":null,"abstract":"<p>The identification of coal and gas outburst risks is crucial for the safe production of coal mines. The application of deep learning techniques in this domain shows significant promise, particularly in small sample scenarios. This paper investigates the use of transfer learning and self-supervised learning strategies in static outburst risk identification models under small sample data scenarios. A TabNet-based model was utilized, focusing on performance improvements achieved through pretraining, particularly with respect to recall rate and false negative rate. The model was pretrained using a combination of self-supervised and supervised learning to enhance adaptability and generalization capabilities for small sample data scenarios, followed by evaluation with stratified fivefold cross-validation. Experimental results demonstrated that the pretrained TabNet model significantly outperformed the non-pretrained model as well as traditional machine learning models, including random forest, XGBoost, LightGBM, SVM, and MLP, in terms of accuracy and stability. Furthermore, removing features with weak correlations to the target variable further improved model performance, emphasizing the importance of integrating various learning strategies during data preprocessing and model training, particularly in limited data contexts. Model interpretability was also analyzed using SHAP and TabNet's inherent interpretability, confirming consistent feature importance rankings and highlighting the model's robustness and reliability.</p>","PeriodicalId":11673,"journal":{"name":"Energy Science & Engineering","volume":"13 2","pages":"909-925"},"PeriodicalIF":3.5000,"publicationDate":"2025-01-05","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://onlinelibrary.wiley.com/doi/epdf/10.1002/ese3.2049","citationCount":"0","resultStr":"{\"title\":\"Interpretable Transfer Learning for Small Sample Coal and Gas Outburst Risk Identification Using TabNet\",\"authors\":\"Shuren Mao,&nbsp;Yunpei Liang,&nbsp;Wanjie Sun,&nbsp;Quangui Li\",\"doi\":\"10.1002/ese3.2049\",\"DOIUrl\":null,\"url\":null,\"abstract\":\"<p>The identification of coal and gas outburst risks is crucial for the safe production of coal mines. The application of deep learning techniques in this domain shows significant promise, particularly in small sample scenarios. This paper investigates the use of transfer learning and self-supervised learning strategies in static outburst risk identification models under small sample data scenarios. A TabNet-based model was utilized, focusing on performance improvements achieved through pretraining, particularly with respect to recall rate and false negative rate. The model was pretrained using a combination of self-supervised and supervised learning to enhance adaptability and generalization capabilities for small sample data scenarios, followed by evaluation with stratified fivefold cross-validation. Experimental results demonstrated that the pretrained TabNet model significantly outperformed the non-pretrained model as well as traditional machine learning models, including random forest, XGBoost, LightGBM, SVM, and MLP, in terms of accuracy and stability. Furthermore, removing features with weak correlations to the target variable further improved model performance, emphasizing the importance of integrating various learning strategies during data preprocessing and model training, particularly in limited data contexts. Model interpretability was also analyzed using SHAP and TabNet's inherent interpretability, confirming consistent feature importance rankings and highlighting the model's robustness and reliability.</p>\",\"PeriodicalId\":11673,\"journal\":{\"name\":\"Energy Science & Engineering\",\"volume\":\"13 2\",\"pages\":\"909-925\"},\"PeriodicalIF\":3.5000,\"publicationDate\":\"2025-01-05\",\"publicationTypes\":\"Journal Article\",\"fieldsOfStudy\":null,\"isOpenAccess\":false,\"openAccessPdf\":\"https://onlinelibrary.wiley.com/doi/epdf/10.1002/ese3.2049\",\"citationCount\":\"0\",\"resultStr\":null,\"platform\":\"Semanticscholar\",\"paperid\":null,\"PeriodicalName\":\"Energy Science & Engineering\",\"FirstCategoryId\":\"5\",\"ListUrlMain\":\"https://onlinelibrary.wiley.com/doi/10.1002/ese3.2049\",\"RegionNum\":3,\"RegionCategory\":\"工程技术\",\"ArticlePicture\":[],\"TitleCN\":null,\"AbstractTextCN\":null,\"PMCID\":null,\"EPubDate\":\"\",\"PubModel\":\"\",\"JCR\":\"Q3\",\"JCRName\":\"ENERGY & FUELS\",\"Score\":null,\"Total\":0}","platform":"Semanticscholar","paperid":null,"PeriodicalName":"Energy Science & Engineering","FirstCategoryId":"5","ListUrlMain":"https://onlinelibrary.wiley.com/doi/10.1002/ese3.2049","RegionNum":3,"RegionCategory":"工程技术","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"Q3","JCRName":"ENERGY & FUELS","Score":null,"Total":0}
引用次数: 0

摘要

煤与瓦斯突出危险性的识别对煤矿安全生产至关重要。深度学习技术在这一领域的应用显示出巨大的前景,特别是在小样本场景中。本文研究了小样本数据场景下迁移学习和自监督学习策略在静态突出风险识别模型中的应用。使用基于tabnet的模型,重点关注通过预训练实现的性能改进,特别是在召回率和假阴性率方面。采用自监督学习和监督学习相结合的方法对模型进行预训练,增强模型对小样本数据场景的适应性和泛化能力,然后进行分层五重交叉验证评估。实验结果表明,预训练的TabNet模型在准确性和稳定性方面明显优于非预训练模型以及传统的机器学习模型,包括随机森林、XGBoost、LightGBM、SVM和MLP。此外,去除与目标变量弱相关的特征进一步提高了模型性能,强调了在数据预处理和模型训练过程中整合各种学习策略的重要性,特别是在有限的数据环境中。使用SHAP和TabNet的固有可解释性分析模型的可解释性,确认一致的特征重要性排名,突出模型的鲁棒性和可靠性。
本文章由计算机程序翻译,如有差异,请以英文原文为准。

Interpretable Transfer Learning for Small Sample Coal and Gas Outburst Risk Identification Using TabNet

Interpretable Transfer Learning for Small Sample Coal and Gas Outburst Risk Identification Using TabNet

The identification of coal and gas outburst risks is crucial for the safe production of coal mines. The application of deep learning techniques in this domain shows significant promise, particularly in small sample scenarios. This paper investigates the use of transfer learning and self-supervised learning strategies in static outburst risk identification models under small sample data scenarios. A TabNet-based model was utilized, focusing on performance improvements achieved through pretraining, particularly with respect to recall rate and false negative rate. The model was pretrained using a combination of self-supervised and supervised learning to enhance adaptability and generalization capabilities for small sample data scenarios, followed by evaluation with stratified fivefold cross-validation. Experimental results demonstrated that the pretrained TabNet model significantly outperformed the non-pretrained model as well as traditional machine learning models, including random forest, XGBoost, LightGBM, SVM, and MLP, in terms of accuracy and stability. Furthermore, removing features with weak correlations to the target variable further improved model performance, emphasizing the importance of integrating various learning strategies during data preprocessing and model training, particularly in limited data contexts. Model interpretability was also analyzed using SHAP and TabNet's inherent interpretability, confirming consistent feature importance rankings and highlighting the model's robustness and reliability.

求助全文
通过发布文献求助,成功后即可免费获取论文全文。 去求助
来源期刊
Energy Science & Engineering
Energy Science & Engineering Engineering-Safety, Risk, Reliability and Quality
CiteScore
6.80
自引率
7.90%
发文量
298
审稿时长
11 weeks
期刊介绍: Energy Science & Engineering is a peer reviewed, open access journal dedicated to fundamental and applied research on energy and supply and use. Published as a co-operative venture of Wiley and SCI (Society of Chemical Industry), the journal offers authors a fast route to publication and the ability to share their research with the widest possible audience of scientists, professionals and other interested people across the globe. Securing an affordable and low carbon energy supply is a critical challenge of the 21st century and the solutions will require collaboration between scientists and engineers worldwide. This new journal aims to facilitate collaboration and spark innovation in energy research and development. Due to the importance of this topic to society and economic development the journal will give priority to quality research papers that are accessible to a broad readership and discuss sustainable, state-of-the art approaches to shaping the future of energy. This multidisciplinary journal will appeal to all researchers and professionals working in any area of energy in academia, industry or government, including scientists, engineers, consultants, policy-makers, government officials, economists and corporate organisations.
×
引用
GB/T 7714-2015
复制
MLA
复制
APA
复制
导出至
BibTeX EndNote RefMan NoteFirst NoteExpress
×
提示
您的信息不完整,为了账户安全,请先补充。
现在去补充
×
提示
您因"违规操作"
具体请查看互助需知
我知道了
×
提示
确定
请完成安全验证×
copy
已复制链接
快去分享给好友吧!
我知道了
右上角分享
点击右上角分享
0
联系我们:info@booksci.cn Book学术提供免费学术资源搜索服务,方便国内外学者检索中英文文献。致力于提供最便捷和优质的服务体验。 Copyright © 2023 布克学术 All rights reserved.
京ICP备2023020795号-1
ghs 京公网安备 11010802042870号
Book学术文献互助
Book学术文献互助群
群 号:481959085
Book学术官方微信