Attention-based LSTM network-assisted time series forecasting models for petroleum production

IF 8 2区 计算机科学 Q1 AUTOMATION & CONTROL SYSTEMS
Indrajeet Kumar, Bineet Kumar Tripathi, Anugrah Singh
{"title":"Attention-based LSTM network-assisted time series forecasting models for petroleum production","authors":"Indrajeet Kumar,&nbsp;Bineet Kumar Tripathi,&nbsp;Anugrah Singh","doi":"10.1016/j.engappai.2023.106440","DOIUrl":null,"url":null,"abstract":"<div><p><span>Petroleum production forecasting is the process of predicting fluid production from the wells using historical data. In contrast to the traditional methods of analysing surface and subsurface parameters governing fluid production, machine learning (ML) techniques are being applied to forecast the production. The major drawback of traditional and conventional ML techniques is that they are time-consuming and often lack good forecasting power. In this work, time-series forecast models based on powerful and efficient ML techniques are developed to forecast production with historical data. We have fused the attention mechanism<span> into the long short-term memory network, which is referred as the attention-based long short-term memory (A-LSTM) network. The A-LSTM network is fast and accurate, thus solving the low forecasting power problem. To ensure no data leakage occurs during training, and to build a reliable data-driven forecasting approach, we construct the dynamic floating window with varying window sizes over the entire production data. The dynamic floating window slides one-step forward after every prediction and continues till the last production window enabling the model to fit the new data automatically. We have tested and validated the proposed forecasting models with the ML algorithm<span> using actual production data for three wells from entirely different geographies. We then compared them with statistical, deep learning, hybrid, and </span></span></span>ML approaches<span>. The genetic algorithm (GA) is applied to optimize the hyper-parameters of the A-LSTM. The results of a comparative analysis show that the A-LSTM network statistically and computationally outperforms the other models for forecasting petroleum production.</span></p></div>","PeriodicalId":50523,"journal":{"name":"Engineering Applications of Artificial Intelligence","volume":"123 ","pages":"Article 106440"},"PeriodicalIF":8.0000,"publicationDate":"2023-08-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":"3","resultStr":null,"platform":"Semanticscholar","paperid":null,"PeriodicalName":"Engineering Applications of Artificial Intelligence","FirstCategoryId":"94","ListUrlMain":"https://www.sciencedirect.com/science/article/pii/S0952197623006243","RegionNum":2,"RegionCategory":"计算机科学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"Q1","JCRName":"AUTOMATION & CONTROL SYSTEMS","Score":null,"Total":0}
引用次数: 3

Abstract

Petroleum production forecasting is the process of predicting fluid production from the wells using historical data. In contrast to the traditional methods of analysing surface and subsurface parameters governing fluid production, machine learning (ML) techniques are being applied to forecast the production. The major drawback of traditional and conventional ML techniques is that they are time-consuming and often lack good forecasting power. In this work, time-series forecast models based on powerful and efficient ML techniques are developed to forecast production with historical data. We have fused the attention mechanism into the long short-term memory network, which is referred as the attention-based long short-term memory (A-LSTM) network. The A-LSTM network is fast and accurate, thus solving the low forecasting power problem. To ensure no data leakage occurs during training, and to build a reliable data-driven forecasting approach, we construct the dynamic floating window with varying window sizes over the entire production data. The dynamic floating window slides one-step forward after every prediction and continues till the last production window enabling the model to fit the new data automatically. We have tested and validated the proposed forecasting models with the ML algorithm using actual production data for three wells from entirely different geographies. We then compared them with statistical, deep learning, hybrid, and ML approaches. The genetic algorithm (GA) is applied to optimize the hyper-parameters of the A-LSTM. The results of a comparative analysis show that the A-LSTM network statistically and computationally outperforms the other models for forecasting petroleum production.

基于注意力的LSTM网络辅助石油产量时间序列预测模型
石油产量预测是利用历史数据预测油井流体产量的过程。与分析控制流体生产的地表和地下参数的传统方法不同,机器学习(ML)技术正被应用于预测产量。传统和传统ML技术的主要缺点是它们耗时且往往缺乏良好的预测能力。在这项工作中,开发了基于强大高效的ML技术的时间序列预测模型,以利用历史数据预测产量。我们将注意力机制融合到长短期记忆网络中,称为基于注意力的长短期记忆(A-LSTM)网络。A-LSTM网络快速准确,解决了低预测能力的问题。为了确保训练过程中不会发生数据泄露,并建立可靠的数据驱动预测方法,我们在整个生产数据上构建了具有不同窗口大小的动态浮动窗口。动态浮动窗口在每次预测后向前滑动一步,并持续到最后一个生产窗口,使模型能够自动拟合新数据。我们使用来自完全不同地理位置的三口井的实际生产数据,用ML算法测试并验证了所提出的预测模型。然后,我们将它们与统计、深度学习、混合和ML方法进行了比较。应用遗传算法对A-LSTM的超参数进行了优化。比较分析的结果表明,a-LSTM网络在统计和计算上都优于其他预测石油产量的模型。
本文章由计算机程序翻译,如有差异,请以英文原文为准。
求助全文
约1分钟内获得全文 求助全文
来源期刊
Engineering Applications of Artificial Intelligence
Engineering Applications of Artificial Intelligence 工程技术-工程:电子与电气
CiteScore
9.60
自引率
10.00%
发文量
505
审稿时长
68 days
期刊介绍: Artificial Intelligence (AI) is pivotal in driving the fourth industrial revolution, witnessing remarkable advancements across various machine learning methodologies. AI techniques have become indispensable tools for practicing engineers, enabling them to tackle previously insurmountable challenges. Engineering Applications of Artificial Intelligence serves as a global platform for the swift dissemination of research elucidating the practical application of AI methods across all engineering disciplines. Submitted papers are expected to present novel aspects of AI utilized in real-world engineering applications, validated using publicly available datasets to ensure the replicability of research outcomes. Join us in exploring the transformative potential of AI in engineering.
×
引用
GB/T 7714-2015
复制
MLA
复制
APA
复制
导出至
BibTeX EndNote RefMan NoteFirst NoteExpress
×
提示
您的信息不完整,为了账户安全,请先补充。
现在去补充
×
提示
您因"违规操作"
具体请查看互助需知
我知道了
×
提示
确定
请完成安全验证×
copy
已复制链接
快去分享给好友吧!
我知道了
右上角分享
点击右上角分享
0
联系我们:info@booksci.cn Book学术提供免费学术资源搜索服务,方便国内外学者检索中英文文献。致力于提供最便捷和优质的服务体验。 Copyright © 2023 布克学术 All rights reserved.
京ICP备2023020795号-1
ghs 京公网安备 11010802042870号
Book学术文献互助
Book学术文献互助群
群 号:604180095
Book学术官方微信