Enhancing shale gas EUR predictions with TPE optimized SMOGN: A comparative study of machine learning algorithms in the marcellus shale with an imbalanced dataset
{"title":"Enhancing shale gas EUR predictions with TPE optimized SMOGN: A comparative study of machine learning algorithms in the marcellus shale with an imbalanced dataset","authors":"Yildirim Kocoglu , Sheldon Burt Gorell , Hossein Emadi , Athar Hussain , Farshad Bolouri , Phillip McElroy , Marshal Wigwe","doi":"10.1016/j.jgsce.2024.205475","DOIUrl":null,"url":null,"abstract":"<div><div>Oil and gas operators frequently rely on traditional methods to predict Estimated Ultimate Recovery (EUR) but, these methods often fail to accurately predict shale gas EUR. Therefore, machine learning (ML) algorithms were shown as promising alternatives but, the negative effects of imbalanced datasets on their performance still remains underexplored. This study addresses this gap with a Tree-Parzen Estimator (TPE) optimized Synthetic Minority Over-sampling Technique for Regression with Gaussian Noise (SMOGN) to alleviate the detrimental effects of the imbalanced datasets on model performance. Two cases were compared: one employed standard pre-processing while, the other employed TPE optimized SMOGN. Four ML algorithms: Artificial Neural (ANN), Deep-ANN, Support Vector Regression (SVR), and eXtreme Gradient Boosting (XGBoost) were trained across both cases with an imbalanced dataset of 460 Marcellus shale wells. Exploratory data analysis revealed that the imbalance was due to the evolution of completion techniques, leading to the underrepresentation of wells completed with more recent, aggressive methods. The proposed framework improved <span><math><mrow><msup><mi>R</mi><mn>2</mn></msup></mrow></math></span> of the models from 0.8243 to 0.8934 to 0.8851–0.9186 with more significant gains in the underrepresented wells in the higher EUR regions (<span><math><mrow><mo>></mo><mn>1.5</mn><mo>×</mo><msup><mn>10</mn><mn>7</mn></msup><mspace></mspace><mtext>Mscf</mtext></mrow></math></span>), where the <span><math><mrow><msup><mi>R</mi><mn>2</mn></msup></mrow></math></span> improved from 0.2155 to 0.4598 to 0.5615–0.9472. The SMOGN enhanced SVR had the highest computational efficiency (<span><math><mrow><mo><</mo><mn>1</mn><mspace></mspace><mtext>second</mtext></mrow></math></span> to train) and highest performance <span><math><mrow><mo>(</mo><msup><mi>R</mi><mn>2</mn></msup></mrow></math></span> of 0.9472) in these higher EUR regions, while the SMOGN enhanced Deep-ANN had the highest overall performance (<span><math><mrow><msup><mi>R</mi><mn>2</mn></msup></mrow></math></span> of 0.9186). This framework outperforms standard pre-processing frameworks. Additionally, it enables operators to predict shale gas EUR more accurately for future infill wells completed with recent techniques, even while the wells are still producing in transient flow, facilitating early cost-saving decisions. To the best knowledge of the authors, this is the first research that proposed TPE optimized SMOGN to improve shale gas predictions.</div></div>","PeriodicalId":100568,"journal":{"name":"Gas Science and Engineering","volume":"131 ","pages":"Article 205475"},"PeriodicalIF":0.0000,"publicationDate":"2024-11-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":"0","resultStr":null,"platform":"Semanticscholar","paperid":null,"PeriodicalName":"Gas Science and Engineering","FirstCategoryId":"1085","ListUrlMain":"https://www.sciencedirect.com/science/article/pii/S2949908924002711","RegionNum":0,"RegionCategory":null,"ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"0","JCRName":"ENERGY & FUELS","Score":null,"Total":0}
引用次数: 0
Abstract
Oil and gas operators frequently rely on traditional methods to predict Estimated Ultimate Recovery (EUR) but, these methods often fail to accurately predict shale gas EUR. Therefore, machine learning (ML) algorithms were shown as promising alternatives but, the negative effects of imbalanced datasets on their performance still remains underexplored. This study addresses this gap with a Tree-Parzen Estimator (TPE) optimized Synthetic Minority Over-sampling Technique for Regression with Gaussian Noise (SMOGN) to alleviate the detrimental effects of the imbalanced datasets on model performance. Two cases were compared: one employed standard pre-processing while, the other employed TPE optimized SMOGN. Four ML algorithms: Artificial Neural (ANN), Deep-ANN, Support Vector Regression (SVR), and eXtreme Gradient Boosting (XGBoost) were trained across both cases with an imbalanced dataset of 460 Marcellus shale wells. Exploratory data analysis revealed that the imbalance was due to the evolution of completion techniques, leading to the underrepresentation of wells completed with more recent, aggressive methods. The proposed framework improved of the models from 0.8243 to 0.8934 to 0.8851–0.9186 with more significant gains in the underrepresented wells in the higher EUR regions (), where the improved from 0.2155 to 0.4598 to 0.5615–0.9472. The SMOGN enhanced SVR had the highest computational efficiency ( to train) and highest performance of 0.9472) in these higher EUR regions, while the SMOGN enhanced Deep-ANN had the highest overall performance ( of 0.9186). This framework outperforms standard pre-processing frameworks. Additionally, it enables operators to predict shale gas EUR more accurately for future infill wells completed with recent techniques, even while the wells are still producing in transient flow, facilitating early cost-saving decisions. To the best knowledge of the authors, this is the first research that proposed TPE optimized SMOGN to improve shale gas predictions.