Pedro H.T. Gama , Jackson Faria , Jessica Sena , Francisco Neves , Vinícius R. Riffel , Lucas Perez , André Korenchendler , Matheus C.A. Sobreira , Alexei M.C. Machado
{"title":"Imputation in well log data: A benchmark for machine learning methods","authors":"Pedro H.T. Gama , Jackson Faria , Jessica Sena , Francisco Neves , Vinícius R. Riffel , Lucas Perez , André Korenchendler , Matheus C.A. Sobreira , Alexei M.C. Machado","doi":"10.1016/j.cageo.2024.105789","DOIUrl":null,"url":null,"abstract":"<div><div>Well log data are an important source of information about the geological patterns along the wellbore but may present missing values due to sensor failure, wellbore irregularities or the cost of acquisition. As a consequence, incomplete log sequences may impact the performance of machine learning (ML) models for classification or prediction. Although several approaches for this problem have been proposed in the literature, the lack of consistent evaluation protocols hinders the comparison of different solutions. This paper aims at bridging this gap by proposing a robust benchmark for comparing imputation ML methods. It contributes to establish a standardized experimental protocol that could be used by the petroleum industry in the development of new methodologies for this purpose. It differs from previous works that have been based on different datasets and metrics that prevent an unbiased comparison of results. Eight imputation methods were investigated: Autoencoders (AE), Bidirectional Recurrent Neural Network for Time Series Imputation, Last Observation Carry Forward (LOCF), Random Forests, Self Attention for Imputation of Time Series (SAITS), Transformers, UNet, and XGBoost. The Geolink, Taranaki and Teapot datasets were used to contemplate data from different locations, from which sequences of measurements were deleted and further imputed by the selected ML methods. The Mean Absolute Error, Mean Squared Error, Root Mean Squared Error, Pearson Correlation Coefficient and the Determination Coefficient were used for performance assessment in a set of 480 experiments. The results demonstrated that simple methods as the LOCF and the AE provided competitive imputation results, although the overall best model was SAITS. This reveals that self-attention models are a promising trend for imputation techniques. The choice for the LOCF, AE, SAITS, UNet, and XGBoost to compose the proposed benchmark was corroborated by subsequent statistical analyses, showing that it can be considered a compromise between simplicity, unbiasedness, variety and meaningfulness.</div></div>","PeriodicalId":55221,"journal":{"name":"Computers & Geosciences","volume":"196 ","pages":"Article 105789"},"PeriodicalIF":4.2000,"publicationDate":"2025-02-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":"0","resultStr":null,"platform":"Semanticscholar","paperid":null,"PeriodicalName":"Computers & Geosciences","FirstCategoryId":"89","ListUrlMain":"https://www.sciencedirect.com/science/article/pii/S0098300424002723","RegionNum":2,"RegionCategory":"地球科学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"Q1","JCRName":"COMPUTER SCIENCE, INTERDISCIPLINARY APPLICATIONS","Score":null,"Total":0}
引用次数: 0
Abstract
Well log data are an important source of information about the geological patterns along the wellbore but may present missing values due to sensor failure, wellbore irregularities or the cost of acquisition. As a consequence, incomplete log sequences may impact the performance of machine learning (ML) models for classification or prediction. Although several approaches for this problem have been proposed in the literature, the lack of consistent evaluation protocols hinders the comparison of different solutions. This paper aims at bridging this gap by proposing a robust benchmark for comparing imputation ML methods. It contributes to establish a standardized experimental protocol that could be used by the petroleum industry in the development of new methodologies for this purpose. It differs from previous works that have been based on different datasets and metrics that prevent an unbiased comparison of results. Eight imputation methods were investigated: Autoencoders (AE), Bidirectional Recurrent Neural Network for Time Series Imputation, Last Observation Carry Forward (LOCF), Random Forests, Self Attention for Imputation of Time Series (SAITS), Transformers, UNet, and XGBoost. The Geolink, Taranaki and Teapot datasets were used to contemplate data from different locations, from which sequences of measurements were deleted and further imputed by the selected ML methods. The Mean Absolute Error, Mean Squared Error, Root Mean Squared Error, Pearson Correlation Coefficient and the Determination Coefficient were used for performance assessment in a set of 480 experiments. The results demonstrated that simple methods as the LOCF and the AE provided competitive imputation results, although the overall best model was SAITS. This reveals that self-attention models are a promising trend for imputation techniques. The choice for the LOCF, AE, SAITS, UNet, and XGBoost to compose the proposed benchmark was corroborated by subsequent statistical analyses, showing that it can be considered a compromise between simplicity, unbiasedness, variety and meaningfulness.
期刊介绍:
Computers & Geosciences publishes high impact, original research at the interface between Computer Sciences and Geosciences. Publications should apply modern computer science paradigms, whether computational or informatics-based, to address problems in the geosciences.