Gabriel P. Oliveira, Bárbara M. A. Mendes, Clara A. Bacha, Lucas L. Costa, Larissa D. Gomide, Mariana O. Silva, Michele A. Brandão, A. Lacerda, Gisele L. Pappa
{"title":"Assessing Data Quality Inconsistencies in Brazilian Governmental Data","authors":"Gabriel P. Oliveira, Bárbara M. A. Mendes, Clara A. Bacha, Lucas L. Costa, Larissa D. Gomide, Mariana O. Silva, Michele A. Brandão, A. Lacerda, Gisele L. Pappa","doi":"10.5753/jidm.2023.3220","DOIUrl":null,"url":null,"abstract":"In recent years, vast volumes of data are constantly being made available on the Web, and they have been increasingly used as decision support in different contexts. However, for these decisions to be more assertive and reliable, it is necessary to ensure data quality. Although there are several definitions for this area, it is a consensus that data quality is always associated with a specific context. This work aims to analyze data quality in a data warehouse with governmental information of the Brazilian state of Minas Gerais. We first present a brief comparison of eight open-source data quality tools and then choose the Great Expectations tool for analyzing such data in two real applications: public bids and public expenditure. Our analyses show that the chosen tool has relevant characteristics to generate good data quality indicators to reveal data quality issues that may directly impact the construction of final applications using such data.","PeriodicalId":301338,"journal":{"name":"J. Inf. Data Manag.","volume":"100 1","pages":""},"PeriodicalIF":0.0000,"publicationDate":"2023-10-31","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":"0","resultStr":null,"platform":"Semanticscholar","paperid":null,"PeriodicalName":"J. Inf. Data Manag.","FirstCategoryId":"1085","ListUrlMain":"https://doi.org/10.5753/jidm.2023.3220","RegionNum":0,"RegionCategory":null,"ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"","JCRName":"","Score":null,"Total":0}
引用次数: 0
Abstract
In recent years, vast volumes of data are constantly being made available on the Web, and they have been increasingly used as decision support in different contexts. However, for these decisions to be more assertive and reliable, it is necessary to ensure data quality. Although there are several definitions for this area, it is a consensus that data quality is always associated with a specific context. This work aims to analyze data quality in a data warehouse with governmental information of the Brazilian state of Minas Gerais. We first present a brief comparison of eight open-source data quality tools and then choose the Great Expectations tool for analyzing such data in two real applications: public bids and public expenditure. Our analyses show that the chosen tool has relevant characteristics to generate good data quality indicators to reveal data quality issues that may directly impact the construction of final applications using such data.
近年来,网络上不断出现大量数据,这些数据越来越多地被用作不同情况下的决策支持。然而,要使这些决策更加果断可靠,就必须确保数据质量。尽管对这一领域有多种定义,但数据质量总是与特定环境相关联,这一点已达成共识。这项工作旨在分析巴西米纳斯吉拉斯州政府信息数据仓库的数据质量。我们首先对八个开源数据质量工具进行了简要比较,然后选择了 Great Expectations 工具,用于分析两个实际应用中的此类数据:公开招标和公共支出。我们的分析表明,所选工具具有相关特性,可生成良好的数据质量指标,揭示可能直接影响使用此类数据构建最终应用程序的数据质量问题。