An Effective Source Selection Algorithm for Filling Missing Tuples

Abstract

Completeness is one of the central criteria for data quality, and the completeness of data becomes particularly important. Specifically, incomplete data refers to a data set that does not contain enough information to answer the query, which can be divided into missing the values and tuples. This paper presents a technique of leveraging other data sources to fill missing tuples in target data. However, accessing too many data sources introduces a huge cost, so we investigate how to select a proper subset of sources to fill the missing tuples. Firstly, we define the gain model of sources and introduce the optimization problem of source selection from the perspective of missing tuples, in which the gain is maximized with the cost under a threshold. For filling the missing tuples, we propose a data source selection strategy based on a genetic algorithm. Experimental results show high performance on both the effectiveness of our algorithm.