Ranking for data repairs

Mohamed Yakout*, Ahmed K. Elmagarmid, Jennifer Neville

*Corresponding author for this work

Research output: Chapter in Book/Report/Conference proceedingConference contributionpeer-review

4 Citations (Scopus)

Abstract

Improving data quality is a time-consuming, labor-intensive and often domain specific operation. A recent principled approach for repairing dirty database is to use data quality rules in the form of database constraints to identify dirty tuples and then use the rules to derive data repairs. Most of existing data repair approaches focus on providing fully automated solutions, which could be risky to depend upon especially for critical data. To guarantee the optimal quality repairs applied to the database, users should be involved to confirm each repair. This highlights the need for an interactive approach that combines the best of both; automatically generating repairs, while efficiently employing user's efforts to verify the repairs. In such approach, the user will guide an online repairing process to incrementally generate repairs. A key challenge in this approach is the response time within the user's interactive sessions, because the process of generating the repairs is time consuming due to the large search space of possible repairs. To this end, we present in this paper a mechanism to continuously generate repairs only to the current top k important violated data quality rules. Moreover, the repairs are grouped and ranked such that the most beneficial in terms of improving data quality comes first to consult the user for verification and feedback. Our experiments on real-world dataset demonstrate the effectiveness of our ranking mechanism to provide a fast response time for the user while improving the data quality as quickly as possible.

Original languageEnglish
Title of host publicationICDE Workshops 2010 - The 2010 IEEE 26th International Conference on Data Engineering Workshops
Pages23-28
Number of pages6
DOIs
Publication statusPublished - 2010
Externally publishedYes
Event2010 IEEE 26th International Conference on Data Engineering Workshops, ICDEW 2010 - Long Beach, CA, United States
Duration: 1 Mar 20106 Mar 2010

Publication series

NameProceedings - International Conference on Data Engineering
ISSN (Print)1084-4627

Conference

Conference2010 IEEE 26th International Conference on Data Engineering Workshops, ICDEW 2010
Country/TerritoryUnited States
CityLong Beach, CA
Period1/03/106/03/10

Fingerprint

Dive into the research topics of 'Ranking for data repairs'. Together they form a unique fingerprint.

Cite this