Katara: A data cleaning system powered by knowledge bases and crowdsourcing

Xu Chu, John Morcos, Ihab F. Ilyas, Mourad Ouzzani, Paolo Papotti, Nan Tang, Yin Ye

Research output: Chapter in Book/Report/Conference proceedingConference contributionpeer-review

221 Citations (Scopus)

Abstract

Classical approaches to clean data have relied on using integrity constraints, statistics, or machine learning. These approaches are known to be limited in the cleaning accuracy, which can usually be improved by consulting master data and involving experts to resolve ambiguity. The advent of knowledge bases (kbs), both general-purpose and within enterprises, and crowdsourcing marketplaces are providing yet more opportunities to achieve higher accuracy at a larger scale. We propose Katara, a knowledge base and crowd powered data cleaning system that, given a table, a kb, and a crowd, interprets table semantics to align it with the kb, identifies correct and incorrect data, and generates top-k possible repairs for incorrect data. Experiments show that Katara can be applied to various datasets and kbs, and can efficiently annotate data and suggest possible repairs.

Original languageEnglish
Title of host publicationSIGMOD 2015 - Proceedings of the 2015 ACM SIGMOD International Conference on Management of Data
PublisherAssociation for Computing Machinery
Pages1247-1261
Number of pages15
ISBN (Electronic)9781450327589
DOIs
Publication statusPublished - 27 May 2015
EventACM SIGMOD International Conference on Management of Data, SIGMOD 2015 - Melbourne, Australia
Duration: 31 May 20154 Jun 2015

Publication series

NameProceedings of the ACM SIGMOD International Conference on Management of Data
Volume2015-May
ISSN (Print)0730-8078

Conference

ConferenceACM SIGMOD International Conference on Management of Data, SIGMOD 2015
Country/TerritoryAustralia
CityMelbourne
Period31/05/154/06/15

Fingerprint

Dive into the research topics of 'Katara: A data cleaning system powered by knowledge bases and crowdsourcing'. Together they form a unique fingerprint.

Cite this