Road to freedom in big data analytics

Divy Agrawal, Sanjay Chawla, Ahmed Elmagarmid, Zoi Kaoudi, Mourad Ouzzani, Paolo Papotti, Jorge Arnulfo Quiané-Ruiz, Nan Tang, Mohammed J. Zaki

Research output: Chapter in Book/Report/Conference proceedingConference contributionpeer-review

26 Citations (Scopus)

Abstract

The world is fast moving towards a data-driven society where data is the most valuable asset. Organizations need to perform very diverse analytic tasks using various data processing platforms. In doing so, they face many challenges; chiefly, platform dependence, poor interoperability, and poor performance when using multiple platforms. We present Rheem, our vision for big data analytics over diverse data processing platforms. Rheem provides a threelayer data processing and storage abstraction to achieve both platform independence and interoperability across multiple platforms. In this paper, we discuss our vision as well as present multiple research challenges that we need to address to achieve it. As a case in point, we present a data cleaning application built using some of the ideas of Rheem. We show how it achieves platform independence and the performance benefits of following such an approach.

Original languageEnglish
Title of host publicationAdvances in Database Technology - EDBT 2016
Subtitle of host publication19th International Conference on Extending Database Technology, Proceedings
EditorsIoana Manolescu, Evaggelia Pitoura, Amelie Marian, Sofian Maabout, Letizia Tanca, Georgia Koutrika, Kostas Stefanidis
PublisherOpenProceedings.org
Pages479-484
Number of pages6
ISBN (Electronic)9783893180707
DOIs
Publication statusPublished - 2016
Event19th International Conference on Extending Database Technology, EDBT 2016 - Bordeaux, France
Duration: 15 Mar 201618 Mar 2016

Publication series

NameAdvances in Database Technology - EDBT
Volume2016-March
ISSN (Electronic)2367-2005

Conference

Conference19th International Conference on Extending Database Technology, EDBT 2016
Country/TerritoryFrance
CityBordeaux
Period15/03/1618/03/16

Fingerprint

Dive into the research topics of 'Road to freedom in big data analytics'. Together they form a unique fingerprint.

Cite this