JISC: Adaptive stream processing using just-in-time state completion?

Ahmed M. Aly, Walid G. Aref, Mourad Ouzzani, Hosam M. Mahmoud

Research output: Chapter in Book/Report/Conference proceedingConference contributionpeer-review

3 Citations (Scopus)

Abstract

The continuous and dynamic nature of data streams may lead a query execution plan (QEP) of a long-running continuous query to become suboptimal during execution, and hence will need to be altered. The ability to perform an efficient and flawless transition to an equivalent, yet optimal QEP is essential for a data stream query processor. Such transition is challenging for plans with stateful binary operators, such as joins, where the states of the QEP have to be maintained during query transition without compromising the correctness of the query output. This paper presents Just-In-Time State Completion (JISC); a new technique for query plan migration. JISC does not cause any halt to the query execution, and thus allows the query to maintain steady output. JISC is applicable to pipelined as well as eddy-based query evaluation frameworks. Probabilistic analysis of the cost and experimental studies show that JISC increases the execution throughput during the plan migration stage by up to an order of magnitude compared to existing solutions.

Original languageEnglish
Title of host publicationAdvances in Database Technology - EDBT 2014
Subtitle of host publication17th International Conference on Extending Database Technology, Proceedings
EditorsVincent Leroy, Vassilis Christophides, Vassilis Christophides, Stratos Idreos, Anastasios Kementsietsidis, Minos Garofalakis, Sihem Amer-Yahia
PublisherOpenProceedings.org, University of Konstanz, University Library
Pages73-84
Number of pages12
ISBN (Electronic)9783893180653
DOIs
Publication statusPublished - 2014
Event17th International Conference on Extending Database Technology, EDBT 2014 - Athens, Greece
Duration: 24 Mar 201428 Mar 2014

Publication series

NameAdvances in Database Technology - EDBT 2014: 17th International Conference on Extending Database Technology, Proceedings

Conference

Conference17th International Conference on Extending Database Technology, EDBT 2014
Country/TerritoryGreece
CityAthens
Period24/03/1428/03/14

Fingerprint

Dive into the research topics of 'JISC: Adaptive stream processing using just-in-time state completion?'. Together they form a unique fingerprint.

Cite this