Optimizing Multiple Multi-Way Stream Joins release_p2f2wqsy2rdatgteljoo5idwre

by Manuel Dossinger, Sebastian Michel

Released as a article .

2021  

Abstract

We address the joint optimization of multiple stream joins in a scale-out architecture by tailoring prior work on multi-way stream joins to predicate-driven data partitioning schemes. We present an integer linear programming (ILP) formulation for selecting the partitioning and tuple routing with minimal probe load and describe how routing and operator placement can be rewired dynamically at changing data characteristics and arrival or expiration of queries. The presented algorithms and optimization schemes are implemented in CLASH, a data stream processor developed in our group that translates queries to deployable Apache Storm topologies after optimization. The experiments conducted over real-world data exhibit the potential of multi-query optimization of multi-way stream joins and the effectiveness and feasibility of the ILP optimization problem.
In text/plain format

Archived Files and Locations

application/pdf  503.5 kB
file_lufhsftxfbcxddezm7ib7ir5hq
arxiv.org (repository)
web.archive.org (webarchive)
Read Archived PDF
Preserved and Accessible
Type  article
Stage   submitted
Date   2021-04-15
Version   v1
Language   en ?
arXiv  2104.07742v1
Work Entity
access all versions, variants, and formats of this works (eg, pre-prints)
Catalog Record
Revision: 7b575b03-4302-495b-8a21-a693e14849bc
API URL: JSON