54,400 Hits in 6.2 sec

Optimizing Multiple Multi-Way Stream Joins [article]

Manuel Dossinger, Sebastian Michel
2021 arXiv   pre-print
We address the joint optimization of multiple stream joins in a scale-out architecture by tailoring prior work on multi-way stream joins to predicate-driven data partitioning schemes.  ...  The experiments conducted over real-world data exhibit the potential of multi-query optimization of multi-way stream joins and the effectiveness and feasibility of the ILP optimization problem.  ...  CONCLUSION We presented an approach for multi-query optimization of multi-way joins in scale-out streaming environments.  ... 
arXiv:2104.07742v1 fatcat:p2f2wqsy2rdatgteljoo5idwre

Achieving High Freshness and Optimal Throughput in CPU-Limited Execution of Multi-join Continuous Queries [chapter]

Abhishek Mukherji, Elke A. Rundensteiner, Matthew O. Ward
2011 Lecture Notes in Computer Science  
The existing JDA solutions allocate the scarce CPU resources to the most productive half-way join within a single operator.  ...  We explore join direction adaptation (JDA) to tackle CPU-limited processing of multijoin stream queries.  ...  Given a multi-join plan Q with k input streams 5 (I = 1, . . . , k); each pipeline of half-way joins from the leaf to the root operator forms an input path denoted by Path I .  ... 
doi:10.1007/978-3-642-24577-0_6 fatcat:rfjzq73r5zhdziwyew3n75cjby

Scalable stream join processing with expensive predicates

Song Wang, Elke Rundensteiner
2009 Proceedings of the 12th International Conference on Extending Database Technology Advances in Database Technology - EDBT '09  
Multi-way stream joins with expensive join predicates lead to great challenge for real-time (or close to real-time) stream processing.  ...  This paper proposes a novel scheme for distributed processing of generic multi-way joins with window constraints, called Pipelined State Partitioning (PSP).  ...  execution of a multi-way join in the time domain.  ... 
doi:10.1145/1516360.1516396 dblp:conf/edbt/WangR09 fatcat:oy4dz72jnfbrle4vzcu254hwbi

Optimization for Multi-Join Queries on the GPU

Xue-Xuan Hu, Jian-Qing Xi, De-You Tang
2020 IEEE Access  
This paper studies the use of GPU technology to optimize multi-join queries and focuses on two points: 1) a multi-phase optimization strategy and 2) optimization methods of each stage.  ...  Experimental results show that the multi-join query optimization proposed in this paper improves the efficiency of multi-join queries, especially in the case of high load and complex join queries, achieving  ...  There are two ways to implement parallel execution of multiple independent joins on the GPU. One is to execute multiple joins in parallel using one stream.  ... 
doi:10.1109/access.2020.3002610 fatcat:ackdeastyfezrihezfp2e3hrcy

Multi-Way Windowed Streams θ-Joins Using Cluster

Xinchun Liu, Jing Li, Xiaopeng Fan, Jun Chen
2016 International Journal of Grid and Distributed Computing  
In this paper, we present a general method named Distributed Streams Join (DSJ) to process multi-way windowed streams θ-joins using a shared-nothing cluster.  ...  Join is applied to explore the correlation among the tuples from multiple streams.  ...  What's more, Photon only provides two-way streams joins and gives no details on multi-way streams joins. We focus on multi-way streams -joins in this paper.  ... 
doi:10.14257/ijgdc.2016.9.2.10 fatcat:3v3s3udyenccnm7jd7yza6frhy

Scaling Out Continuous Multi-Way Theta-Joins

Manuel Hoffmann, Sebastian Michel
2017 Proceedings of the 4th Algorithms and Systems on MapReduce and Beyond - BeyondMR'17  
In this paper, we propose generic tuple routing schemes that allow the computation of distributed multi-way thetajoins over streaming data.  ...  Joglekar and Ré [9] propose using information on the multiplicity of values to optimize multi-way joins, also limited to equi-joins, and not considering distributed computation (although some results  ...  In this paper, we propose generic tuple routing schemes that allow processing distributed multi-way theta-joins over streaming data.  ... 
doi:10.1145/3070607.3070611 dblp:conf/sigmod/HoffmannM17 fatcat:65kafp4hifegzff3fkwfgrzafy

Maximizing the Output Rate of Multi-Way Join Queries over Streaming Information Sources [chapter]

Stratis D. Viglas, Jeffrey F. Naughton, Josef Burger
2003 Proceedings 2003 VLDB Conference  
This suggests that supporting multi-way joins in a single, symmetric, streaming operator may be a useful addition to systems that support queries over input streams from remote sites.  ...  Toward this end, we have completed a prototype implementation of a multi-way join operator, which we term the "MJoin" operator, and explored its performance.  ...  In future work we plan to explore the optimization problem of how to best to split a very large multi-way join into a set of smaller multi-way joins.  ... 
doi:10.1016/b978-012722442-8/50033-1 dblp:conf/vldb/ViglasNB03 fatcat:jyzvxbatubdfzlho7yysrfz56e

PMJoin: Optimizing Distributed Multi-way Stream Joins by Stream Partitioning [chapter]

Yongluan Zhou, Ying Yan, Feng Yu, Aoying Zhou
2006 Lecture Notes in Computer Science  
In this paper, we focus on multi-way window join query which is an important and expensive type of continuous queries. These queries may involve multiple streams from different source nodes.  ...  In this paper, we focus on the optimization of continuous multi-join queries over distributed streams.  ...  Streams are routed to the various processing nodes through their delegated nodes. A multi-way window join query may involve streams from multiple nodes.  ... 
doi:10.1007/11733836_24 fatcat:bzhrjwklffbflivczvw6uyojie

Load Shedding for Window Joins on Multiple Data Streams

Yan-Nei Law, Carlo Zaniolo
2007 2007 IEEE 23rd International Conference on Data Engineering Workshop  
We first consider the problem of computing maximal subsets of approximate window joins over multiple data streams.  ...  Previously proposed approaches are based on multiple pairwise joins and, in their load-shedding decisions, disregard the content of streams outside the joined pairs.  ...  For our problem, our aim is to compute the cardinality of the multi-way join where the j-th stream window only contains t, i.e. |T W j ={t} |.  ... 
doi:10.1109/icdew.2007.4401054 dblp:conf/icde/LawZ07 fatcat:bgwn2csw55em3p7sp7xqho4whu

Sketch-Based Multi-Query Processing over Data Streams [chapter]

Alin Dobra, Minos Garofalakis, Johannes Gehrke, Rajeev Rastogi
2016 Data-Centric Systems and Applications  
In this paper, we investigate the problems arising when data-stream sketches are used to process multiple such queries concurrently.  ...  We provide necessary and sufficient conditions for multi-query sketch sharing that guarantee the correctness of the result-estimation process.  ...  . , Q q } comprising multiple (multi-join) COUNT aggregate queries.  ... 
doi:10.1007/978-3-540-28608-0_12 fatcat:pikysomhbbbhrhnqhzfbec7xy4

Sketch-Based Multi-query Processing over Data Streams [chapter]

Alin Dobra, Minos Garofalakis, Johannes Gehrke, Rajeev Rastogi
2004 Lecture Notes in Computer Science  
In this paper, we investigate the problems arising when data-stream sketches are used to process multiple such queries concurrently.  ...  We provide necessary and sufficient conditions for multi-query sketch sharing that guarantee the correctness of the result-estimation process.  ...  . , Q q } comprising multiple (multi-join) COUNT aggregate queries.  ... 
doi:10.1007/978-3-540-24741-8_32 fatcat:e2ts6l3xmzhidj7cmoooyz2fo4


Aleksandar Vitorovic, Mohammed Elseidy, Khayyam Guliyev, Khue Vu Minh, Daniel Espino, Mohammad Dashti, Yannis Klonatos, Christoph Koch
2016 Proceedings of the VLDB Endowment  
This paper presents the overview of Squall, including some novel join operators.  ...  We also devise a novel multi-way join partitioning scheme that further enhances performance. In addition, Squall has efficient local online multi-way joins.  ...  We build novel join operators: adaptive 1-Bucket [3] and Equi-weight-histogram (EWH) join [8] . This paper also presents some novel multi-way joins (a multi-way join runs within a component).  ... 
doi:10.14778/3007263.3007307 fatcat:gjwsccccqjasbkexrojikud56y

Multi-query Stream Processing on FPGAs

Mohammad Sadoghi, Rija Javed, Naif Tarafdar, Harsh Singh, Rohan Palaniappan, Hans-Arno Jacobsen
2012 2012 IEEE 28th International Conference on Data Engineering  
Fig. 7 ) to analyze event streams over multiple queries in parallel while streams seamlessly pass through the platform.  ...  Our approach also differs from [4] , [8] as we are primarily concerned with multi-query optimization (with joins computed over a moderate size window) using Rete-like processing networks, supporting  ... 
doi:10.1109/icde.2012.39 dblp:conf/icde/SadoghiJTSPJ12 fatcat:3ztsskxvdre2dmgrmybvjvbwpy

Distributed stream join query processing with semijoins

Tri Minh Tran, Byung Suk Lee
2010 Distributed and parallel databases  
Then, based on the model, we propose join algorithms in a multi-way join case: first, one-way join algorithms for different combinations of join placement and join method and, then, multi-way join algorithms  ...  This paper addresses the distributed stream processing of window-based multi-way join queries considering the semijoin as a key join operator.  ...  The optimization algorithm constructs an efficient multi-way join plan by using a greedy heuristic which adds to the plan one stream with the minimum join execution cost in each step.  ... 
doi:10.1007/s10619-010-7062-7 fatcat:3w4fj5r46bfuzpq3y2qnj6wpbm

Challenges for a GPU-Accelerated Dynamic Programming Approach for Join-Order Optimization

Andreas Meister, Gunter Saake
2016 Workshop Grundlagen von Datenbanken  
In this paper, we discuss the challenges for a GPU-accelerated dynamic programming approach for join-order optimization, and propose different ways to handle these challenges.  ...  The state of the art in commercial systems for determining optimal join orders is dynamic programming.  ...  Since, in general, for each subsolution multiple equivalent join-orders are available, the optimal subsolution must be selected based on a cost model.  ... 
dblp:conf/gvd/0001S16 fatcat:a6ewabqyjfddtjbdoy2qdzdrom
« Previous Showing results 1 — 15 out of 54,400 results