10,175 Hits in 4.5 sec

A Survey of IoT Stream Query Execution Latency Optimization within Edge and Cloud

Fatima Abdullah, Limei Peng, Byungchul Tak, Xiaojie Wang
2021 Wireless Communications and Mobile Computing  
For many IoT applications, fast stream query processing is crucial for correct operations.  ...  In this work, we provide a comprehensive review and analysis of query execution models within the context of the query execution latency optimization.  ...  The resource heterogeneity incorporation is crucial for efficient task placement in geo-distributed query processing [5, 11, 46] .  ... 
doi:10.1155/2021/4811018 fatcat:kex7f5r2tzconkhhmjqjavusxi

Heterogeneous placement optimization for database query processing

Tomas Karnagel, Dirk Habich
2017 it - Information Technology  
In this paper, we summarize our efforts to use hardware heterogeneity efficiently for query processing.  ...  The current hardware trend is heterogeneity, where multiple computing units like CPUs and GPUs are used together in one system.  ...  Funding: This work is funded by the German Research Foundation (DFG) within the Cluster of Excellence "Center for Advancing Electronics Dresden" (Orchestration Path).  ... 
doi:10.1515/itit-2016-0048 fatcat:accqkgmvl5eshc2hkyfvleh73u

Demonstrating efficient query processing in heterogeneous environments

Tomas Karnagel, Matthias Hille, Mario Ludwig, Dirk Habich, Wolfgang Lehner, Max Heimel, Volker Markl
2014 Proceedings of the 2014 ACM SIGMOD international conference on Management of data - SIGMOD '14  
However, to achieve fully heterogeneous query processing, placement decisions are needed for the database operators.  ...  In prior work, we presented a generic hardwareoblivious database system, where the operators can be executed on the main processor as well as on a large number of accelerator architectures.  ...  However, our focus lies on heterogeneous systems and using all heterogeneous compute units for execution.  ... 
doi:10.1145/2588555.2594526 dblp:conf/sigmod/KarnagelHLHLHM14 fatcat:nil6zmxs2rgszeqhfgoma4sxuy

Generic event-based monitoring and adaptation methodology for heterogeneous distributed systems

Christian Inzinger, Waldemar Hummer, Benjamin Satzger, Philipp Leitner, Schahram Dustdar
2014 Software, Practice & Experience  
We propose a mechanism for optimal deployment of the defined control operators onto available computing resources.  ...  The Cloud computing paradigm provides the basis for a class of platforms and applications that face novel challenges related to multi-tenancy, adaptivity, and elasticity.  ...  An elastic approach for optimal CEP query operator placement using cloud computing techniques is presented in [7] .  ... 
doi:10.1002/spe.2254 fatcat:wehciclu3jfxnpmoju2zya2bwq


Sebastian Breß, Bastian Köcher, Max Heimel, Volker Markl, Michael Saecker, Gunter Saake
2014 Proceedings of the VLDB Endowment  
Our system integrates a hardware-oblivious data processing engine with a learning query optimizer for placement decisions, resulting in a highly adaptive DBMS that is specifically tailored towards heterogeneous  ...  Efficiently exploiting these systems for data processing is a challenging research problem that comprises many facets, including how to find an optimal operator placement strategy, how to estimate runtime  ...  Furthermore, we thank Jens Teubner from TU Dortmund University for the fruitful feedback and discussions.  ... 
doi:10.14778/2733004.2733042 fatcat:e77x5te7xrasdmuqzunuod2fqy

Specification and Deployment of Distributed Monitoring and Adaptation Infrastructures [chapter]

Christian Inzinger, Benjamin Satzger, Waldemar Hummer, Schahram Dustdar
2013 Lecture Notes in Computer Science  
This paper presents a new domain-specific language that allows to define integrated monitoring and adaptation functionality for controlling heterogeneous systems.  ...  We propose a mechanism for optimal deployment of the defined control operators onto available resources.  ...  Related Work The query operator placement problem in the context of complex event processing has received considerable attention in the past.  ... 
doi:10.1007/978-3-642-37804-1_18 fatcat:cwvi6jj32febva4wcynwszc4di

Optimizing execution of component-based applications using group instances

Michael D. Beynon, Tahsin Kurc, Alan Sussman, Joel Saltz
2002 Future generations computer systems  
In earlier work, we studied the effects of filter placement across heterogeneous host machines on the performance of the application.  ...  Applications that query, analyze and manipulate very large data sets have become important consumers of resources.  ...  An example of a unit-of-work would be a spatial query for an image processing application that describes a region within an image to retrieve and process.  ... 
doi:10.1016/s0167-739x(01)00070-x fatcat:xash3ocoyjdkfawvjxihqebzrq

Modulo Based Data Placement Algorithm for Energy Consumption Optimization of MapReduce System

Jie Song, HongYan He, Zhi Wang, Ge Yu, Jean-Marc Pierson
2016 Journal of Grid Computing  
We argue that a fair data placement is helpful to save energy, and then we propose three goals of data placement, and a modulo based Data Placement Algorithm (DPA for short) which achieves these goals.  ...  OATAO is an open access repository that collects the work of Toulouse researchers and makes it freely available over the web where possible.  ...  In summary, if the fairness of size is satisfied, each node can spend same time on data query; if the fairness of range is satisfied, each node can spend same time on data computation; if the Best Adaptability  ... 
doi:10.1007/s10723-016-9370-2 fatcat:hgt5v7kvmnghjnkqx25rou7lzq

Distributed data stream processing and edge computing: A survey on resource elasticity and future directions

Marcos Dias de Assunção, Alexandre da Silva Veith, Rajkumar Buyya
2018 Journal of Network and Computer Applications  
This paper surveys state of the art on stream processing engines and mechanisms for exploiting resource elasticity features of cloud computing in stream processing.  ...  More recently, architecture has been proposed to use edge computing for data stream processing.  ...  comments on a preliminary version of this work.  ... 
doi:10.1016/j.jnca.2017.12.001 fatcat:twmpqzkb3nco3a7nwyhloe5qvu

Distributed Data Stream Processing and Edge Computing: A Survey on Resource Elasticity and Future Directions [article]

Marcos Dias de Assuncao, Alexandre da Silva Veith, Rajkumar Buyya
2017 arXiv   pre-print
This paper surveys state of the art on stream processing engines and mechanisms for exploiting resource elasticity features of cloud computing in stream processing.  ...  More recently, architecture has been proposed to use edge computing for data stream processing.  ...  comments on a preliminary version of this work.  ... 
arXiv:1709.01363v2 fatcat:ajven75pjrgqhkpmi2d3pxs5pu

Big data challenges in simulation-based science

Manish Parashar
2014 Proceedings of the sixth international workshop on Data intensive distributed computing - DIDC '14  
Left) Index building time for different data size; (Right) Breakdown of query processing time for different query selectivities Scalable In-Memory Data Indexing and Querying for Scientific Simulation Workflows  ...  (Top: full-resolution; Bottom: adaptive resolution) Amount of data transfer using static placement, adaptive placement and combined adaption (adaptive data resolution + adaptive placement) Cross-Layer  ... 
doi:10.1145/2608020.2612731 dblp:conf/hpdc/Parashar14 fatcat:f4a4iueobjgfdhsq7mfytlhs3i

HaRD: a heterogeneity-aware replica deletion for HDFS

Hilmi Egemen Ciritoglu, John Murphy, Christina Thorpe
2019 Journal of Big Data  
Then, we show that even keeping a balanced data distribution using WBRD (data-distribution-aware replica deletion scheme) that we proposed in previous work performs sub-optimally on heterogeneous clusters  ...  We implemented HaRD on top of HDFS and conducted a performance evaluation on a 23-node dedicated heterogeneous cluster.  ...  Acknowledgements This work was supported, in part, by Science Foundation Ireland Grant 13/RC/2094 and co-funded under the European Regional Development Fund through the Southern & Eastern Regional Operational  ... 
doi:10.1186/s40537-019-0256-6 pmid:31700766 pmcid:PMC6803594 fatcat:73aihkvbzjfmldykwbblrvfqti

Dynamic Query Processing for P2P Data Services in the Cloud [chapter]

Pawel Jurczyk, Li Xiong
2009 Lecture Notes in Computer Science  
The query processing is capable of fully benefiting from all the distributed resources to minimize the query response time and maximize system throughput.  ...  This paper presents the details of the dynamic query execution engine within our data query infrastructure that dynamically adapts to network and node conditions.  ...  Acknowledgement We thank the anonymous reviewers for their valuable feedback. The research is partially supported by a Career Enhancement Fellowship by the Woodrow Wilson Foundation.  ... 
doi:10.1007/978-3-642-03573-9_34 fatcat:c6vnebikhjgxzatgpmrrbi2usa

A survey on bandwidth-aware geo-distributed frameworks for big-data analytics

Mohammed Bergui, Said Najah, Nikola S. Nikolov
2021 Journal of Big Data  
While cluster computing applications, such as MapReduce and Spark, have been widely deployed in data centres to support commercial applications and scientific research, they are not designed for running  ...  The necessity to utilise such infrastructure introduces new challenges in the data analytics process due to bandwidth limitations of the inter-data-centre communication.  ...  Acknowledgements The authors thank the anonymous reviewers for their helpful suggestions and comments.  ... 
doi:10.1186/s40537-021-00427-9 fatcat:u2jx7x6hkfc47kn2iqpkcquhi4

Elastic stream processing in the Cloud

Waldemar Hummer, Benjamin Satzger, Schahram Dustdar
2013 Wiley Interdisciplinary Reviews Data Mining and Knowledge Discovery  
The advent of Cloud computing fosters the development of elastic stream processing platforms which are able to dynamically adapt based on different cost-benefit tradeoffs.  ...  In contrast to traditional databases, stream processing systems perform continuous queries and handle data on-the-fly.  ...  The advent of Cloud computing has fostered a resource-oriented view towards adaptation, allowing to elastically allocate and release resources on demand.  ... 
doi:10.1002/widm.1100 fatcat:o67z4wzq75cbboef2ex5a7lmma
« Previous Showing results 1 — 15 out of 10,175 results