A copy of this work was available on the public web and has been preserved in the Wayback Machine. The capture dates from 2017; you can also visit the original URL.
The file type is application/pdf.
Filters
Locality-aware dynamic VM reconfiguration on MapReduce clouds
2012
Proceedings of the 21st international symposium on High-Performance Parallel and Distributed Computing - HPDC '12
Preserved Fulltext
In this paper, we propose a dynamic VM reconfiguration technique for data-intensive computing on clouds, called Dynamic Resource Reconfiguration (DRR). ...
DRR dynamically increases or decreases the computing capability of each node to enhance locality-aware task scheduling. ...
Purlieus improved the locality of map and reduce tasks in MapReduce platforms on the cloud by locality-aware VM placement [17] . ...
doi:10.1145/2287076.2287082
dblp:conf/hpdc/ParkLKHM12
fatcat:hvb5mh7hprbehj2n5dqdg4n2u4
Dynamic workload management in heterogeneous Cloud computing environments
2014
2014 IEEE Network Operations and Management Symposium (NOMS)
Preserved Fulltext
A copy of this work was available on the public web and has been preserved in the Wayback Machine. The capture dates from 2017; you can also visit the original URL.
The file type is application/pdf.
• Service Placement in Geo-Distributed Clouds
• Heterogeneity-Aware Dynamic Capacity Provisioning
• Fine-Grained Resource-Aware Scheduling for MapReduce
• Conclusion
19
Resource-Aware MapReduce ...
on static problem where demand is not changing
• Heuristic algorithm (e.g. local search) for dynamic cases
• Service placement
• Energy and carbon footprint-aware placement (e.g. ...
• Data locality can be considered by profiling local and nonlocal tasks • Missing details/ unstated assumptions for job profiling, would be good to add to the technical content. • Can use general profilers ...
doi:10.1109/noms.2014.6838288
dblp:conf/noms/ZhangB14
fatcat:qlhsggqzdza6bd4mkcn4sy7f5i
Cost-Effective Resource Provisioning for MapReduce in a Cloud
2015
IEEE Transactions on Parallel and Distributed Systems
Preserved Fulltext
A copy of this work was available on the public web and has been preserved in the Wayback Machine. The capture dates from 2017; you can also visit the original URL.
The file type is application/pdf.
Cura's core resource management schemes include cost-aware resource provisioning, VM-aware scheduling and online virtual machine reconfiguration. ...
This paper presents a new MapReduce cloud service model, Cura, for provisioning cost-effective MapReduce services in a cloud. ...
ACKNOWLEDGMENTS The first and third authors are supported by grants from US National Science Foundation (NSF) CISE NetSE program, SaTC program, I/UCRC and a grant from Intel ICST on cloud computing. ...
doi:10.1109/tpds.2014.2320498
fatcat:2ef5fjxtmfbapnn3sb7mdnjsau
Cura: A Cost-Optimized Model for MapReduce in a Cloud
2013
2013 IEEE 27th International Symposium on Parallel and Distributed Processing
Preserved Fulltext
A copy of this work was available on the public web and has been preserved in the Wayback Machine. The capture dates from 2017; you can also visit the original URL.
The file type is application/pdf.
We propose a new MapReduce cloud service model, Cura, for data analytics in the cloud. ...
Cura also benefits from a number of additional performance enhancements including cost-aware resource provisioning, VMaware scheduling and online virtual machine reconfiguration. ...
The first and third authors are partially sponsored by grants from NSF CISE NetSE program, SaTC program and I/UCRCs program, an IBM faculty award and a grant from Intel ISTC on Cloud Computing. ...
doi:10.1109/ipdps.2013.20
dblp:conf/ipps/PalanisamySLL13
fatcat:luwigic3rrcmhhk3gnwsh6gyaa
Scheduling Data Intensive Workloads through Virtualization on MapReduce based Clouds
2012
International Journal of Distributed and Parallel systems
Preserved Fulltext
A copy of this work was available on the public web and has been preserved in the Wayback Machine. The capture dates from 2018; you can also visit the original URL.
The file type is application/pdf.
Other Versions
MapReduce has become a popular programming model for running data intensive applications on the cloud. ...
In this paper, a novel scheduler is proposed to address the above problem which is primarily based on the dynamic resource reconfiguration approach. ...
Purlieus [18] improved the locality of map and reduce tasks in MapReduce platforms on the cloud by locality-aware VM placement by exploiting prior knowledge about the characteristics of MapReduce workloads ...
doi:10.5121/ijdps.2012.3411
fatcat:ryyde2gvkvexrhwe2u3lobj2ky
PARALLEL AND DISTRIBUTE PROCESSING FOR VIRTUAL MAPREDUCE CLUSTERS BY USING IMPROVISED HYBRID JOB SCHEDULING ALGORITHM
2017
International Journal of Advanced Research in Computer Science
Preserved Fulltext
A copy of this work was available on the public web and has been preserved in the Wayback Machine. The capture dates from 2018; you can also visit the original URL.
The file type is application/pdf.
It also accomplishes these tasks in parallel on a MapReduce cluster. ...
We have researched a resourceful and appropriate scheduling scheme called as hybrid job-driven scheduling scheme (JoSS) which source higher map and reduce data-locality. ...
Their work evaluated for distributed data-intensive platforms on virtualized cloud environments and developed this DDR using a dynamic VM reconfiguration mechanism. ...
doi:10.26483/ijarcs.v8i9.5210
fatcat:4riinqfyn5glrkz6s4vsenyv3q
Interference and locality-aware task scheduling for MapReduce applications in virtual clusters
2013
Proceedings of the 22nd international symposium on High-performance parallel and distributed computing - HPDC '13
Preserved Fulltext
A copy of this work was available on the public web and has been preserved in the Wayback Machine. The capture dates from 2017; you can also visit the original URL.
The file type is application/pdf.
On the other hand, virtualization offers an extra opportunity of data locality for co-hosted VMs. ...
In a virtual MapReduce cluster, the interference between virtual machines (VMs) causes performance degradation of map and reduce tasks and renders existing data locality-aware task scheduling policy, like ...
Park et al. introduced a locality-aware dynamic VM reconfiguration technique to improve MapReduce's performance [25] . ...
doi:10.1145/2493123.2462904
fatcat:u5njufiirnazdhwfcxft7hqsji
Locality and loading aware virtual machine mapping techniques for optimizing communications in MapReduce applications
2015
Future generations computer systems
Preserved Fulltext
A copy of this work was available on the public web and has been preserved in the Wayback Machine. The capture dates from 2017; you can also visit the original URL.
The file type is application/pdf.
h i g h l i g h t s • Improving performance of MapReduce programs in heterogeneous environments and hybrid clouds. • Enhancing data locality through a virtual machine mapping technique. • Optimizing shuffle ...
However, this means the time required to process a MapReduce job is dependent on whichever node is last to complete a task. Heterogeneous environments exacerbate this problem. ...
Research into on MapReduce clouds [26] looked at how locality aware VM reconfiguration could be attained. ...
doi:10.1016/j.future.2015.04.006
fatcat:zygcfqyn2ne4neif3vpiwc7yki
A Survey of Big Data Machine Learning Applications Optimization in Cloud Data Centers and Networks
[article]
2019
arXiv
pre-print
Preserved Fulltext
A copy of this work was available on the public web and has been preserved in the Wayback Machine. The capture dates from 2020; you can also visit the original URL.
The file type is application/pdf.
Moreover, we provide a brief review of data centers topologies, routing protocols, and traffic characteristics, and emphasize the implications of big data on such cloud data centers and their supporting ...
The MapReduce programming model and its widely-used open-source platform; Hadoop, are enabling the development of a large number of cloud-based services and big data applications. ...
Cura was proposed in [141] to provide costeffective provisioning for interactive MapReduce jobs by utilizing Starfish profiling, VM-aware scheduling, and online VMs reconfigurations. ...
arXiv:1910.00731v1
fatcat:kvi3br4iwzg3bi7fifpgyly7m4
Dynamic energy efficient data placement and cluster reconfiguration algorithm for MapReduce framework
2012
Future generations computer systems
Preserved Fulltext
A copy of this work was available on the public web and has been preserved in the Wayback Machine. The capture dates from 2012; you can also visit the original URL.
The file type is application/pdf.
The algorithm dynamically reconfigures the cluster based on the current workload and turns cluster nodes on or off when the average cluster utilization rises above or falls below administrator specified ...
With the recent emergence of cloud computing based services on the Internet, MapReduce and distributed file systems like HDFS have emerged as the paradigm of choice for developing large scale data intensive ...
We would also like to thank Jaideep Dhok, Sudip Datta and Manisha Verma for their constant feedback on our work. ...
doi:10.1016/j.future.2011.07.001
fatcat:d7ffbaxy7rb5rj62ituy63zrmu
Merlin
2014
Proceedings of the ACM Symposium on Cloud Computing - SOCC '14
Preserved Fulltext
A copy of this work was available on the public web and has been preserved in the Wayback Machine. The capture dates from 2016; you can also visit the original URL.
The file type is application/pdf.
Workload consolidation, whether via use of virtualization or with lightweight, container-based methods, is critically important for current and future datacenter and cloud computing systems. ...
Elevating isolation into a first-class management principle, these sensitivity-and cost-based allocation and sharing methods lead to efficient methods for shared resource use on scaleup server systems. ...
using four copies of Matrix-Multiplication MapReduce codes (each in one VM of 2 VCPUs and 4GB memory) and two copies of Wordcount codes in separate VMs of four VCPUs and 4GB memory. ...
doi:10.1145/2670979.2670993
dblp:conf/cloud/TembeyGS14
fatcat:r7fa4sudrvdorflctgobj6iauq
Self-awareness of Cloud Applications
[chapter]
2017
Self-Aware Computing Systems
Preserved Fulltext
A copy of this work was available on the public web and has been preserved in the Wayback Machine. The capture dates from 2018; you can also visit the original URL.
The file type is application/pdf.
A much shorter, revised version of this material will be available in print, as part of a Springer book on "Self-Aware Computing". The book is due to appear in 2017. ...
Last, we propose a roadmap for addressing open challenges in self-aware cloud and datacenter applications. ...
Dutch national program COM-MIT and COMMissioner sub-project, by the Dutch KIEM project KIESA, and by a generous ERO gift from Oracle, by the European FP7 research project AMADEOS Grant Agreement 610535 on ...
doi:10.1007/978-3-319-47474-8_20
fatcat:ckcxfmjmvvas5bhg7wp5qfmehy
CloudScope: Diagnosing and Managing Performance Interference in Multi-tenant Clouds
2015
2015 IEEE 23rd International Symposium on Modeling, Analysis, and Simulation of Computer and Telecommunication Systems
Preserved Fulltext
A copy of this work was available on the public web and has been preserved in the Wayback Machine. The capture dates from 2017; you can also visit the original URL.
The file type is application/pdf.
The interference-aware scheduler improves VM performance by up to 10% compared to the default scheduler. In addition, the hypervisor reconfiguration can improve network throughput by up to 30%. ...
We have implemented CloudScope on top of the Xen hypervisor and conducted experiments using a set of CPU, disk, and network intensive workloads and a real system (MapReduce). ...
We greatly appreciate the help from Thomas Joseph, Lloyd Kamara, and Duncan White with setting up the experiments on the departmental cloud. ...
doi:10.1109/mascots.2015.35
dblp:conf/mascots/ChenROPFK15
fatcat:zo67zs4erfclhmexlrqbmfncku
Experimental Study on the Energy Consumption in IaaS Cloud Environments
2013
2013 IEEE/ACM 6th International Conference on Utility and Cloud Computing
Preserved Fulltext
A copy of this work was available on the public web and has been preserved in the Wayback Machine. The capture dates from 2015; you can also visit the original URL.
The file type is application/pdf.
the tradeoff between performance and energy consumption of MapReduce virtual clusters through typical cloud applications. ...
Among the many aspects that influence the energy consumption of a cloud system, the hardware-component level is one of the most intensively studied. ...
This implies a local storage-based VM management, that is each cloud needed to copy the VM image from the image repository to the local disk of each compute node. ...
doi:10.1109/ucc.2013.24
dblp:conf/ucc/Carpen-AmarieOM13
fatcat:3xtfq7lyv5gwzjufgh3o3g2bjy
Distributionin of Data Handling in Cloud Asset
2020
International Journal of Engineering and Advanced Technology
Preserved Fulltext
A copy of this work was available on the public web and has been preserved in the Wayback Machine. The capture dates from 2020; you can also visit the original URL.
The file type is application/pdf.
In Cloud computing, task scheduling is one of the technique of specifying and assigning job to assets that finish the job. ...
Preference will be provided based on the requirements and goals of the user. Multiple computing parts comprise of many parallel applications while duties of execution are relied on other duties. ...
Tasks are dynamically combined with concrete VMs in second phase. Therefore, dynamic algorithms for planning tasks are suggested. ...
doi:10.35940/ijeat.c6031.029320
fatcat:5mx7tzbi6vcfnheqsqdbfvlyga
« Previous
Showing results 1 — 15 out of 314 results