314 Hits in 7.2 sec

Locality-aware dynamic VM reconfiguration on MapReduce clouds

Jongse Park, Daewoo Lee, Bokyeong Kim, Jaehyuk Huh, Seungryoul Maeng
2012 Proceedings of the 21st international symposium on High-Performance Parallel and Distributed Computing - HPDC '12  
In this paper, we propose a dynamic VM reconfiguration technique for data-intensive computing on clouds, called Dynamic Resource Reconfiguration (DRR).  ...  DRR dynamically increases or decreases the computing capability of each node to enhance locality-aware task scheduling.  ...  Purlieus improved the locality of map and reduce tasks in MapReduce platforms on the cloud by locality-aware VM placement [17] .  ... 
doi:10.1145/2287076.2287082 dblp:conf/hpdc/ParkLKHM12 fatcat:hvb5mh7hprbehj2n5dqdg4n2u4

Dynamic workload management in heterogeneous Cloud computing environments

Qi Zhang, Raouf Boutaba
2014 2014 IEEE Network Operations and Management Symposium (NOMS)  
• Service Placement in Geo-Distributed Clouds • Heterogeneity-Aware Dynamic Capacity Provisioning • Fine-Grained Resource-Aware Scheduling for MapReduce • Conclusion 19 Resource-Aware MapReduce  ...  on static problem where demand is not changing • Heuristic algorithm (e.g. local search) for dynamic cases • Service placement • Energy and carbon footprint-aware placement (e.g.  ...  • Data locality can be considered by profiling local and nonlocal tasks • Missing details/ unstated assumptions for job profiling, would be good to add to the technical content. • Can use general profilers  ... 
doi:10.1109/noms.2014.6838288 dblp:conf/noms/ZhangB14 fatcat:qlhsggqzdza6bd4mkcn4sy7f5i

Cost-Effective Resource Provisioning for MapReduce in a Cloud

Balaji Palanisamy, Aameek Singh, Ling Liu
2015 IEEE Transactions on Parallel and Distributed Systems  
Cura's core resource management schemes include cost-aware resource provisioning, VM-aware scheduling and online virtual machine reconfiguration.  ...  This paper presents a new MapReduce cloud service model, Cura, for provisioning cost-effective MapReduce services in a cloud.  ...  ACKNOWLEDGMENTS The first and third authors are supported by grants from US National Science Foundation (NSF) CISE NetSE program, SaTC program, I/UCRC and a grant from Intel ICST on cloud computing.  ... 
doi:10.1109/tpds.2014.2320498 fatcat:2ef5fjxtmfbapnn3sb7mdnjsau

Cura: A Cost-Optimized Model for MapReduce in a Cloud

Balaji Palanisamy, Aameek Singh, Ling Liu, Bryan Langston
2013 2013 IEEE 27th International Symposium on Parallel and Distributed Processing  
We propose a new MapReduce cloud service model, Cura, for data analytics in the cloud.  ...  Cura also benefits from a number of additional performance enhancements including cost-aware resource provisioning, VMaware scheduling and online virtual machine reconfiguration.  ...  The first and third authors are partially sponsored by grants from NSF CISE NetSE program, SaTC program and I/UCRCs program, an IBM faculty award and a grant from Intel ISTC on Cloud Computing.  ... 
doi:10.1109/ipdps.2013.20 dblp:conf/ipps/PalanisamySLL13 fatcat:luwigic3rrcmhhk3gnwsh6gyaa

Scheduling Data Intensive Workloads through Virtualization on MapReduce based Clouds

B Thirumala Rao
2012 International Journal of Distributed and Parallel systems  
MapReduce has become a popular programming model for running data intensive applications on the cloud.  ...  In this paper, a novel scheduler is proposed to address the above problem which is primarily based on the dynamic resource reconfiguration approach.  ...  Purlieus [18] improved the locality of map and reduce tasks in MapReduce platforms on the cloud by locality-aware VM placement by exploiting prior knowledge about the characteristics of MapReduce workloads  ... 
doi:10.5121/ijdps.2012.3411 fatcat:ryyde2gvkvexrhwe2u3lobj2ky


Dr N Sandhya
2017 International Journal of Advanced Research in Computer Science  
It also accomplishes these tasks in parallel on a MapReduce cluster.  ...  We have researched a resourceful and appropriate scheduling scheme called as hybrid job-driven scheduling scheme (JoSS) which source higher map and reduce data-locality.  ...  Their work evaluated for distributed data-intensive platforms on virtualized cloud environments and developed this DDR using a dynamic VM reconfiguration mechanism.  ... 
doi:10.26483/ijarcs.v8i9.5210 fatcat:4riinqfyn5glrkz6s4vsenyv3q

Interference and locality-aware task scheduling for MapReduce applications in virtual clusters

Xiangping Bu, Jia Rao, Cheng-zhong Xu
2013 Proceedings of the 22nd international symposium on High-performance parallel and distributed computing - HPDC '13  
On the other hand, virtualization offers an extra opportunity of data locality for co-hosted VMs.  ...  In a virtual MapReduce cluster, the interference between virtual machines (VMs) causes performance degradation of map and reduce tasks and renders existing data locality-aware task scheduling policy, like  ...  Park et al. introduced a locality-aware dynamic VM reconfiguration technique to improve MapReduce's performance [25] .  ... 
doi:10.1145/2493123.2462904 fatcat:u5njufiirnazdhwfcxft7hqsji

Locality and loading aware virtual machine mapping techniques for optimizing communications in MapReduce applications

Ching-Hsien Hsu, Kenn D. Slagter, Yeh-Ching Chung
2015 Future generations computer systems  
h i g h l i g h t s • Improving performance of MapReduce programs in heterogeneous environments and hybrid clouds. • Enhancing data locality through a virtual machine mapping technique. • Optimizing shuffle  ...  However, this means the time required to process a MapReduce job is dependent on whichever node is last to complete a task. Heterogeneous environments exacerbate this problem.  ...  Research into on MapReduce clouds [26] looked at how locality aware VM reconfiguration could be attained.  ... 
doi:10.1016/j.future.2015.04.006 fatcat:zygcfqyn2ne4neif3vpiwc7yki

A Survey of Big Data Machine Learning Applications Optimization in Cloud Data Centers and Networks [article]

Sanaa Hamid Mohamed, Taisir E.H. El-Gorashi, Jaafar M.H. Elmirghani
2019 arXiv   pre-print
Moreover, we provide a brief review of data centers topologies, routing protocols, and traffic characteristics, and emphasize the implications of big data on such cloud data centers and their supporting  ...  The MapReduce programming model and its widely-used open-source platform; Hadoop, are enabling the development of a large number of cloud-based services and big data applications.  ...  Cura was proposed in [141] to provide costeffective provisioning for interactive MapReduce jobs by utilizing Starfish profiling, VM-aware scheduling, and online VMs reconfigurations.  ... 
arXiv:1910.00731v1 fatcat:kvi3br4iwzg3bi7fifpgyly7m4

Dynamic energy efficient data placement and cluster reconfiguration algorithm for MapReduce framework

Nitesh Maheshwari, Radheshyam Nanduri, Vasudeva Varma
2012 Future generations computer systems  
The algorithm dynamically reconfigures the cluster based on the current workload and turns cluster nodes on or off when the average cluster utilization rises above or falls below administrator specified  ...  With the recent emergence of cloud computing based services on the Internet, MapReduce and distributed file systems like HDFS have emerged as the paradigm of choice for developing large scale data intensive  ...  We would also like to thank Jaideep Dhok, Sudip Datta and Manisha Verma for their constant feedback on our work.  ... 
doi:10.1016/j.future.2011.07.001 fatcat:d7ffbaxy7rb5rj62ituy63zrmu


Priyanka Tembey, Ada Gavrilovska, Karsten Schwan
2014 Proceedings of the ACM Symposium on Cloud Computing - SOCC '14  
Workload consolidation, whether via use of virtualization or with lightweight, container-based methods, is critically important for current and future datacenter and cloud computing systems.  ...  Elevating isolation into a first-class management principle, these sensitivity-and cost-based allocation and sharing methods lead to efficient methods for shared resource use on scaleup server systems.  ...  using four copies of Matrix-Multiplication MapReduce codes (each in one VM of 2 VCPUs and 4GB memory) and two copies of Wordcount codes in separate VMs of four VCPUs and 4GB memory.  ... 
doi:10.1145/2670979.2670993 dblp:conf/cloud/TembeyGS14 fatcat:r7fa4sudrvdorflctgobj6iauq

Self-awareness of Cloud Applications [chapter]

Alex Iosup, Xiaoyun Zhu, Arif Merchant, Eva Kalyvianaki, Martina Maggio, Simon Spinner, Tarek Abdelzaher, Ole Mengshoel, Sara Bouchenak
2017 Self-Aware Computing Systems  
A much shorter, revised version of this material will be available in print, as part of a Springer book on "Self-Aware Computing". The book is due to appear in 2017.  ...  Last, we propose a roadmap for addressing open challenges in self-aware cloud and datacenter applications.  ...  Dutch national program COM-MIT and COMMissioner sub-project, by the Dutch KIEM project KIESA, and by a generous ERO gift from Oracle, by the European FP7 research project AMADEOS Grant Agreement 610535 on  ... 
doi:10.1007/978-3-319-47474-8_20 fatcat:ckcxfmjmvvas5bhg7wp5qfmehy

CloudScope: Diagnosing and Managing Performance Interference in Multi-tenant Clouds

Xi Chen, Lukas Rupprecht, Rasha Osman, Peter Pietzuch, Felipe Franciosi, William Knottenbelt
2015 2015 IEEE 23rd International Symposium on Modeling, Analysis, and Simulation of Computer and Telecommunication Systems  
The interference-aware scheduler improves VM performance by up to 10% compared to the default scheduler. In addition, the hypervisor reconfiguration can improve network throughput by up to 30%.  ...  We have implemented CloudScope on top of the Xen hypervisor and conducted experiments using a set of CPU, disk, and network intensive workloads and a real system (MapReduce).  ...  We greatly appreciate the help from Thomas Joseph, Lloyd Kamara, and Duncan White with setting up the experiments on the departmental cloud.  ... 
doi:10.1109/mascots.2015.35 dblp:conf/mascots/ChenROPFK15 fatcat:zo67zs4erfclhmexlrqbmfncku

Experimental Study on the Energy Consumption in IaaS Cloud Environments

Alexandra Carpen-Amarie, Anne-Cecile Orgerie, Christine Morin
2013 2013 IEEE/ACM 6th International Conference on Utility and Cloud Computing  
the tradeoff between performance and energy consumption of MapReduce virtual clusters through typical cloud applications.  ...  Among the many aspects that influence the energy consumption of a cloud system, the hardware-component level is one of the most intensively studied.  ...  This implies a local storage-based VM management, that is each cloud needed to copy the VM image from the image repository to the local disk of each compute node.  ... 
doi:10.1109/ucc.2013.24 dblp:conf/ucc/Carpen-AmarieOM13 fatcat:3xtfq7lyv5gwzjufgh3o3g2bjy

Distributionin of Data Handling in Cloud Asset

2020 International Journal of Engineering and Advanced Technology  
In Cloud computing, task scheduling is one of the technique of specifying and assigning job to assets that finish the job.  ...  Preference will be provided based on the requirements and goals of the user. Multiple computing parts comprise of many parallel applications while duties of execution are relied on other duties.  ...  Tasks are dynamically combined with concrete VMs in second phase. Therefore, dynamic algorithms for planning tasks are suggested.  ... 
doi:10.35940/ijeat.c6031.029320 fatcat:5mx7tzbi6vcfnheqsqdbfvlyga
« Previous Showing results 1 — 15 out of 314 results