Filters








19 Hits in 1.7 sec

GreenHadoop

Íñigo Goiri, Kien Le, Thu D. Nguyen, Jordi Guitart, Jordi Torres, Ricardo Bianchini
2012 Proceedings of the 7th ACM european conference on Computer Systems - EuroSys '12  
In particular, we consider data-processing frameworks, in which many background computations can be delayed by a bounded amount of time.  ...  GreenHadoop predicts the amount of solar energy that will be available in the near future, and schedules the MapReduce jobs to maximize the green energy consumption within the jobs' time bounds.  ...  Acknowledgements We would like to thank Kevin Elphinstone and the anonymous reviewers for their help in improving our paper.  ... 
doi:10.1145/2168836.2168843 dblp:conf/eurosys/GoiriLNGTB12 fatcat:crxyh7hes5gylbopvf4fet3uhe

Not All Joules are Equal: Towards Energy-Efficient and Green-Aware Data Processing Frameworks

Zhaojie Niu, Bingsheng He, Fangming Liu
2016 2016 IEEE International Conference on Cloud Engineering (IC2E)  
Interests have been growing in integrating renewable energy into data centers, which attracts many research efforts in developing green-aware algorithms and systems.  ...  We have implemented GreenMR, an energy-efficient and green-aware MapReduce framework, on top of Hadoop YARN.  ...  We have observed a number of key factors resulting in joule efficiency of data processing frameworks in data centers.  ... 
doi:10.1109/ic2e.2016.17 dblp:conf/ic2e/NiuHL16 fatcat:yywk4lm56ffoxee4stw6s5vobu

Leveraging renewable energy in data centers

Ricardo Bianchini
2012 Proceedings of the 21st international symposium on High-Performance Parallel and Distributed Computing - HPDC '12  
In this keynote talk, I will first discuss the tradeoffs involved in leveraging green energy today and the prospects for the future.  ...  I will then discuss the main research challenges and questions involved in managing the use of green energy in data centers.  ...  Along similar lines, GreenHadoop extends the Hadoop data-processing framework.  ... 
doi:10.1145/2287076.2287101 dblp:conf/hpdc/Bianchini12 fatcat:7psspyx5hzampb54ijmkvczyfe

A Study of Big Data Computing Platforms: Fairness and Energy Consumption

Zhaojie Niu, Bingsheng He
2016 2016 IEEE International Conference on Cloud Engineering Workshop (IC2EW)  
Improving the performance is the common sense on those large-scale data processing frameworks and fruitful studies are proposed in this direction.  ...  In this thesis proposal, we investigate how to leverage such joule efficiency to maximize the profits of renewable energy for MapReduce framework.  ... 
doi:10.1109/ic2ew.2016.31 dblp:conf/ic2e/NiuH16 fatcat:f2lhabqwgrd27m7unqf5k4qcmm

On Understanding the Energy Impact of Speculative Execution in Hadoop

Tien-Dat Phan, Shadi Ibrahim, Gabriel Antoniu, Luc Bouge
2015 2015 IEEE International Conference on Data Science and Data Intensive Systems  
Hadoop emerged as an important system for largescale data analysis.  ...  Speculative execution is a key feature in Hadoop that is extensively leveraged in clouds: it is used to mask slow tasks (i.e., stragglers) -resulted from resource contention and heterogeneity in clouds  ...  [19] present GreenHadoop, a MapReduce framework for a data-center powered by renewable green sources of energy (e.g. solar or wind) and the electrical grid (as a backup).  ... 
doi:10.1109/dsdis.2015.45 dblp:conf/dsdis/PhanIAB15 fatcat:hs7xxvan7vc4veci4q2nahq5uq

Green-Aware Virtual Machine Migration Strategy in Sustainable Cloud Computing Environments [chapter]

Xiaoying Wang, Guojing Zhang, Mengqin Yang, Lei Zhang
2017 Cloud Computing - Architecture and Applications  
Evaluation experiments are conducted under realistic workload traces and solar energy generation data in order to validate the feasibility.  ...  In this chapter, we present a green-aware virtual machine (VM) migration strategy in such datacenters powered by sustainable energy sources, considering the power consumption of both IT functional devices  ...  Acknowledgements This work is partially supported in part by National Natural Science Foundation of China  ... 
doi:10.5772/67350 fatcat:7jmctv6jbzb65jfazejufjdpau

Green-aware workload scheduling in geographically distributed data centers

Changbing Chen, Bingsheng He, Xueyan Tang
2012 4th IEEE International Conference on Cloud Computing Technology and Science Proceedings  
While green energy supply for a single data center is intermittent due to daily/seasonal effects, our workload scheduling algorithm is aware of different amounts of green energy supply and dynamically  ...  Renewable (or green) energy, such as solar or wind, has at least partially powered data centers to reduce the environmental impact of traditional energy sources (brown energy with high carbon footprint  ...  This work is supported by an Inter-disciplinary Strategic Competitive Fund of Nanyang Technological University 2011 for "C3: Cloud-Assisted Green Computing at NTU Campus".  ... 
doi:10.1109/cloudcom.2012.6427545 dblp:conf/cloudcom/ChenHT12 fatcat:yb7alwuuw5gubmc3czbtrwsequ

Green Data Centers: A Survey, Perspectives, and Future Directions [article]

Xibo Jin, Fa Zhang, Athanasios V. Vasilakos, Zhiyong Liu
2016 arXiv   pre-print
In this paper, we provide a survey of the state-of-the-art research on green data center techniques, including energy efficiency, resource management, thermal control and green metrics.  ...  However, because of the over-provisioning of resources, the utilization of existing data centers is, in fact, remarkably low, leading to considerable energy waste.  ...  Two scheduler frameworks, named GreenSlot and GreenHadoop, were proposed for parallel batch jobs and data-processing jobs, respectively.  ... 
arXiv:1608.00687v1 fatcat:if2x3wmy3rhorasl3f2vyvcozy

On the performance and energy efficiency of Hadoop deployment models

Eugen Feller, Lavanya Ramakrishnan, Christine Morin
2013 2013 IEEE International Conference on Big Data  
In this paper, we also conduct an energy efficiency evaluation of Hadoop on physical and virtual clusters in different configurations.  ...  The Hadoop framework has recently evolved to the standard framework implementing the MapReduce model.  ...  Department of Energy under Contract No. DE-AC02-05CH11231 and by NSF under Grant No. 1032873.  ... 
doi:10.1109/bigdata.2013.6691564 dblp:conf/bigdataconf/FellerRM13 fatcat:7yjqtnd2crbtpb4qzxqr7leuvq

Towards a Systematic Survey for Carbon Neutral Data Centers [article]

Zhiwei Cao, Xin Zhou, Han Hu, Zhi Wang, Yonggang Wen
2022 arXiv   pre-print
Furthermore, three key scientific challenges for putting such a framework in place are discussed. Finally, several applications for this framework are presented to demonstrate its enormous potential.  ...  On the technological front, we propose achieving carbon-neutral data centers by increasing renewable energy penetration, improving energy efficiency, and boosting energy circulation simultaneously.  ...  Furthermore, Goiri et al. applied GreenSlot scheduler in Hadoop [89] , resulting in a solar energy-and electricity cost-aware MapReduce framework called GreenHadoop [82] .  ... 
arXiv:2110.09284v3 fatcat:gwlgrioigbedzauyeaopdlxngu

Big Data and cloud computing: innovation opportunities and challenges

Chaowei Yang, Qunying Huang, Zhenlong Li, Kai Liu, Fei Hu
2016 International Journal of Digital Earth  
At the same time, Big Data presents challenges for digital earth to store, transport, process, mine and serve the data.  ...  cloud computing and processing Big Data; (v) open availability of Big Data and processing capability pose social challenges of geospatial significance and (vi) a weave of innovations is transforming Big  ...  High energy consumption is a major obstacle for achieving green computing with large-scale data centers .  ... 
doi:10.1080/17538947.2016.1239771 fatcat:qbcgqj2pcvbgja6dnnakoj2saa

Green IoT for Eco-Friendly and Sustainable Smart Cities: Future Directions and Opportunities

Faris. A. Almalki, S. H. Alsamhi, Radhya Sahal, Jahan Hassan, Ammar Hawbani, N. S. Rajput, Abdu Saif, Jeff Morgan, John Breslin
2021 Journal on spesial topics in mobile networks and applications  
However, IoT technologies present several challenges such as increases in energy consumption, and produces toxic pollution as well as E-waste in smart cities.  ...  Smart city applications must be environmentally-friendly, hence require a move towards green IoT. Green IoT leads to an eco-friendly environment, which is more sustainable for smart cities.  ...  Green IoT includes designing and leveraging green aspects.  ... 
doi:10.1007/s11036-021-01790-w fatcat:vlcrka3vpzevhkc4z7ylj7q4ba

A comprehensive view of Hadoop research—A systematic literature review

Ivanilton Polato, Reginaldo Ré, Alfredo Goldman, Fabio Kon
2014 Journal of Network and Computer Applications  
Lately, Apache Hadoop has attracted strong attention due to its applicability to Big Data processing.  ...  Context: In recent years, the valuable knowledge that can be retrieved from petabyte scale datasetsknown as Big Dataled to the development of solutions to process information based on parallel and distributed  ...  Table A1 and A2 Table A1 Studies with implementation and/or experiments (MapReduce and data storage & manipulation categories). Appendix A.  ... 
doi:10.1016/j.jnca.2014.07.022 fatcat:4xjveqy6mrctzjc4ou7llyy4u4

Matching renewable energy supply and demand in green datacenters

Íñigo Goiri, Md E. Haque, Kien Le, Ryan Beauchea, Thu D. Nguyen, Jordi Guitart, Jordi Torres, Ricardo Bianchini
2015 Ad hoc networks  
and a data processing workload.  ...  Based on these positive results, we conclude that green datacenters and green-energy-aware scheduling can have a significant role in building a more sustainable IT ecosystem.  ...  We thank Oscar Flores and Modesto Orozco for the genomics workloads we used in this paper.  ... 
doi:10.1016/j.adhoc.2014.11.012 fatcat:5yc3h4pskvfebigjx5fnq2hw3q

Performance and energy efficiency of big data applications in cloud environments: A Hadoop case study

Eugen Feller, Lavanya Ramakrishnan, Christine Morin
2015 Journal of Parallel and Distributed Computing  
In this paper, we also conduct an energy efficiency evaluation of Hadoop on physical and virtual clusters in different configurations.  ...  In this paper, we evaluate Hadoop performance in both the traditional model of collocated data and compute services as well as consider the impact of separating out the services.  ...  Department of Energy under Contract No. DE-AC02-05CH11231.  ... 
doi:10.1016/j.jpdc.2015.01.001 fatcat:wbtxc3s2yvd4jl4akd7iiruea4
« Previous Showing results 1 — 15 out of 19 results