2,018 Hits in 8.9 sec

Building a Private HPC Cloud for Compute and Data-Intensive Applications

Moussa Taifi, Abdallah Khreishah, Justin Y. Shi
2013 International Journal on Cloud Computing Services and Architecture  
We report our evaluation criteria using Open Source software, and performance studies for compute-intensive and data-intensive applications.  ...  types of HPC and Big Data workloads.  ...  ACKNOWLEDGEMENTS The authors would like Thomas Stauffer, AakashPradeep and Dr.Jie Wu for useful feedback and suggestions, as well operational support during the design and deployment phases of the private  ... 
doi:10.5121/ijccsa.2013.3201 fatcat:73pwlzqdgnavlp6rjhs2yjtycq

Portable Parallel Programming on Cloud and HPC: Scientific Applications of Twister4Azure

T. Gunarathne, Bingjing Zhang, Tak-Lon Wu, J. Qiu
2011 2011 Fourth IEEE International Conference on Utility and Cloud Computing  
It extends the familiar, easy-to-use MapReduce programming model with iterative extensions, enabling a wide array of large-scale iterative data analysis for scientific applications on Azure cloud.  ...  Recent advancements in data intensive computing for science discovery are fueling a dramatic growth in use of data-intensive iterative computations.  ...  Geoffrey C Fox for his many insights and feedbacks about this work. We would also like to thank Seung-Hee Bae for many discussions on MDS.  ... 
doi:10.1109/ucc.2011.23 dblp:conf/ucc/GunarathneZWQ11 fatcat:2vf5gmxmvncufmxkptsoqvkhmi

Understanding Scientific Applications for Cloud Environments [chapter]

Shantenu Jha, Daniel S. Katz, Andre Luckow, Andre Merzky, Katerina Stamou
2011 Cloud Computing  
With the emergence of clouds and a general increase in the importance of data-intensive applications, programming models for data-intensive applications have gained significant attention; a prominent example  ...  A lot of interesting work has been done around the accommodation of workflow and generally data-intensive applications into the cloud.  ... 
doi:10.1002/9780470940105.ch13 fatcat:cq6najley5cd5lpf5vvitdkdgu

10 Years Later: Cloud Computing is Closing the Performance Gap [article]

Giulia Guidi, Marquita Ellis, Aydin Buluc, Katherine Yelick, David Culler
2020 arXiv   pre-print
Our results show that today's high-end cloud computing can deliver HPC-like performance - at least at modest scales - not only for computationally intensive applications, but also for memory- and communication-intensive  ...  Despite the prolific literature, the question remains open whether cloud computing can provide HPC-competitive performance for a wide range of scientific applications.  ...  Department of Energy Office of Science and the National Nuclear Security Administration. AWS Cloud Credits were provided through the AWS Cloud Credits for Research program.  ... 
arXiv:2011.00656v1 fatcat:kc45ocpm25c7nbpceejvins2gu

Addressing the Complexity of HPC in the Cloud: Emergence, Self-Organisation, Self-Management, and the Separation of Concerns [chapter]

Theo Lynn
2018 Heterogeneity, High Performance Computing, Self-Organization and the Cloud  
Three illustrative application scenarios for HPC in the cloud-(i) oil and gas exploration, (ii) ray tracing, and (iii) genomics-are discussed.  ...  service providers as they conceptualise the next generation of cloud architectures.  ...  A third category of HPC application is data-intensive applications.  ... 
doi:10.1007/978-3-319-76038-4_1 fatcat:mghwrgbdingxbmzz7fbsvlnrfq

Advanced Virtualization Techniques for High Performance Cloud Cyberinfrastructure

Andrew J. Younge, Geoffrey C. Fox
2014 2014 14th IEEE/ACM International Symposium on Cluster, Cloud and Grid Computing  
This is due to the relative scalability, ease of use, advanced user environment customization abilities, and the many novel computing paradigms available for data-intensive applications.  ...  With the advent of virtualization and Infrastructure-as-a-Service (IaaS), the broader scientific computing community is considering the use of clouds for their scientific computing needs.  ...  InfiniBand and MMP interconnects, the backbone of the HPC industry, have largely gone unused in clouds.  ... 
doi:10.1109/ccgrid.2014.93 dblp:conf/ccgrid/YoungeF14 fatcat:hntwcefmcve4fm4hkraduxmao4

IaaS cloud benchmarking

Alexandru Iosup
2013 Proceedings of the 2013 international workshop on Hot topics in cloud services - HotTopiCS '13  
Provisioning & Allocation Policies for IaaS Clouds (Q3) 7. Big Data: Large-Scale Graph Processing (Q4) 8.  ...  Provisioning & Allocation Policies for IaaS Clouds (Q3) 7. Big Data: Large-Scale Graph Processing (Q4) 8.  ... 
doi:10.1145/2462307.2462309 dblp:conf/wosp/Iosup13 fatcat:xtdv2ab4dbbolenkqol7miq2z4

High Performance Computing Clouds [chapter]

Andrzej Goscinski, Michael Brock, Philip Church
2011 Cloud Computing  
Particle accelerators such as synchrotrons and the Large Hadron Collider (LHC) generate large amounts of data.  ...  This saving can be significant when running large-scale distributed applications.  ...  With these weaknesses, running HPC applications on clouds has thought to have been unfeasible [345] . This chapter demonstrates that HPC clouds have a bright and promising feature.  ... 
doi:10.1201/b11149-14 fatcat:7wuwffksnvahvjxmdlop2mcqm4

Understanding the Performance and Potential of Cloud Computing for Scientific Applications

Iman Sadooghi, Jesus Hernandez Martin, Tonglin Li, Kevin Brandstatter, Ketan Maheshwari, Tiago Pais Pitta de Lacerda Ruivo, Gabriele Garzoglio, Steven Timm, Yong Zhao, Ioan Raicu
2017 IEEE Transactions on Cloud Computing  
We also evaluated a real scientific computing application through the Swift parallel scripting system at scale.  ...  Cloud Computing has gained the attention of scientists as a competitive resource to run HPC applications at a potentially lower cost.  ...  Zavala of ANL for power grid application.  ... 
doi:10.1109/tcc.2015.2404821 fatcat:xfrv3mmhozejjogccqdezlg45u

HPC Cloud for Scientific and Business Applications

Marco A. S. Netto, Rodrigo N. Calheiros, Eduardo R. Rodrigues, Renato L. F. Cunha, Rajkumar Buyya
2018 ACM Computing Surveys  
High Performance Computing (HPC) clouds are becoming an alternative to on-premise clusters for executing scientific applications and business analytics services.  ...  Moreover, the discussion on the right pricing and contractual models to fit small and large users is relevant for the sustainability of HPC clouds.  ...  ACKNOWLEDGMENTS We thank the anonymous reviewers for their helpful comments in the preparation of this article. This work has been partially supported by FINEP/MCTI under grant no. 03.14.0062.00.  ... 
doi:10.1145/3150224 fatcat:o76lya7e2nb2tdom54oshgd5qe

A Self-adaptive Auto-scaling Method for Scientific Applications on HPC Environments and Clouds [article]

Kiran Mantripragada and Alecio Binotto and Leonardo P. Tizzei
2015 arXiv   pre-print
In order to meet deadlines, high intensive computational applications can use the Cloud to boost their performance when they are data and task parallel.  ...  The method is exemplified along with a seismic application that, at runtime, adapts itself to move part of the processing to the Cloud (in a movement called bursting) and also auto-scales (the moved part  ...  It focuses on hosting computing intensive industrial and scientific workloads that deal with sensitive and large amounts of data -on demand, but in a private and specialized space.  ... 
arXiv:1412.6392v3 fatcat:qxbbh66yrzh65ivcslojlk64ai

A view of programming scalable data analysis: from clouds to exascale

Domenico Talia
2019 Journal of Cloud Computing: Advances, Systems and Applications  
Scalability is a key feature for big data analysis and machine learning frameworks and for applications that need to analyze very large and real-time data available from data repositories, social media  ...  Scalable big data analysis today can be achieved by parallel implementations that are able to exploit the computing and storage facilities of high performance computing (HPC) systems and clouds, whereas  ...  Availability of data and materials Data sharing not applicable to this article as no datasets were generated or analyzed during the current study.  ... 
doi:10.1186/s13677-019-0127-x fatcat:l5mimqzwibh7fn4fedlsz4jkji

The Who, What, Why, and How of High Performance Computing in the Cloud

Abhishek Gupta, Laxmikant V. Kale, Filippo Gioachin, Verdi March, Chun Hui Suen, Bu-Sung Lee, Paolo Faraboschi, Richard Kaufmann, Dejan Milojicic
2013 2013 IEEE 5th International Conference on Cloud Computing Technology and Science  
In this paper, we take a holistic viewpoint to answer the questionwhy and who should choose cloud for HPC, for what applications, and how should cloud be used for HPC?  ...  To this end, we perform a comprehensive performance evaluation and analysis of a set of benchmarks and complex HPC applications on a range of platforms, varying from supercomputers to clouds.  ...  ACKNOWLEDGMENTS The authors gratefully acknowledge Lavanya Ramakrishnan of US DoE's Magellan project and Robert Schreiber of HP labs for reviewing this paper and providing valuable feedback.  ... 
doi:10.1109/cloudcom.2013.47 dblp:conf/cloudcom/GuptaKGMSLFKM13 fatcat:g26bxhal7fekrkqx3ea52ff2ke

Scalable parallel computing on clouds using Twister4Azure iterative MapReduce

Thilina Gunarathne, Bingjing Zhang, Tak-Lon Wu, Judy Qiu
2013 Future generations computer systems  
Twister4Azure extends the familiar, easy-to-use MapReduce programming model with iterative extensions, enabling a wide array of large-scale iterative data analysis and scientific applications to utilize  ...  Iterative computations are at the core of the vast majority of large scale data intensive computations.  ...  Twister4Azure enables a wide array of large-scale iterative data analysis and data mining applications to utilize the Azure cloud platform in an easy, efficient and fault-tolerant manner.  ... 
doi:10.1016/j.future.2012.05.027 fatcat:7555zbco7rggvhvpvswuvsnteu

A Framework for Data-Intensive Computing with Cloud Bursting

Tekin Bicer, David Chiu, Gagan Agrawal
2011 2011 IEEE International Conference on Cluster Computing  
Our evaluation with three different applications shows that data-intensive computing with cloud bursting is feasible and scalable.  ...  However, as next generation applications are expected to see orders of magnitude increase in data set sizes, cloud resources can be used to store additional data after local resources are exhausted.  ...  RELATED WORK There have been a number of recent efforts focusing on the use of cloud computing for scientific and data-intensive applications.  ... 
doi:10.1109/cluster.2011.21 dblp:conf/cluster/BicerCA11 fatcat:fpowbddez5a5nie3un3nilnoiy
« Previous Showing results 1 — 15 out of 2,018 results