Filters








2,086 Hits in 3.4 sec

Scientific Workflow Applications on Amazon EC2 [article]

Gideon Juve, Ewa Deelman, Karan Vahi, Gaurang Mehta, Bruce Berriman, Benjamin P. Berman, Phil Maechling
2010 arXiv   pre-print
In this paper we examine the performance and cost of clouds from the perspective of scientific workflow applications.  ...  required for scientific applications at a reasonable price.  ...  Execution Environment In this section we describe the experimental setup that was used to run workflows. We ran experiments on Amazon EC2 and NCSA's Abe cluster.  ... 
arXiv:1005.2718v1 fatcat:dyvlknapnvhefpzlraapkdfncy

Early Cloud Experiences with the Kepler Scientific Workflow System

Jianwu Wang, Ilkay Altintas
2012 Procedia Computer Science  
In this paper, we present our preliminary work and experiences on enabling the interaction between the Kepler scientific workflow system and the Amazon Elastic Compute Cloud (EC2).  ...  A set of EC2 actors and Kepler Amazon Machine Images are introduced with the discussion on their different usage modes.  ...  We also thank the AWS in Education Research Grants from Amazon.com, Inc for EC2 usage credit.  ... 
doi:10.1016/j.procs.2012.04.179 fatcat:lp6tu7c7czhpzmgfbji7p334bm

Comparing FutureGrid, Amazon EC2, and Open Science Grid for Scientific Workflows

Gideon Juve, Mats Rynge, Ewa Deelman, Jens-S. Vockler, G. Bruce Berriman
2013 Computing in science & engineering (Print)  
In this paper we describe our experiences modeling the periodogram application as a scientific workflow using Pegasus, and deploying it on the FutureGrid scientific cloud testbed, the Amazon EC2 commercial  ...  Traditionally, scientific workflows have been executed on campus clusters, or grids.  ...  The use of Amazon EC2 resources was supported by an AWS in Education research grant. G. B.  ... 
doi:10.1109/mcse.2013.44 fatcat:loobib3hfbh63l3xuevxdpvyue

DynamicCloudSim: Simulating heterogeneity in computational clouds

Marc Bux, Ulf Leser
2015 Future generations computer systems  
As a validation of the introduced functionality, we simulate the impact of instability on scientific workflow scheduling by assessing and comparing the performance of four schedulers in the course of several  ...  experiments both in simulation and on real cloud infrastructure.  ...  Finally, we validated the models of instability introduced in DynamicCloudSim by comparing the simulated execution of a workflow in DynamicCloudSim against actual runs on Amazon EC2.  ... 
doi:10.1016/j.future.2014.09.007 fatcat:7mzkqlbaonfwnlvhyc4cachuiu

DynamicCloudSim

Marc Bux, Ulf Leser
2013 Proceedings of the 2nd ACM SIGMOD Workshop on Scalable Workflow Execution Engines and Technologies - SWEET '13  
As a validation of the introduced functionality, we simulate the impact of instability on scientific workflow scheduling by assessing and comparing the performance of four schedulers in the course of several  ...  experiments both in simulation and on real cloud infrastructure.  ...  Finally, we validated the models of instability introduced in DynamicCloudSim by comparing the simulated execution of a workflow in DynamicCloudSim against actual runs on Amazon EC2.  ... 
doi:10.1145/2499896.2499897 dblp:conf/sigmod/BuxL13 fatcat:untycaebkrg27jleqzq3uuung4

Rapid 3D Seismic Source Inversion Using Windows Azure and Amazon EC2

Vedaprakash Subramanian, Hongyi Ma, Liqiang Wang, En-Jui Lee, Po Chen
2011 2011 IEEE World Congress on Services  
This paper presents our experience on designing and implementing seismic source inversion on both cluster (specifically, MPI-based) and cloud computing (specifically, Amazon EC2 and Microsoft Windows Azure  ...  Cloud computing is suited for real-time processing scientific applications but it (especially Azure) does not work well for tightly-coupled applications.  ...  Juve et al. study the performance of Amazon EC2 cloud for a memory-intensive seismic application [5] .  ... 
doi:10.1109/services.2011.90 dblp:conf/services/SubramanianMWLC11 fatcat:euwfiuctu5bq7buikf3hxf5ysq

Data Sharing Options for Scientific Workflows on Amazon EC2

Gideon Juve, Ewa Deelman, Karan Vahi, Gaurang Mehta, Bruce Berriman, Benjamin P. Berman, Phil Maechling
2010 2010 ACM/IEEE International Conference for High Performance Computing, Networking, Storage and Analysis  
We ran experiments using three typical workflow applications on Amazon's EC2.  ...  Workflow applications typically communicate data between tasks using files.  ...  using five different storage systems on Amazon EC2. • An analysis of the cost of running workflows with different storage systems on Amazon EC2.  ... 
doi:10.1109/sc.2010.17 dblp:conf/sc/JuveDVMBBM10 fatcat:iye43g47xzcqnhzyb44nirsibq

Data Sharing Options for Scientific Workflows on Amazon EC2 [article]

Gideon Juve, Ewa Deelman, Karan Vahi, Gaurang Mehta, Bruce Berriman, Benjamin P. Berman, Phil Maechling
2010 arXiv   pre-print
We ran experiments using three typical workflow applications on Amazon's EC2.  ...  Workflow applications typically communicate data between tasks using files.  ...  using five different storage systems on Amazon EC2.  An analysis of the cost of running workflows with different storage systems on Amazon EC2.  ... 
arXiv:1010.4822v1 fatcat:6oaurxdifrd7zgsaotxay6jy7m

Scheduling Multilevel Deadline-Constrained Scientific Workflows on Clouds Based on Cost Optimization

Maciej Malawski, Kamil Figiela, Marian Bubak, Ewa Deelman, Jarek Nabrzyski
2015 Scientific Programming  
, executed on Amazon EC2 cloud.  ...  This paper presents a cost optimization model for scheduling scientific workflows on IaaS clouds such as Amazon EC2 or RackSpace.  ...  Access to Amazon EC2 was provided via the AWS in Education Grant.  ... 
doi:10.1155/2015/680271 fatcat:ep33dzb75na5tpzde2fnxcrgkq

An Evaluation of the Cost and Performance of Scientific Workflows on Amazon EC2

Gideon Juve, Ewa Deelman, G. Bruce Berriman, Benjamin P. Berman, Philip Maechling
2012 Journal of Grid Computing  
We ran experiments using three typical workflow applications on Amazon's EC2 cloud computing platform.  ...  Workflows are used to orchestrate dataintensive applications in many different scientific domains. Workflow applications typically communicate data between processing steps using intermediate files.  ...  using six different storage configurations on Amazon EC2. • An analysis of the cost of running workflows with different storage systems on Amazon EC2.  ... 
doi:10.1007/s10723-012-9207-6 fatcat:ckwaunvz2ncexkptp7emslekge

The Application of Cloud Computing to Astronomy: A Study of Cost and Performance [article]

G. Bruce Berriman, Ewa Deelman, Gideon Juve, Moira Regelson, Peter Plavchan
2010 arXiv   pre-print
We have used three workflow applications to compare the performance of processing data on the Amazon EC2 cloud with the performance on the Abe high-performance cluster at the National Center for Supercomputing  ...  We show that the Amazon EC2 cloud offers better performance and value for processor- and memory-limited applications than for I/O-bound applications.  ...  Goals of This Study Our goal is to determine which types of scientific workflow applications are cheaply and efficiently run on the Amazon EC2 cloud (hereafter, AmEC2).  ... 
arXiv:1010.4813v1 fatcat:6j2l7c2d7zcg5jodnyed52sqla

Workflow Scheduling with Amazon EC2 Spot Instances: Building Reliable Compute Environments

Altino M. Sampaio, CIICESI, Escola Superior de Tecnologia e Gestão, Instituto Politécnico do Porto, Felgueiras, Portugal, Jorge G. Barbosa
2020 International Journal of Machine Learning and Computing  
The results show that our solution is able to build reliable virtual compute environments on top of EC2 on-demand-, spot block, and SI purchasing models, and successfully conclude submitted workflow applications  ...  Amazon Elastic Compute Cloud (EC2) gives access to resources in the form of instances.  ...  Workflow Application Model Users submit scientific workflow applications that are expressed as DAGs.  ... 
doi:10.18178/ijmlc.2020.10.1.911 fatcat:7xqcd2ovgngh5gja6pqjb3bbly

Scientific Workflows in the Cloud [chapter]

Gideon Juve, Ewa Deelman
2011 Grids, Clouds and Virtualization  
We describe how clouds can be configured to execute workflow tasks, and present a case study that examines the performance and cost of three typical workflow applications on Amazon EC2.  ...  In this chapter we consider the impact of cloud computing on scientific workflow applications.  ...  Case Study: Scientific Workflows on Amazon EC2 To illustrate how clouds can be used for workflow applications we present a case study using Amazon's EC2 [1] cloud.  ... 
doi:10.1007/978-0-85729-049-6_4 fatcat:423wdzax3jejtljpzjhcwhi27i

Bringing Scientific Workflows to Amazon SWF

Matthias Janetschek, Simon Ostermann, Radu Prodan
2013 2013 39th Euromicro Conference on Software Engineering and Advanced Applications  
We present in this paper a software engineering solution that allows the scientific workflow community access the Amazon Cloud through one single frontend converter, and propose a legacy wrapper service  ...  In response to the ever-increasing needs of scientific applications for resources, Cloud computing emerged as an alternative on-demand and cost-effective resource provisioning approach.  ...  In this paper, we show how the IWIR-based approach opens the Amazon EC2 infrastructure and its SWF workflow system to the scientific community through one single IWIR-to-SWF translator.  ... 
doi:10.1109/seaa.2013.13 dblp:conf/euromicro/Janetschek0P13 fatcat:cfo6xwcpcrdbphg2gvtuk2gmxa

Uncovering the Perfect Place: Optimising Workflow Engine Deployment in the Cloud [article]

Michael Luckeneder, Adam Barker
2014 arXiv   pre-print
We present CloudForecast: a Web service framework and analysis tool which, given a workflow specification, computes the optimal Amazon EC2 Cloud region to automatically deploy the orchestration engine  ...  Our experimental results show that our proposed optimisation strategy, depending on the particular workflow, can speed up execution time on average by 82.25% compared to local execution.  ...  Amazon EC2 regions) that should be considered for workflow execution.  ... 
arXiv:1410.5976v1 fatcat:bimhhseo55dkhle5pwl6js74ny
« Previous Showing results 1 — 15 out of 2,086 results