379 Hits in 9.0 sec

Asterism: Pegasus and Dispel4py Hybrid Workflows for Data-Intensive Science

Rosa Filgueira, Rafael Ferreira da Silva, Amrey Krause, Ewa Deelman, Malcolm Atkinson
2016 2016 Seventh International Workshop on Data-Intensive Computing in the Clouds (DataCloud)  
We also present the Data-Intensive workflows as a Service (DIaaS) model, which enables easy dataintensive workflow composition and deployment on clouds using containers.  ...  Keywords Data-Intensive science, scientific workflows, stream-based system, deployment and reusability of execution environments  ...  We thank the NSF Chameleon Cloud for providing time grants to access their resources.  ... 
doi:10.1109/datacloud.2016.004 dblp:conf/sc/FilgueiraSKDA16 fatcat:efpt66w6tnho3p7a3j6eoqejva

Grids and Clouds: Making Workflow Applications Work in Heterogeneous Distributed Environments

Ewa Deelman
2009 The international journal of high performance computing applications  
Although clouds were first introduced in the business arena, they have a potential to be provide ondemand resources for scientific computations.  ...  In this paper we describe some of these applications and illustrate techniques that improve their performance and reliably in distributed environments, such as grids and clouds.  ...  At the ISI, she is leading the Pegasus project, which designs and implements workflow mapping techniques for large-scale workflows running in distributed environments.  ... 
doi:10.1177/1094342009356432 fatcat:dielha3lpnftzcrp6y7ykwjqaq

Executing cyclic scientific workflows in the cloud

Michel Krämer, Hendrik M. Würz, Christian Altenhofen
2021 Journal of Cloud Computing: Advances, Systems and Applications  
Our software architecture distributes the process chains to multiple compute nodes in the cloud and oversees their execution.  ...  In contrast, our system supports cycles natively, avoids workarounds, and as such reduces the complexity of workflow modelling and maintenance.  ...  /California Institute of Technology, funded by the National Aeronautics and Space Administration and the National Science Foundation.  ... 
doi:10.1186/s13677-021-00229-7 fatcat:ogzdrrdidza6zols2yb5sg3fsq

Experiences using cloud computing for a scientific workflow application

Jens-Sönke Vöckler, Gideon Juve, Ewa Deelman, Mats Rynge, Bruce Berriman
2011 Proceedings of the 2nd international workshop on Scientific cloud computing - ScienceCloud '11  
This workflow was deployed across multiple clouds using the Pegasus Workflow Management System. The clouds used include several sites within the FutureGrid, NERSC's Magellan cloud, and Amazon EC2.  ...  Clouds are rapidly becoming an important platform for scientific applications. In this paper we describe our experiences running a scientific workflow application in the cloud.  ...  We suspect this signal to be partly responsible for problems determining the proper count of J.EXECUTE. Running the workflow through Pegasus provides us with retries in case of job failures.  ... 
doi:10.1145/1996109.1996114 fatcat:xaldzcbzrjdvzob4qjglgufkvq

Scientific Workflows in the Cloud [chapter]

Gideon Juve, Ewa Deelman
2011 Grids, Clouds and Virtualization  
Finally, we identify several areas in which existing clouds can be improved and discuss the future of workflows in the cloud.  ...  We examine the benefits and drawbacks of cloud computing for workflows, and argue that the primary benefit of cloud computing is not the economic model it promotes, but rather the technologies it employs  ...  Deploying Workflows in the Cloud Workflow Management Systems such as Pegasus WMS [40, 16] , plan, execute, and monitor scientific workflows.  ... 
doi:10.1007/978-0-85729-049-6_4 fatcat:423wdzax3jejtljpzjhcwhi27i

Workflow Engine for Clouds [chapter]

Suraj Pandey, Dileban Karunamoorthy, Rajkumar Buyya
2011 Cloud Computing  
The recent progress in virtualization technologies and the rapid growth of cloud computing services have opened a new paradigm in distributed computing for utilizing existing (and often cheaper) resource  ...  Scientific Workflow Management Systems (WfMS) need to adapt to this new paradigm in order to leverage the benefits of cloud services.  ...  We would like to thank Christian Vecchiola from University of Melbourne for his help in defining the EMO application. We also thank Adam Barker for reviewing and providing feedback on this chapter.  ... 
doi:10.1002/9780470940105.ch12 fatcat:kamkdhtdazfzng2tmnibma72pq

Enhanced Resource Provisioning Strategies for Scientific Workflows in Cloud Environment: A Survey

S. Sridevi, Jeevaa Katiravan
2018 International Journal of Computer Applications  
The on-demand provisioning and resource availability in cloud computing make it ideal for executing scientific workflow applications. To ensure better performance, there is a need for auto-scaling.  ...  This survey presents the existing auto-scaling techniques and metaheuristics approaches for VM placements of cloud workflows.  ...  The IWD is a population based algorithm proposed by Shah-Hosseini in 2007 for solving combinatorial problems. The IWD algorithm mimics the dynamics of river system and the  ... 
doi:10.5120/ijca2018917097 fatcat:sbdiqpmbxvd6njvdg6xwyeu7iu

Comparison of Workflow Scheduling Algorithms in Cloud Computing

Navjot Kaur, Taranjit Singh, Rajbir Singh
2011 International Journal of Advanced Computer Science and Applications  
Cloud computing has gained popularity in recent times.  ...  The main aim of my work is to study various problems, issues and types of scheduling algorithms for cloud workflows as well as on designing new workflow algorithms for cloud Workflow management system.  ...  The representation of a workflow process in a form which supports automated manipulation. 3) Workflow Interoperability.  ... 
doi:10.14569/ijacsa.2011.021013 fatcat:hbrw6mxjrrhidmhyukchuug36q

A Cloud-aware Autonomous Workflow Engine and Its Application to Gene Regulatory Networks Inference

Arnaud Bonnaffoux, Eddy Caron, Hadrien Croubois, Olivier Gandrillon
2018 Proceedings of the 8th International Conference on Cloud Computing and Services Science  
As a proof of concept we validate our solution through a biologic application with the WASABI workflow.  ...  Notably, combining the workflow representation of complex scientific applications with the dynamic allocation of resources in a Cloud environment is still a major challenge.  ...  While our middleware is not based on the Pegasus engine, for the sake of clarity, our inputs file are compliant with the well-known Pegasus workflow syntax.  ... 
doi:10.5220/0006772805090516 dblp:conf/closer/BonnaffouxCCG18 fatcat:dmdf6otbrfgubjqifdlctagk74

SwinDeW-C: A Peer-to-Peer Based Cloud Workflow System [chapter]

Xiao Liu, Dong Yuan, Gaofeng Zhang, Jinjun Chen, Yun Yang
2010 Handbook of Cloud Computing  
Therefore, the investigation of workflow systems based on cloud computing, i.e. cloud workflow systems, is a timely issue and worthwhile for increasing efforts.  ...  Through those super nodes which maintain all the necessary information about the neighbouring nodes, workflow management tasks can be effectively executed where data and control messages are transmitted  ...  The CROWN Node is also connected to some other nodes such as those at the Hong Kong University of Science and Technology, and at the University of Leeds in the UK.  ... 
doi:10.1007/978-1-4419-6524-0_13 fatcat:y6zhcdh3b5f6hj6yjfgctmjhza

A Survey on Deadline Constrained Workflow Scheduling Algorithms in Cloud Environment [article]

Nallakumar R., Sruthi Priya K.S
2014 arXiv   pre-print
Cloud Computing is the latest blooming technology in the era of Computer Science and Information Technology domain.  ...  There are several algorithms to automate the workflows in a way to satisfy the Quality of service (QoS) of the user among which deadline is considered as a major criterion, i.e.  ...  Various new features rendered by Cloud Computing enables the efficient automation and execution of workflows.  ... 
arXiv:1409.7916v1 fatcat:asgsm22hejgylexfg2tfogjzry

A Taxonomy and Survey on eScience as a Service in the Cloud [article]

Amelie Chi Zhou, Bingsheng He, Shadi Ibrahim
2014 arXiv   pre-print
In particular, we introduce a taxonomy specifically designed for scientific computing in the cloud, and further review the taxonomy with four major kinds of science applications, including life sciences  ...  We review recent efforts in developing and deploying scientific computing applications in the cloud.  ...  Different applications owners have to redundantly deploy and In the Life science project MassMatrix [58] , the authors used the Pegasus Workflow Management System (WMS) to create parallel workflows for  ... 
arXiv:1407.7360v1 fatcat:doofgetfezel3f6glfkjluxqta

Developing Use Cases and State Transition Models for Effective Protection of Electronic Health Records (EHRs) in Cloud

V.M.Prabha karan, Prof.S.Bala murugan, S.Chara nyaa
2015 International Journal of Innovative Research in Computer and Communication Engineering  
Cloud storage service is accessed through the cloud computer service, web service application programming interface or by a cloud storage gateway.  ...  In this paper, the issue of outsourcing of data in cloud is addressed by the method of key generation for cloud user.  ...  Pegasus also automates the job of replica selection so that the user does not have to specify the location of input data files.  ... 
doi:10.15680/ijircce.2015.0301029 fatcat:ecr5p5audnbgjcitkzxoudqow4

Workflow-as-a-Service Cloud Platform and Deployment of Bioinformatics Workflow Applications [article]

Muhammad H. Hilman, Maria A. Rodriguez, Rajkumar Buyya
2020 arXiv   pre-print
This concept drives the existing WMS technology to evolve towards the development of the WaaS cloud platform.  ...  Workflow management systems (WMS) support the composition and deployment of workflow-oriented applications in distributed computing environments.  ...  A lightweight WMS, HyperFlow [10] is a computational model, programming approach, and also a workflow engine for scientific workflows from AGH University of Science and Technology, Poland.  ... 
arXiv:2006.01957v1 fatcat:z5paewg2mrgdxnkqvcsvu3gzmu

Optimization Patterns for the Decentralized Orchestration of Parameter-Sweep Workflows

Selim Kalayci, S. Masoud Sadjadi
2014 2014 International Conference on Cloud and Autonomic Computing  
Through the usage of generic workflow patterns, centralized orchestration of workflows are transformed into decentralized and adaptive orchestration without modifying the business logic of the workflow  ...  In our previous studies, we have designed and developed techniques to orchestrate the execution of large-scale workflows in a decentralized and adaptive manner.  ...  ACKNOWLEDGMENT This material is based upon work supported by the National Science Foundation under Grant No. OISE-0730065.  ... 
doi:10.1109/iccac.2014.28 dblp:conf/iccac/KalayciS14 fatcat:drbxzl2gzbgsvk4e3l7bh4j6a4
« Previous Showing results 1 — 15 out of 379 results