15,492 Hits in 5.1 sec

Balanced Task Clustering in Scientific Workflows

Weiwei Chen, Rafael Ferreira Da Silva, Ewa Deelman, Rizos Sakellariou
2013 2013 IEEE 9th International Conference on e-Science  
Scientific workflows can be composed of many fine computational granularity tasks.  ...  In our work, we examine the reasons that cause Runtime Imbalance and Dependency Imbalance in task clustering.  ...  In a scientific workflow, tasks within a level may have different runtimes.  ... 
doi:10.1109/escience.2013.40 dblp:conf/eScience/ChenSDS13 fatcat:toalut75wndhhp3de5rovssm7u

Hybrid Balanced Task Clustering Algorithm for Scientific Workflows in Cloud Computing

Avinash Kaur, Pooja Gupta, Manpreet Singh
2019 Scalable Computing : Practice and Experience  
We propose hybrid balanced task clustering algorithm that uses the parameter of impact factor of workflows along with the structure of workflow.  ...  However available task clustering methods involve clustering the tasks horizontally without the consideration of the structure of tasks in a workflow.  ...  Merging clusters into a job Hybrid Balanced Task Clustering Algorithm for Scientific Workflows in Cloud Computing 247 4. 2 . 2472 Pseudocode for Hybrid Balanced clustering algorithm (HYB).  ... 
doi:10.12694/scpe.v20i2.1515 fatcat:tciwop35vzh4na2jt3ajmwtcti

Imbalance optimization in scientific workflows

Weiwei Chen, Ewa Deelman, Rizos Sakellariou
2013 Proceedings of the 27th international ACM conference on International conference on supercomputing - ICS '13  
Finally, we study a wide range of real scientific workflows to generalize the relationship between these metrics and balancing methods.  ...  Task clustering is a runtime optimization technique that merges multiple short workflow tasks into a single job such that the job execution overhead is reduced and the overall runtime performance of the  ...  In [1] [3] , task clustering strategies use structural information of the workflows to develop algorithms to iterate through the nodes, for example, horizontal clustering that merges tasks at the same  ... 
doi:10.1145/2464996.2467270 dblp:conf/ics/ChenDS13 fatcat:lgmj7kkpurgqjka2wpnkjly6pm

Coupling Factor and Cost Based Task Clustering Method to Optimize Task Clustering For Scientific Workflows in Cloud Environment

2019 International Journal of Engineering and Advanced Technology  
Scientific workflows are large scale loosely coupled submissions that are used by Computational Scientists.  ...  In this work two task clustering ideas were proposed namely Horizontal Coupling Factor (HCF) based clustering and Horizontal Processing Cost (HPC) based Task Clustering.  ...  Scientific workflows are collection of dependent and inter-dependent tasks and these scientific workflows consists of many computational tasks with dependencies among them and they are of short running  ... 
doi:10.35940/ijeat.f9288.088619 fatcat:izkyq2swpvbi7fumnjtesievfu

Using imbalance metrics to optimize task clustering in scientific workflow executions

Weiwei Chen, Rafael Ferreira da Silva, Ewa Deelman, Rizos Sakellariou
2015 Future generations computer systems  
Keywords: Scientific workflows, Performance analysis, Scheduling, Workflow simulation, Task clustering, Load balancing 1.  ...  Furthermore, we propose a series of task balancing methods (horizontal and vertical) to address the load balance problem when performing task clustering for five widely used scientific workflows.  ... 
doi:10.1016/j.future.2014.09.014 fatcat:3wmkdt7h45fyvfe6hc4nrbkila

A Physical and Virtual Compute Cluster Resource Load Balancing Approach to Data-Parallel Scientific Workflow Scheduling

Jianwu Wang, Prakashan Korambath, Ilkay Altintas
2011 2011 IEEE World Congress on Services  
Keywords-data-parallel workflow scheduling, virtual cluster, load balancing, cluster resource manager comparison I. IEEE World Congress on Services 978-0-7695-4461-8/11 $26.00  ...  To execute workflows on a compute cluster resource, workflow engines can work with cluster resource manager software to distribute jobs into compute nodes on the cluster.  ...  In our approach, jobs in different tasks are managed by the same job scheduler to achieve overall load balancing on distributed nodes.  ... 
doi:10.1109/services.2011.50 dblp:conf/services/WangKA11 fatcat:mcqf4ft73jckxdgzmjfwqxkwpy

Extended Balanced Scheduler with Clustering and Rep- lication for Data Intensive Scientific Workflow Applications in Cloud Computing

Satwinder Kaur, Mehak Aggarwal
2018 Journal of Electronic Research and Application  
If multiple fine grain task are executing in scientific workflow, it increase the scheduling overhead.  ...  As scientific workflow is combination of fine grain and coarse grain task. Every task scheduled to VM has system overhead.  ...  Scientific Workflow Management System To perform execution of computational tasks in cloud environment the scientific workflow management system.  ... 
doi:10.26689/jera.v2i3.380 fatcat:usn3jr4sfvfjdnivefitvnnse4

Improving Many-Task computing in scientific workflows using P2P techniques

Jonas Dias, Eduardo Ogasawara, Daniel de Oliveira, Esther Pacitti, Marta Mattoso
2010 2010 3rd Workshop on Many-Task Computing on Grids and Supercomputers  
In this paper, we propose Heracles, an approach to apply consolidated P2P techniques to improve Many-Task computing of workflow activities on large clusters.  ...  Large-scale scientific experiments are usually supported by scientific workflows that may demand high performance computing infrastructure.  ...  This paper proposes Heracles, an approach that uses P2P techniques to address many-task computing in scientific workflows on huge clusters such as a petascale supercomputer.  ... 
doi:10.1109/mtags.2010.5699430 dblp:conf/sc/DiasO0PM10 fatcat:bjilkiz6tnasrf744ejrnzfwqy

Fault-Tolerant and Data-Intensive Resource Scheduling and Management for Scientific Applications in Cloud Computing

Zulfiqar Ahmad, Ali Imran Jehangiri, Mohammed Alaa Ala'anzy, Mohamed Othman, Arif Iqbal Umar
2021 Sensors  
The CFD strategy addresses the data intensiveness of tasks of scientific workflows with cluster-based, fault-tolerant mechanisms.  ...  These characteristics include the tasks of scientific workflows that are executed in terms of integration, disintegration, pipeline, and parallelism, and thus require special attention to task management  ...  Acknowledgments: The authors gratefully acknowledge the Ministry of Higher Education Malaysia for in partial financial support through the Fundamental Research Grant Scheme with reference code FRGS/1/2018  ... 
doi:10.3390/s21217238 pmid:34770545 pmcid:PMC8587021 fatcat:u53ocebfavfgnog7rwdkwdwz4e

Community Resources for Enabling Research in Distributed Scientific Workflows

Rafael Ferreira da Silva, Weiwei Chen, Gideon Juve, Karan Vahi, Ewa Deelman
2014 2014 IEEE 10th International Conference on e-Science  
In this paper we describe a collection of tools and data that have enabled research in new techniques, algorithms, and systems for scientific workflows.  ...  A significant amount of recent research in scientific workflows aims to develop new techniques, algorithms and systems that can overcome the challenges of efficient and robust execution of ever larger  ...  task clustering in scientific workflows [24] , [26] .  ... 
doi:10.1109/escience.2014.44 dblp:conf/eScience/SilvaCJVD14 fatcat:bnmiqfstnrbpzavs52aklwj5ju

Multiobjective Level-Wise Scientific Workflow Optimization in IaaS Public Cloud Environment

Phyo Thandar Thant, Courtney Powell, Martin Schlueter, Masaharu Munetomo
2017 Scientific Programming  
Further, balanced task assignment to the virtual machine instances at each level of the workflow is also considered.  ...  In this paper, we conduct scientific workflow optimization on three perspectives: makespan minimization, virtual machine deployment cost minimization, and virtual machine failure minimization in the cloud  ...  Figure 4 shows the task clustering for balanced task assignment process. There are two stages for balanced clustering: (1) task sorting and (2) balanced clustering.  ... 
doi:10.1155/2017/5342727 fatcat:hcxby47e7jcwla4z4qujqgn2j4

A Survey on Data Placement Strategies for Cloud based Scientific Workflows

Lalitha Singh, Jyoti Malhotra
2016 International Journal of Computer Applications  
The ideal data placement scheme optimizes the execution of the data intensive scientific workflows in cloud by assigning the tasks to the execution site in such a way that the file transfers and the cost  ...  Scientific workflows perform computations exceeding single workstation's capabilities.  ...  Scientific workflows were executed on different platforms such as Clusters and Grids [3] [4] .  ... 
doi:10.5120/ijca2016909651 fatcat:a65624d6tbfcjmi2abjabydyti

E-HEFT: Enhancement Heterogeneous Earliest Finish Time algorithm for Task Scheduling based on Load Balancing in Cloud Computing

Yassir Samadi, Mostapha Zbakh, Claude Tadonki
2018 2018 International Conference on High Performance Computing & Simulation (HPCS)  
However, there are various issues that need to be addressed in order to be efficiently utilized for workflow applications.  ...  One of the fundamental issues in cloud computing is related to task scheduling.  ...  Index Terms-scientific workflows; task scheduling; data dependency; cloud computing; load balancing I.  ... 
doi:10.1109/hpcs.2018.00100 dblp:conf/ieeehpcs/SamadiZT18 fatcat:wovrgfybe5daxk463uixah7wuq

A Survey of Data-Intensive Scientific Workflow Management

Ji Liu, Esther Pacitti, Patrick Valduriez, Marta Mattoso
2015 Journal of Grid Computing  
This paper provides a survey of data-intensive scientific workflow management in SWfMSs and their parallelization techniques.  ...  Finally, we identify research issues for improving the execution of data-intensive scientific workflows in a multisite cloud.  ...  [23] present a balanced task clustering approach for scientific workflow execution. They cluster the tasks by balancing total execution of each bag of task.  ... 
doi:10.1007/s10723-015-9329-8 fatcat:5urst5aphjftbli3pukmnbutri

Enabling scalable scientific workflow management in the Cloud

Yong Zhao, Youfu Li, Ioan Raicu, Shiyong Lu, Wenhong Tian, Heng Liu
2015 Future generations computer systems  
to support the execution of large-scale scientific workflows in the Cloud.  ...  Then, we present the key challenges in supporting Cloud workflows, and present our reference framework for scientific workflow management in the Cloud.  ...  Load balancing: We are also integrating work stealing strategy in the task scheduling framework that can improve workflow task scheduling efficiency and load balance.  ... 
doi:10.1016/j.future.2014.10.023 fatcat:myqbnunkk5dmdml4stdgvedk2y
« Previous Showing results 1 — 15 out of 15,492 results