Filters








1,786 Hits in 8.5 sec

Exploring Trade-offs in Dynamic Task Triggering for Loosely Coupled Scientific Workflows [article]

Zhe Wang, Pradeep Subedi, Shaohua Duan, Yubo Qin, Philip Davis, Anthony Simonet, Ivan Rodero, Manish Parashar
2020 arXiv   pre-print
In order to achieve near-time insights, scientific workflows tend to be organized in a flexible and dynamic way.  ...  Data-driven triggering of tasks has been explored as a way to support workflows that evolve based on the data.  ...  ACKNOWLEDGEMENTS The research presented in this paper is supported by the U.S. Department of Energy, Office of Science, Office of Advanced Scientific Computing Research, Scientific Discovery through  ... 
arXiv:2004.10381v1 fatcat:7jf3lcczpbbnbcpqigggj5ibsq

The Systematic Study of Scientific Workflows in Distributed and Cloud Environments: A Review of Privacy Issues in Workflow Provenance, Challenges and Opportunities

Shridevi Erayya
2018 International Journal of Computer Applications  
This paper discusses the i) Workflow lifecycle and challenges ii) Research issues in provenance for the scientific workflows.  ...  At the end the paper discusses about the challenging task related to increasing number of workflows in the cloud environment is that managing various workflows, VMs & workflow execution on VM instances  ...   Taverna: It provides loosely coupled, transparent platform for the scientists to perform data intensive in-silico [5] experiments.  ... 
doi:10.5120/ijca2018916696 fatcat:7ctw576kvvfjlilhmk5loxsg5q

The future of scientific workflows

Ewa Deelman, Tom Peterka, Ilkay Altintas, Christopher D Carothers, Kerstin Kleese van Dam, Kenneth Moreland, Manish Parashar, Lavanya Ramakrishnan, Michela Taufer, Jeffrey Vetter
2017 The international journal of high performance computing applications  
of emerging extreme-scale computing systems on those workflows, and to develop requirements for automated workflow management in future and existing environments.  ...  The success of a scientific mission often hinges on the computer automation of these workflows.  ...  Acknowledgments The authors would like to thank all workshop participants for their contributions: Greg Abram, Gagan Agrawal, James  ... 
doi:10.1177/1094342017704893 fatcat:wkqlq7kzlnfx7acppift6ot4u4

PaDaWAn

Julien Capul, Sébastien Morais, Jacques-Bernard Lekien
2018 Proceedings of the Workshop on In Situ Infrastructures for Enabling Extreme-Scale Analysis and Visualization - ISAV '18  
It provides services for in-memory data exchange between applications and a simple configuration model to switch from a file-based workflow to a loosely coupled in situ workflow.  ...  This paper presents PaDaWAn, an infrastructure written in Python to provide loosely coupled in situ capabilities to accelerate filebased simulation workflows.  ...  INTRODUCTION In this paper we describe PaDaWAn (for Parallel Data Workflow for Analysis), an experimental infrastructure written in Python to provide loosely coupled in situ workflow capabilities.  ... 
doi:10.1145/3281464.3281470 dblp:conf/sc/CapulML18 fatcat:7z2z6o5b5vg2liw2u5xkhosgea

A Remote Sensing Application Workflow and Its Implementation in Remote Sensing Service Grid Node [chapter]

Ying Luo, Yong Xue, Chaolin Wu, Yincui Hu, Jianping Guo, Wei Wan, Lei Zheng, Guoyin Cai, Shaobo Zhong, Zhengfang Wang
2006 Lecture Notes in Computer Science  
In this article we describe a remote sensing application workflow in building a Remote Sensing Information Analysis and Service Grid Node at Institute of Remote Sensing Applications based on the Condor  ...  Implementing it we use workflow technology to manage the node, control resources, and make traditional algorithms as a Grid service.  ...  Only when the task is large enough, or on the user's request, the node triggers off the super computer to do a large sub-task.  ... 
doi:10.1007/11758501_42 fatcat:fuz3owstaneu7cvnfax7tao734

Roadmap to the multidisciplinary design analysis and optimisation of wind energy systems

S Sanchez Perez-Moreno, M B Zaaijer, C L Bottasso, K Dykes, K O Merz, P-E Réthoré, F Zahle
2016 Journal of Physics, Conference Series  
As a group of researchers closely collaborating within the International Energy Agency (IEA) Wind Task 37 for Wind Energy Systems Engineering: Integrated Research, Design and Development, we have identified  ...  This roadmap comprises 17 research questions and activities recognised to belong to three research directions: model fidelity, system scope and workflow architecture.  ...  Acknowledgements This work has been partially supported by the Mexican Council for Science and Technology (CONACYT).  ... 
doi:10.1088/1742-6596/753/6/062011 fatcat:4dn3ixs6nzarzmx3a56g6sinde

Integrating Abstractions to Enhance the Execution of Distributed Applications [article]

Matteo Turilli, Feng Liu, Zhao Zhang, Andre Merzky, Michael Wilde, Jon Weissman, Daniel S. Katz, Shantenu Jha
2016 arXiv   pre-print
In part, this is due to a poor understanding of the general properties and performance of the coupling between applications and dynamic resources.  ...  The middleware provides a platform that can specify distributed applications, execute them on multiple resource and for different configurations, and is instrumented to support investigative analysis.  ...  their performance trade offs.  ... 
arXiv:1504.04720v2 fatcat:tb7p5uxprfcr3drddkgfvirjgi

A Collaboration Model for Community-Based Software Development with Social Machines

Dave Murray-Rust, Ognjen Scekic, Petros Papapanagiotou, Hong-Linh Truong, Dave Roberston, Schahram Dustdar
2015 EAI Endorsed Transactions on Collaborative Computing  
Today's crowdsourcing systems are predominantly used for processing independent tasks with simplistic coordination.  ...  In this paper we present models and techniques for coordination of human workers in crowdsourced software development environments.  ...  Social Compute Unit (SCU) An SCU [8] is a loosely-coupled virtual team of sociallyconnected experts with skills in the relevant domain. The SCU is created upon request to solve a given task.  ... 
doi:10.4108/eai.17-12-2015.150812 fatcat:3foa3otwizf2hga3addmufw344

A Collaboration Model for Community-Based Software Development with Social Machines

Dave Murray-Rust, Ognjen Scekic, Hong-Linh Truong, Dave Robertson, Schahram Dustdar
2014 Proceedings of the 10th IEEE International Conference on Collaborative Computing: Networking, Applications and Worksharing  
Today's crowdsourcing systems are predominantly used for processing independent tasks with simplistic coordination.  ...  In this paper we present models and techniques for coordination of human workers in crowdsourced software development environments.  ...  Social Compute Unit (SCU) An SCU [8] is a loosely-coupled virtual team of sociallyconnected experts with skills in the relevant domain. The SCU is created upon request to solve a given task.  ... 
doi:10.4108/icst.collaboratecom.2014.257245 dblp:conf/colcom/Murray-RustSTRD14 fatcat:kq77stvx4zhf7igvcfjfefvzky

Exaflop/s: The why and the how

David E. Keyes
2011 Comptes rendus. Mecanique  
Drawing on vendor projections and experiences with scientific codes on contemporary platforms, we outline the challenges and propose roles and essential adaptations for mathematical modelers in one of  ...  Many scientific and engineering applications force the modeling community to attempt to scale this summit.  ...  Also, stability theory for loose coupling of nonlinear problems is incomplete, at best.  ... 
doi:10.1016/j.crme.2010.11.002 fatcat:go2cav7yi5elxigo6va65ccswq

A FRAMEWORK FOR DYNAMIC SEMANTIC WEB SERVICES MANAGEMENT

RANDY HOWARD, LARRY KERSCHBERG
2004 International Journal of Cooperative Information Systems  
What is needed is a comprehensive and overarching framework that handles the processing and workflow requirements of Virtual Organizations, maps them to a collection of service-oriented tasks, dynamically  ...  The goal is to add semantics to Web services to endow them with capabilities needed for their successful deployment in future systems.  ...  This work was also supported in part by the Advanced Research and Development Activity (ARDA).  ... 
doi:10.1142/s0218843004001024 fatcat:mnvageg67ngq3pofin6smqpq6m

Introducing distributed dynamic data-intensive (D3) science: Understanding applications and infrastructure

Shantenu Jha, Daniel S. Katz, Andre Luckow, Neil Chue Hong, Omer Rana, Yogesh Simmhan
2017 Concurrency and Computation  
in support of applications.  ...  The characteristics, requirements, and software systems for the analysis of large volumes of dynamic, distributed and data intensive have however received relatively less.  ...  Trade-offs exists between the cost/challenges in distributing data versus I/O saturation or memory bottlenecks.  ... 
doi:10.1002/cpe.4032 fatcat:4cwhp5kgojc2hfftidamig72zy

Introducing Distributed Dynamic Data-intensive (D3) Science: Understanding Applications and Infrastructure [article]

Shantenu Jha, Daniel S. Katz, Andre Luckow, Omer Rana, Yogesh Simmhan, Neil Chue Hong
2016 arXiv   pre-print
While "static" data applications have received significant attention, the characteristics, requirements, and software systems for the analysis of large volumes of dynamic, distributed data, and data-intensive  ...  This paper surveys several representative dynamic distributed data-intensive application scenarios, provides a common conceptual framework to understand them, and examines the infrastructure used in support  ...  We thank Simon Dobson, Jon Weissman and Jon Blower for useful initial discussions, as well as 3DPAS workshop attendees.  ... 
arXiv:1609.03647v1 fatcat:jpu4s2d3nfg3hntaagekozjv2m

Analyzing runtime adaptability of collaboration patterns

Christoph Dorn, Richard N. Taylor
2014 Concurrency and Computation  
ACKNOWLEDGEMENTS This work is supported in part by the Austrian Science Fund (FWF): J3068-N23.  ...  The authors would like to thank the reviewers for their valuable, insightful comments that greatly helped to improve this paper.  ...  All patterns (except Social Networks) exhibit loose coupling of collaborators.  ... 
doi:10.1002/cpe.3438 fatcat:xlwiwyjvxrdhhpew3jh7agbw6i

Monetary Cost Optimizations for Hosting Workflow-as-a-Service in IaaS Clouds

Amelie Chi Zhou, Bingsheng He, Cheng Liu
2016 IEEE Transactions on Cloud Computing  
Dyna includes an A $ -based instance configuration method for performance dynamics, and a hybrid instance configuration refinement for using spot instances.  ...  The major concern of WaaS providers is to minimize the monetary cost of executing workflows in the IaaS clouds.  ...  We implement the Oracle method to assess the trade-off between the optimization overhead and the effectiveness of the optimizations in Dyna.  ... 
doi:10.1109/tcc.2015.2404807 fatcat:vv2jrjr2nfh7tnznmrc57hezpm
« Previous Showing results 1 — 15 out of 1,786 results