3,177 Hits in 5.7 sec

A data-driven workflow language for grids based on array programming principles

Johan Montagnat, Benjamin Isnard, Tristan Glatard, Ketan Maheshwari, Mireille Blay Fornarino
2009 Proceedings of the 4th Workshop on Workflows in Support of Large-Scale Science - WORKS '09  
The language proposed is data-driven for easing the expression of parallel flows. It leverages array programming principles to ease data-intensive applications design.  ...  This work is motivated by the search for a scientific workflow language which coherently integrates different aspects of distributed computing.  ...  Yet, there is no real grid workflow language based on functional principles as far as we know.  ... 
doi:10.1145/1645164.1645171 dblp:conf/sc/MontagnatIGMB09 fatcat:qzepyau46fhxfctrudf65lotf4

A Taxonomy of Workflow Management Systems for Grid Computing [article]

Jia Yu, Rajkumar Buyya
2005 arXiv   pre-print
In this paper, we propose a taxonomy that characterizes and classifies various approaches for building and executing workflows on Grids.  ...  Therefore, many efforts have been made towards the development of workflow management systems for Grid computing.  ...  ACKNOWLEDGEMENTS We would like to acknowledge all developers of the workflow management systems described in the paper.  ... 
arXiv:cs/0503025v2 fatcat:uadtgvc3bvdpxblsxaepcbjkky

A Taxonomy of Workflow Management Systems for Grid Computing

Jia Yu, Rajkumar Buyya
2005 Journal of Grid Computing  
In this paper, we propose a taxonomy that characterizes and classifies various approaches for building and executing workflows on Grids.  ...  Therefore, many efforts have been made towards the development of workflow management systems for Grid computing.  ...  ACKNOWLEDGEMENTS We would like to acknowledge all developers of the workflow management systems described in the paper.  ... 
doi:10.1007/s10723-005-9010-8 fatcat:b2ptnwxnhbeltlybivpxl6m654

HPTMT: Operator-Based Architecture for Scalable High-Performance Data-Intensive Frameworks [article]

Supun Kamburugamuve, Chathura Widanage, Niranda Perera, Vibhatha Abeykoon, Ahmet Uyar, Thejaka Amila Kanewala, Gregor von Laszewski, Geoffrey Fox
2021 arXiv   pre-print
In this paper, we propose High-Performance Tensors, Matrices and Tables (HPTMT), an operator-based architecture for data-intensive applications, and identify the fundamental principles needed for performance  ...  They employ a set of operators on specific data abstractions that include vectors, matrices, tensors, graphs, and tables.  ...  We thank the FutureSystems team for their infrastructure support.  ... 
arXiv:2107.12807v2 fatcat:4t4dnafwwbgk3arxzuwikjwdgm

Comparative Studies Simplified in GPFlow [chapter]

Lawrence Buckingham, James M. Hogan, Paul Roe, Jiro Sumitomo, Michael Towsey
2008 Lecture Notes in Computer Science  
We introduce a new model for collection processing based on key aggregation and slicing which guarantees processing integrity and facilitates automatic association of inputs, allowing scientific users  ...  We present a novel, web-accessible scientific workflow system which makes large-scale comparative studies accessible without programming or excessive configuration requirements.  ...  Data Driven Iteration At the most basic level, a Component iterates over the Cartesian product of its input collections and queues one Processor for each combination.  ... 
doi:10.1007/978-3-540-69389-5_56 fatcat:javkxzwndff35eezwkyoinvao4

Scientific Workflow Infrastructure for Computational Chemistry on the Grid [chapter]

Wibke Sudholt, Ilkay Altintas, Kim Baldridge
2006 Lecture Notes in Computer Science  
The implementation is based on the idea that the time-consuming parts of the calculations can be distributed onto computational Grids using the Kepler scientific workflow system and the Nimrod toolkit  ...  We describe an example workflow that allows preparing, running, and displaying jobs on different molecules, employing the GAMESS quantum chemical program package.  ...  Amoreira and Yohann Potier from the University of Zurich, Adam Birnbaum and Jerry Greenberg from SDSC, Yang Zhao from UC Berkeley, and David Abramson and his group from Monash University, Australia, for  ... 
doi:10.1007/11758532_11 fatcat:l4v2hjunbfemxdut74fehhlc6q

Algorithms and the Grid

Geoffrey C. Fox, Mehmet S. Aktas, Galip Aydin, Harshawardhan Gadgil, Shrideep Pallickara, Marlon E. Pierce, Ahmet Sayar
2008 Computing and Visualization in Science  
We comment on the appropriate messaging infrastructure for Grids and data assimilation and contrast it with MPI.  ...  We review the impact of Grid Computing and Web Services on scientific computing, stressing the importance of the "data-deluge" that is driven by deployment of new instruments, sensors and satellites.  ...  Acknowledgements This paper describes work that is supported by the Advanced Information Systems Technology Program of NASA's Earth-Sun System Technology Office and the UK e-Science program's Open Middleware  ... 
doi:10.1007/s00791-007-0083-8 fatcat:oenkjgz2r5fshnxmo5hfijfi5e

HERCULES: A Pattern Driven Code Transformation System

Christos Kartsaklis, Oscar Hernandez, Chung-Hsing Hsu, Thomas Ilsche, Wayne Joubert, Richard L. Graham
2012 2012 IEEE 26th International Parallel and Distributed Processing Symposium Workshops & PhD Forum  
Thread-based programming • Task-based execution models -Either on die or off die -Lower memory footprint per core -Deeper memory hierarchies -Component failure is the norm 4 Managed by UT-Battelle for  ...  and transformations at different phases • Designed a pattern language, and built a directives parser and pattern-matching engine that uses underlying PROLOG technology. • Progress on output program analysis  ...  HERCULES in CAM/SE • Pattern-based parallelization support to reuse transformation logic. do q=1,qsize do k=1,nlev do j=1,nv do l=1,nv dudx00=0.0d0 dvdy00i=0.0d0 do i=1,nv dudx00 = dudx00 + Dvv(i,l ) *  ... 
doi:10.1109/ipdpsw.2012.69 dblp:conf/ipps/KartsaklisHHIJG12 fatcat:ulsv2roi5fc5xojpiq7dinbr6q

Increasing Scientific Workflow Programming Productivity with HyperFlow

Bartosz Balis
2014 2014 9th Workshop on Workflows in Support of Large-Scale Science  
The workflow execution model of HyperFlow is based on a formal model of computation -Process Networks.  ...  This paper presents HyperFlow: an approach to workflow programming which combines the advantages of a declarative workflow description and low-level scripting programming.  ...  Acknowledgment This work is partially supported by the National Centre for Research and Development (NCBiR), Poland, project PBS1/B9/18/2013 -(no 180535); and by AGH University of Science and Technology  ... 
doi:10.1109/works.2014.10 dblp:conf/sc/Balis14 fatcat:33fikjy52jfivlky7bjvxlr5v4

Diva: A Declarative and Reactive Language for In-Situ Visualization [article]

Qi Wu
2020 arXiv   pre-print
With this paper, we present a language design and runtime system for developing adaptive systems through a declarative and reactive programming paradigm.  ...  The use of adaptive workflow management for in situ visualization and analysis has been a growing trend in large-scale scientific simulations.  ...  ACKNOWLEDGMENTS The authors wish to thank Martin Rieth at Sandia National Laboratories for providing advice, support, and data for this research. This research is sponsored in part by the U.S.  ... 
arXiv:2001.11604v2 fatcat:avndspeblvhcjnrnbu5ssuxnie

Development of Web services-based Multidisciplinary Design Optimization framework

Ho-Jun Lee, Jae-Woo Lee, Jeong-Oog Lee
2009 Advances in Engineering Software  
This paper proposes a Web services-based MDO framework that enables the synthesis of available disciplinary and cross-disciplinary resources for MDO via the Globus Toolkit.  ...  Therefore, a framework that allows the implementation of MDO methods must be an environment for design synthesis.  ...  BPEL4WS is a Web Services standard technology and an XML-based Workflow Language for describing business process interactions, and hence the most suitable format for data storage in a Web Services-based  ... 
doi:10.1016/j.advengsoft.2008.03.015 fatcat:mgutlsctkfbanifowdklaqcaee

Scientific workflow systems - can one size fit all?

V. Curcin, M. Ghanem
2008 2008 Cairo International Biomedical Engineering Conference  
We provide a high-level framework for comparing the systems based on their control flow and data flow properties with a view of both informing future research in the area by academic researchers and facilitating  ...  The past decade has witnessed a growing trend in designing and using workflow systems with a focus on supporting the scientific research process in bioinformatics and other areas of life sciences.  ...  on how to behave when data becomes available. • Data-driven orchestration.  ... 
doi:10.1109/cibec.2008.4786077 fatcat:7ri2p6u63ngqpcvt7vmpm3qtni

The ACGT project in retrospect: Lessons learned and future outlook

Anca Bucur, Stefan Ruping, Thierry Sengstag, Stelios Sfakianakis, Manolis Tsiknakis, Dennis Wegener
2011 Procedia Computer Science  
The objective of the ACGT (Advancing Clinico-Genomic Trials on Cancer: Open Grid Services for improving Medical Knowledge Discovery, project that has recently concluded successfully was  ...  Furthermore we provide a number of key "lessons learned" during the process and give directions for further developments in the future.  ...  Acknowledgements The authors gratefully acknowledge the financial support of the European Commission for the Project ACGT, FP6/2004/IST-026996.  ... 
doi:10.1016/j.procs.2011.04.119 fatcat:ls5emmpmrrfwnhnkscbpazorge

Web-Scale Workflow: Integrating Distributed Services

M. Brian Blake, Michael N. Huhns
2008 IEEE Internet Computing  
B r i a n B l a k e • m b7 @ g e o r g e t o w n .e d u M i c h a e l N .  ...  This is the essence of Web-scale workflows.  ...  As such, the first step of any Web-scale workflow architecture should be the acceptance of a service-based development approach 6 and the population of an array of services that represent capabilities  ... 
doi:10.1109/mic.2008.24 fatcat:toemcgev5rfvnen3sjjt2iijmq

Web services: been there, done that?

S. Staab, W. van der Aalst, V.R. Benjamins, A. Sheth, J.A. Miller, C. Bussler, A. Maedche, D. Fensel, D. Gannon
2003 IEEE Intelligent Systems  
Acknowledgments I thank Arthur ter Hofstede, Bartek Kiepuszewski, Marlon Dumas, and Petia Wohed for contributing to the results mentioned in this essay. Acknowledgments  ...  (For example, any of the constructs can be realized using a standard programming language, but this does not imply that there is direct support for all workflow patterns.)  ...  The concrete protocol and data WSDL is an XML format for describing format specifications for a particular port network services based on a standard mes- type constitute a reusable binding.  ... 
doi:10.1109/mis.2003.1179197 fatcat:zdt7sar7bfbs5kb4unmvgce3ui
« Previous Showing results 1 — 15 out of 3,177 results