1,325 Hits in 16.1 sec

A Semantic-Based Approach to Attain Reproducibility of Computational Environments in Scientific Workflows: A Case Study [chapter]

Idafen Santana-Perez, Rafael Ferreira da Silva, Mats Rynge, Ewa Deelman, María S. Pérez-Hernández, Oscar Corcho
2014 Lecture Notes in Computer Science  
In this work, we propose describing the resources involved in the execution of an experiment using a set of semantic vocabularies, so as to conserve the computational environment.  ...  Reproducible research in scientific workflows is often addressed by tracking the provenance of the produced results.  ...  Acknowledgements This material is based upon work supported in part by the National Science Foundation under Grant No. 0910812 to Indiana University for "FutureGrid: An Experimental, High-Performance Grid  ... 
doi:10.1007/978-3-319-14325-5_39 fatcat:z6hcnjrnxvhcbdpkmyeb2trehy

Hierarchical Caches for Grid Workflows

David Chiu, Gagan Agrawal
2009 2009 9th IEEE/ACM International Symposium on Cluster Computing and the Grid  
In this paper, we describe an approach to combat the challenges of maintaining large, fast virtual data caches for workflow composition.  ...  But in distributed query intensive environments, where high volumes of intermediate virtual data can potentially be stored anywhere on the grid, a novel cache structure is needed to efficiently facilitate  ...  In this paper, we address approaches in handling several technical challenges towards the design of a grid based cache-sensitive workflow composition system.  ... 
doi:10.1109/ccgrid.2009.10 dblp:conf/ccgrid/ChiuA09 fatcat:ql6h6lu5djfktlppjdbli4vw3i

Scientific workflows: Past, present and future

Malcolm Atkinson, Sandra Gesing, Johan Montagnat, Ian Taylor
2017 Future generations computer systems  
There have been very substantial advances in the representation of workflows and in the engineering of workflow management systems (WMS).  ...  This special issue and our editorial celebrate 10 years of progress with data-intensive or scientific workflows.  ...  We are grateful for the contributions of the authors and reviewers of this special issue and the editors of Future Generation Computing Systems.  ... 
doi:10.1016/j.future.2017.05.041 fatcat:j6ofz4kjjbdgdjmnsnj3fe63ju

An approach for pipelining nested collections in scientific workflows

Timothy M. McPhillips, Shawn Bowers
2005 SIGMOD record  
This work was supported by the National Science Foundation GriPhyN Project, grant ITR-800864, the Mathematical, Information, and Computational Sciences Division subprogram of the Office of Advanced Scientific  ...  These 18 people are providing a truly valuable service to readers, to authors, and to reviewers.  ...  To address these requirements, the approach we take is to represent computational models as scientific workflows targeted towards execution in a distributed Grid environment.  ... 
doi:10.1145/1084805.1084809 fatcat:sgtpcat7vzc3veb4dx2jgskpte

A Survey of Data-Intensive Scientific Workflow Management

Ji Liu, Esther Pacitti, Patrick Valduriez, Marta Mattoso
2015 Journal of Grid Computing  
Nowadays, more and more computer-based scientific experiments need to handle massive amounts of data. Their data processing consists of multiple computational steps and dependencies within them.  ...  This paper provides a survey of data-intensive scientific workflow management in SWfMSs and their parallelization techniques.  ...  A Scientific Workflow Management System (SWfMS ) is an efficient tool to execute workflows and manage data sets in various computing environments.  ... 
doi:10.1007/s10723-015-9329-8 fatcat:5urst5aphjftbli3pukmnbutri

Scalable and Resilient Workflow Executions on Production Distributed Computing Infrastructures

Javier Rojas Balderrama, Tram Truong Huu, Johan Montagnat
2012 2012 11th International Symposium on Parallel and Distributed Computing  
This paper introduces a pragmatic solution to tackle these four issues based on a serviceoriented methodology, the reuse of existing middleware services, and the joint exploitation of local and distributed  ...  In spite of the growing interest for grids and cloud infrastructures among scientific communities and the availability of such facilities at large-scale, achieving high performance in production environments  ...  The authors would like to thank the Asclepios Research Project from Inria Sophia-Antipolis for providing the case study used in this work.  ... 
doi:10.1109/ispdc.2012.24 dblp:conf/ispdc/BalderramaHM12 fatcat:bn46lqptonam5esczt5xt73ozi

Distributed Management of Scientific Workflows in SWIMS

Mahmoud El-Gayyar, Y. Leng, Armin Cremers
2010 2010 Ninth International Symposium on Distributed Computing and Applications to Business, Engineering and Science  
Beratungsdiensten (Promotionsberater oder andere Personen) in Anspruch genommen wurde sowie keinerlei Dritte vom Doktoranden unmittelbar oder mittelbar geldwerte Leistungen für Tätigkeiten erhalten haben  ...  In most cases, scientific workflows consist of complex tasks that need a large amount of computing and storage resources.  ...  It is also quite important to study the performance impacts of these additional features on the overall workflow performance in computational Grid environments.  ... 
doi:10.1109/dcabes.2010.73 fatcat:dummtej5t5c6dp4a2dmy35u6ha

A characterization of workflow management systems for extreme-scale applications

Rafael Ferreira da Silva, Rosa Filgueira, Ilia Pietri, Ming Jiang, Rizos Sakellariou, Ewa Deelman
2017 Future generations computer systems  
We classify 15 popular workflow management systems in terms of workflow execution models, heterogeneous computing environments, and data access methods.  ...  As the resource requirements of today's computational and data science applications that process vast amounts of data keep increasing, there is a compelling case for a new generation of advances in high-performance  ...  Workflows provide automation that increases the productivity of scientists when conducting computation-based studies.  ... 
doi:10.1016/j.future.2017.02.026 fatcat:3ri627jyy5a47hgh5r343f5ife

A Community Roadmap for Scientific Workflows Research and Development [article]

Rafael Ferreira da Silva, Henri Casanova, Kyle Chard, Ilkay Altintas, Rosa M Badia, Bartosz Balis, Tainã Coleman, Frederik Coppens, Frank Di Natale, Bjoern Enders, Thomas Fahringer, Rosa Filgueira (+17 others)
2021 arXiv   pre-print
The overarching goals of these workshops were to develop a view of the state of the art, identify crucial research challenges in the workflows community, articulate a vision for potential community efforts  ...  The landscape of workflow systems for scientific applications is notoriously convoluted with hundreds of seemingly equivalent workflow systems, many isolated research claims, and a steep learning curve  ...  This work was funded by NSF awards #2016610, #2016682, and #2016619, and by the Exascale Computing Project  ... 
arXiv:2110.02168v2 fatcat:ktesrennqrgnnayvp2rsl33y7m

Accelerating Sensitivity Analysis in Microscopy Image Segmentation Workflows [article]

Willian de Oliveira Barreiros Junior, George Teodoro
2018 arXiv   pre-print
Due to the high computational cost of such analyses and the recurrent nature of executed tasks from sensitivity analysis methods (i.e., reexecution of tasks), the opportunity for computation reuse arises  ...  This work focuses then on finding new ways to take advantage of computation reuse opportunities on multiple task abstraction levels.  ...  In the best case, RTMA attained a speedup of up to 2.61× on top of the "No reuse" version.  ... 
arXiv:1811.11653v1 fatcat:vxrt37zm3zce7iazz4nyoxnn2m

Towards Simulation-Data Science – A Case Study on Material Failures

Holger Trittenbach, Martin Gauch, Klemens Bohm, Katrin Schulz
2018 2018 IEEE 5th International Conference on Data Science and Advanced Analytics (DSAA)  
To identify a respective research agenda and to structure the research questions, we conduct a case study from the domain of materials science.  ...  In other words, is it worthwhile to target at "simulation-data science" as a distinct subdiscipline of data science?  ...  As a first step in our case study, we map the time-series measurements to a common scale to address Challenge Semantics.  ... 
doi:10.1109/dsaa.2018.00058 dblp:conf/dsaa/TrittenbachGBS18 fatcat:wm3m3m5cyvdcdg6fqqyubb65wi

A Workflow-Inspired, Modular and Robust Approach to Experiments in Distributed Systems

Tomasz Buchert, Lucas Nussbaum, Jens Gustedt
2014 2014 14th IEEE/ACM International Symposium on Cluster, Cloud and Grid Computing  
To this end, we present an interdisciplinary approach to the control of large-scale experiments in distributed systems research that draws its foundations from workflow management and scientific workflows  ...  We show how the aforementioned problems are solved by our approach in an exemplary performance study of an HTTP server.  ...  Acknowledgments Experiments presented in this paper were carried out using the Grid'5000 experimental testbed, being developed under the INRIA ALADDIN development action with support from CNRS, RENATER  ... 
doi:10.1109/ccgrid.2014.33 dblp:conf/ccgrid/BuchertNG14 fatcat:a65xb2rdovfdnkq5u4lgaaxkm4

Data reduction in scientific workflows using provenance monitoring and user steering

Renan Souza, Vítor Silva, Alvaro L.G.A. Coutinho, Patrick Valduriez, Marta Mattoso
2017 Future generations computer systems  
We propose an adaptive workflow monitoring approach that combines provenance data monitoring and computational steering to support users in analyzing the evolution of key parameters and determining the  ...  Reducing data from input datasets is a powerful way to reduce overall execution time in such workflows.  ...  Valduriez) in the context of the Computational Biology Institute ( The experiments were carried out using Grid'5000 (  ... 
doi:10.1016/j.future.2017.11.028 fatcat:de5ikhrce5gblo3jdjn2jweqia

Performance Comparison Between BPMN 2.0 Workflow Management Systems Versions [chapter]

Vincenzo Ferme, Marigianna Skouradaki, Ana Ivanchikj, Cesare Pautasso, Frank Leymann
2017 Lecture Notes in Business Information Processing  
In our case study scenario the results reveal relevant variations in the WfMSs' performance and resource consumption, indicating a decrease in performance for newer versions.  ...  Thus, users considering a WfMS upgrade need to evaluate the extent of such changes for frequently issued workload.  ...  Acknowledgements This work is partially funded by the Swiss National Science Foundation and the German Research Foundation through the BenchFlow: A Benchmark for Workflow Management Systems (DACH Grant  ... 
doi:10.1007/978-3-319-59466-8_7 fatcat:7f6ptb3275aq7f4k2aydukpxv4

JETS: Language and System Support for Many-Parallel-Task Workflows

Justin M. Wozniak, Michael Wilde, Daniel S. Katz
2013 Journal of Grid Computing  
JETS is based on a highly concurrent approach to parallel task dispatch and on new capabilities now available in the MPICH2 MPI implementation and the ZeptoOS Linux operating system.  ...  In this work, we present JETS, a middleware component that provides high performance support for many-parallel-task computing (MPTC).  ...  This research is supported by the Office of Advanced Scientific Computing Research, Office of Science, U.S. Department of Energy under Contract DE-AC02-06CH11357.  ... 
doi:10.1007/s10723-013-9259-2 fatcat:qzvhquhsfzf73hqpeufbgihlhi
« Previous Showing results 1 — 15 out of 1,325 results