12,573 Hits in 3.9 sec

Logical provenance in data-oriented workflows?

R. Ikeda, Akash Das Sarma, J. Widom
2013 2013 IEEE 29th International Conference on Data Engineering (ICDE)  
in data-oriented workflows, as well as debugging and drill-down using logical provenance Overall, our work provides a comprehensive foundation, set of algorithms, and prototype system for provenance in  ...  In data-oriented workflows, it can be useful to track data provenance (also sometimes called lineage), which describes where data came from and how it has been manipulated and combined.  ...  In data-oriented workflows, it can be useful to track data provenance (also sometimes called lineage).  ... 
doi:10.1109/icde.2013.6544882 dblp:conf/icde/IkedaSW13 fatcat:vmwxwcwzfjhnjmyfomce6l5m2y

Scientific Workflows

Chee Sun Liew, Malcolm P. Atkinson, Michelle Galea, Tan Fong Ang, Paul Martin, Jano I. Van Hemert
2016 ACM Computing Surveys  
A common strategy to make these in silico experiments more manageable is to model them as workflows, and to use a workflow management system to organise their execution.  ...  poses a challenge however due to a) the complexity and diversity of applications, b) the diversity of analysis goals, c) the heterogeneity of computing platforms, and d) the volume and distribution of data  ...  ACKNOWLEDGMENTS We thank James Cheney, University of Edinburgh (UoE) and Alessandro Spinuso of KNMI for alerting us to work on provenance and its standardisation, Murray Cole, UoE for encouraging our architectural  ... 
doi:10.1145/3012429 fatcat:23z6g32jfvgeto5zrigk4ysmx4

Collaborative Scientific Workflows

Shiyong Lu, Jia Zhang
2009 2009 IEEE International Conference on Web Services  
As more scientific research projects become collaborative in nature, there is a compelling need of dedicated services to support collaborative scientific workflows on the Internet.  ...  In recent years, a number of scientific workflow management systems (SWFMSs) have been developed to help domain scientists synergistically integrate distributed computations, datasets, and analysis tools  ...  X-CODL models collaboration-oriented coordination requirements, while decoupling the coordination statements from collaboration logic.  ... 
doi:10.1109/icws.2009.150 dblp:conf/icws/LuZ09 fatcat:uixs7xfwond7ncnairul5yheje

Integrating existing scientific workflow systems

Nandita Mandal, Ewa Deelman, Gaurang Mehta, Mei-Hui Su, Karan Vahi
2007 Proceedings of the 2nd workshop on Workflows in support of large-scale science - WORKS '07  
We illustrate the combined system on a workflow used as a basis of a provenance challenge.  ...  Scientific workflows have become an important tool used by scientists to conduct large-scale analysis in distributed environments.  ...  The challenge brought together researchers interested in comparing and contrasting the data provenance solutions developed within a variety of workflow and data management systems.  ... 
doi:10.1145/1273360.1273365 dblp:conf/hpdc/MandalDMSV07 fatcat:zqpuaz46mraj5ofavx5cgjdjoy

Performance Tool Workflows [chapter]

Wyatt Spear, Allen Malony, Alan Morris, Sameer Shende
2008 Lecture Notes in Computer Science  
In this paper we describe the user-definable tool workflow system provided by this performance framework. We discuss the framework's implementation and the rationale for its design.  ...  A use case featuring the TAU performance analysis system demonstrates the utility of the workflow system with respect to conventional performance analysis procedures.  ...  Soon, the modular nature of the workflow components will allow the addition of some logical elements to the workflow system.  ... 
doi:10.1007/978-3-540-69389-5_32 fatcat:fxzfksrgojf47gq4fkf2o45dxu

Views on Scientific Workflows [chapter]

Mirko Sonntag, Katharina Görlach, Dimka Karastoyanova, Frank Leymann, Polina Malets, David Schumm
2011 Lecture Notes in Business Information Processing  
Workflows are becoming more and more important in e-Science due to the support they provide to scientists in computer simulations, experiments and calculations.  ...  Our experiences with workflows in this field and the literature show that scientific workflows consist of a large number of related information.  ...  The authors would like to thank the German Research Foundation (DFG) for financial support of the project within the Cluster of Excellence in Simulation Technology (EXC 310/1) at the University of Stuttgart  ... 
doi:10.1007/978-3-642-24511-4_25 fatcat:jxf4rkex4rcidcp32rpinw3w2q

Collaborative scientific workflows supporting collaborative science

Shiyong Lu, Jia Zhang
2011 International Journal of Business Process Integration and Management  
, and concludes with our ongoing work in this direction.  ...  The convergence of the above two trends naturally leads to the concept of collaborative scientific workflows.  ...  X-CODL models collaboration-oriented coordination requirements, while decoupling the coordination statements from collaboration business logic.  ... 
doi:10.1504/ijbpim.2011.040209 fatcat:5op5on2xgffhjabh7wgjrfuhai

Provenance-Based Debugging and Drill-Down in Data-Oriented Workflows

Robert Ikeda, Junsang Cho, Charlie Fang, Semih Salihoglu, Satoshi Torikai, Jennifer Widom
2012 2012 IEEE 28th International Conference on Data Engineering  
We demonstrate Panda (for Provenance and Data), a system for data-oriented workflows that supports debugging and drill-down using logical provenance-provenance information stored at the processing-node  ...  Such analyses can be managed using data-oriented workflows [13] , in which input data sets are processed by a graph of processing nodes to produce output data.  ... 
doi:10.1109/icde.2012.118 dblp:conf/icde/IkedaCFSTW12 fatcat:vdem6yp3hjealkwjif53hglioq

A Logic Programming Approach to Scientific Workflow Provenance Querying [chapter]

Yong Zhao, Shiyong Lu
2008 Lecture Notes in Computer Science  
In Section 3, we show the mapping of the virtual data schema into Frame Logic, and the logic programming representation of the sample fMRI workflow used in the provenance challenges.  ...  for a scientific workflow provenance query language; ii) Based on these requirements, we propose FLOQ, a Frame Logic based query language for scientific workflow provenance, iii) We demonstrate that our  ...  In this section, we show that the virtual data schema can also be modeled from an object oriented (OO) perspective, and it can be represented naturally in F-Logic.  ... 
doi:10.1007/978-3-540-89965-5_5 fatcat:i5thodt4zzb6pcdo3pib7ha55e

Capturing Workflow Event Data for Monitoring, Performance Analysis, and Management of Scientific Workflows

Matthew D. Valerio, Satya S. Sahoo, Roger S. Barga, Jared J. Jackson
2008 2008 IEEE Fourth International Conference on eScience  
This paper discusses the creation of an ontology-aware workflow monitoring system for use in the Trident system which utilizes a distributed publish/subscribe event model.  ...  To effectively support real-time monitoring and performance analysis of scientific workflow execution, varying levels of event data must be captured and made available to interested parties.  ...  Such changes would normally involve the addition or subtraction of activities, changes in workflow execution logic, changes to input parameters, and changes to data bindings between activities.  ... 
doi:10.1109/escience.2008.164 dblp:conf/eScience/ValerioSBJ08 fatcat:q7rmrxyg6ragfg66zrnn4pfwie

Provenance in High-Energy Physics Workflows

Andrew Dolgert, Lawrence Gibbons, Christopher D. Jones, Valentin Kuznetsov, Mirek Riedewald, Daniel Riley, Gregory J. Sharp, Peter Wittich
2008 Computing in science & engineering (Print)  
In this article, we examine the role of provenance in several projects in which members of our group have participated, with an emphasis on using data provenance to improve the reproducibility of the physics  ...  With petabytes of data to manage, effective use of provenance is critical to understanding the results.  ...  In the terms of a widely cited taxonomy, 4 the DBS data provenance is process oriented-it collects provenance about the deriving processes with file granularity.  ... 
doi:10.1109/mcse.2008.81 fatcat:7ebjhayxqbdh3azxohpbl44mhq

Provenance-Driven Data Curation Workflow Analysis

Tianhong Song
2015 Proceedings of the 2015 ACM SIGMOD on PhD Symposium - SIGMOD '15 PhD Symposium  
In this paper, we propose a provenance-driven workflow analysis framework that exploits both prospective and retrospective provenance.  ...  Manually designed workflows can be error-prone and inefficient. Workflow provenance contains fine-grained data processing information that can be used to detect workflow design problems.  ...  However, little work has been done for datacuration workflows or collection-oriented workflows [21] in general.  ... 
doi:10.1145/2744680.2744691 dblp:conf/sigmod/Song15 fatcat:5y5wg3utjvewvh2rhatyvypdza

The Systematic Study of Scientific Workflows in Distributed and Cloud Environments: A Review of Privacy Issues in Workflow Provenance, Challenges and Opportunities

Shridevi Erayya
2018 International Journal of Computer Applications  
In short the data provenance is an overloaded term that has been defined differently by different people. Data provenance can be examined from different point of perspective such as semantics.  ...  This paper discusses the i) Workflow lifecycle and challenges ii) Research issues in provenance for the scientific workflows.  ...  Service Oriented Architecture provides the interoperability among the services. 3) Data Provenance: In addition to managing the metadata, the provenance data management is essential for scientific and  ... 
doi:10.5120/ijca2018916696 fatcat:7ctw576kvvfjlilhmk5loxsg5q

Enterprise wide workflow management

C. Bussler
1999 IEEE Concurrency  
Object-Oriented Technology Showcasing traditional and innovative uses of object-oriented languages, systems, and technologies.  ...  Design engineers are asked to use standard parts where possible because they are not only proven technology, but also their delivery is guaranteed in a specific timeframe due to established supplier relation  ...  JANUARY Process Diversity MARCH Cobol: New Millenium APRIL Engineering in the Small Keep track of advances in the software development industry!  ... 
doi:10.1109/4434.788777 fatcat:3yiaagp7t5aznflw7octoli3ki

Provenance-based refresh in data-oriented workflows

Robert Ikeda, Semih Salihoglu, Jennifer Widom
2011 Proceedings of the 20th ACM international conference on Information and knowledge management - CIKM '11  
We consider a general workflow setting in which input data sets are processed by a graph of transformations to produce output results.  ...  Our approach is based on capturing one-level data provenance at each transformation when the workflow is run initially.  ...  and refresh procedure to data-oriented workflows.  ... 
doi:10.1145/2063576.2063816 dblp:conf/cikm/IkedaSW11 fatcat:tpedymqs6bbojevewb4bjfob3q
« Previous Showing results 1 — 15 out of 12,573 results