CONFLuEnCE: Implementation and Application Design

Panayiotis Neophytou, Panos Chrysanthis, Alexandros Labrinidis
2011 Proceedings of the 7th International Conference on Collaborative Computing: Networking, Applications and Worksharing  
Data streams have become pervasive and data production rates are increasing exponentially, driven by advances in technology, for example the proliferation of sensors, smart phones, and their applications. This fact effectuates an unprecedented opportunity to build real-time monitoring and analytics applications, which when used collaboratively and interactively, will provide insights to every aspect of our environment, both in the business and scientific domains. In our previous work, we have
more » ... entified the need for workflow management systems which are capable of orchestrating the processing of multiple heterogeneous data streams, while enabling their users to interact collaboratively with the workflows in real time. In this paper, we describe CONFLuEnCE (CONtinuous workFLow ExeCution Engine), which is an implementation of our continuous workflow model. CONFLuEnCE is built on top of Kepler, an existing workflow management system, by fusing stream semantics and stream processing methods as another computational domain. Furthermore, we explicate our experiences in designing and implementing real-life business and scientific continuous workflow monitoring applications, which attest to the ease of use and applicability of our system.
doi:10.4108/icst.collaboratecom.2011.247204 dblp:conf/colcom/NeophytouCL11 fatcat:tdu6izl57zccpg34lcf3oxmdqy