3,859 Hits in 6.8 sec

From a stream of relational queries to distributed stream processing

Qiong Zou, Huayong Wang, Robert Soulé, Martin Hirzel, Henrique Andrade, Buǧra Gedik, Kun-Lung Wu
2010 Proceedings of the VLDB Endowment  
In this paper we demonstrate an application acceleration approach whereby a regular ODBC-based application is converted into a true streaming application with minimal disruption from a software engineering  ...  Many of these applications have been written relying solely on database and data warehouse technologies, despite their lack of need for transactional support and ACID properties.  ...  Likewise, stream processing has been an active research area for over half a decade. This has led to the development of several academic and commercial platforms.  ... 
doi:10.14778/1920841.1921012 fatcat:xvbizkiianhhzorpnzmhp5dboq

The design of a streaming analytical workflow for processing massive transit feeds [article]

Hung Cao, Monica Wachowicz
2018 arXiv   pre-print
In this paper, we consider the fundamental issues in developing a streaming analytical workflow for analyzing the continuous arrival of multiple, unbounded transit data feeds for automatically processing  ...  The workflow was implemented in a Hadoop cloud ecosystem using data streams from the CODIAC Transit System of the city of Moncton, NB.  ...  The authors would also like to thank Ryan Brideau, Iyke Maduako and Emerson Cavalleri from the People in Motion Lab for their constructive comments on the development of the streaming analytics workflow  ... 
arXiv:1706.04722v2 fatcat:x6y7abbywvdhjathun75zdbqai

Open challenges for data stream mining research

Georg Krempl, Myra Spiliopoulou, Jerzy Stefanowski, Indre Žliobaite, Dariusz Brzeziński, Eyke Hüllermeier, Mark Last, Vincent Lemaire, Tino Noack, Ammar Shaker, Sonja Sievi
2014 SIGKDD Explorations  
This article presents a discussion on eight open challenges for data stream mining.  ...  ABSTRACT With the inception of the Twitter microblogging platform in 2006, a myriad of research efforts have emerged studying different aspects of the Twittersphere.  ...  on the challenges in stream mining.  ... 
doi:10.1145/2674026.2674028 fatcat:y3bozzeohveibgxb5wmiwfcogm

Declarative Stream Runtime Verification (hLola) [article]

Martin Ceresa, Felipe Gorostiaga, Cesar Sanchez
2020 arXiv   pre-print
In this paper we study the problem of implementing an SRV engine that is truly extensible to arbitrary data theories, and we propose a solution as a Haskell embedded domain specific language.  ...  This novel technique, which we call lift deep embedding, allows for example, the use of higher-order functions for static stream parameterization.  ...  Introduction In this paper we study the problem of implementing a truly generic Stream Runtime Verification (SRV) engine, and show a solution using an embedded domain specific language (eDSL) based on  ... 
arXiv:2003.00032v2 fatcat:6c567x2mdzbhjculc5dh4atgwa

Knowledge-infused and consistent Complex Event Processing over real-time and persistent streams

Qunzhi Zhou, Yogesh Simmhan, Viktor Prasanna
2017 Future generations computer systems  
Ubiquitous sensors from IoT deployments are able to generate data streams at high velocity, that include information from a variety of domains, and accumulate to large volumes on disk.  ...  Emerging applications in Internet of Things (IoT) and Cyber-Physical Systems (CPS) present novel challenges to Big Data platforms for performing online analytics.  ...  This work was also supported by grants to the second author from the Department of Electronics & Information Technology (DeitY), India, and the Robert Bosch Centre for Cyber Physical Systems (RBCCPS),  ... 
doi:10.1016/j.future.2016.10.030 fatcat:gvqp34dfvbfwjbefip5cu35tsm

Deep Learning for IoT Big Data and Streaming Analytics: A Survey [article]

Mehdi Mohammadi, Ala Al-Fuqaha, Sameh Sorour, Mohsen Guizani
2018 arXiv   pre-print
In the era of the Internet of Things (IoT), an enormous amount of sensing devices collect and/or generate various sensory data over time for a wide range of fields and applications.  ...  Based on the nature of the application, these devices will result in big or fast/real-time data streams.  ...  In another study by Liu et al. [84] , a CNN architecture is used for detection of extreme climate events, such as tropical cyclones, atmospheric rivers and weather fronts.  ... 
arXiv:1712.04301v2 fatcat:kr64lst37rhlfcpaxckgzlozvu

Closing the Gap Between Watershed Modeling, Sediment Budgeting, and Stream Restoration [chapter]

Sean M. C. Smith, Patrick Belmont, Peter R. Wilcock
2013 Stream Restoration in Dynamic Fluvial Systems  
The connection between stream restoration and sediment budgeting runs both ways: stream restoration is proposed as a means to reduce sediment yields, but an accurate understanding of sediment supply is  ...  In both cases, reliable estimates of sediment yield depend essentially on the accurate identification of sediment sources and sinks and, hence, require careful delineation of landscape units and identification  ...  For one, dense vegetation in floodplains is often not adequately filtered out in the process of generating a bare-earth digital elevation model (DEM), resulting in an inaccurate surface.  ... 
doi:10.1029/2011gm001085 fatcat:qk6dyib2xjcjlfl6if5osrsyhe

On the HTTP segment streaming potentials and performance improvements

Tomas Kupka
2013 ACM SIGMultimedia Records  
To improve the situation in the network between the server and the client is generally impossible for a streaming provider.  ...  In general, there are three possible places to improve the situation: on the server, in the network and on the client.  ...  Acknowledgements First of all, I would like to thank my supervisors Prof. Pål Halvorsen and Prof. Carsten Griwodz for reviewing this thesis and for interesting discussions.  ... 
doi:10.1145/2518140.2518146 fatcat:vw2rzzbbgvet5hihfcke6jzspy

Data Streams: Algorithms and Applications

S. Muthukrishnan
2005 Foundations and Trends® in Theoretical Computer Science  
In the past few years, a new theory has emerged for reasoning about algorithms that work within these constraints on space, time, and number of passes.  ...  The applications for this scenario include IP network traffic analysis, mining text message streams and processing massive data sets in general.  ...  Acknowledgements My sincere thanks to the referees for correcting the mistakes without curbing my style. Also, thanks to the many coauthors and coresearchers who have led the way.  ... 
doi:10.1561/0400000002 fatcat:ozoe572tfnappg2zcpgtzdeasm

Real-Time Sentiment-Based Anomaly Detection in Twitter Data Streams [chapter]

Khantil Patel, Orland Hoeber, Howard J. Hamilton
2015 Lecture Notes in Computer Science  
Based on this approach, researchers have developed techniques for event detection through tweet frequency time series, assuming that a sudden peak in the number of tweets is an indicator of a micro-event  ...  Many social media platforms have made user-generated content available for data analysis in the form of data streams.  ... 
doi:10.1007/978-3-319-18356-5_17 fatcat:mf2havpljvaupdc5s34xa6fa5u

Discharge–calcium concentration relationships in streams of the Amazon and Cerrado of Brazil: soil or land use controlled

Daniel Markewitz, E. Conrad Lamon, Mercedes C. Bustamante, Joaquin Chaves, Ricardo O. Figueiredo, Mark S. Johnson, Alex Krusche, Christopher Neill, José S. O. Silva
2011 Biogeochemistry  
current data set, soil class, which is related to lithology, has an important effect on Ca concentration but land use, likely through its effect on runoff concentration and hydrology, has a greater effect  ...  on discharge-concentration relationships.  ...  Acknowledgements This research was supported by grant #'s NCC5-686 and NNG06GE88A of NASA's Terrestrial Ecology Program as part of the Large-scale Biosphere-Atmosphere Experiment in Amazonia (LBA-ECO)  ... 
doi:10.1007/s10533-011-9574-2 fatcat:2vucsrb4bnbnpggndbs4ucy6yu

Developer Testing in The IDE: Patterns, Beliefs, And Behavior

Moritz Beller, Gousios Georgios, Annibale Panichella, Sebastian Proksch, Sven Amann, Andy Zaidman
2017 IEEE Transactions on Software Engineering  
In this paper, we report on a large-scale field study with 2,443 software engineers whose development activities we closely monitored over 2.5 years in four integrated development environments (IDEs).  ...  Software testing is one of the key activities to achieve software quality in practice.  ...  This lack of empirical knowledge of when, how, and why developers test in their Integrated Development Environments (IDEs) stands in contrast to a large body of folklore in software engineering [2] ,  ... 
doi:10.1109/tse.2017.2776152 fatcat:h6pxirsdhjguxhnnesawvb4gbm

Engineering Scalable Distributed Services for Real-Time Big Data Analytics

Sahar Jambi, Kenneth M. Anderson
2017 2017 IEEE Third International Conference on Big Data Computing Service and Applications (BigDataService)  
For this research, I design and develop a flexible set of real-time analytical tools that will allow analysts to ask new types of questions as they move their research activity from after a crisis to analysis  ...  I am building a lightweight service-based framework-EPIC Real-Timethat manages a set of queries that can be applied to user-initiated data analysis events (such as studying tweets generated during a disaster  ...  Recent interest in analyzing big data in real time has resulted in the active development of software frameworks and tools to perform real-time stream computation and analysis.  ... 
doi:10.1109/bigdataservice.2017.22 dblp:conf/bigdataservice/JambiA17 fatcat:ffx657klkbbqvnv7v6yztb6tfi

When, how, and why developers (do not) test in their IDEs

Moritz Beller, Georgios Gousios, Annibale Panichella, Andy Zaidman
2015 Proceedings of the 2015 10th Joint Meeting on Foundations of Software Engineering - ESEC/FSE 2015  
With this paper, we report on the surprising results of a large-scale field study with 416 software engineers whose development activity we closely monitored over the course of five months, resulting in  ...  our study does not test; developers rarely run their tests in the IDE; Test-Driven Development (TDD) is not widely practiced; and, last but not least, software developers only spend a quarter of their  ...  This lack of empirical knowledge of when, how, and why developers test in their Integrated Development Environments (IDEs) stands in contrast to a large body of folklore in software engineering [2] ,  ... 
doi:10.1145/2786805.2786843 dblp:conf/sigsoft/BellerGPZ15 fatcat:a7wgx3qokrdgpmty2arowacngq

Sonification design guidelines to enhance program comprehension

Khaled Hussein, Eli Tilevich, Ivica Ico Bukvic, SooBeen Kim
2009 2009 IEEE 17th International Conference on Program Comprehension  
Faced with the challenges of understanding the source code of a program, software developers are assisted by a wealth of software visualization research.  ...  Based on our experiences, we then propose a set of guidelines for the design of a new generation of tools that increase their information utility by combining visualization and sonification.  ...  As a result, software comprehension has long been recognized as one of the most critical and timeconsuming software development activities [33, 30, 47, 36] .  ... 
doi:10.1109/icpc.2009.5090035 dblp:conf/iwpc/HusseinTBK09 fatcat:clxatidym5bofco5ssi4irmesu
« Previous Showing results 1 — 15 out of 3,859 results