Enabling Signal Processing over Data Streams

Milos Nikolic, Badrish Chandramouli, Jonathan Goldstein
<span title="">2017</span> <i title="ACM Press"> <a target="_blank" rel="noopener" href="https://fatcat.wiki/container/vxrc3vebzzachiwy3nopwi3h5u" style="color: black;">Proceedings of the 2017 ACM International Conference on Management of Data - SIGMOD &#39;17</a> </i> &nbsp;
Internet of Things applications analyze the data coming from large networks of sensor devices using relational and signal processing operations and running the same query logic over groups of sensor signals. To support such increasingly important scenarios, many data management systems integrate with numerical frameworks like R. Such solutions, however, incur significant performance penalties as relational data processing engines and numerical tools operate on fundamentally different data
more &raquo; ... with expensive intercommunication mechanisms. In addition, none of these solutions supports efficient real-time and incremental analysis. In this paper, we advocate a deep integration of signal processing operations and general-purpose query processors. We aim to reconcile the disparate data models and provide a common query language that allows users to seamlessly interleave tempo-relational and signal operations for both online and offline processing. Our approach is extensible and offers frameworks for quick and easy integration of user-defined operations while supporting incremental computation. Our system that deeply integrates relational and signal operations, called TRILLDSP, achieves up to two orders of magnitude better performance than popular loosely-coupled data management systems on grouped signal processing workflows.
<span class="external-identifiers"> <a target="_blank" rel="external noopener noreferrer" href="https://doi.org/10.1145/3035918.3035935">doi:10.1145/3035918.3035935</a> <a target="_blank" rel="external noopener" href="https://dblp.org/rec/conf/sigmod/NikolicCG17.html">dblp:conf/sigmod/NikolicCG17</a> <a target="_blank" rel="external noopener" href="https://fatcat.wiki/release/m7wwhctohfb2fi5pze6ubibnn4">fatcat:m7wwhctohfb2fi5pze6ubibnn4</a> </span>
<a target="_blank" rel="noopener" href="https://web.archive.org/web/20201108165818/https://ora.ox.ac.uk/objects/uuid:80e5729d-398d-4ead-800d-721720ad3c73/download_file?safe_filename=sigmod2017_trilldsp_cr.pdf&amp;file_format=application%2Fpdf&amp;type_of_work=Conference+item" title="fulltext PDF download" data-goatcounter-click="serp-fulltext" data-goatcounter-title="serp-fulltext"> <button class="ui simple right pointing dropdown compact black labeled icon button serp-button"> <i class="icon ia-icon"></i> Web Archive [PDF] <div class="menu fulltext-thumbnail"> <img src="https://blobs.fatcat.wiki/thumbnail/pdf/e0/77/e0774d161c8643cfd3a966b8c8abfd68854bdd3f.180px.jpg" alt="fulltext thumbnail" loading="lazy"> </div> </button> </a> <a target="_blank" rel="external noopener noreferrer" href="https://doi.org/10.1145/3035918.3035935"> <button class="ui left aligned compact blue labeled icon button serp-button"> <i class="external alternate icon"></i> acm.org </button> </a>