Processing High-Volume Stream Queries on a Supercomputer

E. Zeitler, T. Risch
2006 22nd International Conference on Data Engineering Workshops (ICDEW'06)  
Scientific instruments, such as radio telescopes, colliders, sensor networks, and simulators generate very high volumes of data streams that scientists analyze to detect and understand physical phenomena. The high data volume and the need for advanced computations on the streams require substantial hardware resources and scalable stream processing. We address these challenges by developing data stream management technology to support high-volume stream queries utilizing massively parallel
more » ... er hardware. We have developed a data stream management system prototype for state-of-the-art parallel hardware. The performance evaluation uses real measurement data from LOFAR, a radio telescope antenna array being developed in the Netherlands.
doi:10.1109/icdew.2006.118 dblp:conf/icde/ZeitlerR06 fatcat:jrwejkvspfdfrebuj735f6wbwm