A Streaming Real-Time Web Observatory Architecture for Monitoring the Health of Social Machines

Ramine Tinati, Xin Wang, Ian Brown, Thanassis Tiropanis, Wendy Hall
2015 Proceedings of the 24th International Conference on World Wide Web - WWW '15 Companion  
Over the past years, streaming Web services have become popular, with many of the top Web platforms now offering near real-time streams of user and machine activity. In light of this, Web Observatories now are faced with the challenge of being able to process and republish real-time, big data, Web streams, whilst maintaining access control and data consistency. In this paper we describe the architecture used in the Southampton Web Observatory to harvest, process, and serve real-time Web streams.
doi:10.1145/2740908.2743977 dblp:conf/www/TinatiWBTH15 fatcat:bkctdj663vfpplxqrh7sly2xiy