Elasticity management of Streaming Data Analytics Flows on clouds

Alireza Khoshkbarforoushha, Alireza Khosravian, Rajiv Ranjan
2017 Journal of computer and system sciences (Print)  
A typical Streaming Data Analytics Flow (SDAF) consists of three layers: data ingestion, analytics, and storage, each of which is provided by a data processing platform. Despite numerous related studies, we still lack effective resource management techniques across an SDAF, leaving users struggling with a key question of: "How much share of different resources (e.g. queue partitions, compute servers, NoSQL throughputs capacity) each layer needs to operate, given the budget constraints?". Moreover, unpredictability of streaming data arrival
doi:10.1016/j.jcss.2016.11.002 fatcat:clwx4od7nnh5xdwm4lfhncf34u