Backlog Estimation and Management for Real-Time Data Services

Kyoung-Don Kang, Jisu Oh, Yan Zhou
2008 2008 Euromicro Conference on Real-Time Systems  
Real-time data services can benefit data-intensive real-time applications, e.g., e-commerce, via timely transaction processing using fresh data, e.g., the current stock prices. To enhance the real-time data service quality, we present several novel techniques for (1) database backlog estimation, (2) fine-grained closedloop admission control based on the backlog model, and (3) hint-based incoming load smoothing. Our backlog estimation and feedback control aim to support the desired service delay
more » ... bound without degrading the data freshness critical for real-time data services. Workload smoothing, under overload, help the database admit and process more transactions in a timely manner by probabilistically reducing the burstiness of incoming data service requests. In terms of the data service delay and throughput, our feedback-based admission control and probabilistic load smoothing considerably outperform the baselines, which represent the current state of the art, in the experiments performed in a stock trading database testbed.
doi:10.1109/ecrts.2008.11 dblp:conf/ecrts/KangOZ08 fatcat:vdcpocdxf5ddpgz5ij2bs3rbta