Arana: A Cross-domain Workflow Scheduling System

Jian-Hua Gu, Xue-Yuan Lan, Ying Hao, Yu-Tong Hu
2017 Proceedings of the 3rd International Conference on Wireless Communication and Sensor Networks (WCSN 2016)   unpublished
Single data center is difficult to meet current demands of data storage and computing resources, leading to data broadly stored in different data centers far from each other geographically. Cross-domain big data processing usually requires data from other data centers across different network. Since the network environment is extremely complex and large amount of data is required for computing, time spent in data transmission is unacceptable, resulting in slow scheduling. In this paper, we
more » ... this paper, we propose a cross-domain workflow scheduling system called Arana. By moving program close to data and integrating popular big data processing platform, this system enables user to complete computing with cross-domain data without transferring.
doi:10.2991/icwcsn-16.2017.72 fatcat:xajx5ugo7vezjlznjlosnq5jpu