Efficient and Parallel Data Processing and Resource Allocation in the Cloud by using Nephele's Data Processing Framework

V. Saranya, S. Ramya, R.G. Suresh Kumar, T. Nalini
2016 International Journal of Grid and Distributed Computing  
Cloud computing is a technology in which the Cloud Service Providers (CSP) provide many virtual servers to the users to store their information in the cloud. The faults occurring on the assignment and dismission of the virtual machines, the processing cost in the allocation of resources must also be considered. The parallel processing of the information on the virtual machines must be done effectively and in an efficient manner. A variety of systems were developed to facilitate Many Task
more » ... ng (MTC). These systems aim to hide the issues of parallelism and fault tolerant and they are used in many applications. In this paper, we introduced Nephele, a data processing framework to exploit dynamic resource provisioning offered by IaaS clouds. The performance evaluation of the virtual machines has been evaluated and the allocation and deallocation of job tasks to the specific virtual machines has also been considered. A performance comparison with the well known data processing framework hadoop has been done. Thus this paper tells about the effective and efficient manner of processing the data by parallel processing and allocating the correct resources for the desired task. It also helps to reduce the cost of resource utilization by exploiting the dynamic resource utilization. the enterprise and it is extended from single corporate to large enterprise. The applications and services offered by cloud are available to variety of users and enterprises. Cloud provides the services over the internet by hiding the hardware it uses from the users. The cloud users connect to the cloud from their personal computer or any accessible device. The users are unaware of where their data are stored and how their data are stored. The data may be stored on various number of remote servers and data may be splitted into various parts before storage. This is usually done for security purpose. The cloud users are not known about this method followed by the cloud. Microsoft office communication online, Windows azure, Google app engine, Amazon web services, Gogrid are some applications that uses cloud computing [1]. intrusion. We planned for secure transmission of information from source to destination that are forwarded by active nodes.
doi:10.14257/ijgdc.2016.9.3.05 fatcat:2o72jgi42feqpn4lvavockif5e