An Overview of Apache Pig and Apache Hive

Saiyam Arora, Abinesh Verma, Richa Vasuja, Richa Vasuja
2019 International Journal of Scientific Research in Computer Science Engineering and Information Technology  
Ever since the enhancement of technology has taken place, the data is growing at an alarming rate. The most prominent factor of data growth is the "Social Media", leads to the origination of a tremendous amount of data called Big Data. Big Data is a term used for data sets that are extremely large in size as well as complicated to store and process using traditional database processing applications. A saviour to deal with Big Data is "Hadoop" and two major components of Hadoop which are HDFS
more » ... stributed Storage) and Map Reduce(Parallel Processing). Apache Pig and Hive is an essential part of the Hadoop Ecosystem. This paper covers an overview of both Apache Pig and Hive with their architecture. As Hadoop, no doubt is doing tremendously great work by storing and processing the huge volume of data but there are more frameworks now a days to increase the efficiency of Hadoop framework which are basically seen as the layers of Hadoop or a part of Apache Hadoop project. And that is why this paper includes the two most important layers namely Apache Pig and Apache Hive.
doi:10.32628/cseit195250 fatcat:va5776oqtvfhvplit2qduevlqy