Design and Implement of Large-scale Social Network Analysis Platform Based on Hadoop

Di Yang, Huamin Yang, Peng Wang, Songjiang Li
2017 Journal of Information Hiding and Multimedia Signal Processing  
With the rapid development of social networks, Social Network Analysis (SNA) has become an important research direction. Aiming at the convenience of analyzing big data of social network, this paper designs a Hadoop based large-scale social network analysis platform (HNAP) for processing and analyzing large-scale data sets in a distributed environment. The designs of system framework, data model and processing model are introduced in detail. We also stresses on analyzing the characteristics of
more » ... mporting file format in preprocessing, the necessary features for an algorithm suitable for Hadoop platform and post-processing model in processing model. Finally, the rationality of the platform is verified by experiments. Our design is fully applicable to large-scale social network analysis, and takes full account of expandability in the future.
dblp:journals/jihmsp/YangYWL17 fatcat:g4twndclvrg2bh62x37eyfwdci