Emerging semantic communities in peer web search

R. Akavipat, L.-S. Wu, F. Menczer, A.G. Maguitman
2006 Proceedings of the international workshop on Information retrieval in peer-to-peer networks - P2PIR '06  
Peer network systems are becoming an increasingly important development in Web search technology. Many studies show that peer search systems perform better when a query is sent to a group of peers semantically similar to the query. This suggests that semantic communities should form so that a query can quickly propagate to many appropriate peers. For the network to be functional, its dynamic communication topology must match the semantic clustering of peers. We introduce two criteria to
more » ... a peer search network based on the concept of semantic locality: first, the "smallworld" topology of the network; second, we use topical semantic similarity to monitor the quality of a peer's neighbors over time by looking at whether a peer chooses semantically appropriate neighbors to route its queries. We present several simulation experiments conducted with different peer search algorithms on our peer Web search system, 6S. The results suggest that 6S, despite its use of an unstructured overlay network; can effectively foster the spontaneous formation of semantic communities through local peer interactions alone. There are many aspects of peer-to-peer application performance, such as the degree of fault tolerance, scalability, quality of service, and network traffic. In this paper, we propose a different factor that can also predict the performance of a peer search application, the existence of semantic communities in peer systems. To achieve good results for a text query, a peer search system must try to predict which peers are best suited for the query. The best candidates for the query are the peers whose content is semantically closest to the query. Several studies confirm this observation [8, 27, 31] . They show that when peers are grouped by their semantic similarity, the performance of the system increases. Therefore, in this paper, we argue that the emergence of semantic communities is another important feature in peer search systems. In particular we focus on 6S, a peer search system under development by our group, and show that semantic communities can emerge even under the unstructured peer network model used by 6S. To evaluate the emergence of semantic communities, we propose measures based on two tests:
doi:10.1145/1183579.1183581 fatcat:lcrtvp776vdelpzisbkt2gydji