A Scalable Randomized Method to Compute Link-Based Similarity Rank on the Web Graph [chapter]

Dániel Fogaras, Balázs Rácz
2004 Lecture Notes in Computer Science  
Several iterative hyperlink-based similarity measures were published to express the similarity of web pages. However, it usually seems hopeless to evaluate complex similarity functions over large repositories containing hundreds of millions of pages. We introduce scalable algorithms computing SimRank scores, which express the contextual similarities of pages based on the hyperlink structure. The proposed methods scale well to large repositories, fulfilling strict requirements about
more » ... complexity, memory usage and parallelization. The algorithms were tested on a set of ten million pages, but parallelization techniques make it possible to compute the SimRank scores even for the entire web with over 4 billion pages. The key idea of this paper is that randomized Monte Carlo methods combined with indexing techniques yield a scalable approximation of SimRank.
doi:10.1007/978-3-540-30192-9_55 fatcat:2xtr5dixizexpef7qchuy4mgn4