Two-Dimensional Distributed Inverted Files [chapter]

Esteban Feuerstein, Mauricio Marin, Michel Mizrahi, Veronica Gil-Costa, Ricardo Baeza-Yates
2009 Lecture Notes in Computer Science  
Term-partitioned indexes are generally inefficient for the evaluation of conjunctive queries, as they require the communication of long posting lists. On the other side, document-partitioned indexes incur in excessive overheads as the evaluation of every query involves the participation of all the processors, therefore their scalability is not adequate for real systems. We propose to arrange a set of processors in a two-dimensional array, applying term-partitioning at row level and
more » ... itioning at column level. Choosing the adequate number of rows and columns given the available number of processors, together with the selection of the proper ways of partitioning the index over that topology is the subject of this paper.
doi:10.1007/978-3-642-03784-9_20 fatcat:5kloeouqsndadop4belgpqqjca