In Vacuo and In Situ Evaluation of SIMD Codecs

Andrew Trotman, Jimmy Lin
2016 Proceedings of the 21st Australasian Document Computing Symposium on ZZZ - ADCS '16  
The size of a search engine index and the time to search are inextricably related through the compression codec. This investigation examines this tradeoff using several relatively unexplored SIMD-based codecs including QMX, TurboPackV, and TurboPFor. It uses (the non-SIMD) OPTPFor as a baseline. Four new variants of QMX are introduced and also compared. Those variants include optimizations for space and for time. Experiments were conducted on the TREC .gov2 collection using topics 701-850, in
more » ... awl order and in URL order. The results suggest that there is very little difference between these codecs, but that the reference implementation of QMX performs well.
doi:10.1145/3015022.3015023 fatcat:2syrr7rj4fghdh5c5tmxby7cry