A web search engine model based on index-query bit-level compression

Hussein Al-Bahadili, Saif Al-Saab, Reyadh Naoum, Shakir M. Hussain
2010 Proceedings of the 1st International Conference on Intelligent Semantic Web-Services and Applications - ISWSA '10  
In this paper, we propose a new web search engine model based on index-query bit-level compression. The model incorporates two bit-level compression layers both implemented at the backend processor (server) side, one layer resides after the indexer acting as a second compression layer to generate a double compressed index, and the second layer be located after the query parser for query compression to enable bit-level compressed index-query search. This contributes to reducing the size of the
more » ... dex file as well as reducing disk I/O overheads, and consequently yielding higher retrieval rate and performance. The data compression scheme used in this model is the adaptive character wordlength (ACW(n,s)) scheme, which is an asymmetric, lossless, bit-level scheme that permits compressed index-query search. Results investigating the performance of the ACW(n,s) scheme is presented and discussed.
doi:10.1145/1874590.1874597 dblp:conf/iswsa/Al-BahadiliANH10 fatcat:ujtdl3kltnf6zlyfdmdd24yacq