Dv2v: A Dynamic Variable-to-Variable Compressor

Nieves R. Brisaboa, Antonio Farina, Adrian Gomez-Brandon, Gonzalo Navarro, Tirso V. Rodeiro
2019 2019 Data Compression Conference (DCC)  
We present Dv2v, a new dynamic (one-pass) variable-to-variable compressor. Variable-to-variable compression aims at using a modeler that gathers variable-length input symbols and a variable-length statistical coder that assigns shorter codewords to the more frequent symbols. In Dv2v, we process the input text word-wise to gather variable-length symbols that can be either terminals (new words) or non-terminals, subsequences of words seen before in the input text. Those input symbols are set in a
more » ... vocabulary that is kept sorted by frequency. Therefore, those symbols can be easily encoded with dense codes. Our Dv2v permits real-time transmission of data, i.e. compression/transmission can begin as soon as data become available. Our experiments show that Dv2v is able to overcome the compression ratios of the v2vDC, the state-of-the-art semi-static variable-to-variable compressor, and to almost reach p7zip values. It also draws a competitive performance at both compression and decompression.
doi:10.1109/dcc.2019.00016 dblp:conf/dcc/BrisaboaFGNR19 fatcat:lodwg4amifhgtnv3h6jqo5rch4