Compressing Colour Images with Joint Inpainting and Prediction [article]

Rahul Mohideen Kaja Mohideen, Pascal Peter, Tobias Alt, Joachim Weickert, Alexander Scheer
2020 arXiv   pre-print
Inpainting-based codecs store sparse, quantised pixel data directly and decode by interpolating the discarded image parts. This interpolation can be used simultaneously for efficient coding by predicting pixel data to be stored. Such joint inpainting and prediction approaches yield good results with simple components such as regular grids and Shepard interpolation on grey value images, but they lack a dedicated mode for colour images. Therefore, we evaluate different approaches for
more » ... sed colour compression. Inpainting operators are able to reconstruct a large range of colours from a small colour palette of the known pixels. We exploit this with a luma preference mode which uses higher sparsity in YCbCr colour channels than in the brightness channel. Furthermore, we propose the first full vector quantisation mode for an inpainting-based codec that stores only a small codebook of colours. Our experiments reveal that both colour extensions yield significant improvements.
arXiv:2010.09866v1 fatcat:aj67togiu5hk3ipcglz3cl4af4