
The student-t mixture as a natural image patch prior with application to image compression
- Author
- Aäron van den Oord (UGent) and Benjamin Schrauwen (UGent)
- Organization
- Abstract
- Recent results have shown that Gaussian mixture models (GMMs) are remarkably good at density modeling of natural image patches, especially given their simplicity. In terms of log likelihood on real-valued data they are comparable with the best performing techniques published, easily outperforming more advanced ones, such as deep belief networks. They can be applied to various image processing tasks, such as image denoising, deblurring and inpainting, where they improve on other generic prior methods, such as sparse coding and field of experts. Based on this we propose the use of another, even richer mixture model based image prior: the Student-t mixture model (STM). We demonstrate that it convincingly surpasses GMMs in terms of log likelihood, achieving performance competitive with the state of the art in image patch modeling. We apply both the GMM and STM to the task of lossy and lossless image compression, and propose efficient coding schemes that can easily be extended to other unsupervised machine learning models. Finally, we show that the suggested techniques outperform JPEG, with results comparable to or better than JPEG 2000.
- Keywords
- SPARSE, MODELS, REPRESENTATION, LIKELIHOOD, ALGORITHM, STANDARD, EXPERTS, image compression, mixture models, GMM, density modeling, unsupervised learning
Downloads
-
(...).pdf
- full text
- |
- UGent only
- |
- |
- 9.55 MB
Citation
Please use this url to cite or link to this publication: http://hdl.handle.net/1854/LU-5706323
- MLA
- van den Oord, Aäron, and Benjamin Schrauwen. “The Student-t Mixture as a Natural Image Patch Prior with Application to Image Compression.” JOURNAL OF MACHINE LEARNING RESEARCH, edited by Ruslan Salakhutdinov, vol. 15, 2014, pp. 2061–86.
- APA
- van den Oord, A., & Schrauwen, B. (2014). The student-t mixture as a natural image patch prior with application to image compression. JOURNAL OF MACHINE LEARNING RESEARCH, 15, 2061–2086.
- Chicago author-date
- Oord, Aäron van den, and Benjamin Schrauwen. 2014. “The Student-t Mixture as a Natural Image Patch Prior with Application to Image Compression.” Edited by Ruslan Salakhutdinov. JOURNAL OF MACHINE LEARNING RESEARCH 15: 2061–86.
- Chicago author-date (all authors)
- van den Oord, Aäron, and Benjamin Schrauwen. 2014. “The Student-t Mixture as a Natural Image Patch Prior with Application to Image Compression.” Ed by. Ruslan Salakhutdinov. JOURNAL OF MACHINE LEARNING RESEARCH 15: 2061–2086.
- Vancouver
- 1.van den Oord A, Schrauwen B. The student-t mixture as a natural image patch prior with application to image compression. Salakhutdinov R, editor. JOURNAL OF MACHINE LEARNING RESEARCH. 2014;15:2061–86.
- IEEE
- [1]A. van den Oord and B. Schrauwen, “The student-t mixture as a natural image patch prior with application to image compression,” JOURNAL OF MACHINE LEARNING RESEARCH, vol. 15, pp. 2061–2086, 2014.
@article{5706323, abstract = {{Recent results have shown that Gaussian mixture models (GMMs) are remarkably good at density modeling of natural image patches, especially given their simplicity. In terms of log likelihood on real-valued data they are comparable with the best performing techniques published, easily outperforming more advanced ones, such as deep belief networks. They can be applied to various image processing tasks, such as image denoising, deblurring and inpainting, where they improve on other generic prior methods, such as sparse coding and field of experts. Based on this we propose the use of another, even richer mixture model based image prior: the Student-t mixture model (STM). We demonstrate that it convincingly surpasses GMMs in terms of log likelihood, achieving performance competitive with the state of the art in image patch modeling. We apply both the GMM and STM to the task of lossy and lossless image compression, and propose efficient coding schemes that can easily be extended to other unsupervised machine learning models. Finally, we show that the suggested techniques outperform JPEG, with results comparable to or better than JPEG 2000.}}, author = {{van den Oord, Aäron and Schrauwen, Benjamin}}, editor = {{Salakhutdinov, Ruslan}}, issn = {{1533-7928}}, journal = {{JOURNAL OF MACHINE LEARNING RESEARCH}}, keywords = {{SPARSE,MODELS,REPRESENTATION,LIKELIHOOD,ALGORITHM,STANDARD,EXPERTS,image compression,mixture models,GMM,density modeling,unsupervised learning}}, language = {{eng}}, pages = {{2061--2086}}, title = {{The student-t mixture as a natural image patch prior with application to image compression}}, url = {{http://www.jmlr.org/papers/volume15/vandenoord14a/vandenoord14a.pdf}}, volume = {{15}}, year = {{2014}}, }