Compressing the Illumination-Adjustable Images with Principal Component Analysis

Pun-Mo Ho , Tien-Tsin Wong and Chi-Sing Leung
IEEE Transactions on Circuits and Systems for Video Technology, Vol. 15, No. 3, March 2005, pp. 355-364.

Abstract

The ability to change illumination is a crucial factor in image-based modeling and rendering. Image-based relighting offers such capability. However, the trade-off is the enormous increase of storage requirement. In this paper, we propose a compression scheme that effectively reduces the data volume while maintaining the real-time relighting capability. The proposed method is based on principal component analysis (PCA). A block-wise PCA is used to practically process the huge input data. The output of PCA is a set of eigenimages and the corresponding relighting coefficients. By dropping those low-energy eigenimages, the data size is drastically reduced. To further compress the data, eigenimages left are compressed using transform coding and quantization while the relighting coefficients are compressed using uniform quantization. We also suggest the suitable target bit rate for each phase of the compression method in order to preserve the visual quality. Finally, we propose a real-time engine that relights images from the compressed data.

Download Paper

Related Publications

  1. " Compression of Illumination-Adjustable Images",
    T. T. Wong and C. S. Leung,
    IEEE Transactions on Circuits and Systems for Video Technology (special issue on Image-based Modeling, Rendering and Animation), Vol. 13, No. 11, November 2003, pp. 1107-1118.

  2. " The Plenoptic Illumination Function",
    T. T. Wong, C. W. Fu, P. A. Heng and C. S. Leung,
    IEEE Transactions on Multimedia, Vol. 4, No. 3, September 2002, pp. 361-371.
    (This paper received the IEEE Transactions on Multimedia Prize Paper Award 2005.)