Exploiting the GPU Power for Intensive Geometric and Imaging Data Computation
Jianqing Wang
Computer graphics, imaging and visualization nowadays requires dealing with and performing various analysis on large amount of data. For example, deformation and skeletal animation of complex geometries in real-time, multiple-level discrete wavelet transform on high resolution imaging data, etc. These operations usually are computational intensive and impose a heavy burden on the CPU, which are also hard to achieve real-time performance. On the other hand, with the recent advances in consumer-level graphics hardware, the current new generation of graphics accelerator now consists of a graphics processing unit (GPU) which offers SIMD-based parallel processing power. It doesn't merely do the job of rendering texture-mapped polygons, but also provide us with high-precision rendering pipeline and high programmability nowadays. We can perform other general purpose computing on it when carefully designed. In this thesis, we have successfully exploited the power of GPU for computation and processing of both geometric data and imaging data in the 2 applications -- real-time character facial and skeletal animation; and multiple levels of discrete wavelet transform. We develop parallel algorithms to map our solutions to the GPU SIMD architecture and leverage its power to give a great performance gain in both applications. These approaches also offload the intensive computing tasks from CPU and achieve load balancing between CPU and GPU. At the same time, for the virtual character project, we also propose a simple and efficient framework for both facial and skeletal animation, as well as the seamless integration of them for rendering. The solutions for supporting multilingual lip synchronization and integration with text-to-speech system of multiple languages are also developed.
Related publication:
- " Discrete Wavelet Transform on Consumer-Level Graphics Hardware",
T. T. Wong, C. S. Leung, P. A. Heng and J. Wang,
IEEE Transactions on Multimedia, Vol. 9, No. 3, April 2007, pp. 668-673.
- "Discrete Wavelet Transform on GPU",
J. Wang, T. T. Wong, P. A. Heng and C. S. Leung,
in Proceedings of ACM Workshop on General Purpose Computing on Graphics Processors, Los Angeles, USA, August 2004, pp. C-41.
- "A Real-Time Cantonese Text-To-Audiovisual Speech Synthesizer",
J. Q. Wang, K. H. Wong, P. A. Heng, H. M. Meng and T. T. Wong,
in Proceedings of IEEE International Conference on Acoustics, Speech, and Signal Processing (ICASSP 2004), Vol. I, Montreal, Quebec, Canada, May 2004, pp. 653-656.