Computational Photography and Videography

Overview

• High dynamic range imaging. Recovering an HDR image from differently exposed photographs has become very popular. However, it often requires a tripod to keep the camera still because, when taking photos with a hand-held camera, long-exposed photographs often become blurred. We proposed a method to allow HDR photo taking with hand-held cameras by iteratively performing blur kernel estimation, HDR image reconstruction and camera curve recovery. When convergence, we simultaneously obtain an HDR image with rich and clear structures, the camera response curve and blur kernels. The proposed algorithm makes easy HDR image taking. It was accepted by CVPR 2009.
  
  
• Video Stabilization. Casual videos taken by amateurs often exhibits annoying jitter due to shaky motion of an unsteady handheld camera. Video stabilization removes unwanted video perturbations due to unstable camera motions for enhancing user's experiences in watching casual videos. In ICCV 2009, we proposed an approach to stabilize a video by smoothing feature trajectories without explicitly estimating camera motion. The method is more robust than previous methods which often rely on motion estimation.
  
  
• Image Resizing. Image resizing has received considerable attention recently and many content-aware methods have been proposed. However, few specifically pay attention to preserve line structure properties. Since human are often very sensitive to distortions of geometric structures such as lines, such distortions often look more noticeable and disturbing. We proposed an image resizing method to simultaneously minimize content distortion of prominent regions and preserve important line-structure properties: parallelism, collinearity and orientation. It has been accepted by CVPR 2012
  
  
• Moire Pattern Synthesis. In ICCV 2013, we proposed a method for target-driven moire pattern synthesis: Given a target image I, find two curvilinear grating images L1 and L2 such that the moire pattern of their superposition is close to I. The technique can be used for generating moire arts and moire cryptography.
  
  
• Shape-preserving warps. In CVPR 2014, we proposed a novel parametric warp which is a spatial combination of a projective transformation and a similarity transformation. The proposed warp has the strengths of both projective and similarity warps. It provides good alignment accuracy as projective warps while preserving the perspective of individual image as similarity warps. It can also be combined with more advanced local-warp-based alignment methods such as the as-projective-as-possible warp for better alignment accuracy. With the proposed warp, the field of view can be extended by stitching images with less projective distortion (stretched shapes and enlarged sizes).
  
  
• Natural image stitching. In ECCV 2016, we proposed a technique for natural image stitching which strike a good trade-off among alignment accuracy, distortion reduction and naturalness. For improving the naturalness of the results, we add a global similarity prior that constrains the warp of each image so that it resembles a similarity transformation as a whole.
  
  
• Image deblurring. In CVPR 2015, we propose a single-image blur kernel estimation algorithm that utilizes the normalized color-line prior to restore sharp edges without altering edge structures or enhancing noise. A comprehensive evaluation on a large image deblurring dataset shows that our algorithm achieves the state-of-the-art results.

Publications

Natural Image Stitching with the Global Similarity Prior

Yu-Sheng Chen, Yung-Yu Chuang

ECCV 2016

Blur Kernel Estimation using Normalized Color-Line Priors

Wei-Sheng Lai, Jian-Jiun Ding, Yen-Yu Lin, Yung-Yu Chuang

CVPR 2015

Shape-Preserving Half-Projective Warps for Image Stitching

Che-Han Chang, Yoichi Sato, Yung-Yu Chuang

CVPR 2014

Target-Driven Moire Pattern Synthesis by Phase Modulation

Pei-Hen Tsai, Yung-Yu Chuang

ICCV 2013

Rectangling Stereographic Projection for Wide-Angle Image Visualization

Che-Han Chang, Min-Chun Hu, Wen-Huang Cheng, Yung-Yu Chuang

ICCV 2013

A Line-Structure-Preserving Approach to Image Resizing

Che-Han Chang, Yung-Yu Chuang

CVPR 2012

Video Stabilization using Robust Feature Trajectories

Ken-Yi Lee, Yung-Yu Chuang, Bing-Yu Chen, Ming Ouhyoung

ICCV 2009

High Dynamic Range Image Reconstruction from Hand-held Cameras

Pei-Ying Lu, Tz-Huan Huang, Meng-Sung Wu, Yi-Ting Cheng, Yung-Yu Chuang

CVPR 2009

Animating Pictures with Stochastic Motion Textures

Yung-Yu Chuang, Dan B Goldman, Ke Colin Zheng, Brian Curless, David Salesin, Richard Szeliski

SIGGRAPH 2005

Support

• NSC101-2628-E-002-031-MY3
• NSC102-2622-E-002-013-CC2
• NSC100-2628-E-002-009
• NSC100-2622-E-002-016-CC2
• NSC97-2622-E-002-010-CC2
• NTU-98R0062-04