Morphable 3D facial animation based on thin plate splines

Download
2010
Erdoğdu, Aysu
The aim of this study is to present a novel three dimensional (3D) facial animation method for morphing emotions and facial expressions from one face model to another. For this purpose, smooth and realistic face models were animated with thin plate splines (TPS). Neutral face models were animated and compared with the actual expressive face models. Neutral and expressive face models were obtained from subjects via a 3D face scanner. The face models were preprocessed for pose and size normalization. Then muscle and wrinkle control points were located to the source face with neutral expression according to the human anatomy. Facial Action Coding System (FACS) was used to determine the control points and the face regions in the underlying model. The final positions of the control points after a facial expression were received from the expressive scan data of the source face. Afterwards control points were transferred to the target face using the facial landmarks and TPS as the morphing function. Finally, the neutral target face was animated with control points by TPS. In order to visualize the method, face scans with expressions composed of a selected subset of action units found in Bosphorus Database were used. Five lower-face and three-upper face action units are simulated during this study. For experimental results, the facial expressions were created on the 3D neutral face scan data of a human subject and the synthetic faces were compared to the subject’s actual 3D scan data with the same facial expressions taken from the dataset.

Suggestions

Multiview 3d reconstruction of a scene containing independently moving objects
Tola, Engin; Alatan, Abdullah Aydın; Department of Electrical and Electronics Engineering (2005)
In this thesis, the structure from motion problem for calibrated scenes containing independently moving objects (IMO) has been studied. For this purpose, the overall reconstruction process is partitioned into various stages. The first stage deals with the fundamental problem of estimating structure and motion by using only two views. This process starts with finding some salient features using a sub-pixel version of the Harris corner detector. The features are matched by the help of a similarity and neighbo...
Watermarking for 3D represantations
Koz, Alper; Alatan, Abdullah Aydın; Department of Electrical and Electronics Engineering (2007)
In this thesis, a number of novel watermarking techniques for different 3D representations are presented. A novel watermarking method is proposed for the mono-view video, which might be interpreted as the basic implicit representation of 3D scenes. The proposed method solves the common flickering problem in the existing video watermarking schemes by means of adjusting the watermark strength with respect to temporal contrast thresholds of human visual system (HVS), which define the maximum invisible distorti...
Computer simulation and implementation of a visual 3-d eye gaze tracker for autostreoscopic displays
İnce, Kutalmış Gökalp; Alatan, Abdullah Aydın; Department of Electrical and Electronics Engineering (2009)
In this thesis, a visual 3-D eye gaze tracker is designed and implemented to tested via computer simulations and on an experimental setup. Proposed tracker is designed to examine human perception on autostereoscopic displays when the viewer is 3m away from such displays. Two different methods are proposed for calibrating personal parameters and gaze estimation, namely line of gaze (LoG) and line of sight (LoS) solutions. 2-D and 3-D estimation performances of the proposed system are observed both using comp...
Java applets for simulation of magnetic resonance imaging
Altın, Çağdaş; Gençer, Nevzat Güneri; Department of Electrical and Electronics Engineering (2008)
The aim of this study is to develop an easily accessible and realistic magnetic resonance imaging (MRI) simulation tool for educational and research purposes. With this aim, NMR (nuclear magnetic resonance imaging) phenomenon is simulated based on the physical principles, starting from the motion of a spin under the influence of external magnetic fields to pulse sequences generating the image. The inputs of the simulation are a 3D virtual object and a pulse sequence definition. The simulation software gener...
Prioritized 3D scene reconstruction and rate-distortion efficient representation for video sequences
İmre, Evren; Alatan, Abdullah Aydın; Department of Electrical and Electronics Engineering (2007)
In this dissertation, a novel scheme performing 3D reconstruction of a scene from a 2D video sequence is presented. To this aim, first, the trajectories of the salient features in the scene are determined as a sequence of displacements via Kanade-Lukas-Tomasi tracker and Kalman filter. Then, a tentative camera trajectory with respect to a metric reference reconstruction is estimated. All frame pairs are ordered with respect to their amenability to 3D reconstruction by a metric that utilizes the baseline dis...
Citation Formats
A. Erdoğdu, “Morphable 3D facial animation based on thin plate splines,” M.S. - Master of Science, Middle East Technical University, 2010.