Morphable 3D facial animation based on thin plate splines

Download
2010
Erdoğdu, Aysu
The aim of this study is to present a novel three dimensional (3D) facial animation method for morphing emotions and facial expressions from one face model to another. For this purpose, smooth and realistic face models were animated with thin plate splines (TPS). Neutral face models were animated and compared with the actual expressive face models. Neutral and expressive face models were obtained from subjects via a 3D face scanner. The face models were preprocessed for pose and size normalization. Then muscle and wrinkle control points were located to the source face with neutral expression according to the human anatomy. Facial Action Coding System (FACS) was used to determine the control points and the face regions in the underlying model. The final positions of the control points after a facial expression were received from the expressive scan data of the source face. Afterwards control points were transferred to the target face using the facial landmarks and TPS as the morphing function. Finally, the neutral target face was animated with control points by TPS. In order to visualize the method, face scans with expressions composed of a selected subset of action units found in Bosphorus Database were used. Five lower-face and three-upper face action units are simulated during this study. For experimental results, the facial expressions were created on the 3D neutral face scan data of a human subject and the synthetic faces were compared to the subject’s actual 3D scan data with the same facial expressions taken from the dataset.

Suggestions

Multiview 3d reconstruction of a scene containing independently moving objects
Tola, Engin; Alatan, Abdullah Aydın; Department of Electrical and Electronics Engineering (2005)
In this thesis, the structure from motion problem for calibrated scenes containing independently moving objects (IMO) has been studied. For this purpose, the overall reconstruction process is partitioned into various stages. The first stage deals with the fundamental problem of estimating structure and motion by using only two views. This process starts with finding some salient features using a sub-pixel version of the Harris corner detector. The features are matched by the help of a similarity and neighbo...
Computer simulation and implementation of a visual 3-d eye gaze tracker for autostreoscopic displays
İnce, Kutalmış Gökalp; Alatan, Abdullah Aydın; Department of Electrical and Electronics Engineering (2009)
In this thesis, a visual 3-D eye gaze tracker is designed and implemented to tested via computer simulations and on an experimental setup. Proposed tracker is designed to examine human perception on autostereoscopic displays when the viewer is 3m away from such displays. Two different methods are proposed for calibrating personal parameters and gaze estimation, namely line of gaze (LoG) and line of sight (LoS) solutions. 2-D and 3-D estimation performances of the proposed system are observed both using comp...
Java applets for simulation of magnetic resonance imaging
Altın, Çağdaş; Gençer, Nevzat Güneri; Department of Electrical and Electronics Engineering (2008)
The aim of this study is to develop an easily accessible and realistic magnetic resonance imaging (MRI) simulation tool for educational and research purposes. With this aim, NMR (nuclear magnetic resonance imaging) phenomenon is simulated based on the physical principles, starting from the motion of a spin under the influence of external magnetic fields to pulse sequences generating the image. The inputs of the simulation are a 3D virtual object and a pulse sequence definition. The simulation software gener...
Prioritized 3D scene reconstruction and rate-distortion efficient representation for video sequences
İmre, Evren; Alatan, Abdullah Aydın; Department of Electrical and Electronics Engineering (2007)
In this dissertation, a novel scheme performing 3D reconstruction of a scene from a 2D video sequence is presented. To this aim, first, the trajectories of the salient features in the scene are determined as a sequence of displacements via Kanade-Lukas-Tomasi tracker and Kalman filter. Then, a tentative camera trajectory with respect to a metric reference reconstruction is estimated. All frame pairs are ordered with respect to their amenability to 3D reconstruction by a metric that utilizes the baseline dis...
Analysis and design of microstrip printed structures on electromagnetic bandgap substrates
Güdü, Tamer; Alatan, Lale; Department of Electrical and Electronics Engineering (2008)
In the first part of the thesis, the 2-D structures in stratified media are analyzed using an efficient MoM technique. The method is used to optimize transmitted or reflected electric fields from the 2-D structures. The genetic algorithm is used in the optimization process. In the second part a 3-D MoM technique is implemented to analyze multilayered structures with periodically implanted material blocks. Using the method, the dispersion and reflection characteristics of the structure are calculated for dif...
Citation Formats
A. Erdoğdu, “Morphable 3D facial animation based on thin plate splines,” M.S. - Master of Science, Middle East Technical University, 2010.