What will Your Future Child Look Like? Modeling and Synthesis of Hereditary Patterns of Facial Dynamics

2017-06-03
Ertugrul, Itir Onal
Dibeklioglu, Hamdi
Analysis of kinship from facial images or videos is an important problem. Prior machine learning and computer vision studies approach kinship analysis as a verification or recognition task. In this paper, first time in the literature, we propose a kinship synthesis framework, which generates smile videos of (probable) children from the smile videos of parents. While the appearance of a child's smile is learned using a convolutional encoder-decoder network, another neural network models the dynamics of the corresponding smile. The smile video of the estimated child is synthesized by the combined use of appearance and dynamics models. In order to validate our results, we perform kinship verification experiments using videos of real parents and estimated children generated by our framework. The results show that generated videos of children achieve higher correct verification rates than those of real children. Our results also indicate that the use of generated videos together with the real ones in the training of kinship verification models, increases the accuracy, suggesting that such videos can be used as a synthetic dataset.

Suggestions

Contrast Enhancement of Microscopy Images Using Image Phase Information
Çakır, Serhat; Atalay, Rengül; ÇETİN, AHMET ENİS (2018-01-01)
Contrast enhancement is an important preprocessing step for the analysis of microscopy images. The main aim of contrast enhancement techniques is to increase the visibility of the cell structures and organelles by modifying the spatial characteristics of the image. In this paper, phase information-based contrast enhancement framework is proposed to overcome the limitations of existing image enhancement techniques. Inspired by the groundbreaking design of the phase contrast microscopy (PCM), the proposed ima...
Comparison of histograms of oriented optical flow based action recognition methods
Erciş, Fırat; Ulusoy, İlkay; Department of Electrical and Electronics Engineering (2012)
In the task of human action recognition in uncontrolled video, motion features are used widely in order to achieve subject and appearence invariance. We implemented 3 Histograms of Oriented Optical Flow based method which have a common motion feature extraction phase. We compute an optical flow field over each frame of the video. Then those flow vectors are histogrammed due to angle values to represent each frame with a histogram. In order to capture local motions, The bounding box of the subject is divided...
Statistical analysis of local 3D structure in 2D images
Kalkan, Sinan; Wörgötter, Florentin; Krüger, Norbert (2006-01-01)
For the analysis of images, a deeper understanding of their intrinsic structure is required. This has been obtained for 2D images by means of statistical analysis [15, 18]. Here, we analyze the relation between local image structures (i.e., homogeneous, edge-like, corner-like or texture-like structures) and the underlying local 3D structure, represented in terms of continuous surfaces and different kinds of 3D discontinuities, using 3D range data with the true color information. We find that homogeneous ima...
Ongoing mechanism in the tactile communication between children and adults in picture storybooks for 4-to-6-yearolds
Eryiğit, Sümeyra; Olgan, Refika; Department of Early Childhood Education (2017)
The purpose of this study is to investigate the characteristics of meaning categories for individual touches in picture storybooks for 4-to-6-year-olds and related contextual factors and descriptive features. The sample of the study involves 489 picture storybooks for 4-to-6-year-olds. Qualitative analysis and inferential statistics were conducted. Ali Dayı Children Library in Ankara was chosen as the site to collect data, which required three weeks. Data was collected through a codebook, which was develope...
Cinematic representation of gecekondu as an urban memory
Seçkiner, Vildan; Sargın, Güven Arif; Department of City and Regional Planning (2009)
The purpose of this study is to assess Turkish squatters, namely ‘gecekondu’ over the image in cinema in terms of a visual urban archive. In order to analyze this representation in cinema as an urban image, both the cinematic production and urban theoretical approaches about migration and gecekonduzation process are discussed in order to find out the parallelism between the stories of gecekondu in these two fields, and to crosscheck the cinematic image of gecekondu. Therefore, the study is held in accordanc...
Citation Formats
I. O. Ertugrul and H. Dibeklioglu, “What will Your Future Child Look Like? Modeling and Synthesis of Hereditary Patterns of Facial Dynamics,” 2017, p. 33, Accessed: 00, 2020. [Online]. Available: https://hdl.handle.net/11511/65812.