Unsupervised Metric Learning for Face Identification in TV Video

Download

index.pdf

Date

2011-01-01

Author

Cinbiş, Ramazan Gökberk
Schmid, Cordelia

Metadata

Show full item record

This work is licensed under a Creative Commons Attribution-NonCommercial-NoDerivatives 4.0 International License.

Item Usage Stats

105
views

0
downloads

The goal of face identification is to decide whether two faces depict the same person or not. This paper addresses the identification problem for face-tracks that are automatically collected from uncontrolled TV video data. Face-track identification is an important component in systems that automatically label characters in TV series or movies based on subtitles and/or scripts: it enables effective transfer of the sparse text-based supervision to otherfaces. We show that, without manually labeling any examples, metric learning can be effectively used to address this problem. This is possible by using pairs of faces within a track as positive examples, while negative training examples can be generated from pairs of face tracks of different people that appear together in a video frame. In this manner we can learn a cast-specific metric, adapted to the people appearing in a particular video, without using any supervision. Identification performance can be further improved using semi-supervised learning where we also include labels for some of the face tracks. We show that our cast-specific metrics not only improve identification, but also recognition and clustring.

Subject Keywords

Face, Robustness, Feature extraction, TV , Face recognition, Training, Measurement

URI

https://hdl.handle.net/11511/56156

DOI

https://doi.org/10.1109/iccv.2011.6126415

Conference Name

IEEE International Conference on Computer Vision (ICCV)

Collections

Department of Computer Engineering, Conference / Seminar

Suggestions

OpenMETU
Core

Design of a feature set for face recognition problem Akbaş, Emre (2006-11-03) An important problem in face recognition is the design of the feature space which represents the human face. Various feature sets have been and are continually being proposed for this purpose. However, there exists no feature set which gives a superior and consistent recognition performance on various face databases. Concatenating the popular features together and forming a high dimensional feature space introduces the curse of dimensionality problem. For this reason, dimensionality reduction techniques suc...
Quantification of the effect of symmetry in face perception Dövencioğlu, N. Dicle; Gökçay, Didem; Department of Cognitive Sciences (2008) Facial symmetry has been a central component in many studies on face perception. The relationship between bilateral symmetry and subjective judgments on faces is still arguable in the literature. In this study, a database of natural looking face images with different levels of symmetry is constructed using several digital preprocessing and morphing methods. Our aim is to investigate the correlations between quantified asymmetry, perceived symmetry and a subjective judgment: ‘attractiveness’. Images in the M...
GAYE: A face recognition system Kepenekci, B; Tek, FB; Cilingir, O; Sakarya, U; Akar, Gözde (2004-01-21) In this paper, a new face recognition system, GAYE, is presented. GAYE is a fully automatic system that detects and recognizes faces in cluttered scenes. The input of the system is any digitized image/image sequence that includes face/faces. The basic building blocks of the system are face detection, feature extraction and feature comparison. Face detection is based on skin color segmentation. For feature extraction, a novel approach is proposed that depends on the Gabor wavelet transform of the face image....
3D face recognition with local shape descriptors İnan, Tolga; Halıcı, Uğur; Department of Electrical and Electronics Engineering (2011) This thesis represents two approaches for three dimensional face recognition. In the first approach, a generic face model is fitted to human face. Local shape descriptors are located on the nodes of generic model mesh. Discriminative local shape descriptors on the nodes are selected and fed as input into the face recognition system. In the second approach, local shape descriptors which are uniformly distributed across the face are calculated. Among the calculated shape descriptors that are discriminative fo...
Infrared face recognition Konuk, Uğur; Akar, Gözde; Department of Electrical and Electronics Engineering (2015) Face recognition is a leading biometrics technique that fulfills the increasing need to identify a person in today’s world. Face recognition also has broad range of utilization, such as commercial and law enforcement applications. That is the reason why it still gathers a lot of attention and is an active research topic. Nevertheless visible spectrum face recognition algorithms are not free of challenges. Illumination, pose, expression variances and existence of facial disguises still degrade the performanc...

Citation Formats

R. G. Cinbiş and C. Schmid, “Unsupervised Metric Learning for Face Identification in TV Video,” presented at the IEEE International Conference on Computer Vision (ICCV), Barcelona, SPAIN, 2011, Accessed: 00, 2020. [Online]. Available: https://hdl.handle.net/11511/56156.