Mouse face tracking using convolutional neural networks

2018-03-01
Akkaya, Ibrahim Batuhan
Halıcı, Uğur
Facial expressions of laboratory mice provide important information for pain assessment to explore the effect of drugs being developed for medical purposes. For automatic pain assessment, a mouse face tracker is needed to extract the face regions in videos recorded in pain experiments. However, since the body and face of mice are the same colour and mice move fast, tracking their face is a challenging task. In recent years, with their ability to learn from data, deep learning provides effective solutions for a wide variety of problems. In particular, convolutional neural networks (CNNs) are very successful in computer vision tasks. In this study, a CNN based tracker network called MFTN is proposed for mouse face tracking. CNNs are good at extracting hierarchical features from the training dataset. High-level features contain semantic features and low-level features have high spatial resolution. In the proposed MFTN architecture, target information is extracted from a combination of low- and high-level features by a sub-network, namely the Feature Adaptation Network (FAN), to achieve a robust and accurate tracker. Among the MFTN versions, the MFTN/c tracker achieved an accuracy of 0.8, robustness of 0.67, and a throughput of 213fps on a workstation with GPU.
IET COMPUTER VISION

Suggestions

Assesment of Pain in Mouse Facial Images
ERAL, Mustafa; ÇAKIR AKTAŞ, Canan; EREN KOÇAK, EMİNE; DALKARA, TURGAY; Halıcı, Uğur (2016-11-05)
Analysing mouse behavior in medical experiments to determine adverse effects of medical drugs requires special expertise and it is a time consuming tedious task. Automatic scaling of facial pain mimics in mice are important for a fast and objective labeling. Although there exists a manual procedure for scaling mouse facial pain expression, a full automatic method does not exist yet. In this paper, a computational method is proposed for assesment of pain through facial exressions of mouses in experiments whe...
Mouse face tracking using convolutional neural networks
Akkaya, İbrahim Batuhan; Halıcı, Uğur; Department of Electrical and Electronics Engineering (2016)
Laboratory mice are frequently used in biomedical studies. Facial expressions of mice provide important data about various issues. For this reason real time tracking of mice provide output to both researcher and software that operate on face image directly. Since body and face of mice is the same color and mice moves fast, tracking of face of mice is a challenging task. In recent years, methods that use artificial neural networks provide effective solutions to problems such as classification, decision makin...
Automatic Bayesian segmentation of human facial tissue using 3D MR-CT fusion by incorporating models of measurement blurring, noise and partial volume
Şener, Emre; Kanoğlu, Utku; Mumcuoğlu, Ünal Erkan; Department of Engineering Sciences (2012)
Segmentation of human head on medical images is an important process in a wide array of applications such as diagnosis, facial surgery planning, prosthesis design, and forensic identification. In this study, a new Bayesian method for segmentation of facial tissues is presented. Segmentation classes include muscle, bone, fat, air and skin. The method incorporates a model to account for image blurring during data acquisition, a prior helping to reduce noise as well as a partial volume model. Regularization ba...
Automatic segmentation of human facial tissue by MRI-CT fusion: A feasibility study
Kale, Emre H.; Mumcuoğlu, Ünal Erkan; HAMCAN, Salih (2012-12-01)
The aim of this study was to develop automatic image segmentation methods to segment human facial tissue which contains very thin anatomic structures. The segmentation output can be used to construct a more realistic human face model for a variety of purposes like surgery planning, patient specific prosthesis design and facial expression simulation. Segmentation methods developed were based on Bayesian and Level Set frameworks, which were applied on three image types: magnetic resonance imaging (MRI), compu...
Tracking Mice Face in Video
AKKAYA, Batuhan; TABAR, Yousef Rezaei; GHARBALCHİ, Fourough; Ulusoy, İlkay; Halıcı, Uğur (2016-01-01)
Laboratory mice are frequently used in biomedical studies. Facial expressions of mice provides important data about various issues. For this reason real time tracking of mice provide output to both researcher and software that operate on face image directly. Since body and face of laboratory mice is the same color and mice moves fast, tracking of face of mice is a challenging task. In recent years, methods that uses artificial neural networks provide effective solutions to problems such as classification, d...
Citation Formats
I. B. Akkaya and U. Halıcı, “Mouse face tracking using convolutional neural networks,” IET COMPUTER VISION, pp. 153–161, 2018, Accessed: 00, 2020. [Online]. Available: https://hdl.handle.net/11511/40413.