Feature detection and matching towards augmented reality applications on mobile devices

Download
2012
Gündoğdu, Erhan
Local feature detection and its applications in different problems are quite popular in vision research. In order to analyze a scene, its invariant features, which are distinguishable in many views of this scene, are used in pose estimation, object detection and augmented reality. However, required performance metrics might change according to the application type; in general, the main metrics are accepted as accuracy and computational complexity. The contributions in this thesis provide improving these metrics and can be divided into three parts, as local feature detection, local feature description and description matching in different views of the same scene. In this thesis an efficient feature detection algorithm with sufficient repeatability performance is proposed. This detection method is convenient for real-time applications. For local description, a novel local binary pattern outperforming state-of-the-art binary pattern is proposed. As a final task, a fuzzy decision tree method is presented for approximate nearest neighbor search. In all parts of the system, computational efficiency is considered and the algorithms are designed according to limited processing time. Finally, an overall system capable of matching different views of the same scene has been proposed and executed in a mobile platform. The results are quite promising such that the presented system can be used in real-time applications, such as augmented reality, object retrieval, object tracking and pose estimation.

Suggestions

3D TRACKING OF PEOPLE WITH RAO-BLACKWELLIZED PARTICLE FILTERS
Topcu, Osman; Orguner, Umut; Alatan, Abdullah Aydın; ERCAN, ALİ ÖZER (2014-04-25)
Visual tracking has an important place among computer vision applications. Visual tracking with particle filters is a well-known methodology. The performance of particle filters is dependent on efficient sampling of the state space, which in turn, is dependent on number of particles. In this paper, Rao-Blackwell technique is applied to particle filters to improve sampling efficiency. Both algorithms are applied to people tracking problem. Under the same circumstances, the resulting algorithm is demonstrated...
Computational Optical Sensing and Imaging 2021: introduction to the feature issue
Ke, Jun; Alieva, Tatiana; Öktem, Sevinç Figen; Silveira, Paulo E. X.; Wetzstein, Gordon; Willomitzer, Florian (2021-03-01)
This feature issue includes two reviews and 34 research papers that highlight recent works in the field of computational optical sensing and imaging. Many of the works were presented at the 2021 Optica (formerly OSA) Topical Meeting on Computational Optical Sensing and Imaging, held virtually from 19 July to 23 July 2021. Papers in the feature issue cover a broad scope of computational imaging topics, such as microscopy, 3D imaging, phase retrieval, non-line-of-sight imaging, imaging through scattering medi...
Absorbance Estimation and Gas Emissions Detection in Hyperspectral Imagery
Başkurt, Nur Didem; Gur, Yusuf; Omruuzun, Fatih; Çetin, Yasemin (2016-05-19)
Hyperspectral imaging in gas detection applications is a leading and widely studied research topic thanks to its high spectral resolution and remote detection ability. The main problems in these applications covers the leakage detection, gas identification, and quantification. The proposed algorithm aims to reach the transmittance and absorbance features of the gas and to detect the gaseous region by using the measured radiance data from the hyperspectral infrared sensors.
Comparison of feature sets using multimedia translation
Duygulu, P; Ozcanli, OC; Papernick, N (2003-01-01)
Feature selection is very important for many computer vision applications. However, it is hard to find a good measure for the comparison. In this study, feature sets are compared using the translation model of object recognition which is motivated by the availablity of large annotated data sets. Image regions are linked to words using a model which is inspired by machine translation. Word prediction performance is used to evaluate large numbers of images.
Performance evaluation of similarity measures for dense multimodal stereovision
Yaman, Mustafa; Kalkan, Sinan (SPIE-Intl Soc Optical Eng, 2016-05-01)
Multimodal imaging systems have recently been drawing attention in fields such as medical imaging, remote sensing, and video surveillance systems. In such systems, estimating depth has become possible due to the promising progress of multimodal matching techniques. We perform a systematic performance evaluation of similarity measures frequently used in the literature for dense multimodal stereovision. The evaluated measures include mutual information (MI), sum of squared distances, normalized cross-correlat...
Citation Formats
E. Gündoğdu, “Feature detection and matching towards augmented reality applications on mobile devices,” M.S. - Master of Science, Middle East Technical University, 2012.