Real-time arbitrary view rendering from stereo video and time-of-flight camere

Download

index.pdf

Date

2010

Author

Ateş, Tuğrul Kağan

Metadata

Show full item record

Item Usage Stats

194
views

106
downloads

Generating in-between images from multiple views of a scene is a crucial task for both computer vision and computer graphics fields. Photorealistic rendering, 3DTV and robot navigation are some of many applications which benefit from arbitrary view synthesis, if it is achieved in real-time. Most modern commodity computer architectures include programmable processing chips, called Graphics Processing Units (GPU), which are specialized in rendering computer generated images. These devices excel in achieving high computation power by processing arrays of data in parallel, which make them ideal for real-time computer vision applications. This thesis focuses on an arbitrary view rendering algorithm by using two high resolution color cameras along with a single low resolution time-of-flight depth camera and matching the programming paradigms of the GPUs to achieve real-time processing rates. Proposed method is divided into two stages. Depth estimation through fusion of stereo vision and time-of-flight measurements forms the data acquisition stage and second stage is intermediate view rendering from 3D representations of scenes. Ideas presented are examined in a common experimental framework and practical results attained are put forward. Based on the experimental results, it could be concluded that it is possible to realize content production and display stages of a free-viewpoint system in real-time by using only low cost commodity computing devices.

Subject Keywords

Real-time data processing., Computer software.

URI

http://etd.lib.metu.edu.tr/upload/12612801/index.pdf
https://hdl.handle.net/11511/20259

Collections

Graduate School of Natural and Applied Sciences, Thesis

Suggestions

OpenMETU
Core

REAL-TIME ARBITRARY VIEW RENDERING ON GPU FROM STEREO VIDEO AND TIME-OF-FLIGHT CAMERA Ates, Tugrul K.; Alatan, Abdullah Aydın (2011-05-18) Generating in-between images from multiple views of a scene is a crucial task for both computer vision and computer graphics fields. Photorealistic rendering, 3DTV and robot navigation are some of many applications which benefit from arbitrary view synthesis, if it is achieved in real-time. GPUs excel in achieving high computation power by processing arrays of data in parallel, which make them ideal for real-time computer vision applications. This paper proposes an arbitrary view rendering algorithm by usin...
Voxel transformation: scalable scene geometry discretization for global illumination Yalciner, Bora; Sahillioğlu, Yusuf (Springer Science and Business Media LLC, 2020-10-01) In real-time computer graphics, efficient discretization of scenes is required in order to accelerate graphics related algorithms such as realistic rendering with indirect illumination and visibility checking. Sparse voxel octree (SVO) is a popular data structure for such a discretization task. Populating an SVO with data is challenging when dynamic object count is high, especially when data per spatial location is large. Problem of populating such trees is adressed with our Voxel Transformation method, whe...
Data-driven image captioning via salient region discovery Kilickaya, Mert; Akkuş, Burak Kerim; Çakıcı, Ruket; Erdem, Aykut; Erdem, Erkut; İKİZLER CİNBİŞ, NAZLI (Institution of Engineering and Technology (IET), 2017-09-01) n the past few years, automatically generating descriptions for images has attracted a lot of attention in computer vision and natural language processing research. Among the existing approaches, data-driven methods have been proven to be highly effective. These methods compare the given image against a large set of training images to determine a set of relevant images, then generate a description using the associated captions. In this study, the authors propose to integrate an object-based semantic image r...
3D TRACKING OF PEOPLE WITH RAO-BLACKWELLIZED PARTICLE FILTERS Topcu, Osman; Orguner, Umut; Alatan, Abdullah Aydın; ERCAN, ALİ ÖZER (2014-04-25) Visual tracking has an important place among computer vision applications. Visual tracking with particle filters is a well-known methodology. The performance of particle filters is dependent on efficient sampling of the state space, which in turn, is dependent on number of particles. In this paper, Rao-Blackwell technique is applied to particle filters to improve sampling efficiency. Both algorithms are applied to people tracking problem. Under the same circumstances, the resulting algorithm is demonstrated...
Efficient rendering of complex scenes on heterogeneous parallel architectures Yıldırım Kalkan, Gökçe; İşler, Veysi; Department of Computer Engineering (2014) In computer graphics, generating high-quality images at high frame rates for rendering complex scenes is a challenging task. A well-known approach to tackling this important task is to utilize parallel processing through distributing rendering and simulation tasks to different processing units. In this thesis, several methods of distributed rendering architectures are investigated, and the bottlenecks in distributed rendering are analyzed. Based on this analysis, guidelines for distributed rendering in a ne...

Citation Formats

T. K. Ateş, “Real-time arbitrary view rendering from stereo video and time-of-flight camere,” M.S. - Master of Science, Middle East Technical University, 2010.