Multi-view video coding via dense depth field

Download
2006
Özkalaycı, Burak Oğuz
Emerging 3-D applications and 3-D display technologies raise some transmission problems of the next-generation multimedia data. Multi-view Video Coding (MVC) is one of the challenging topics in this area, that is on its road for standardization via ISO MPEG. In this thesis, a 3-D geometry-based MVC approach is proposed and analyzed in terms of its compression performance. For this purpose, the overall study is partitioned into three preceding parts. The first step is dense depth estimation of a view from a fully calibrated multi-view set. The calibration information and smoothness assumptions are utilized for determining dense correspondences via a Markov Random Field (MRF) model, which is solved by Belief Propagation (BP) method. In the second part, the estimated dense depth maps are utilized for generating (predicting) arbitrary (other camera) views of a scene, that is known as novel view generation. A 3-D warping algorithm, which is followed by an occlusion-compatible hole-filling process, is implemented for this aim. In order to suppress the occlusion artifacts, an intermediate novel view generation method, which fuses two novel views generated from different source views, is developed. Finally, for the last part, dense depth estimation and intermediate novel view generation tools are utilized in the proposed H.264-based MVC scheme for the removal of the spatial redundancies between different views. The performance of the proposed approach is compared against the simulcast coding and a recent MVC proposal, which is expected to be the standard recommendation for MPEG in the near future. These results show that the geometric approaches in MVC can still be utilized, especially in certain 3-D applications, in addition to conventional temporal motion compensation techniques, although the rate-distortion performances of geometry-free approaches are quite superior.

Suggestions

Parallel decodable channel coding implemented on a MIMO testbed
Aktaş, Tuğcan; Yılmaz, Ali Özgür; Department of Electrical and Electronics Engineering (2007)
This thesis considers the real-time implementation phases of a multiple-input multiple-output (MIMO) wireless communication system. The parts which are related to the implementation detail the blocks realized on a field programmable gate array (FPGA) board and define the connections between these blocks and typical radio frequency front-end modules assisting the wireless communication. Two sides of the implemented communication testbed are discussed separately as the transmitter and the receiver parts. In a...
A new stack architecture for sensor networks
Eroğlu, Muammer; Bilgen, Semih; Department of Electrical and Electronics Engineering (2006)
In this thesis, a new stack architecture for sensor networks is proposed. The stack consists of the following layers: application, query, aggregation, network, MAC and physical. Various algorithms are implemented using this stack and it is shown that this stack is modular. Following an overview of sensor networks, the previous protocol stack suggestions for sensor networks are examined. Sensor network algorithms that can be classified as sensor data management systems are surveyed and compared with each oth...
Implementation of a digital signal synthesizer with high spurious free dynamic range
Kılıç, Argun; Yılmaz, Ali Özgür; Department of Electrical and Electronics Engineering (2006)
Today’s analog modulators and upconverters are inadequate to synthesize and modulate signals with high ‘Spurious Free Dynamic Range’ (SFDR). Thus, the main objective of this thesis is to design and implement a ‘Digital Signal Synthesizer’ (DSS) that is capable of synthesizing signals between 50-100 MHz with 60dB SFDR and to modulate them variable symbol rates and modulation techniques with very high phase/frequency resolution and switching speed while keeping the amplitude modulation occurring during a modu...
Reliable real-time video communication in wireless sensor networks
Ayran, Orhan; Akan, Özgür Barış; Department of Electrical and Electronics Engineering (2007)
Many wireless sensor network (WSN) applications require efficient multimedia communication capabilities. However, the existing communication protocols in the literature mainly aim to achieve energy efficiency and reliability objectives and do not address the multimedia communication challenges in WSN. In this thesis, comprehensive performance evaluation of the existing transport protocols is performed and it has been shown that the existing proposals achieve very poor performance in terms of large set of me...
Implementation of a DF algorithm on an FPGA platform
İpek, Abdullah Volkan; Severcan, Mete; Department of Electrical and Electronics Engineering (2006)
In this thesis work, the implementations of the monopulse amplitude comparison and phase comparison DF algorithms are performed on an FPGA platform. After the mathematical formulation of the algorithms using maximum-likelihood approach is done, software simulations are carried out to validate and find the DF accuracies of the algorithms under various conditions. Then the algorithms are implemented on an FPGA platform by utilizing platform specific software tools. Block diagrams of the hardware implementatio...
Citation Formats
B. O. Özkalaycı, “Multi-view video coding via dense depth field,” M.S. - Master of Science, Middle East Technical University, 2006.