FRAME-RATE CONVERSION FOR MULTIVIEW VIDEO EXPLOITING 3D MOTION MODELS

Date

2010-09-29

Author

Gedik, O. Serdar
Alatan, Abdullah Aydın

Metadata

Show full item record

This work is licensed under a Creative Commons Attribution-NonCommercial-NoDerivatives 4.0 International License.

Item Usage Stats

205
views

0
downloads

A frame-rate conversion (FRC) scheme for increasing the frame-rate of multiview video for reduction of motion blur in hold-type displays is proposed. In order to obtain high quality inter-frames, the proposed method utilizes 3D motion models relying on the 3D scene information extractable from multiview video. First of all, independently moving objects (IMOs) are segmented by using a depth-based object segmentation method. Then, interest points on IMOs are obtained via scale invariant feature transform (SIFT). Estimating 3D rotation and translation matrices of moving rigid objects by the help of SIFT features between successive frames; 3D scene is reconstructed at any desired time instant. Inter-frames for the desired view of the multiview set are rendered by projecting the reconstructed 3D scene on this view. Simulation results reveal that, by utilizing true 3D object trajectory, the proposed method interpolates frames with increased quality compared to some conventional techniques.

Subject Keywords

Frame rate conversion, Multiview video, 3D motion model

URI

https://hdl.handle.net/11511/48407

DOI

https://doi.org/10.1109/icip.2010.5651311

Collections

Department of Electrical and Electronics Engineering, Conference / Seminar

Suggestions

OpenMETU
Core

MULTI-RESOLUTION MOTION ESTIMATION FOR MOTION COMPENSATED FRAME INTERPOLATION Guenyel, Bertan; Alatan, Abdullah Aydın (2010-09-29) A multi-resolution motion estimation scheme is proposed for tracking of the true 2D motion in video sequences for motion compensated image interpolation. The proposed algorithm utilizes frames with different resolutions and adaptive block dimensions for efficient representation of motion. Firstly, motion vectors for each block are assigned as a result of predictive search in each pass. Then, the outlier motion vectors are detected and corrected at the end of each pass. Simulation results with respect to dif...
Recursive Prediction for Joint Spatial and Temporal Prediction in Video Coding Kamışlı, Fatih (2014-06-01) Video compression systems use prediction to reduce redundancies present in video sequences along the temporal and spatial dimensions. Standard video coding systems use either temporal or spatial prediction on a per block basis. If temporal prediction is used, spatial information is ignored. If spatial prediction is used, temporal information is ignored. This may be a computationally efficient approach, but it does not effectively combine temporal and spatial information. In this letter, we provide a framewo...
Statistical Analysis of Residue Signal for Backward Compatible HDR Image Coding Kamışlı, Fatih; Koz, Alper; Zerman, Emin; Valenzise, Giuseppe; Dufaux, Frederic (2017-07-29) Backward compatibility to the existing 8-bit displays for HDR image and video compression is an essential requirement for the wide acceptance of HDR technology by the users. While these previous methods mainly focus on the rate-distortion optimization of base layer, the encoding of the residue in the enhancement layer comparatively has received less attention. In this paper, we investigate whether HDR image coding residue exhibits also local anisotropic characteristics or not as in the case of motion compen...
UTILIZATION OF EVENT BASED CAMERAS FOR VIDEO FRAME INTERPOLATION Kılıç, Onur Selim; Alatan, Abdullah Aydın; Department of Electrical and Electronics Engineering (2022-8-25) Video Frame Interpolation (VFI) aims to synthesize several frames in the middle of two adjacent original video frames. State-of-the-art frame interpolation techniques create intermediate frames by considering the objects' motions within the frames. However, these approaches adopt a first-order approximation that fails without information between the keyframes. Event cameras are new sensors that provide additional information in the dead time between frames. They measure per-pixel brightness changes asynchro...
Statistical Analysis and Directional Coding of Layer-based HDR Image Coding Residue Feyiz, Kutan; Kamışlı, Fatih; Zerman, Emin; Valenzise, Giuseppe; Koz, Alper; Dufaux, Frederic (2017-10-18) Existing methods for layer-based backward compatible high dynamic range (HDR) image and video coding mostly focus on the rate-distortion optimization of base layer while neglecting the encoding of the residue signal in the enhancement layer. Although some recent studies handle residue coding by designing function based fixed global mapping curves for 8-bit conversion and exploiting standard codecs on the resulting 8-bit images, they do not take the local characteristics of residue blocks into account. Inspi...

Citation Formats

O. S. Gedik and A. A. Alatan, “FRAME-RATE CONVERSION FOR MULTIVIEW VIDEO EXPLOITING 3D MOTION MODELS,” 2010, Accessed: 00, 2020. [Online]. Available: https://hdl.handle.net/11511/48407.