FRAME-RATE CONVERSION FOR MULTIVIEW VIDEO EXPLOITING 3D MOTION MODELS

Date

2010-09-29

Author

Gedik, O. Serdar
Alatan, Abdullah Aydın

Metadata

Show full item record

This work is licensed under a Creative Commons Attribution-NonCommercial-NoDerivatives 4.0 International License.

Item Usage Stats

47
views

0
downloads

A frame-rate conversion (FRC) scheme for increasing the frame-rate of multiview video for reduction of motion blur in hold-type displays is proposed. In order to obtain high quality inter-frames, the proposed method utilizes 3D motion models relying on the 3D scene information extractable from multiview video. First of all, independently moving objects (IMOs) are segmented by using a depth-based object segmentation method. Then, interest points on IMOs are obtained via scale invariant feature transform (SIFT). Estimating 3D rotation and translation matrices of moving rigid objects by the help of SIFT features between successive frames; 3D scene is reconstructed at any desired time instant. Inter-frames for the desired view of the multiview set are rendered by projecting the reconstructed 3D scene on this view. Simulation results reveal that, by utilizing true 3D object trajectory, the proposed method interpolates frames with increased quality compared to some conventional techniques.

Subject Keywords

Frame rate conversion, Multiview video, 3D motion model

URI

https://hdl.handle.net/11511/48407

DOI

https://doi.org/10.1109/icip.2010.5651311

Collections

Department of Electrical and Electronics Engineering, Conference / Seminar

Suggestions

OpenMETU
Core

MULTI-RESOLUTION MOTION ESTIMATION FOR MOTION COMPENSATED FRAME INTERPOLATION Guenyel, Bertan; Alatan, Abdullah Aydın (2010-09-29) A multi-resolution motion estimation scheme is proposed for tracking of the true 2D motion in video sequences for motion compensated image interpolation. The proposed algorithm utilizes frames with different resolutions and adaptive block dimensions for efficient representation of motion. Firstly, motion vectors for each block are assigned as a result of predictive search in each pass. Then, the outlier motion vectors are detected and corrected at the end of each pass. Simulation results with respect to dif...
Recursive Prediction for Joint Spatial and Temporal Prediction in Video Coding Kamışlı, Fatih (2014-06-01) Video compression systems use prediction to reduce redundancies present in video sequences along the temporal and spatial dimensions. Standard video coding systems use either temporal or spatial prediction on a per block basis. If temporal prediction is used, spatial information is ignored. If spatial prediction is used, temporal information is ignored. This may be a computationally efficient approach, but it does not effectively combine temporal and spatial information. In this letter, we provide a framewo...
Metric scale and 6dof pose estimation using a color camera and distance sensors Ölmez, Burhan; Tuncer, Temel Engin; Department of Electrical and Electronics Engineering (2021-2-26) Monocular color cameras are widely used for 6DoF pose estimation and sparse creation of 3D point cloud of the environment over decades with SfM, VO, and V-SLAM algorithms. In this thesis, a novel algorithm is presented to estimate the metric scale information of a monocular visual odometry algorithm using a distance sensor. This method uses a state-of-the-art visual odometry algorithm Semi-Direct Visual Odometry (SVO) [1] for obtaining sparse 3D point cloud and then matches these points with the measurement...
Composite Method in Real Time Video Stabilization Bayrak, Serhat; Ulusoy, İlkay (2009-01-01) Since digital video stabilization completely performs over the images, if requires exhaustive processing power. Therefore, it is less preferred for real-time applications. Global (background) motion estimation in floating video is the most time consuming part of digital video stabilization. In this work, the load of digital motion estimation is reduced by using mechanical motion sensors, thus, it is shown that digital video stabilization can be used for real-time applications.
Efficient rendering of complex scenes on heterogeneous parallel architectures Yıldırım Kalkan, Gökçe; İşler, Veysi; Department of Computer Engineering (2014) In computer graphics, generating high-quality images at high frame rates for rendering complex scenes is a challenging task. A well-known approach to tackling this important task is to utilize parallel processing through distributing rendering and simulation tasks to different processing units. In this thesis, several methods of distributed rendering architectures are investigated, and the bottlenecks in distributed rendering are analyzed. Based on this analysis, guidelines for distributed rendering in a ne...

Citation Formats

O. S. Gedik and A. A. Alatan, “FRAME-RATE CONVERSION FOR MULTIVIEW VIDEO EXPLOITING 3D MOTION MODELS,” 2010, Accessed: 00, 2020. [Online]. Available: https://hdl.handle.net/11511/48407.