Superpixel based image sequence representation and motion estimation

Download
2017
İnce, Kutalmış Gökalp
In this study a superpixel based representation of image sequences is proposed. For superpixel extraction, a novel gradient ascent approach, in which spatial and spectral statistics are utilized to obtain an optimal Bayesian classifier for pixel to superpixel label assignment, is proposed. Utilization of the spectral and spatial statistics reduce the dependency on user selected global parameters, while increasing the robustness and adaptability. Proposed Local Adaptive Superpixels (LASP) approach exploits hexagonal tiling, while achieving some refinement during initialization in order to improve the computation time and accuracy. The experiments conducted on Berkeley segmentation database show that LASP outperforms the existing methods in terms of boundary recall and computation time. Moreover, the proposed method provides lower bleeding error performance compared to the existing gradient ascent techniques. In order to obtain temporally consistent superpixels, a superpixel based occlusion aware layered motion estimation method is also proposed. Proposed motion estimation method combines a Bayesian method with well known gradient descent approaches for optical flow estimation. Proposed method is able to handle occlusions and large displacements. Experiments conducted on Middlebury Database show that performance of the proposed motion estimation method is comparable to state-of-the-art methods, while providing a less computationally complex solution. Using the output of the motion estimation algorithm, the superpixels in the previous frame placed on the current frame, which provide an initial estimate for superpixels on this frame. Refining this estimate with the information on current frame, it becomes possible to obtain temporally consistent superpixels. These superpixels can be utilized for the representation of image sequences. This representation is developed for video object segmentation, but might also be utilized for various computer vision problems like compression, object tracking and background modeling.  

Suggestions

Prioritized sequential 3D reconstruction in video sequences with multiple motions
Imre, Evren; Knorr, Sebastian; Alatan, Abdullah Aydın; Sikora, Thomas (2006-10-11)
in this study, an algorithm is proposed to solve the multi-frame structure from motion (MFSfM) problem for monocular video sequences in dynamic scenes. The algorithm uses the epipolar criterion to segment the features belonging to independently moving objects. Once the features are segmented, corresponding objects are reconstructed individually by using a sequential algorithm, which is also capable of prioritizing the frame pairs with respect to their reliability and information content, thus achieving a fa...
Contrast Enhancement of Microscopy Images Using Image Phase Information
Çakır, Serhat; Atalay, Rengül; ÇETİN, AHMET ENİS (2018-01-01)
Contrast enhancement is an important preprocessing step for the analysis of microscopy images. The main aim of contrast enhancement techniques is to increase the visibility of the cell structures and organelles by modifying the spatial characteristics of the image. In this paper, phase information-based contrast enhancement framework is proposed to overcome the limitations of existing image enhancement techniques. Inspired by the groundbreaking design of the phase contrast microscopy (PCM), the proposed ima...
Analysis of nanoparticle Transmission Electron Microscopy data using a public-domain image-processing program, Image
Woehrle, GH; Hutchison, JE; Özkar, Saim; Finke, RG (2006-01-01)
The need to easily and quickly count larger numbers of nanoparticles, in order to obtain statistically useful size and size-distribution data, is addressed via the use of a readily available, free, public-domain program for particle counting, NIH-Image (and 2 others derived from it, Scion Image and Image J), collectively referred to herein as Image. The best protocols that we have found useful for the use of Image are reported; both appropriate as well as problematic applications of Image are then illustrat...
Road network extraction from high-resolution multi spectral satellite images
Karaman, Ersin; Çetin, Yasemin; Department of Information Systems (2012)
In this thesis, an automatic road extraction algorithm for multi-spectral images is developed. The developed model extracts elongated structures from images by using edge detection, segmentation and clustering techniques. The study also extracts non-road regions like vegetative fields, bare soils and water bodies to obtain more accurate road map. The model is constructed in a modular approach that aims to extract roads with different characteristics. Each module output is combined to create a road score map...
PROGRESSIVE COMPRESSION OF DIGITAL ELEVATION DATA USING MESHES
Kose, Kivanc; Yılmaz, Erdal; ÇETİN, AHMET ENİS (2009-07-17)
In this paper a new Digital Elevation Map (DEM) image compression algorithm is proposed. DEM image can be threated as a grayscale image, whose pixel values are the elevation values of the map points. The grayscale DEM image is compressed using an adaptive wavelet based image compression algorithm. The method, which is an extension of the progressive mesh compression takes advantage of the multiresolution property of the wavelets while coding the map images. This makes it possible to decode different resolut...
Citation Formats
K. G. İnce, “Superpixel based image sequence representation and motion estimation,” Ph.D. - Doctoral Program, Middle East Technical University, 2017.