Segmentation Driven Object Detection with Fisher Vectors

Download
2013-01-01
Cinbiş, Ramazan Gökberk
Schmid, Cordelia
We present an object detection system based on the Fisher vector (FV) image representation computed over SIFT and color descriptors. For computational and storage efficiency, we use a recent segmentation-based method to generate class-independent object detection hypotheses, in combination with data compression techniques. Our main contribution is a method to produce tentative object segmentation masks to suppress background clutter in the features. Re-weighting the local image features based on these masks is shown to improve object detection significantly. We also exploit contextual features in the form of a full-image FV descriptor, and an inter-category rescoring mechanism. Our experiments on the PASCAL VOC 2007 and 2010 datasets show that our detector improves over the current state-of-the-art detection results.

Suggestions

SEGMENTATION USING THE EDGE STRENGTH FUNCTION AS A SHAPE PRIOR WITHIN A LOCAL DEFORMATION MODEL
Erdem, Erkut; Tarı, Zehra Sibel; Vese, Luminita (2009-01-01)
This paper presents a new image segmentation framework which employs a shape prior in the form of an edge strength function to introduce a higher-level influence on the segmentation process. We formulate segmentation as the minimization of three coupled functionals, respectively, defining three processes: prior-guided segmentation, shape feature extraction and local deformation estimation. Particularly, the shape feature extraction process is in charge of estimating an edge strength function from the evolvi...
Segmentation Fusion for Building Detection Using Domain-Specific Information
Karadag, Ozge Oztimur; Senaras, Caglar; Yarman Vural, Fatoş Tunay (2015-07-01)
Segment-based classification is one of the popular approaches for object detection, where the performance of the classification task is sensitive to the accuracy of the output of the initial segmentation. Majority of the object detection systems directly use one of the generic segmentation algorithms, such as mean shift or k-means. However, depending on the problem domain, the properties of the regions such as size, color, texture, and shape, which are suitable for classification, may vary. Besides, fine tu...
Representation Learning for Contextual Object and Region Detection in Remote Sensing
Firat, Orhan; Can, Gulcan; Yarman Vural, Fatoş Tunay (2014-08-28)
The performance of object recognition and classification on remote sensing imagery is highly dependent on the quality of extracted features, amount of labelled data and the priors defined for contextual models. In this study, we examine the representation learning opportunities for remote sensing. First we attacked localization of contextual cues for complex object detection using disentangling factors learnt from a small amount of labelled data. The complex object, which consists of several sub-parts is fu...
Segmentation and deciısion fusion for building detection
Karadag, Ozge Oztimur; Senaras, Caglar; Yarman Vural, Fatoş Tunay (2014-07-18)
Segment based classification is one of the popular approaches for object detection, where the performance of the classification task is sensitive to the accuracy of the output of the initial segmentation. Most of these studies includes generic segmentation methods and it is assumed that the segmentation output is compatible with the subsequent classification method. However, depending on the problem domain the properties of the regions such as size, shape etc. which are suitable for classification may vary....
Scale invariant representation of 2 5D data
AKAGUNDUZ, Erdem; ULUSOY PARNAS, İLKAY; BOZKURT, Nesli; Halıcı, Uğur (2007-06-13)
In this paper, a scale and orientation invariant feature representation for 2.5D objects is introduced, which may be used to classify, detect and recognize objects even under the cases of cluttering and/or occlusion. With this representation a 2.5D object is defined by an attributed graph structure, in which the nodes are the pit and peak regions on the surface. The attributes of the graph are the scales, positions and the normals of these pits and peaks. In order to detect these regions a "peakness" (or pi...
Citation Formats
R. G. Cinbiş and C. Schmid, “Segmentation Driven Object Detection with Fisher Vectors,” 2013, Accessed: 00, 2020. [Online]. Available: https://hdl.handle.net/11511/56837.