Weakly Supervised Object Localization with Multi-Fold Multiple Instance Learning

Download

index.pdf

Date

2017-01-01

Author

Cinbiş, Ramazan Gökberk
Schmid, Cordelia

Metadata

Show full item record

This work is licensed under a Creative Commons Attribution-NonCommercial-NoDerivatives 4.0 International License.

Item Usage Stats

215
views

0
downloads

Object category localization is a challenging problem in computer vision. Standard supervised training requires bounding box annotations of object instances. This time-consuming annotation process is sidestepped in weakly supervised learning. In this case, the supervised information is restricted to binary labels that indicate the absence/presence of object instances in the image, without their locations. We follow a multiple-instance learning approach that iteratively trains the detector and infers the object locations in the positive training images. Our main contribution is a multi-fold multiple instance learning procedure, which prevents training from prematurely locking onto erroneous object locations. This procedure is particularly important when using high-dimensional representations, such as Fisher vectors and convolutional neural network features. We also propose a window refinement method, which improves the localization accuracy by incorporating an objectness prior. We present a detailed experimental evaluation using the PASCALVOC 2007 dataset, which verifies the effectiveness of our approach.

Subject Keywords

Object detection, Weakly supervised learning

URI

https://hdl.handle.net/11511/42242

Journal

IEEE TRANSACTIONS ON PATTERN ANALYSIS AND MACHINE INTELLIGENCE

DOI

https://doi.org/10.1109/tpami.2016.2535231

Collections

Department of Computer Engineering, Article

Suggestions

OpenMETU
Core

Multi-fold MIL Training for Weakly Supervised Object Localization Cinbiş, Ramazan Gökberk; Schmid, Cordelia (2014-01-01) Object category localization is a challenging problem in computer vision. Standard supervised training requires bounding box annotations of object instances. This time-consuming annotation process is sidestepped in weakly supervised learning. In this case, the supervised information is restricted to binary labels that indicate the absence/presence of object instances in the image, without their locations. We follow a multiple-instance learning approach that iteratively trains the detector and infers the obj...
A Recurrent and Meta-learned Model of Weakly Supervised Object Localization Sariyildiz, Mert Bulent; Sumbul, Gencer; Cinbiş, Ramazan Gökberk (2022-01-01) The object localization and detection has improved greatly over the past decade, thanks to developments in deep learning based representations and localization models. However, a major bottleneck remains at the reliance on fully-supervised datasets, which can be difficult to gather in many real-world scenarios. In this work, we focus on the problem of weakly-supervised localization, where the goal is to localize instances of objects based on simple image-level class annotations. In particular, instead of en...
Weakly supervised instance attention for multisource fine-grained object recognition with an application to tree species classification Aygunes, Bulut; Cinbiş, Ramazan Gökberk; Aksoy, Selim (2021-06-01) Multisource image analysis that leverages complementary spectral, spatial, and structural information benefits fine-grained object recognition that aims to classify an object into one of many similar subcategories. However, for multisource tasks that involve relatively small objects, even the smallest registration errors can introduce high uncertainty in the classification process. We approach this problem from a weakly supervised learning perspective in which the input images correspond to larger neighborh...
WEAKLY SUPERVISED DEEP CONVOLUTIONAL NETWORKS FOR FINE-GRAINED OBJECT RECOGNITION IN MULTISPECTRAL IMAGES Aygunes, Bulut; AKSOY, SELİM; Cinbiş, Ramazan Gökberk (2019-01-01) The challenging task of training object detectors for fine-grained classification faces additional difficulties when there are registration errors between the image data and the ground truth. We propose a weakly supervised learning methodology for the classification of 40 types of trees by using fixed-sized multispectral images with a class label but with no exact knowledge of the object location. Our approach consists of an end-to-end trainable convolutional neural network with separate branches for learni...
Utilization of dense depth information for monoview object detection and instance segmentation Çakırgöz, Çağlayan Can; Alatan, Abdullah Aydın; Department of Electrical and Electronics Engineering (2022-5-10) Object detection aims for detecting objects of certain classes in an image by bounding them in rectangular boxes whereas instance segmentation tries to detect objects in pixel level. Deep learning techniques, which have shown great improvements over the last decade, are utilized in these topics as well, and a significant success is achieved against the traditional methods. Similar improvements can be observed in dense depth estimation which deals with deducing dense information of a scene from a single imag...

Citation Formats

R. G. Cinbiş and C. Schmid, “Weakly Supervised Object Localization with Multi-Fold Multiple Instance Learning,” IEEE TRANSACTIONS ON PATTERN ANALYSIS AND MACHINE INTELLIGENCE, pp. 189–203, 2017, Accessed: 00, 2020. [Online]. Available: https://hdl.handle.net/11511/42242.