Using 3D contours and their relations for cognitive vision and robotics

2009-12-01
Başeski, Emre
Bodenhagen, Leon
Pugeault, Nicolas
Kalkan, Sinan
Piater, Justus
Krüger, Norbert
In this work, we make use of 3D visual contours carrying geometric as well as appearance information. Between these contours, we define 3D relations that encode structural information relevant to object-level operations such as similarity assessment and grasping. We show that this relational space can also be used as input features for learning which we exemplify for the grasping of unknown objects. Our representation is motivated by the human visual system in two respects. First, we make use of a visual descriptor that is motivated by hyper-columns in V1. Secondly, the contours can be seen as one stage in a visual hierarchy bridging between local symbolic descriptors to higher level stages of processing such as object coding and grasping. © 2009 IEEE.
2009 24th International Symposium on Computer and Information Sciences, ISCIS 2009

Suggestions

Using multi-modal 3D contours and their relations for vision and robotics
BAŞESKİ, Emre; Pugeault, Nicolas; Kalkan, Sinan; BODENHAGEN, Leon; Piater, Justus H.; KRÜGER, Norbert (Elsevier BV, 2010-11-01)
In this work, we make use of 3D contours and relations between them (namely, coplanarity, cocolority, distance and angle) for four different applications in the area of computer vision and vision-based robotics. Our multi-modal contour representation covers both geometric and appearance information. We show the potential of reasoning with global entities in the context of visual scene analysis for driver assistance, depth prediction, robotic grasping and grasp learning. We argue that, such 3D global reasoni...
Image-based extraction of material reflectance properties of a 3D object
Erdem, Mehmet Erkut; Atalay, Mehmet Volkan; Department of Computer Engineering (2003)
In this study, an appearance reconstruction method based on extraction of material re?ectance properties of a three-dimensional (3D) object from its twodimensional (2D) images is explained. One of the main advantages of this system is that the reconstructed object can be rendered in real-time with photorealistic quality in varying illumination conditions. Bidirectional Reflectance Distribution Functions (BRDFs) are used in representing the reflectance of the object. The reflectance of the object is decompos...
Image-based extraction of material reflectance properties of a 3D rigid object
Erdem, ME; Erdem, IA; Yilmaz, UG; Atalay, Mehmet Volkan (2004-01-01)
In this study, an appearance reconstruction method based on extraction of material reflectance properties of a three-dimensional (3D) object from its two-dimensional (2D) images is explained. One of the main advantages of this system is that the reconstructed object can be rendered in real-time with photorealistic quality in varying illumination conditions. The reflectance of the object is decomposed into diffuse and specular components. While the diffuse component is stored in a global texture, the specula...
Computer simulation and implementation of a visual 3-d eye gaze tracker for autostreoscopic displays
İnce, Kutalmış Gökalp; Alatan, Abdullah Aydın; Department of Electrical and Electronics Engineering (2009)
In this thesis, a visual 3-D eye gaze tracker is designed and implemented to tested via computer simulations and on an experimental setup. Proposed tracker is designed to examine human perception on autostereoscopic displays when the viewer is 3m away from such displays. Two different methods are proposed for calibrating personal parameters and gaze estimation, namely line of gaze (LoG) and line of sight (LoS) solutions. 2-D and 3-D estimation performances of the proposed system are observed both using comp...
3D Object Recognition by Geometric Hashing
Eskizara, Omer; Akagündüz, Erdem; Ulusoy, İlkay (2009-01-01)
Using transform invariant 3D fatures obtained from a database of 3D range images, geometric hashing is applied for the purpose of 3D object recognition. Mean (H) and Gaussian (K) curvature values within a scale-space of the surface is used Since H and K values are used and a scale-space of the surface is constructed the method is independent of transformation and resolution. The method is tested on the Stuttgart 3D range image database [1].
Citation Formats
E. Başeski, L. Bodenhagen, N. Pugeault, S. Kalkan, J. Piater, and N. Krüger, “Using 3D contours and their relations for cognitive vision and robotics,” presented at the 2009 24th International Symposium on Computer and Information Sciences, ISCIS 2009, Guzelyurt, Kıbrıs (Gkry), 2009, Accessed: 00, 2022. [Online]. Available: https://www.scopus.com/inward/record.uri?partnerID=HzOxMe3b&scp=73949101892&origin=inward.