Curiosity-driven learning of traversability affordance on a mobile robot

2007-07-13
Ugur, Emre
Dogar, Mehmet R.
Cakmak, Maya
Şahin, Erol
The concept of affordances, as proposed by J.J. Gibson, refers to the relationship between the organism and its environment and has become popular in autonomous robot control. The learning of affordances in autonomous robots, however, typically requires a large set of training data obtained from the interactions of the robot with its environment. Therefore, the learning process is not only time-consuming, and costly but is also risky since some of the interactions may inflict damage on the robot. In this paper, we study the learning of traversability affordance on a mobile robot and investigate how the number of interactions required can be minimized with minimial degradation on the learning process. Specifically, we propose a two step learning process which consists of bootstrapping and curiosity-based learning phases. In the bootstrapping phase, a small set of initial interaction data are used to find the relevant perceptual features for the affordance, and a Support Vector Machine (SVM) classifier is trained. In the curiosity-driven learning phase, a curiosity band around the decision hyperplane of the SVM is used to decide whether a given interaction opportunity is worth exploring or not. Specifically, if the output of the SVM for a given percept lies within curiosity band, indicating that the classifier is not so certain about the hypothesized effect of the interaction, the robot goes ahead with the interaction, and skips if not. Our studies within a physics-based robot simulator show that the robot can achieve better learning with the proposed curiosity-driven learning method for a fixed number of interactions. The results also show that, for optimum performance, there exists a minimum number of initial interactions to be used for bootstrapping. Finally, the trained classifier with the proposed learning method was also successfully tested on the real robot.

Suggestions

Predicting future object states using learned affordances
Ugur, Emre; Şahin, Erol; Oztop, Ethan (2009-09-16)
The notion of affordances that was proposed by JJ. Gibson, refers to the action possibilities offered to the organism by its environment. In a previous formalization, affordances are defined as general relations that pertain to the robot-environment interaction and they are represented as triples which consist of the initial percept of the environment, the behavior applied and the effect produced. In this paper, we focus on the object affordances and propose a developmental method that enables the robot to ...
Mobile robot navigation based on fuzzy discrete event systems
Tampakis, Georgios; Schmidt, Klaus Verner; Boutalis, Yiannis (2009-12-01)
Recently, several approaches for the control of fuzzy discrete event systems (FDES) have been proposed. First results towards the use of FDES in mobile robot navigation have also been presented, which however mainly build on sensory information processing. In this paper, we develop a methodology to compute control actions for the navigation of a mobile robot based on distributed FDES. The FDES description permits to take into account possible uncertainties in sensory information and enables a prediction of ...
Multi-objective decision making using fuzzy discrete event systems: A mobile robot example
Boutalis, Yiannis; Schmidt, Klaus Verner (2010-09-29)
In this paper, we propose an approach for the multi-objective control of sampled data systems that can be modeled as fuzzy discrete event systems (FDES). In our work, the choice of a fuzzy system representation is justified by the assumption of a controller realization that depends on various potentially imprecise sensor measurements. Our approach consists of three basic steps that are performed in each sampling instant. First, the current fuzzy state of the system is determined by a sensor evaluation. Seco...
Comment: On a recently proposed relation between oHS and Ito systems
Karasu, Atalay (1999-08-01)
The bi-Hamiltonian structure of original Hirota-Satsuma system proposed by Roy [Phys. Lett. A 249 (1999) 55] based on a modification of the bi-Hamiltonian structure of Ito system is incorrect. (C) 1999 Published by Elsevier Science B.V. All rights reserved.
QCD coupling constants and VDM
ERKOL, GÜRAY; Özpineci, Altuğ; Zamiralov, V. S. (2012-06-21)
QCD sum rules for coupling constants of vector mesons with baryons are constructed. The corresponding QCD sum rules for electric charges and magnetic moments are also derived and with the use of vector-meson-dominance model related to the coupling constants. The vector-dominance model (VDM) role as the criterium of reciprocal validity of the sum rules is considered.
Citation Formats
E. Ugur, M. R. Dogar, M. Cakmak, and E. Şahin, “Curiosity-driven learning of traversability affordance on a mobile robot,” 2007, Accessed: 00, 2020. [Online]. Available: https://hdl.handle.net/11511/52711.