Staged Development of Robot Skills: Behavior Formation, Affordance Learning and Imitation with Motionese

Download
2015-06-01
Ugur, Emre
Nagai, Yukie
Şahin, Erol
ÖZTOP, ERHAN
Inspired by infant development, we propose a three staged developmental framework for an anthropomorphic robot manipulator. In the first stage, the robot is initialized with a basic reach-and-enclose-on-contact movement capability, and discovers a set of behavior primitives by exploring its movement parameter space. In the next stage, the robot exercises the discovered behaviors on different objects, and learns the caused effects; effectively building a library of affordances and associated predictors. Finally, in the third stage, the learned structures and predictors are used to bootstrap complex imitation and action learning with the help of a cooperative tutor. The main contribution of this paper is the realization of an integrated developmental system where the structures emerging from the sensorimotor experience of an interacting real robot are used as the sole building blocks of the subsequent stages that generate increasingly more complex cognitive capabilities. The proposed framework includes a number of common features with infant sensorimotor development. Furthermore, the findings obtained from the self-exploration and motionese guided human-robot interaction experiments allow us to reason about the underlying mechanisms of simple-to-complex sensorimotor skill progression in human infants.
IEEE TRANSACTIONS ON AUTONOMOUS MENTAL DEVELOPMENT

Suggestions

Recurrent Slow Feature Analysis for Developing Object Permanence in Robots
Çelikkanat, Hande; Şahin, Erol; Kalkan, Sinan (null; 2013-11-03)
In this work, we propose a biologically inspired framework for developing object permanence in robots. In particular, we build upon a previous work on a slowness principle-based visual model (Wiskott and Sejnowski, 2002), which was shown to be adept at tracking salient changes in the environment, while seamlessly “understanding” external causes, and self-emerging structures that resemble the human visual system. We propose an extension to this architecture with a prefrontal cortex-inspired recurrent loop th...
Simple and complex behavior learning using behavior hidden Markov model and CobART
Seyhan, Seyit Sabri; Alpaslan, Ferda Nur; Yavaş, Mustafa (2013-03-01)
This paper proposes behavior learning and generation models for simple and complex behaviors of robots using unsupervised learning methods. While the simple behaviors are modeled by simple-behavior learning model (SBLM), complex behaviors are modeled by complex-behavior learning model (CBLM) which uses previously learned simple or complex behaviors. Both models include behavior categorization, behavior modeling, and behavior generation phases. In the behavior categorization phase, sensory data are categoriz...
Goal emulation and planning in perceptual space using learned affordances
Ugur, Emre; Oztop, Erhan; Şahin, Erol (Elsevier BV, 2011-7)
In this paper, we show that through self-interaction and self-observation, an anthropomorphic robot equipped with a range camera can learn object affordances and use this knowledge for planning. In the first step of learning, the robot discovers commonalities in its action-effect experiences by discovering effect categories. Once the effect categories are discovered, in the second step, affordance predictors for each behavior are obtained by learning the mapping from the object features to the effect catego...
Locomotion Gait Optimization For Modular Robots; Coevolving Morphology and Control
Pouya, Soha; Aydın Göl, Ebru; Moeckel, Rico; Ijspeert, Auke Jan (2011-01-01)
This study aims at providing a control-learning framework capable of generating optimal locomotion patterns for the modular robots. The key ideas are firstly to provide a generic control structure that can be well-adapted for the different morphologies and secondly to exploit and coevolve both morphology and control aspects. A generic framework combining robot morphology, control and environment and on the top of them optimization and evolutionary algorithms are presented. The details of the components and ...
Simple and complex behavior learning using behavior hidden Markov Model and CobART
Seyhan, Seyit Sabri; Alpaslan, Ferda Nur; Department of Computer Engineering (2013)
In this thesis, behavior learning and generation models are proposed for simple and complex behaviors of robots using unsupervised learning methods. Simple behaviors are modeled by simple-behavior learning model (SBLM) and complex behaviors are modeled by complex-behavior learning model (CBLM) which uses previously learned simple or complex behaviors. Both models have common phases named behavior categorization, behavior modeling, and behavior generation. Sensory data are categorized using correlation based...
Citation Formats
E. Ugur, Y. Nagai, E. Şahin, and E. ÖZTOP, “Staged Development of Robot Skills: Behavior Formation, Affordance Learning and Imitation with Motionese,” IEEE TRANSACTIONS ON AUTONOMOUS MENTAL DEVELOPMENT, pp. 119–139, 2015, Accessed: 00, 2020. [Online]. Available: https://hdl.handle.net/11511/34335.