Simple and complex behavior learning using behavior hidden Markov Model and CobART

Download
2013
Seyhan, Seyit Sabri
In this thesis, behavior learning and generation models are proposed for simple and complex behaviors of robots using unsupervised learning methods. Simple behaviors are modeled by simple-behavior learning model (SBLM) and complex behaviors are modeled by complex-behavior learning model (CBLM) which uses previously learned simple or complex behaviors. Both models have common phases named behavior categorization, behavior modeling, and behavior generation. Sensory data are categorized using correlation based adaptive resonance theory network that generates motion primitives corresponding to robot's base abilities in the categorization phase. In the modeling phase, Behavior-HMM, a modified version of hidden Markov model, is used to model the relationships among the motion primitives in a finite state stochastic network. In addition, a motion generator which is an artificial neural network is trained for each motion primitive to learn essential robot motor commands. In the generation phase, desired task is presented as a target observation and the model generates corresponding motion primitive sequence. Then, these motion primitives are executed successively by the motion generators which are specifically trained for the corresponding motion primitives. The models are not proposed for one specific behavior, but are intended to be bases for all behaviors. CBLM enhances learning capabilities by integrating previously learned behaviors hierarchically. Hence, new behaviors can take advantage of already discovered behaviors. The proposed models are tested on a robot simulator and the experiments showed that simple and complex-behavior learning models can generate requested behaviors effectively.

Suggestions

Simple and complex behavior learning using behavior hidden Markov model and CobART
Seyhan, Seyit Sabri; Alpaslan, Ferda Nur; Yavaş, Mustafa (2013-03-01)
This paper proposes behavior learning and generation models for simple and complex behaviors of robots using unsupervised learning methods. While the simple behaviors are modeled by simple-behavior learning model (SBLM), complex behaviors are modeled by complex-behavior learning model (CBLM) which uses previously learned simple or complex behaviors. Both models include behavior categorization, behavior modeling, and behavior generation phases. In the behavior categorization phase, sensory data are categoriz...
Implementation of a closed-loop action generation system on a humanoid robot through learning by demonstration
Tunaoğlu, Doruk; Şahin, Erol; Department of Computer Engineering (2010)
In this thesis the action learning and generation problem on a humanoid robot is studied. Our aim is to realize action learning, generation and recognition in one system and our inspiration source is the mirror neuron hypothesis which suggests that action learning, generation and recognition share the same neural circuitry. Dynamic Movement Primitives, an efficient action learning and generation approach, are modified in order to fulfill this aim. The system we developed (1) can learn from multiple demonstr...
Mobile Robot Heading Adjustment Using Radial Basis Function Neural Networks Controller and Reinforcement Learning
BAYAR, GÖKHAN; Konukseven, Erhan İlhan; Koku, Ahmet Buğra (2008-10-28)
This paper proposes radial basis function neural networks approach to the Solution of a mobile robot heading adjustment using reinforcement learning. In order to control the heading of the mobile robot, the neural networks control system have been constructed and implemented. Neural controller has been charged to enhance the control system by adding some degrees of strength. It has been achieved that neural networks system can learn the relationship between the desired directional heading and the error posi...
Towards an on-line neural conditioning model for mobile robots
Şahin, Erol (2001-01-01)
This paper presents a neural conditioning model for on-line learning of behaviors on mobile robots. The model is based on Grossberg's neural model of conditioning as recently implemented by Chang and Gaudiano. It attempts to tackle some of the limitations of the original model by (1) using a temporal difference of the reinforcement to drive learning, (2) adding eligibility trace mechanisms to dissociate behavior generation from learning, (3) automatically categorizing sensor readings and (4) bootstrapping t...
Hierarchical behavior categorization using correlation based adaptive resonance theory
Yavaş, Mustafa; Alpaslan, Ferda Nur; Department of Computer Engineering (2011)
This thesis introduces a novel behavior categorization model that can be used for behavior recognition and learning. Correlation Based Adaptive Resonance Theory (CobART) network, which is a kind of self organizing and unsupervised competitive neural network, is developed for this purpose. CobART uses correlation analysis methods for category matching. It has modular and simple architecture. It can be adapted to different categorization tasks by changing the correlation analysis methods used when needed. Cob...
Citation Formats
S. S. Seyhan, “Simple and complex behavior learning using behavior hidden Markov Model and CobART,” Ph.D. - Doctoral Program, Middle East Technical University, 2013.