Simple and complex behavior learning using behavior hidden Markov Model and CobART

Download

index.pdf

Date

2013

Author

Seyhan, Seyit Sabri

Metadata

Show full item record

Item Usage Stats

291
views

161
downloads

In this thesis, behavior learning and generation models are proposed for simple and complex behaviors of robots using unsupervised learning methods. Simple behaviors are modeled by simple-behavior learning model (SBLM) and complex behaviors are modeled by complex-behavior learning model (CBLM) which uses previously learned simple or complex behaviors. Both models have common phases named behavior categorization, behavior modeling, and behavior generation. Sensory data are categorized using correlation based adaptive resonance theory network that generates motion primitives corresponding to robot's base abilities in the categorization phase. In the modeling phase, Behavior-HMM, a modified version of hidden Markov model, is used to model the relationships among the motion primitives in a finite state stochastic network. In addition, a motion generator which is an artificial neural network is trained for each motion primitive to learn essential robot motor commands. In the generation phase, desired task is presented as a target observation and the model generates corresponding motion primitive sequence. Then, these motion primitives are executed successively by the motion generators which are specifically trained for the corresponding motion primitives. The models are not proposed for one specific behavior, but are intended to be bases for all behaviors. CBLM enhances learning capabilities by integrating previously learned behaviors hierarchically. Hence, new behaviors can take advantage of already discovered behaviors. The proposed models are tested on a robot simulator and the experiments showed that simple and complex-behavior learning models can generate requested behaviors effectively.

Subject Keywords

Robotics., Robots, Artificial intelligence., Machine learning., Computational learning theory.

URI

http://etd.lib.metu.edu.tr/upload/12615508/index.pdf
https://hdl.handle.net/11511/22293

Collections

Graduate School of Natural and Applied Sciences, Thesis

Suggestions

OpenMETU
Core

Simple and complex behavior learning using behavior hidden Markov model and CobART Seyhan, Seyit Sabri; Alpaslan, Ferda Nur; Yavaş, Mustafa (2013-03-01) This paper proposes behavior learning and generation models for simple and complex behaviors of robots using unsupervised learning methods. While the simple behaviors are modeled by simple-behavior learning model (SBLM), complex behaviors are modeled by complex-behavior learning model (CBLM) which uses previously learned simple or complex behaviors. Both models include behavior categorization, behavior modeling, and behavior generation phases. In the behavior categorization phase, sensory data are categoriz...
Hierarchical behavior categorization using correlation based adaptive resonance theory Yavaş, Mustafa; Alpaslan, Ferda Nur; Department of Computer Engineering (2011) This thesis introduces a novel behavior categorization model that can be used for behavior recognition and learning. Correlation Based Adaptive Resonance Theory (CobART) network, which is a kind of self organizing and unsupervised competitive neural network, is developed for this purpose. CobART uses correlation analysis methods for category matching. It has modular and simple architecture. It can be adapted to different categorization tasks by changing the correlation analysis methods used when needed. Cob...
Implementation of a closed-loop action generation system on a humanoid robot through learning by demonstration Tunaoğlu, Doruk; Şahin, Erol; Department of Computer Engineering (2010) In this thesis the action learning and generation problem on a humanoid robot is studied. Our aim is to realize action learning, generation and recognition in one system and our inspiration source is the mirror neuron hypothesis which suggests that action learning, generation and recognition share the same neural circuitry. Dynamic Movement Primitives, an efficient action learning and generation approach, are modified in order to fulfill this aim. The system we developed (1) can learn from multiple demonstr...
Machine learning methods for opponent modeling in games of imperfect information Şirin, Volkan; Yarman Vural, Fatoş Tunay; Department of Computer Engineering (2012) This thesis presents a machine learning approach to the problem of opponent modeling in games of imperfect information. The efficiency of various artificial intelligence techniques are investigated in this domain. A sequential game is called imperfect information game if players do not have all the information about the current state of the game. A very popular example is the Texas Holdem Poker, which is used for realization of the suggested methods in this thesis. Opponent modeling is the system that enabl...
Towards an on-line neural conditioning model for mobile robots Şahin, Erol (2001-01-01) This paper presents a neural conditioning model for on-line learning of behaviors on mobile robots. The model is based on Grossberg's neural model of conditioning as recently implemented by Chang and Gaudiano. It attempts to tackle some of the limitations of the original model by (1) using a temporal difference of the reinforcement to drive learning, (2) adding eligibility trace mechanisms to dissociate behavior generation from learning, (3) automatically categorizing sensor readings and (4) bootstrapping t...

Citation Formats

S. S. Seyhan, “Simple and complex behavior learning using behavior hidden Markov Model and CobART,” Ph.D. - Doctoral Program, Middle East Technical University, 2013.