Show/Hide Menu
Hide/Show Apps
Logout
Türkçe
Türkçe
Search
Search
Login
Login
OpenMETU
OpenMETU
About
About
Open Science Policy
Open Science Policy
Open Access Guideline
Open Access Guideline
Postgraduate Thesis Guideline
Postgraduate Thesis Guideline
Communities & Collections
Communities & Collections
Help
Help
Frequently Asked Questions
Frequently Asked Questions
Guides
Guides
Thesis submission
Thesis submission
MS without thesis term project submission
MS without thesis term project submission
Publication submission with DOI
Publication submission with DOI
Publication submission
Publication submission
Supporting Information
Supporting Information
General Information
General Information
Copyright, Embargo and License
Copyright, Embargo and License
Contact us
Contact us
Simple and complex behavior learning using behavior hidden Markov Model and CobART
Download
index.pdf
Date
2013
Author
Seyhan, Seyit Sabri
Metadata
Show full item record
Item Usage Stats
285
views
160
downloads
Cite This
In this thesis, behavior learning and generation models are proposed for simple and complex behaviors of robots using unsupervised learning methods. Simple behaviors are modeled by simple-behavior learning model (SBLM) and complex behaviors are modeled by complex-behavior learning model (CBLM) which uses previously learned simple or complex behaviors. Both models have common phases named behavior categorization, behavior modeling, and behavior generation. Sensory data are categorized using correlation based adaptive resonance theory network that generates motion primitives corresponding to robot's base abilities in the categorization phase. In the modeling phase, Behavior-HMM, a modified version of hidden Markov model, is used to model the relationships among the motion primitives in a finite state stochastic network. In addition, a motion generator which is an artificial neural network is trained for each motion primitive to learn essential robot motor commands. In the generation phase, desired task is presented as a target observation and the model generates corresponding motion primitive sequence. Then, these motion primitives are executed successively by the motion generators which are specifically trained for the corresponding motion primitives. The models are not proposed for one specific behavior, but are intended to be bases for all behaviors. CBLM enhances learning capabilities by integrating previously learned behaviors hierarchically. Hence, new behaviors can take advantage of already discovered behaviors. The proposed models are tested on a robot simulator and the experiments showed that simple and complex-behavior learning models can generate requested behaviors effectively.
Subject Keywords
Robotics.
,
Robots
,
Artificial intelligence.
,
Machine learning.
,
Computational learning theory.
URI
http://etd.lib.metu.edu.tr/upload/12615508/index.pdf
https://hdl.handle.net/11511/22293
Collections
Graduate School of Natural and Applied Sciences, Thesis
Suggestions
OpenMETU
Core
Simple and complex behavior learning using behavior hidden Markov model and CobART
Seyhan, Seyit Sabri; Alpaslan, Ferda Nur; Yavaş, Mustafa (2013-03-01)
This paper proposes behavior learning and generation models for simple and complex behaviors of robots using unsupervised learning methods. While the simple behaviors are modeled by simple-behavior learning model (SBLM), complex behaviors are modeled by complex-behavior learning model (CBLM) which uses previously learned simple or complex behaviors. Both models include behavior categorization, behavior modeling, and behavior generation phases. In the behavior categorization phase, sensory data are categoriz...
Hierarchical behavior categorization using correlation based adaptive resonance theory
Yavaş, Mustafa; Alpaslan, Ferda Nur; Department of Computer Engineering (2011)
This thesis introduces a novel behavior categorization model that can be used for behavior recognition and learning. Correlation Based Adaptive Resonance Theory (CobART) network, which is a kind of self organizing and unsupervised competitive neural network, is developed for this purpose. CobART uses correlation analysis methods for category matching. It has modular and simple architecture. It can be adapted to different categorization tasks by changing the correlation analysis methods used when needed. Cob...
Implementation of a closed-loop action generation system on a humanoid robot through learning by demonstration
Tunaoğlu, Doruk; Şahin, Erol; Department of Computer Engineering (2010)
In this thesis the action learning and generation problem on a humanoid robot is studied. Our aim is to realize action learning, generation and recognition in one system and our inspiration source is the mirror neuron hypothesis which suggests that action learning, generation and recognition share the same neural circuitry. Dynamic Movement Primitives, an efficient action learning and generation approach, are modified in order to fulfill this aim. The system we developed (1) can learn from multiple demonstr...
Machine learning methods for opponent modeling in games of imperfect information
Şirin, Volkan; Yarman Vural, Fatoş Tunay; Department of Computer Engineering (2012)
This thesis presents a machine learning approach to the problem of opponent modeling in games of imperfect information. The efficiency of various artificial intelligence techniques are investigated in this domain. A sequential game is called imperfect information game if players do not have all the information about the current state of the game. A very popular example is the Texas Holdem Poker, which is used for realization of the suggested methods in this thesis. Opponent modeling is the system that enabl...
Towards an on-line neural conditioning model for mobile robots
Şahin, Erol (2001-01-01)
This paper presents a neural conditioning model for on-line learning of behaviors on mobile robots. The model is based on Grossberg's neural model of conditioning as recently implemented by Chang and Gaudiano. It attempts to tackle some of the limitations of the original model by (1) using a temporal difference of the reinforcement to drive learning, (2) adding eligibility trace mechanisms to dissociate behavior generation from learning, (3) automatically categorizing sensor readings and (4) bootstrapping t...
Citation Formats
IEEE
ACM
APA
CHICAGO
MLA
BibTeX
S. S. Seyhan, “Simple and complex behavior learning using behavior hidden Markov Model and CobART,” Ph.D. - Doctoral Program, Middle East Technical University, 2013.