Dynamic gait pattern generation with reinforcement learning

Date

2005-01-01

Author

Erden, Mustafa Suphi
Leblebicioğlu, Mehmet Kemal

Metadata

Show full item record

This work is licensed under a Creative Commons Attribution-NonCommercial-NoDerivatives 4.0 International License.

Item Usage Stats

124
views

0
downloads

This paper presents the gait pattern generation work performed for the sixlegged robot EA308 developed in our laboratory. The aim is to achieve a dynamically developing gait pattern generation structure using reinforcement learning. For the six legged robot a simplified simulative model is constructed. The algorithm constructs a radial basis function neural network (RBFNN) to command proper leg configurations to the simulative robot. The weights of the RBFNN are learned using reinforcement learning. The developed structure succeeded in learning gait patterns compatible with different speeds of the robot. Copyright © 2005 IFAC.

Subject Keywords

Gait pattern, Radial basis function neural network, Reinforcement learning, Six-legged robot, Walking

URI

https://www.scopus.com/inward/record.uri?partnerID=HzOxMe3b&scp=79960747404&origin=inward
https://hdl.handle.net/11511/102171

Journal

IFAC Proceedings Volumes (IFAC-PapersOnline)

DOI

https://doi.org/10.3182/20050703-6-cz-1902.01295

Collections

Department of Electrical and Electronics Engineering, Article

Suggestions

OpenMETU
Core

Mobile Robot Heading Adjustment Using Radial Basis Function Neural Networks Controller and Reinforcement Learning BAYAR, GÖKHAN; Konukseven, Erhan İlhan; Koku, Ahmet Buğra (2008-10-28) This paper proposes radial basis function neural networks approach to the Solution of a mobile robot heading adjustment using reinforcement learning. In order to control the heading of the mobile robot, the neural networks control system have been constructed and implemented. Neural controller has been charged to enhance the control system by adding some degrees of strength. It has been achieved that neural networks system can learn the relationship between the desired directional heading and the error posi...
Control of a differentially driven mobile robot using radial basis function based neural networks Bayar, Gökhan; Konukseven, Erhan İlhan; Buǧra Koku, A. (2008-12-01) This paper proposes the use of radial basis function neural networks approach to the solution of a mobile robot orientation adjustment using reinforcement learning. In order to control the orientation of the mobile robot, a neural network control system has been constructed and implemented. Neural controller has been charged to enhance the control system by adding some degrees of award. Making use of the potential of neural networks to learn the relationships, the desired reference orientation and the error...
Analysis of wave gaits for energy efficiency Erden, Mustafa Suphi; Leblebicioğlu, Mehmet Kemal (2007-10-01) In this paper an energy efficiency analysis of wave gaits is performed for a six-legged walking robot. A simulation model of the robot is used to obtain the data demonstrating the energy consumption while walking in different modes and with varying parameters. Based on the analysis of this data some strategies are derived in order to minimize the search effort for determining the parameters of the gaits for an energy efficient walk. Then, similar data is obtained from an actual experimental setup, in which ...
Hierarchical behavior categorization using correlation based adaptive resonance theory Yavaş, Mustafa; Alpaslan, Ferda Nur (2012-02-01) This paper introduces a new model for robot behavior categorization. Correlation based adaptive resonance theory (CobART) networks are integrated hierarchically in order to develop an adequate categorization, and to elicit various behaviors performed by the robot. The proposed model is developed by adding a second layer CobART network which receives first layer CobART network categories as an input, and back-propagates the matching information to the first layer networks. The first layer CobART networks cat...
Analysis of wave gaits for energy efficiency Erden, Mustafa Suphi; Leblebicioğlu, Mehmet Kemal (2006-01-01) In this paper an energy efficiency analysis of wave gaits is performed for a six-legged walking robot. A simulation model of the robot is used to obtain the data demonstrating the energy consumption of the robot while walking in different modes and with varying parameters. Based on the analysis of this data some strategies are derived in order to minimize the search effort for determining the parameters of the gaits for an energy efficient walk. The analysis concludes the following: a phase modified version...

Citation Formats

M. S. Erden and M. K. Leblebicioğlu, “Dynamic gait pattern generation with reinforcement learning,” IFAC Proceedings Volumes (IFAC-PapersOnline), vol. 16, pp. 151–156, 2005, Accessed: 00, 2023. [Online]. Available: https://www.scopus.com/inward/record.uri?partnerID=HzOxMe3b&scp=79960747404&origin=inward.