An Improved eXtended Classifier System for the Real-time-input Real-time-output (XCSRR) Stability Control of a Biped Robot

A. Sabzehzar, W. L. Shan, M. Shariat Panahi, O. Saremi

Research output: Contribution to journalConference article

1 Scopus citations


In this paper a revised reinforcement learning method is presented for stability control problems with real-value inputs and outputs. The revised eXtended Classifier System for Real-input and Real-output (XCSRR) controller is designed, which is capable of working at fully real-value environment such as stability control of robots. XCSRR is a novel approach to enhance the performance of classifier systems for more practical problems than systems with merely binary behaviour. As a case study, we use XCSRR to control the stability of a biped robot, which is subjected to unknown external forces that would disturb the robot equilibrium. The external forces and the dynamics of the upper body of the biped robot are modelled in MATLAB software to train the XCSRR controller. Theoretical and experimental results of the learning behaviour and the performance of stability control on the robot demonstrate the strength and efficiency of the proposed new approach.

Original languageEnglish (US)
Pages (from-to)492-499
Number of pages8
JournalProcedia Computer Science
StatePublished - Jan 1 2015
Externally publishedYes
EventComplex Adaptive Systems, 2015 - San Jose, United States
Duration: Nov 2 2015Nov 4 2015



  • eXtended Classifier Systems (XCS)
  • real-value problem
  • reinforcement learning

ASJC Scopus subject areas

  • Computer Science(all)

Cite this