A Neural Architecture for Performing Actual and Mentally Simulated Movements During Self-Intended and Observed Bimanual Arm Reaching Movements

Rodolphe J. Gentili, Hyuk Oh, Di Wei Huang, Garrett E. Katz, Ross H. Miller, James A. Reggia

Research output: Contribution to journalArticle

8 Scopus citations

Abstract

Dexterous reaching, pointing, and grasping play a critical role in human interactions with tools and the environment, and it also allows individuals to interact with one another effectively in social settings. Developing robotic systems with mental simulation and imitation learning abilities for such tasks seems a promising way to enhance robot performance as well as to enable interactions with humans in a social context. In spite of important advances in artificial intelligence and smart robotics, current robotic systems lack the flexibility and adaptability that humans so naturally exhibit. Here we present and study a neural architecture that captures some critical visuo-spatial transformations that are required for the cognitive processes of mental simulation and imitation. The results show that our neural model can perform accurate, flexible and robust 3D unimanual and bimanual actual/imagined reaching movements while avoiding extreme joint positions and generating kinematics similar to those observed with humans. In addition, using visuo-spatial transformations, the neural model was able to observe/imitate bimanual arm reaching movements independently of the viewpoint, distance and anthropometry between the demonstrator and imitator. Our model is a first step towards developing a more advanced neurally-inspired hierarchical architecture that integrates mental simulation and sensorimotor processing as it learns to imitate dexterous bimanual arm movements.

Original languageEnglish (US)
Pages (from-to)371-392
Number of pages22
JournalInternational Journal of Social Robotics
Volume7
Issue number3
DOIs
StatePublished - Jun 6 2015
Externally publishedYes

Keywords

  • Bimanual reaching movements
  • Internal models
  • Inverse kinematics
  • Mental simulation
  • Motor learning
  • Movement imitation
  • Neural network models

ASJC Scopus subject areas

  • Computer Science(all)

Fingerprint Dive into the research topics of 'A Neural Architecture for Performing Actual and Mentally Simulated Movements During Self-Intended and Observed Bimanual Arm Reaching Movements'. Together they form a unique fingerprint.

  • Cite this