Assessment of a Novel Virtual Environment for Examining Human Cognitive-Motor Performance During Execution of Action Sequences

Alexandra A. Shaver, Neehar Peri, Remy Mezebish, George Matthew, Alyza Berson, Christopher Gaskins, Gregory P. Davis, Garrett E. Katz, Immanuel Samuel, Matthew J. Reinhard, Michelle E. Costanzo, James A. Reggia, James Purtilo, Rodolphe J. Gentili

Research output: Chapter in Book/Report/Conference proceedingConference contribution

Abstract

The examination of neural resource allocation during complex action sequence execution is critical to understanding human behavior. While physical systems are usually used for such assessment, virtual/remote systems offer other approaches with potential benefits such as remote training/evaluation. Here we describe a virtual environment (VLEARN) operated via the internet that has been developed to study the cognitive-motor mechanisms underlying the execution of goal-oriented action sequences in remote and laboratory settings. This study aimed to i) examine the feasibility of evaluating human cognitive-motor behavior when individuals operate VLEARN to complete various tasks; and ii) assess VLEARN by comparing its usability and the resulting performance, mental workload, and mental/physical fatigue during virtual and physical task execution. Results revealed that our approach allowed human cognitive-motor behavior assessment as the tasks completed physically and virtually via VLEARN had similar success rates. Also, there was a relationship between the complexity of the virtual control systems and the dependency on those to complete tasks. Namely, relative to controls with more functionalities, when VLEARN enabled simpler controls, above average usability and similar levels of cognitive-motor performance for both physical and virtual task execution were observed. Thus, a simplification of some aspects of the VLEARN control interface should enhance its usability. Our approach is promising for examining human cognitive-motor behavior and informing multiple applications (e.g., telehealth, remote training).

Original languageEnglish (US)
Title of host publicationAugmented Cognition - 16th International Conference, AC 2022, Held as Part of the 24th HCI International Conference, HCII 2022, Proceedings
EditorsDylan D. Schmorrow, Cali M. Fidopiastis
PublisherSpringer Science and Business Media Deutschland GmbH
Pages361-380
Number of pages20
ISBN (Print)9783031054563
DOIs
StatePublished - 2022
Event16th International Conference on Augmented Cognition, AC 2022 Held as Part of the 24th HCI International Conference, HCII 2022 - Virtual, Online
Duration: Jun 26 2022Jul 1 2022

Publication series

NameLecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics)
Volume13310 LNAI
ISSN (Print)0302-9743
ISSN (Electronic)1611-3349

Conference

Conference16th International Conference on Augmented Cognition, AC 2022 Held as Part of the 24th HCI International Conference, HCII 2022
CityVirtual, Online
Period6/26/227/1/22

Keywords

  • Action sequences
  • Cognitive-motor performance
  • Human-machine interface
  • Mental workload
  • Rehabilitation
  • Virtual environment

ASJC Scopus subject areas

  • Theoretical Computer Science
  • Computer Science(all)

Fingerprint

Dive into the research topics of 'Assessment of a Novel Virtual Environment for Examining Human Cognitive-Motor Performance During Execution of Action Sequences'. Together they form a unique fingerprint.

Cite this