Combining electroencephalograph and functional near infrared spectroscopy to explore users' mental workload

Leanne M. Hirshfield, Krysta Chauncey, Rebecca Gulotta, Audrey Girouard, Erin T. Solovey, Robert J.K. Jacob, Angelo Sassaroli, Sergio Fantini

Research output: Chapter in Book/Report/Conference proceedingConference contribution

37 Scopus citations

Abstract

We discuss the physiological metrics that can be measured with electroencephalography (EEG) and functional near infrared spectroscopy (fNIRs). We address the functional and practical limitations of each device, and technical issues to be mindful of when combining the devices. We also present machine learning methods that can be used on concurrent recordings of EEG and fNIRs data. We discuss an experiment that combines fNIRs and EEG to measure a range of user states that are of interest in HCI. While our fNIRS machine learning results showed promise for the measurement of workload states in HCI, our EEG results indicate that more research must be done in order to combine these two devices in practice.

Original languageEnglish (US)
Title of host publicationFoundations of Augmented Cognition
Subtitle of host publicationNeuroergonomics and Operational Neuroscience - 5th International Conference, FAC 2009, Held as Part of HCI International 2009, Proceedings
Pages239-247
Number of pages9
DOIs
StatePublished - Dec 1 2009
Externally publishedYes
Event5th International Conference on Foundations of Augmented Cognition, FAC 2009, Held as Part of HCI International 2009 - San Diego, CA, United States
Duration: Jul 19 2009Jul 24 2009

Publication series

NameLecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics)
Volume5638 LNAI
ISSN (Print)0302-9743
ISSN (Electronic)1611-3349

Other

Other5th International Conference on Foundations of Augmented Cognition, FAC 2009, Held as Part of HCI International 2009
CountryUnited States
CitySan Diego, CA
Period7/19/097/24/09

Keywords

  • EEG
  • Near infrared spectroscopy
  • Workload
  • fNIRs

ASJC Scopus subject areas

  • Theoretical Computer Science
  • Computer Science(all)

Fingerprint Dive into the research topics of 'Combining electroencephalograph and functional near infrared spectroscopy to explore users' mental workload'. Together they form a unique fingerprint.

  • Cite this

    Hirshfield, L. M., Chauncey, K., Gulotta, R., Girouard, A., Solovey, E. T., Jacob, R. J. K., Sassaroli, A., & Fantini, S. (2009). Combining electroencephalograph and functional near infrared spectroscopy to explore users' mental workload. In Foundations of Augmented Cognition: Neuroergonomics and Operational Neuroscience - 5th International Conference, FAC 2009, Held as Part of HCI International 2009, Proceedings (pp. 239-247). (Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics); Vol. 5638 LNAI). https://doi.org/10.1007/978-3-642-02812-0_28