Combining electroencephalograph and functional near infrared spectroscopy to explore users' mental workload

Leanne M. Hirshfield; Krysta Chauncey; Rebecca Gulotta; Audrey Girouard; Erin T. Solovey; Robert J.K. Jacob; Angelo Sassaroli; Sergio Fantini

doi:10.1007/978-3-642-02812-0_28

Combining electroencephalograph and functional near infrared spectroscopy to explore users' mental workload

Leanne M. Hirshfield, Krysta Chauncey, Rebecca Gulotta, Audrey Girouard, Erin T. Solovey, Robert J.K. Jacob, Angelo Sassaroli, Sergio Fantini

Research output: Chapter in Book/Entry/Poem › Conference contribution

54 Scopus citations

Abstract

We discuss the physiological metrics that can be measured with electroencephalography (EEG) and functional near infrared spectroscopy (fNIRs). We address the functional and practical limitations of each device, and technical issues to be mindful of when combining the devices. We also present machine learning methods that can be used on concurrent recordings of EEG and fNIRs data. We discuss an experiment that combines fNIRs and EEG to measure a range of user states that are of interest in HCI. While our fNIRS machine learning results showed promise for the measurement of workload states in HCI, our EEG results indicate that more research must be done in order to combine these two devices in practice.

Original language	English (US)
Title of host publication	Foundations of Augmented Cognition
Subtitle of host publication	Neuroergonomics and Operational Neuroscience - 5th International Conference, FAC 2009, Held as Part of HCI International 2009, Proceedings
Pages	239-247
Number of pages	9
DOIs	https://doi.org/10.1007/978-3-642-02812-0_28
State	Published - 2009
Externally published	Yes
Event	5th International Conference on Foundations of Augmented Cognition, FAC 2009, Held as Part of HCI International 2009 - San Diego, CA, United States Duration: Jul 19 2009 → Jul 24 2009

Publication series

Name	Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics)
Volume	5638 LNAI
ISSN (Print)	0302-9743
ISSN (Electronic)	1611-3349

Other

Other	5th International Conference on Foundations of Augmented Cognition, FAC 2009, Held as Part of HCI International 2009
Country/Territory	United States
City	San Diego, CA
Period	7/19/09 → 7/24/09

Keywords

EEG
Near infrared spectroscopy
Workload
fNIRs

ASJC Scopus subject areas

Theoretical Computer Science
General Computer Science

Access to Document

10.1007/978-3-642-02812-0_28

Cite this

Hirshfield, L. M., Chauncey, K., Gulotta, R., Girouard, A., Solovey, E. T., Jacob, R. J. K., Sassaroli, A., & Fantini, S. (2009). Combining electroencephalograph and functional near infrared spectroscopy to explore users' mental workload. In Foundations of Augmented Cognition: Neuroergonomics and Operational Neuroscience - 5th International Conference, FAC 2009, Held as Part of HCI International 2009, Proceedings (pp. 239-247). (Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics); Vol. 5638 LNAI). https://doi.org/10.1007/978-3-642-02812-0_28

Combining electroencephalograph and functional near infrared spectroscopy to explore users' mental workload. / Hirshfield, Leanne M.; Chauncey, Krysta; Gulotta, Rebecca et al.
Foundations of Augmented Cognition: Neuroergonomics and Operational Neuroscience - 5th International Conference, FAC 2009, Held as Part of HCI International 2009, Proceedings. 2009. p. 239-247 (Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics); Vol. 5638 LNAI).

Research output: Chapter in Book/Entry/Poem › Conference contribution

Hirshfield, LM, Chauncey, K, Gulotta, R, Girouard, A, Solovey, ET, Jacob, RJK, Sassaroli, A & Fantini, S 2009, Combining electroencephalograph and functional near infrared spectroscopy to explore users' mental workload. in Foundations of Augmented Cognition: Neuroergonomics and Operational Neuroscience - 5th International Conference, FAC 2009, Held as Part of HCI International 2009, Proceedings. Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics), vol. 5638 LNAI, pp. 239-247, 5th International Conference on Foundations of Augmented Cognition, FAC 2009, Held as Part of HCI International 2009, San Diego, CA, United States, 7/19/09. https://doi.org/10.1007/978-3-642-02812-0_28

Hirshfield LM, Chauncey K, Gulotta R, Girouard A, Solovey ET, Jacob RJK et al. Combining electroencephalograph and functional near infrared spectroscopy to explore users' mental workload. In Foundations of Augmented Cognition: Neuroergonomics and Operational Neuroscience - 5th International Conference, FAC 2009, Held as Part of HCI International 2009, Proceedings. 2009. p. 239-247. (Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics)). doi: 10.1007/978-3-642-02812-0_28

Hirshfield, Leanne M. ; Chauncey, Krysta ; Gulotta, Rebecca et al. / Combining electroencephalograph and functional near infrared spectroscopy to explore users' mental workload. Foundations of Augmented Cognition: Neuroergonomics and Operational Neuroscience - 5th International Conference, FAC 2009, Held as Part of HCI International 2009, Proceedings. 2009. pp. 239-247 (Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics)).

@inproceedings{e9c1d0b3cd0a4f55a36c88551ff7a3da,

title = "Combining electroencephalograph and functional near infrared spectroscopy to explore users' mental workload",

abstract = "We discuss the physiological metrics that can be measured with electroencephalography (EEG) and functional near infrared spectroscopy (fNIRs). We address the functional and practical limitations of each device, and technical issues to be mindful of when combining the devices. We also present machine learning methods that can be used on concurrent recordings of EEG and fNIRs data. We discuss an experiment that combines fNIRs and EEG to measure a range of user states that are of interest in HCI. While our fNIRS machine learning results showed promise for the measurement of workload states in HCI, our EEG results indicate that more research must be done in order to combine these two devices in practice.",

keywords = "EEG, Near infrared spectroscopy, Workload, fNIRs",

author = "Hirshfield, {Leanne M.} and Krysta Chauncey and Rebecca Gulotta and Audrey Girouard and Solovey, {Erin T.} and Jacob, {Robert J.K.} and Angelo Sassaroli and Sergio Fantini",

year = "2009",

doi = "10.1007/978-3-642-02812-0_28",

language = "English (US)",

isbn = "364202811X",

series = "Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics)",

pages = "239--247",

booktitle = "Foundations of Augmented Cognition",

note = "5th International Conference on Foundations of Augmented Cognition, FAC 2009, Held as Part of HCI International 2009 ; Conference date: 19-07-2009 Through 24-07-2009",

}

TY - GEN

T1 - Combining electroencephalograph and functional near infrared spectroscopy to explore users' mental workload

AU - Hirshfield, Leanne M.

AU - Chauncey, Krysta

AU - Gulotta, Rebecca

AU - Girouard, Audrey

AU - Solovey, Erin T.

AU - Jacob, Robert J.K.

AU - Sassaroli, Angelo

AU - Fantini, Sergio

PY - 2009

Y1 - 2009

N2 - We discuss the physiological metrics that can be measured with electroencephalography (EEG) and functional near infrared spectroscopy (fNIRs). We address the functional and practical limitations of each device, and technical issues to be mindful of when combining the devices. We also present machine learning methods that can be used on concurrent recordings of EEG and fNIRs data. We discuss an experiment that combines fNIRs and EEG to measure a range of user states that are of interest in HCI. While our fNIRS machine learning results showed promise for the measurement of workload states in HCI, our EEG results indicate that more research must be done in order to combine these two devices in practice.

AB - We discuss the physiological metrics that can be measured with electroencephalography (EEG) and functional near infrared spectroscopy (fNIRs). We address the functional and practical limitations of each device, and technical issues to be mindful of when combining the devices. We also present machine learning methods that can be used on concurrent recordings of EEG and fNIRs data. We discuss an experiment that combines fNIRs and EEG to measure a range of user states that are of interest in HCI. While our fNIRS machine learning results showed promise for the measurement of workload states in HCI, our EEG results indicate that more research must be done in order to combine these two devices in practice.

KW - EEG

KW - Near infrared spectroscopy

KW - Workload

KW - fNIRs

UR - http://www.scopus.com/inward/record.url?scp=77951998378&partnerID=8YFLogxK

UR - http://www.scopus.com/inward/citedby.url?scp=77951998378&partnerID=8YFLogxK

U2 - 10.1007/978-3-642-02812-0_28

DO - 10.1007/978-3-642-02812-0_28

M3 - Conference contribution

AN - SCOPUS:77951998378

SN - 364202811X

SN - 9783642028113

T3 - Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics)

SP - 239

EP - 247

BT - Foundations of Augmented Cognition

T2 - 5th International Conference on Foundations of Augmented Cognition, FAC 2009, Held as Part of HCI International 2009

Y2 - 19 July 2009 through 24 July 2009

ER -

Combining electroencephalograph and functional near infrared spectroscopy to explore users' mental workload

Abstract

Publication series

Other

Keywords

ASJC Scopus subject areas

Access to Document

Other files and links

Fingerprint

Cite this