A Neurophysiological Sensor Suite for Real-Time Prediction of Pilot Workload in Operational Settings

Trevor Grant; Kaunil Dhruv; Lucca Eloy; Lucas Hayne; Kevin Durkee; Leanne Hirshfield

doi:10.1007/978-3-030-60128-7_5

A Neurophysiological Sensor Suite for Real-Time Prediction of Pilot Workload in Operational Settings

Trevor Grant, Kaunil Dhruv, Lucca Eloy, Lucas Hayne, Kevin Durkee, Leanne Hirshfield

S.I. Newhouse School of Public Communications

Research output: Chapter in Book/Entry/Poem › Conference contribution

1 Scopus citations

Abstract

In recent years, research involving the use of neurophysiological sensor streams to quantitatively measure and predict the level of mental workload experienced by an individual user has gained momentum as the complexity of the tasks operators have experienced in heavily computerized contexts has continued to expand. Despite the promising results from many empirical studies reporting successful classification of workload using neurophysiological sensor data, accurate classification of workload in real-time remains a largely unsolved problem. This research aims to both introduce and examine the efficacy of a new research tool: Tools for Object Measurement and Evaluation (TOME). The TOME system is a toolset for collating and examining neurophysiological data in real time. Following a presentation of the system, and the problems the system may help to solve, a validation study using the TOME system is presented.

Original language	English (US)
Title of host publication	HCI International 2020 – Late Breaking Papers
Subtitle of host publication	Cognition, Learning and Games - 22nd HCI International Conference, HCII 2020, Proceedings
Editors	Constantine Stephanidis, Don Harris, Wen-Chin Li, Dylan D. Schmorrow, Cali M. Fidopiastis, Panayiotis Zaphiris, Andri Ioannou, Andri Ioannou, Xiaowen Fang, Robert A. Sottilare, Jessica Schwarz
Publisher	Springer Science and Business Media Deutschland GmbH
Pages	60-77
Number of pages	18
ISBN (Print)	9783030601270
DOIs	https://doi.org/10.1007/978-3-030-60128-7_5
State	Published - 2020
Event	22nd International Conference on Human-Computer Interaction,HCII 2020 - Copenhagen, Denmark Duration: Jul 19 2020 → Jul 24 2020

Publication series

Name	Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics)
Volume	12425 LNCS
ISSN (Print)	0302-9743
ISSN (Electronic)	1611-3349

Conference

Conference	22nd International Conference on Human-Computer Interaction,HCII 2020
Country/Territory	Denmark
City	Copenhagen
Period	7/19/20 → 7/24/20

Keywords

Data acquisition
Mental workload
Physiological sensors

ASJC Scopus subject areas

Theoretical Computer Science
General Computer Science

Access to Document

10.1007/978-3-030-60128-7_5

Cite this

Grant, T., Dhruv, K., Eloy, L., Hayne, L., Durkee, K., & Hirshfield, L. (2020). A Neurophysiological Sensor Suite for Real-Time Prediction of Pilot Workload in Operational Settings. In C. Stephanidis, D. Harris, W.-C. Li, D. D. Schmorrow, C. M. Fidopiastis, P. Zaphiris, A. Ioannou, A. Ioannou, X. Fang, R. A. Sottilare, & J. Schwarz (Eds.), HCI International 2020 – Late Breaking Papers: Cognition, Learning and Games - 22nd HCI International Conference, HCII 2020, Proceedings (pp. 60-77). (Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics); Vol. 12425 LNCS). Springer Science and Business Media Deutschland GmbH. https://doi.org/10.1007/978-3-030-60128-7_5

A Neurophysiological Sensor Suite for Real-Time Prediction of Pilot Workload in Operational Settings. / Grant, Trevor; Dhruv, Kaunil; Eloy, Lucca et al.
HCI International 2020 – Late Breaking Papers: Cognition, Learning and Games - 22nd HCI International Conference, HCII 2020, Proceedings. ed. / Constantine Stephanidis; Don Harris; Wen-Chin Li; Dylan D. Schmorrow; Cali M. Fidopiastis; Panayiotis Zaphiris; Andri Ioannou; Andri Ioannou; Xiaowen Fang; Robert A. Sottilare; Jessica Schwarz. Springer Science and Business Media Deutschland GmbH, 2020. p. 60-77 (Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics); Vol. 12425 LNCS).

Research output: Chapter in Book/Entry/Poem › Conference contribution

Grant, T, Dhruv, K, Eloy, L, Hayne, L, Durkee, K & Hirshfield, L 2020, A Neurophysiological Sensor Suite for Real-Time Prediction of Pilot Workload in Operational Settings. in C Stephanidis, D Harris, W-C Li, DD Schmorrow, CM Fidopiastis, P Zaphiris, A Ioannou, A Ioannou, X Fang, RA Sottilare & J Schwarz (eds), HCI International 2020 – Late Breaking Papers: Cognition, Learning and Games - 22nd HCI International Conference, HCII 2020, Proceedings. Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics), vol. 12425 LNCS, Springer Science and Business Media Deutschland GmbH, pp. 60-77, 22nd International Conference on Human-Computer Interaction,HCII 2020, Copenhagen, Denmark, 7/19/20. https://doi.org/10.1007/978-3-030-60128-7_5

Grant T, Dhruv K, Eloy L, Hayne L, Durkee K, Hirshfield L. A Neurophysiological Sensor Suite for Real-Time Prediction of Pilot Workload in Operational Settings. In Stephanidis C, Harris D, Li WC, Schmorrow DD, Fidopiastis CM, Zaphiris P, Ioannou A, Ioannou A, Fang X, Sottilare RA, Schwarz J, editors, HCI International 2020 – Late Breaking Papers: Cognition, Learning and Games - 22nd HCI International Conference, HCII 2020, Proceedings. Springer Science and Business Media Deutschland GmbH. 2020. p. 60-77. (Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics)). doi: 10.1007/978-3-030-60128-7_5

Grant, Trevor ; Dhruv, Kaunil ; Eloy, Lucca et al. / A Neurophysiological Sensor Suite for Real-Time Prediction of Pilot Workload in Operational Settings. HCI International 2020 – Late Breaking Papers: Cognition, Learning and Games - 22nd HCI International Conference, HCII 2020, Proceedings. editor / Constantine Stephanidis ; Don Harris ; Wen-Chin Li ; Dylan D. Schmorrow ; Cali M. Fidopiastis ; Panayiotis Zaphiris ; Andri Ioannou ; Andri Ioannou ; Xiaowen Fang ; Robert A. Sottilare ; Jessica Schwarz. Springer Science and Business Media Deutschland GmbH, 2020. pp. 60-77 (Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics)).

@inproceedings{f88e44fc599d4f9483a1f90687c6187d,

title = "A Neurophysiological Sensor Suite for Real-Time Prediction of Pilot Workload in Operational Settings",

abstract = "In recent years, research involving the use of neurophysiological sensor streams to quantitatively measure and predict the level of mental workload experienced by an individual user has gained momentum as the complexity of the tasks operators have experienced in heavily computerized contexts has continued to expand. Despite the promising results from many empirical studies reporting successful classification of workload using neurophysiological sensor data, accurate classification of workload in real-time remains a largely unsolved problem. This research aims to both introduce and examine the efficacy of a new research tool: Tools for Object Measurement and Evaluation (TOME). The TOME system is a toolset for collating and examining neurophysiological data in real time. Following a presentation of the system, and the problems the system may help to solve, a validation study using the TOME system is presented.",

keywords = "Data acquisition, Mental workload, Physiological sensors",

author = "Trevor Grant and Kaunil Dhruv and Lucca Eloy and Lucas Hayne and Kevin Durkee and Leanne Hirshfield",

note = "Publisher Copyright: {\textcopyright} 2020, Springer Nature Switzerland AG.; 22nd International Conference on Human-Computer Interaction,HCII 2020 ; Conference date: 19-07-2020 Through 24-07-2020",

year = "2020",

doi = "10.1007/978-3-030-60128-7_5",

language = "English (US)",

isbn = "9783030601270",

series = "Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics)",

publisher = "Springer Science and Business Media Deutschland GmbH",

pages = "60--77",

editor = "Constantine Stephanidis and Don Harris and Wen-Chin Li and Schmorrow, {Dylan D.} and Fidopiastis, {Cali M.} and Panayiotis Zaphiris and Andri Ioannou and Andri Ioannou and Xiaowen Fang and Sottilare, {Robert A.} and Jessica Schwarz",

booktitle = "HCI International 2020 – Late Breaking Papers",

address = "Germany",

}

TY - GEN

T1 - A Neurophysiological Sensor Suite for Real-Time Prediction of Pilot Workload in Operational Settings

AU - Grant, Trevor

AU - Dhruv, Kaunil

AU - Eloy, Lucca

AU - Hayne, Lucas

AU - Durkee, Kevin

AU - Hirshfield, Leanne

PY - 2020

Y1 - 2020

N2 - In recent years, research involving the use of neurophysiological sensor streams to quantitatively measure and predict the level of mental workload experienced by an individual user has gained momentum as the complexity of the tasks operators have experienced in heavily computerized contexts has continued to expand. Despite the promising results from many empirical studies reporting successful classification of workload using neurophysiological sensor data, accurate classification of workload in real-time remains a largely unsolved problem. This research aims to both introduce and examine the efficacy of a new research tool: Tools for Object Measurement and Evaluation (TOME). The TOME system is a toolset for collating and examining neurophysiological data in real time. Following a presentation of the system, and the problems the system may help to solve, a validation study using the TOME system is presented.

AB - In recent years, research involving the use of neurophysiological sensor streams to quantitatively measure and predict the level of mental workload experienced by an individual user has gained momentum as the complexity of the tasks operators have experienced in heavily computerized contexts has continued to expand. Despite the promising results from many empirical studies reporting successful classification of workload using neurophysiological sensor data, accurate classification of workload in real-time remains a largely unsolved problem. This research aims to both introduce and examine the efficacy of a new research tool: Tools for Object Measurement and Evaluation (TOME). The TOME system is a toolset for collating and examining neurophysiological data in real time. Following a presentation of the system, and the problems the system may help to solve, a validation study using the TOME system is presented.

KW - Data acquisition

KW - Mental workload

KW - Physiological sensors

UR - http://www.scopus.com/inward/record.url?scp=85092926413&partnerID=8YFLogxK

UR - http://www.scopus.com/inward/citedby.url?scp=85092926413&partnerID=8YFLogxK

U2 - 10.1007/978-3-030-60128-7_5

DO - 10.1007/978-3-030-60128-7_5

M3 - Conference contribution

AN - SCOPUS:85092926413

SN - 9783030601270

T3 - Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics)

SP - 60

EP - 77

BT - HCI International 2020 – Late Breaking Papers

A2 - Stephanidis, Constantine

A2 - Harris, Don

A2 - Li, Wen-Chin

A2 - Schmorrow, Dylan D.

A2 - Fidopiastis, Cali M.

A2 - Zaphiris, Panayiotis

A2 - Ioannou, Andri

A2 - Fang, Xiaowen

A2 - Sottilare, Robert A.

A2 - Schwarz, Jessica

PB - Springer Science and Business Media Deutschland GmbH

T2 - 22nd International Conference on Human-Computer Interaction,HCII 2020

Y2 - 19 July 2020 through 24 July 2020

ER -

A Neurophysiological Sensor Suite for Real-Time Prediction of Pilot Workload in Operational Settings

Abstract

Publication series

Conference

Keywords

ASJC Scopus subject areas

Access to Document

Other files and links

Fingerprint

Cite this