M.I.N.D. brain sensor caps: Coupling precise brain imaging to virtual reality head-mounted displays

Gyoung Kim, Joonhyun Jeon, Frank Biocca

Research output: Chapter in Book/Report/Conference proceedingConference contribution

1 Citation (Scopus)

Abstract

Today, Virtual Reality (VR) and Augmented Reality (AR) are the new communication tools readily available to consumers. Because of the increasing availability of AR and VR, communication and neuroscience researchers are showing increasing interest in the use of VR systems for studies in collaboration, communication, and basic neuroscience. Beyond relying on self-reported or behavioral measures, psychophysiological or functional neuroimaging measurements sensing brain waves (e.g. EEG) or brain hemodynamics (e.g. fNIRS) are powerful techniques for measuring brain activity while interacting with virtual reality stimuli or environments. However, using these measures with virtual reality systems can be difficult due to physical and technical constraints. Both Functional Near-Infrared Spectroscopy (fNIRS) and Electroencephalography (EEG) need multiple channels to measure brain activity, a combination of cables and probes must be attached to a head cap. However, this setup obstructs wearing head-mounted display (HMD) in a VR environment and the challenge varies with the design of the HMD. To overcome these limitations, we introduce the design and development of the M.I.N.D. brain measurement cap specifically adapted for research with virtual reality system. We discuss the design process as well as the advantages and limitations of the current iterative design of the cap. Generally, we anticipate that this measurement system will expand the potential of influence of cognitive neuroscience contribute on VR research by making it easier for researchers to use a breadth of tools.

Original languageEnglish (US)
Title of host publicationAugmented Cognition
Subtitle of host publicationIntelligent Technologies - 12th International Conference, AC 2018, Held as Part of HCI International 2018, Proceedings
PublisherSpringer Verlag
Pages120-130
Number of pages11
ISBN (Print)9783319914695
DOIs
StatePublished - Jan 1 2018
Event12th International Conference on Augmented Cognition, AC 2018 Held as Part of HCI International 2018 - Las Vegas, United States
Duration: Jul 15 2018Jul 20 2018

Publication series

NameLecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics)
Volume10915 LNAI
ISSN (Print)0302-9743
ISSN (Electronic)1611-3349

Other

Other12th International Conference on Augmented Cognition, AC 2018 Held as Part of HCI International 2018
CountryUnited States
CityLas Vegas
Period7/15/187/20/18

Fingerprint

Virtual Reality
Virtual reality
Brain
Display
Display devices
Imaging
Imaging techniques
Sensor
Sensors
Neuroscience
Electroencephalography
Near-infrared Spectroscopy
Augmented Reality
Near infrared spectroscopy
Augmented reality
Communication
Functional neuroimaging
Neuroimaging
Breadth
Cap

Keywords

  • Brain measurement method
  • Brain waves
  • Caps
  • EEG
  • fNIRS
  • Virtual reality

ASJC Scopus subject areas

  • Theoretical Computer Science
  • Computer Science(all)

Cite this

Kim, G., Jeon, J., & Biocca, F. (2018). M.I.N.D. brain sensor caps: Coupling precise brain imaging to virtual reality head-mounted displays. In Augmented Cognition: Intelligent Technologies - 12th International Conference, AC 2018, Held as Part of HCI International 2018, Proceedings (pp. 120-130). (Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics); Vol. 10915 LNAI). Springer Verlag. https://doi.org/10.1007/978-3-319-91470-1_11

M.I.N.D. brain sensor caps : Coupling precise brain imaging to virtual reality head-mounted displays. / Kim, Gyoung; Jeon, Joonhyun; Biocca, Frank.

Augmented Cognition: Intelligent Technologies - 12th International Conference, AC 2018, Held as Part of HCI International 2018, Proceedings. Springer Verlag, 2018. p. 120-130 (Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics); Vol. 10915 LNAI).

Research output: Chapter in Book/Report/Conference proceedingConference contribution

Kim, G, Jeon, J & Biocca, F 2018, M.I.N.D. brain sensor caps: Coupling precise brain imaging to virtual reality head-mounted displays. in Augmented Cognition: Intelligent Technologies - 12th International Conference, AC 2018, Held as Part of HCI International 2018, Proceedings. Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics), vol. 10915 LNAI, Springer Verlag, pp. 120-130, 12th International Conference on Augmented Cognition, AC 2018 Held as Part of HCI International 2018, Las Vegas, United States, 7/15/18. https://doi.org/10.1007/978-3-319-91470-1_11
Kim G, Jeon J, Biocca F. M.I.N.D. brain sensor caps: Coupling precise brain imaging to virtual reality head-mounted displays. In Augmented Cognition: Intelligent Technologies - 12th International Conference, AC 2018, Held as Part of HCI International 2018, Proceedings. Springer Verlag. 2018. p. 120-130. (Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics)). https://doi.org/10.1007/978-3-319-91470-1_11
Kim, Gyoung ; Jeon, Joonhyun ; Biocca, Frank. / M.I.N.D. brain sensor caps : Coupling precise brain imaging to virtual reality head-mounted displays. Augmented Cognition: Intelligent Technologies - 12th International Conference, AC 2018, Held as Part of HCI International 2018, Proceedings. Springer Verlag, 2018. pp. 120-130 (Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics)).
@inproceedings{21cbd35868a24a0886b5ffb3c2ea8987,
title = "M.I.N.D. brain sensor caps: Coupling precise brain imaging to virtual reality head-mounted displays",
abstract = "Today, Virtual Reality (VR) and Augmented Reality (AR) are the new communication tools readily available to consumers. Because of the increasing availability of AR and VR, communication and neuroscience researchers are showing increasing interest in the use of VR systems for studies in collaboration, communication, and basic neuroscience. Beyond relying on self-reported or behavioral measures, psychophysiological or functional neuroimaging measurements sensing brain waves (e.g. EEG) or brain hemodynamics (e.g. fNIRS) are powerful techniques for measuring brain activity while interacting with virtual reality stimuli or environments. However, using these measures with virtual reality systems can be difficult due to physical and technical constraints. Both Functional Near-Infrared Spectroscopy (fNIRS) and Electroencephalography (EEG) need multiple channels to measure brain activity, a combination of cables and probes must be attached to a head cap. However, this setup obstructs wearing head-mounted display (HMD) in a VR environment and the challenge varies with the design of the HMD. To overcome these limitations, we introduce the design and development of the M.I.N.D. brain measurement cap specifically adapted for research with virtual reality system. We discuss the design process as well as the advantages and limitations of the current iterative design of the cap. Generally, we anticipate that this measurement system will expand the potential of influence of cognitive neuroscience contribute on VR research by making it easier for researchers to use a breadth of tools.",
keywords = "Brain measurement method, Brain waves, Caps, EEG, fNIRS, Virtual reality",
author = "Gyoung Kim and Joonhyun Jeon and Frank Biocca",
year = "2018",
month = "1",
day = "1",
doi = "10.1007/978-3-319-91470-1_11",
language = "English (US)",
isbn = "9783319914695",
series = "Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics)",
publisher = "Springer Verlag",
pages = "120--130",
booktitle = "Augmented Cognition",

}

TY - GEN

T1 - M.I.N.D. brain sensor caps

T2 - Coupling precise brain imaging to virtual reality head-mounted displays

AU - Kim, Gyoung

AU - Jeon, Joonhyun

AU - Biocca, Frank

PY - 2018/1/1

Y1 - 2018/1/1

N2 - Today, Virtual Reality (VR) and Augmented Reality (AR) are the new communication tools readily available to consumers. Because of the increasing availability of AR and VR, communication and neuroscience researchers are showing increasing interest in the use of VR systems for studies in collaboration, communication, and basic neuroscience. Beyond relying on self-reported or behavioral measures, psychophysiological or functional neuroimaging measurements sensing brain waves (e.g. EEG) or brain hemodynamics (e.g. fNIRS) are powerful techniques for measuring brain activity while interacting with virtual reality stimuli or environments. However, using these measures with virtual reality systems can be difficult due to physical and technical constraints. Both Functional Near-Infrared Spectroscopy (fNIRS) and Electroencephalography (EEG) need multiple channels to measure brain activity, a combination of cables and probes must be attached to a head cap. However, this setup obstructs wearing head-mounted display (HMD) in a VR environment and the challenge varies with the design of the HMD. To overcome these limitations, we introduce the design and development of the M.I.N.D. brain measurement cap specifically adapted for research with virtual reality system. We discuss the design process as well as the advantages and limitations of the current iterative design of the cap. Generally, we anticipate that this measurement system will expand the potential of influence of cognitive neuroscience contribute on VR research by making it easier for researchers to use a breadth of tools.

AB - Today, Virtual Reality (VR) and Augmented Reality (AR) are the new communication tools readily available to consumers. Because of the increasing availability of AR and VR, communication and neuroscience researchers are showing increasing interest in the use of VR systems for studies in collaboration, communication, and basic neuroscience. Beyond relying on self-reported or behavioral measures, psychophysiological or functional neuroimaging measurements sensing brain waves (e.g. EEG) or brain hemodynamics (e.g. fNIRS) are powerful techniques for measuring brain activity while interacting with virtual reality stimuli or environments. However, using these measures with virtual reality systems can be difficult due to physical and technical constraints. Both Functional Near-Infrared Spectroscopy (fNIRS) and Electroencephalography (EEG) need multiple channels to measure brain activity, a combination of cables and probes must be attached to a head cap. However, this setup obstructs wearing head-mounted display (HMD) in a VR environment and the challenge varies with the design of the HMD. To overcome these limitations, we introduce the design and development of the M.I.N.D. brain measurement cap specifically adapted for research with virtual reality system. We discuss the design process as well as the advantages and limitations of the current iterative design of the cap. Generally, we anticipate that this measurement system will expand the potential of influence of cognitive neuroscience contribute on VR research by making it easier for researchers to use a breadth of tools.

KW - Brain measurement method

KW - Brain waves

KW - Caps

KW - EEG

KW - fNIRS

KW - Virtual reality

UR - http://www.scopus.com/inward/record.url?scp=85050587968&partnerID=8YFLogxK

UR - http://www.scopus.com/inward/citedby.url?scp=85050587968&partnerID=8YFLogxK

U2 - 10.1007/978-3-319-91470-1_11

DO - 10.1007/978-3-319-91470-1_11

M3 - Conference contribution

AN - SCOPUS:85050587968

SN - 9783319914695

T3 - Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics)

SP - 120

EP - 130

BT - Augmented Cognition

PB - Springer Verlag

ER -