Overview

The experiment involves a three person team participating in one or two search and rescue (SAR) missions simulated in the Minecraft environment. Before participants execute this experiment, they individually attend a ‘pre-session’ where:

• They fill consent forms,

• We measure their head circumference to enable setting up brain data caps before they arrive at the main session,

• We ask them to perform a speech elicitation task

The group session typically occurs a few days to few weeks later. The group session has multiple phases:

• Rest state task

• Finger tapping task

• Affective task

• Ping pong competitive task

• Ping pong cooperative task

• Hands-on Minecraft training

• Saturn A mission

• Saturn B mission

The number of Saturn B missions in the data is fewer than the number of Saturn A missions, since frequently there were unexpected technical issues or delays during the group session such that we ran out of time before the Saturn B mission could be run.

During all these phases, for each participant, we record the following:

• EKG

• EEG

• fNIRS

• Eye tracking data

• Testbed messages

• Audio of participants’ spoken dialog

• Facial video

• Screen captures