Neuroergonomics

Approaches

Functional neuroimaging

A central goal of neuroergonomics is to study the way in which brain function is related to task/work performance. To do this, noninvasive neuroimaging methods are typically used to record direct neurophysiological markers of brain activity through electrical activity electroencephalography (EEG), magnetoencephalography (MEG) or through indirect metabolic positron-emission tomography (PET) and neurovascular measures of neural activity including functional magnetic resonance imaging (fMRI), functional near-infrared spectroscopy (fNIRS), transcranial Doppler (TCD) sonography. Typically, neuroergonomic studies are more application-oriented than basic cognitive neuroscience studies and often require a balance between controlled environments and naturalistic settings. Studies using larger room-scale neuroimaging setups such as PET, MEG, and fMRI, offer increased spatial and temporal resolution at the expense of increased restrictions on participants actions. Using more mobile techniques such as fNIRS and EEG, research may be conducted in more realistic settings including even participation in the actual work being investigated (ex: driving). These techniques have the advantage of being more affordable and versatile, but may also compromise by reducing the number of areas recorded and the ability to image neural activity from deeper brain regions. Together the application of both controlled lab experiments and the translation of findings in realistic contexts represents the spectrum of neuroimaging in neuroergonomics.

Neurostimulation

Neurostimulation methods may also be used apart, or in conjunction with neuroimaging approaches to probe the involvement of cortical regions in task performance. Techniques such as transcranial magnetic stimulation (TMS) and transcranial direct-current stimulation (tDCS) can be used to temporarily alter the excitability of cortical regions. It is proposed that stimulating a cortical region (particularly with TMS) can disrupt or enhance that regions function, permitting researchers to test specific hypotheses related to human performance.

Some studies have shown the promise of using TMS and tDCS to improve cognitive skills during tasks. While initially used to treat various neurological disorders such as Parkinson's disease or dementia, the scope of TMS is expanding. In TMS, electricity is passed through a magnetic coil that is positioned near the person's scalp. Results from studies show that noninvasive brain stimulation leads to 20 more minutes of sustained vigilance performance.

Psychophysiology

Psychophysiological measures are physiological measures (blood, heart rate, skin conductance, etc.) which change as part of psychological processes. Although not considered as a direct neural measure, neuroergonomics also promotes the use of physiological correlates as dependent measures when they can serve as an index of neural activities such as attention, motor, or affective processes. These measures can be used in conjunction with neuroimaging measures, or as a substitute when the acquisition of neuroimaging measures is too costly, dangerous, or otherwise impractical. Psychophysiology is a distinct field from neuroergonomics; however, the principals and objectives can be considered complementary.

Applications

Mental Workload Assessment

Using an fMRI, mental workload can be quantified by an increase in cerebral blood flow in regions of the prefrontal cortex (PFC). Many fMRI studies show that there is increased PFC activation during a working memory task. Equally important as measuring mental workload, is evaluating the operator vigilance, or attentiveness. Using TCD to monitor blood flow velocity in intercranial arteries, it was shown that a decrease in blood flow was associated with a decrease in vigilance and depletion of cognitive resources.

Adaptive Automation

Adaptive automation, a novel neuroergonomic concept, refers to a human-machine system that uses real-time assessment of the operator's workload to make the necessary changes to enhance performance. For adaptive automation to work, the system must utilize an accurate operator-state classifier for the real-time assessment. Operator-state classifiers such as discriminant analysis and artificial neural networks show an accuracy of 70% to 85% in real-time. An important part to properly implementing adaptive automation is figuring out how big a workload needs to be to require intervention. Implementing neuroergonomic adaptive automation would require the development of nonintrusive sensors and even techniques to track eye movement. Current research into assessing a person's mental state includes using facial electromyography to detect confusion.

Experiments show that a human-robot team performs better at controlling air and ground vehicles than either a human or robot (i.e. the automatic target recognition system). When compared to 100% human control and static automation, participants showed higher trust and self-confidence, as well as lower perceived workload, when using adaptive automation.

In adaptive automation, getting the machine to accurately reason how to respond to the changes and get back to peak performance is the biggest challenge. The machine has to be able to determine to what extent it must make the changes. This is also a consequence of the complexity of the system and factors such as: how easily can the sensed parameter be quantified, how many parameters in the machine's system can be changed, and how well can these different machine parameters be coordinated.

Brain Computer Interfaces

A developing area of research called brain–computer interfaces (BCIs) strives to use different types of brain signals to operate external devices, without any motor input from the person. BCIs provide promise for patients with limited motor capabilities, such as those with amyotrophic lateral sclerosis. When the user engages in a specific mental activity, it generates a unique brain electrical potential that is processed and relayed into a signal for the external device. BCIs using signals from EEGs and ERPs have been used to operate voice synthesizers and move robotic arms. Research for BCIs began in the 1970s at the University of California Los Angeles, and its current focus is towards neuroprosthetic applications. BCIs can be substantially improved by incorporating high-level control, context, the environment, as well as virtual reality into its design.

Stroke Rehabilitation

As of 2011, there has been an effort to applying a rehabilitation robot connected to a non-invasive brain–computer interface to promote brain plasticity and motor learning following a stroke. Half of stroke survivors experience unilateral paralysis or weakness, and approximately 30-60% of them do not regain function. Typical treatment, post-stroke, involves constraint-induced movement therapy and robotic therapy, which work to restore motor activity by forcing the movement of the weak limbs. Current active therapy cannot be utilized by patients who suffer complete control loss or paralysis, and do not have any residual motor ability to work with.

With a focus on these underserved patients, a BCI was created that used the electrical brain signals detected by an EEG to control an upper-limb rehabilitative robot. The user is instructed to imagine the motor activity while the EEG picks up the associated brain signals. The BCI uses a linear transformation algorithm to convert the EEG spectral features into commands for the robot. An experiment done on 24 subjects tested a non-BCI group, which used sensorimotor rhythms to control the robot, against the BCI-group, which used the BCI-robot system. The results from the brain-plasticity analysis showed that there was a decrease in beta wave activity in the subjects of the BCI-group, which is associated with a change in movement. The results also showed that the BCI-group performed better than the non-BCI group in every measure for motor learning.

Virtual Reality

Virtual reality could allow for testing how human operators would work in dangerous environments without actually putting them in harm's way. For example, it would allow the testing of how fatigue or a new technology would affect a driver or a pilot in their specific environment, without the possibility of injury. Being able to evaluate the effects of some new workplace technology in virtual reality, before real life implementation, could save money and lives. Bringing virtual reality technology to the point where it can accurately mimic real life is difficult, but its potential is vast.

Healthcare Training

Healthcare training programs have adopted virtual reality simulation (VRS) as a training tool for nursing students. This computer-based three-dimensional simulation tool allows for nursing students to practice various nursing skills repeatedly in a risk-free environment. A nursing program at a major Midwestern state university agreed to utilize a VRS module for teaching the insertion of an intravenous (IV) catheter, and complete an evaluation on the effectiveness of the program. The VRS composed of a computer program and a haptic arm device, which worked together to simulate the feel of vascular access. On the computer screen, the user would have to select the equipment for the procedure in the correct order. The user then palpates the veins of the haptic arm, and virtually inserts the IV catheter. The program provides immediate feedback by notifying the user when he/she misses a step and needs to restart the procedure.

Results of evaluation pointed to the VRS an "excellent learning tool" for increasing a student's knowledge on the procedure. All eight of the nursing faculty who participated agreed to this much, and that they would recommend that students work with the VRS before performing the IV catheter insertion on real patients.

This tool allows educators to expose students to an extensive range of real-life patient conditions and nursing experiences. The central advantage of the VRS program is the availability of a variety of case scenarios, which allow students to increase their awareness of differences in patient responses to IV catheter insertion. From the standpoint of the student, the virtual reality simulation helps bridge the gap between nursing theory and practice.

Applications for Neurocognitive Disabilities

Neuroergonomic assessments have tremendous potential for evaluating the psychomotor performance in an individual with a neurocognitive disability or following a stroke or surgery. They would allow for a standardized method for measuring the change in neurocognitive function during rehabilitation for a neurocognitive disability. In terms of rehabilitation, it would allow for the efforts to be goal-oriented. These tests could be applied for measuring change following operational procedures such as neurosurgery, carotid endarterectomy, and coronary artery bypass graft.

Driving Safety

One of the main application domains of neuroergonomics is driving safety, especially for older drivers with cognitive impairments. Driving requires the integration of multiple cognitive processes, which can be studied separately if the right kinds of tools are used. The types of tools used to evaluate cognition during driving include driving simulators, instrumented vehicles, and part task simulators.

The Crossmodal Research Laboratory in Oxford is working on developing a system of warning signals to grab the attention of a distracted driver, in an effort to make driving safer for everybody. The research has found that using auditory icons, such as a car horn, is a better warning signal than a pure tone. On top of that, spatial auditory cues work better at redirecting the driver's attention than non-spatialized auditory cues. Cues that integrate multiple senses, such as an audiotactile signal, grab attention better than unisensory cues. Others have evaluated different types of in-vehicle notifications (i.e., auditory icons, speech commands) designed for task management in autonomous trucks for their relevance to separable neural mechanisms; this serves as an effective method to clarify often conflicting findings drawn from behavioral results alone.

Academic conferences

• International Conference on Human–Computer Interaction (HCII) holds a special track on augmented cognition and neuroergonomics.
• International Conference for Neuroergonomics