Bayesian inference in motor learning

Statistical overview

Bayes' theorem states

${\displaystyle P(A|B)=\frac{P(B|A)P(A)}{P(B)}.}$

In the language of Bayesian statistics, ${\displaystyle P(A|B)}$, or probability of A given B, is called the posterior, while ${\displaystyle P(B|A)}$ and ${\displaystyle P(A)}$ are the likelihood and the prior probabilities, respectively. ${\displaystyle P(B)}$ is a constant scaling factor which allows the posterior to be between zero and one. Translating this into the language of motor learning, the prior represents previous knowledge about the physical state of the thing being observed, the likelihood is sensory information used to update the prior, and the posterior is the nervous system's estimate of the physical state. Therefore, for adaptation, Bayes' Theorem can be expressed as

<big id="mwJQ"><b id="mwJg">estimate</b> = <b id="mwJw">(previous knowledge</b> × <b id="mwKA">sensory information)</b>/<b id="mwKQ">scaling factor</b> </big>

The 3 terms in the equation above are all probability distributions. To find the estimate in non-probabilistic terms, a weighted sum can be used.

${\displaystyle E=\frac{W_{p}S+W_{s}P}{W_p+W_s}.}$

where ${\displaystyle E}$ is the estimate, ${\displaystyle S}$ is sensory information, ${\displaystyle P}$ is previous knowledge, and the weighting factors ${\displaystyle Wp}$ and ${\displaystyle Ws}$ are the variances of ${\displaystyle S}$ and ${\displaystyle P}$, respectively. Variance is a measure of uncertainty in a variable, so the above equation indicates that higher uncertainty in sensory information causes previous knowledge to have more influence on the estimate and vice versa.

More rigorous mathematical Bayesian descriptions are available here and here.

Reaching

Many motor tasks exhibit adaptation to new sensory information. Bayesian inference has been most commonly studied in reaching.

Integrating a prior with current sensory information

Adaptation studies often involve a person reaching for a target without seeing either the target or his/her hand. Instead, the hand is represented by a cursor on a computer screen, which they must move over the target on the screen. In some cases, the cursor is shifted a small distance away from the actual hand position to test how the person responds to changes in visual feedback. A person learns to counteract this shifts by moving his/her hand an equal and opposite distance from the shift and still moves the cursor to the target, meaning he has developed a prior for this specific shift. When the cursor is then shifted a new, different distance from the same person's reaching hand, the person reaction is consistent with Bayesian inference; the hand moves a distance that is between the old shift (prior) and the new shift (sensory information).

If, for the new shift, the cursor is a large cloud of dots instead of one dot (as shown in the figure), the person's sensory information is less clear and will have less influence on how he reacts than the prior will. This supports the Bayesian idea that sensory information with more certainty will have greater influence on a person's adaptation to shifted sensory feedback.

This form of adaptation holds true only when the shift is small compared to the distance the person has to reach to hit the target. A person reaching for a target 15 cm away would adapt to a 2 cm shift of the cursor in a Bayesian way. However, if the target were only 5 cm away, a 2 cm shift cursor position (visual information) would be recognized and the person would realize the visual information does not accurately show hand position. Instead, the person would rely on proprioception and prior knowledge to move the hand to the target.

Humans also adapt to changing forces when reaching. When a force field a person reaches through changes slightly, he modifies his force to maintain reaching in a straight line based partly on a prior force which had been applied earlier. He relies more on the prior if the prior shift is less variable (more certain).

Integrating information from multiple senses

Bayesian inference can also be applied to the way humans combine information about changes in their environment from multiple senses without any consideration of prior knowledge. The two senses that have the strongest influence on how humans' reaching adaptations are vision and proprioception. Typically, proprioception has more weight than vision for adapting hand position in depth – the direction moving toward or away from the person reaching – and vision has more weight in the vertical and horizontal directions. However, changing conditions can alter the relative influence of these two senses. For example, the influence of vision on adapting hand depth is increased when the hand is passive, while proprioception has more influence when the hand is moving. Moreover, when vision is reduced (e.g. in darkness) proprioception has more influence on determining hand position. This result is consistent with Bayesian inference; when one sense becomes more uncertain, humans increase their reliance on another sense.

Posture

Additionally, Bayesian inference has been found to play a part in adaptation of postural control. In one study, for example, subjects use a Wii Balance Board to do a surfing task in which they must move a cursor representing their center of pressure (COP) on a screen. The Wii surfer got visual information about his/her COP from clouds of dots similar to the one shown in the reaching section. With larger clouds, the surfers were more uncertain and less able to move the COP to the target on the screen. While this result is consistent with Bayesian inference, Bayesian mathematical models did not provide the best predictions of COP motion, perhaps because moving the COP accurately is more mechanically difficult than reaching. Therefore, the extent to which postural movement can be described by Bayesian inference is not yet clear.

Gait

Adaptation to shifted feedback also occurs during walking and running. People walking with each foot on a different treadmill belt can adapt their step length when one belt begins moving faster than the other. Additionally, runners are able to alter their maximum ground reaction force and leg acceleration when they see a graph of peak leg acceleration. However, to date, no studies have determined if humans adapt their gates using Bayesian inference or not.

Possible contradictions to Bayesian inference

Some adaptation studies do not support the application of Bayesian inference to motor learning. One study of reaching in a force field found that, rather than being influenced by a prior developed over hundreds of previous reaches, adaptation to subsequent reaches is only influenced by recent memories. People reaching in the force field adapted to shifts in the amount of force exerted on the arm, but this adaptation was only affected by the shift in force of the immediately previous reach, not by a well-developed prior knowledge of shifts that had occurred throughout the previous trials of the experiment. This appears to conflict with the application of Bayesian inference to adaptation, but Bayesian adaptation proponents have argued that this particular study required each participant to do only 600 reaches, which is not enough to develop a prior. In reaching studies that show evidence of Bayesian inference, participants typically perform 900 reaches or more. This indicates that, while Bayesian inference is used in adaptation, it is limited in that much previous experience is necessary to develop an influential prior.