[ExI] Monkeys Use Minds to Control Avatar Arms

Eugen Leitl eugen at leitl.org
Thu Nov 7 09:58:06 UTC 2013


http://news.sciencemag.org/brain-behavior/2013/11/monkeys-use-minds-control-avatar-arms

Monkeys Use Minds to Control Avatar Arms

6 November 2013 2:30 pm

Two monkeys learned to move avatar arms toward shifting targets (see
animation below), simply by putting their minds to it. 

Nicolelis Lab/Duke Center for Neuroengineering

Monkey mind. Two monkeys learned to move avatar arms toward shifting targets
(see animation below), simply by putting their minds to it.

MONKEYS USE MINDS TO CONTROL AVATAR ARMS

Most of us don’t think twice when we extend our arms to hug a friend or push
a shopping cart—our limbs work together seamlessly to follow our mental
commands. For researchers designing brain-controlled prosthetic limbs for
people, however, this coordinated arm movement is a daunting technical
challenge. A new study showing that monkeys can move two virtual limbs with
only their brain activity is a major step toward achieving that goal,
scientists say.

The brain controls movement by sending electrical signals to our muscles
through nerve cells. When limb-connecting nerve cells are damaged or a limb
is amputated, the brain is still able to produce those motion-inducing
signals, but the limb can't receive them or simply doesn’t exist. In recent
years, scientists have worked to create devices called brain-machine
interfaces (BMIs) that can pick up these interrupted electrical signals and
control the movements of a computer cursor or a real or virtual prosthetic.

So far, the success of BMIs in humans has been largely limited to moving
single body parts, such as a hand or an arm. Last year, for example, a woman
paralyzed from the neck down for 10 years commanded a robotic arm to pick up
and lift a piece of chocolate to her mouth just by thinking about it. But,
"no device will ever work for people unless it restores bimanual behaviors,”
says neuroscientist Miguel Nicolelis at Duke University in Durham, North
Carolina, senior author of the paper. "You need to use both arms and hands
for the simplest tasks.”

In 2011, Nicolelis made waves by announcing on The Daily Show that he is
developing a robotic, thought-controlled "exoskeleton" that will allow
paralyzed people to walk again. Further raising the stakes, he pledged that
the robotic body suit will enable a paralyzed person to kick a soccer ball
during the opening ceremony of the 2014 Brazil World Cup. (Nicolelis is
Brazilian and his research is partly funded by the nation’s government.)

That feat will require decoding the complex neural signals that coordinate
two legs as they walk together and keep a person upright. Now, by
successfully training two monkeys to control virtual arms using only their
minds, Nicolelis’s team has moved closer to that goal. The new experiment
involved two monkeys, a male and a female. Before it began, each monkey had
electrodes implanted into its right and left brain hemisphere, which recorded
the activity of up to 500 neurons acting together—the highest number of
neurons yet used in such an experiment, Nicolelis says. The animal’s task was
to control the movement of two avatar arms on a computer monitor: To get a
fruit juice reward, it had to place both hands over two circles and hold them
there for 100 milliseconds, as demonstrated in the video above. A computer
algorithm processed the monkey’s brain activity, homing in on patterns of
neurons firing as it learned to do the task.

The female monkey, called monkey C, first learned how to get the juice by
moving joysticks with her real arms and hands—as she manipulated the
joysticks, the right and left avatar arms did what she wished. After
practicing this during regular 20- to 40-minute sessions over the course of a
year, she was strapped into a padded chair so that she couldn’t move her own
arms or hands, and trained to control the avatar arms just by thinking. After
weeks of practice, she was able to complete the task more than 75% of the
time, the scientists report today in Science Translational Medicine.

Because a paralyzed person or amputee can't necessarily practice a task using
joysticks, the next step was to determine whether observation alone could
teach the BMI. Monkey M, a male, wasn't allowed to use the joysticks or move
his arms at any point in the experiment—he simply observed the task being
performed. It took longer for him to learn, but monkey M also learned to
control the virtual arms using only his thoughts. Both animals’ performances
improved over time, and the researchers noticed that their neuronal firing
patterns changed as this happened, suggesting that their brains were adapting
to the BMI devices. This could be because the monkeys came to consider the
virtual arms as part of their own bodies, Nicolelis suggests. “The animals
literally incorporate the avatar as if the avatar was them.”

The basic technology that Nicolelis and colleagues used to extract
instructions for movement from the mishmash of monkey brain signals isn't
new, says Jose Contreras-Vidal, a biomedical engineer at the University of
Houston in Texas. The real advance of the study, he says, is that the team
was able to figure out which neurons they needed to record to control two
arms working together. Although one might assume that it would be possible to
simply combine neural activity from two arms acting independently, the study
shows that cells act differently when they are coordinating the movements of
two limbs than they do when separately instructing one limb or the other, he
says. This is the first study to extract and use that complex information to
coordinate arm movements in real time, Contreras-Vidal says.

Although he agrees that the new study is strong, Andrew Schwartz, a
neurobiologist at the University of Pittsburgh in Pennsylvania, thinks
scientists can do better. Even though the monkeys’ task was quite simple,
they had only about a 45% success rate overall, he notes. “I’m looking
forward to higher performance and success rates and more realistic natural
movements.”

Nicolelis may have shown that the monkeys can learn to use these avatar arms
to complete a one simple task, but it's not clear that the same type of
training will work for the more complex activities that humans need to
perform, Contreras-Vidal cautions. "This is a first step."



More information about the extropy-chat mailing list