Avatars in virtual worlds provide a richer way than email or chat to communicate online, but despite better graphics and sound quality, they still can't rival in-person meetings. Now new software may help virtual characters appear more lifelike by imbuing them with realistic body language.
Rather than assign physical gestures based on the literal meaning of a person's spoken words, the program focuses on prosody, the combination of vocal rhythm, intonation and stress. To assemble a library of gestures associated with prosody features, Sergey Levine and Vladlen Koltun at Stanford University, California, used a motion-capture studio to digitise the movements that an actor made as he spoke. They used this library to teach their system to correlate features of the actor's speech with the style of his gestures, such as their size and speed, and whether they were angular or smooth.
Because the ...
To continue reading this article, subscribe to receive access to all of newscientist.com, including 20 years of archive content.