Facebook Demos Highly Realistic Avatar Facial Animation

My Twitter feed keeps delivering news nuggets this week! This is an update to a blogpost I had written earlier this year on this technology.

Facebook Reality Labs has published a research article in the journal ACM Transactions on Graphics, which shows cutting-edge avatar facial animation using multiple cameras attached to a VR headset, and a new multiview image processing technique. (The full paper is free to download from the link above.) The researchers also gave a presentation at the SIGGRAPH 2019 computer graphics conference in Los Angeles.

The results are impressive, giving an avatar human-driven, lifelike animations not only of the lower face but also the upper face, which of course if covered by the VR headset:

This is light years ahead of current avatar facial animation technology, such as the avatar facial driver in Sinespace, which operates using your webcam. Imagine being able to conduct a conversation in VR where you can convey the full gamut of facial expressions while you are talking! This is a potential gamechanger for sure. It’s not clear when we can expect to see this technology actually applied to Oculus VR hardware, however. It might still be many years away. But it is exciting!

Advertisements

Medhue’s Animated Animals in Sansar

Medhue, who is well-known in Second Life as a talented creator of animals for Zooby, has brought his animated elephant from SL to Sansar! He’s also brought over an animesh horse he is currently working on in SL. You can visit them at his testing experience in Sansar:

Medhue has told us that he is not going to put products up for sale in the Sansar Store, as his personal protest against what he considers to be the too-high commision fees charged by Linden Lab. However, he has said that he is willing to create tutorial videos for Sansar. He’s already posted ten videos for Sansar creators on his YouTube channel. You can also access Sansar kits, resources, and tutorials on his website.

Sansar Spiders!

There’s an (unofficial) Sansar Discord channel, where creators are busy comparing notes and sharing their handiworks. Here’s an invite link to the server, if you’re interested in joining the discussions. And Björn has shared two amazing videos of an animated spider he has created using 3ds Max.

I asked Björn to explain how he created such realistic spider leg movement, and he replied:

It’s just bones for now. In 3ds Max there is a CAT system, it’s like a rig preset for all kind of characters from spiders to dinosaurs to humans. They are easy to animate. So for this spider, I just used a spider rig and animated it along a spline. The program calculates the foot steps automatically.

Here’s another video, a sort of spider stress test! Not for the arachnophobic!