An Amazing Demonstration of Full-Body Tracking (Including the Eyes and Mouth!) in NeosVR

I found this video so amazing, that I asked the creator (June) if I could share it with you, my blog readers! Here’s a link to his original tweet.

Every single movement of the shark avatar in this one-and-a-half minute machinima (i.e. a video shot in a virtual world), right down to eyes and the mouth, is controlled directly by the user! Even more amazing, he was the sole cameraman!

The eyes are controlled by where the user looks (in a Vive Pro Eye VR headset); the mouth and lower face are controlled by the Vive Facial Tracker attached to the bottom of the headset; the hands and fingers are controlled using Valve Knuckles controllers; and the movements of the lower part of the body are controlled by Vive Pucks attached to the body at the hips and feet!

June says:

Did a full performance of “Crazy for Me” in NeosVR! Everything was recorded in real time audio, tracking, camera work, everything! All within the NeosVR game engine. This was done with 3 2.0 Vive Trackers, a Vive Pro Eye, Vive Facial Tracker, and Valve Index Controllers! This took about 17 takes to get it just right! Feel free to post about this anywhere as long as you link the video with any one of my socials!

I swear, if people in Second Life knew that they could control their entire avatar like this, there would be a stampede to buy VR headsets and head to NeosVR! There’s zero need for animation overrides or any prerecorded animations!

If you’re interested in seeing more of this, you can follow June on Twitter! If you want more information on NeosVR, you can visit their website here, or click here to see all the blogposts tagged NeosVR which I have written to date.

I have finally received a bracket I ordered from Japan to properly attach my Vive Facial Tracker to my Valve Index VR headset, so I am quite looking forward to being able to animate my lower face and mouth soon! (No eye animation or lower body animation for me yet, though…maybe someday!)

One very witty person with whom I had shared this video said:

I aspire to one day be the most tracked human in VR (but then again all Quest users are already there).

Ooh! NURSE!!! Shots fired! 😉

Liked it? Then please consider supporting Ryan Schultz on Patreon! Even as little as US$1 a month unlocks exclusive patron benefits. Thank you!