Loading video...

Video Failed to Load

Go Home

Tutorial video on how to test face tracking in Unity with face tracking hardware is here! This is probably the question I get asked the most, so I'm happy I finally got a chance to make a tutorial on this. This example demonstrates doing it with a Quest Pro...

darealthreevee's profile picture

Threevee

7,472 subscribers

40,076 views • 3 months ago •via X (Twitter)

LIVE

Anya Rossi• Live Now

Private livecam show

7 Comments

toa 🔞's profile picture
toa 🔞3 months ago

you can also do this with your phone using ifacialmocap / facemotion3d! you connect it to VRCFT, but you need to use VRCFT 5.1.1.0 (i think). that's how i test mine out!

Threevee's profile picture
Threevee3 months ago

Yep! anything with a vrcft module will work :D Also the 5.1.1.0 version isn't needed anymore, it works with the newest version available on Steam now

Threevee's profile picture
Threevee3 months ago

Example avatar used - Aryia by @MimiiuVRC

AIDENFUR ✦ VRC Hairstyles's profile picture
AIDENFUR ✦ VRC Hairstyles3 months ago

Thank you Threevee!!!!💜You did an incredible job with my avi!

Aluphineee | Cyber CatVT✨'s profile picture
Aluphineee | Cyber CatVT✨3 months ago

Yay :3 thanks you :3

ChromeBalleBlu's profile picture
ChromeBalleBlu3 months ago

Threevee your a very poggers guy <3

Atherune's profile picture
Atherune3 months ago

I'm gonna save this. This is actually really cool!

Related Videos

Bigscreen Beyond 2e Eye tracking test with vive facial tracker for face tracking, finally getting to use the tongue tracking on this avatar 🖤 first impressions in replies
0:59

Bigscreen Beyond 2e Eye tracking test with vive facial tracker for face tracking, finally getting to use the tongue tracking on this avatar 🖤 first impressions in replies

saintsakura 🌸🤍

53,062 views • 11 months ago

This is native VRChat OSC Eyetracking using the Bigscreen Beyond 2e!! I can't believe how natural it looks... even without eyeblink or VRCFT. Only tweak was to increase my avatar's natural "eyelook" range in Unity. So hyped for the new updates to it too. #VRChat
0:25

This is native VRChat OSC Eyetracking using the Bigscreen Beyond 2e!! I can't believe how natural it looks... even without eyeblink or VRCFT. Only tweak was to increase my avatar's natural "eyelook" range in Unity. So hyped for the new updates to it too. #VRChat

PHIA ⭐️

25,533 views • 1 year ago

Codec Avatars can run on Quest 3 - the hardware is there. What’s missing is seamless face scanning and built-in eye & face tracking. Quest 4 will likely have eye tracking, and it may support codec avatars, but I really hope the lightweight headset in 2026 will do it first.
0:38

Codec Avatars can run on Quest 3 - the hardware is there. What’s missing is seamless face scanning and built-in eye & face tracking. Quest 4 will likely have eye tracking, and it may support codec avatars, but I really hope the lightweight headset in 2026 will do it first.

Mixed Reality Guy

10,490 views • 1 year ago

I posted unity footage of this yesterday in a reply to the person who inspired this but decided to record some jank footage ingame with finger tracking to show off the new nail material I'm working on, pretty happy with how it's looking so far
0:58

I posted unity footage of this yesterday in a reply to the person who inspired this but decided to record some jank footage ingame with finger tracking to show off the new nail material I'm working on, pretty happy with how it's looking so far

ScarlettKat🔞

19,994 views • 9 months ago

So, another shader with animations done with math! This one didn't make it to the game, but I still like it. #VFX #madewithunity How I made it: I wrote a script to merge the coins into a single mesh with their pivots baked on the vertex color (in Unity)...
1:05

So, another shader with animations done with math! This one didn't make it to the game, but I still like it. #VFX #madewithunity How I made it: I wrote a script to merge the coins into a single mesh with their pivots baked on the vertex color (in Unity)...

Gregory Oliveira

55,767 views • 3 years ago

WIP I am currently integrating my "AI video texture" technique with face tracking scripts and active ragdoll physics in standalone VR. For this test video, I only applied the AI video texture to the face, but the body will look much more realistic once I apply the technique to the entire model. I've also figured out how to achieve highly detailed, realistic hair and foliage using the same technique.
0:52

WIP I am currently integrating my "AI video texture" technique with face tracking scripts and active ragdoll physics in standalone VR. For this test video, I only applied the AI video texture to the face, but the body will look much more realistic once I apply the technique to the entire model. I've also figured out how to achieve highly detailed, realistic hair and foliage using the same technique.

Alex

19,101 views • 6 months ago

Take any Python code and build a dynamic GUI on top of it by dragging and dropping components. Python is already the most popular language in the world. This makes it even better! The attached video is only 45 seconds. It will show you how it works. Here is the important part: You can now build an interface for your Python code without learning HTML, JavaScript, or CSS. Go to this link to try this: Remember to work smarter, not harder! Thanks to the team behind Taipy for partnering with me on this post.
0:45

Take any Python code and build a dynamic GUI on top of it by dragging and dropping components. Python is already the most popular language in the world. This makes it even better! The attached video is only 45 seconds. It will show you how it works. Here is the important part: You can now build an interface for your Python code without learning HTML, JavaScript, or CSS. Go to this link to try this: Remember to work smarter, not harder! Thanks to the team behind Taipy for partnering with me on this post.

Santiago

155,254 views • 2 years ago

Tongue tracking for pixel-peepers! I got tired of clipping and ugly mouth blends so I whole-assed the tongue system and now it's just so 😚👌 Coming soon to a VRChat avatar near you!! Also compatible with ANY face tracker, even if it doesn't have built-in tongue tracking. 😉
0:22

Tongue tracking for pixel-peepers! I got tired of clipping and ugly mouth blends so I whole-assed the tongue system and now it's just so 😚👌 Coming soon to a VRChat avatar near you!! Also compatible with ANY face tracker, even if it doesn't have built-in tongue tracking. 😉

Gillie Amanita 🍄❤️

45,437 views • 3 months ago

This is the most impressive tool I’ve tried in my 2 years working with generative AI. Kling AI gave me early access to their Custom Face Video Model, and yes, this is TEXT TO VIDEO. How does it work? I’ll break it all down in this thread (includes tutorial + prompts)🧵👇
0:48

This is the most impressive tool I’ve tried in my 2 years working with generative AI. Kling AI gave me early access to their Custom Face Video Model, and yes, this is TEXT TO VIDEO. How does it work? I’ll break it all down in this thread (includes tutorial + prompts)🧵👇

TechHalla

132,697 views • 2 years ago

How to Be a VTuber on ANY Budget! 🚨 This is probably my most asked question, I finally decided to make an easy no-nonsense tutorial as to how on any budget (even free)! 💸 Hope this helps! 🫰
0:55

How to Be a VTuber on ANY Budget! 🚨 This is probably my most asked question, I finally decided to make an easy no-nonsense tutorial as to how on any budget (even free)! 💸 Hope this helps! 🫰

Senz ❄️🩵

21,455 views • 11 months ago

This is definitely not a free energy device. This video does not show the step by step process on how to build one. It obviously doesn’t test it and prove it works. Do not share this video anywhere. Please.
33:34

This is definitely not a free energy device. This video does not show the step by step process on how to build one. It obviously doesn’t test it and prove it works. Do not share this video anywhere. Please.

Ted Logan

392,145 views • 2 years ago

i will not question how dduks able to do this or what kind of tracking they use or what tech behind this. i will just pretend dduks are a group of witches and accept it as it is
1:47

i will not question how dduks able to do this or what kind of tracking they use or what tech behind this. i will just pretend dduks are a group of witches and accept it as it is

sha ❤️💗

11,532 views • 9 months ago

Learn how to create a smooth, realistic face swap in just minutes with this quick tutorial. Follow the steps and try it yourself with AKOOL!
0:38

Learn how to create a smooth, realistic face swap in just minutes with this quick tutorial. Follow the steps and try it yourself with AKOOL!

Akool Inc

135,386 views • 2 months ago

Here's the first face tracking prefab! 🤫🧏 It can be added to any VRCFT avatar and will allow you to make sparks with your jaw when mewing Available now @
0:50

Here's the first face tracking prefab! 🤫🧏 It can be added to any VRCFT avatar and will allow you to make sparks with your jaw when mewing Available now @

HΛSHΞDITS

38,129 views • 1 year ago

I heard VRC was buggy, but this is RIDICULOUS Finally finished my low poly VRC avatar based on Adfree.EXE 👾⚠️【SVA】's design . Been working on this over the last few months off and on to study low poly modeling, and I can finally call it complete Everything is made from the ground up. Modeling, texture work (though referenced from Adfrees ref sheet) weight painting, and naturally I gave it some face tracking. I also finally had an excuse to use Poiyomi Pro's vertex glitch and vertex rounding features :D This was a super fun project and it feels great to see it finally completed C: Maybe next time I'll go for making an avatar with a higher poly count and more detail (Before anyone asks, I don't plan to make this clonable or share it since I don't own the design lol)
0:33

I heard VRC was buggy, but this is RIDICULOUS Finally finished my low poly VRC avatar based on Adfree.EXE 👾⚠️【SVA】's design . Been working on this over the last few months off and on to study low poly modeling, and I can finally call it complete Everything is made from the ground up. Modeling, texture work (though referenced from Adfrees ref sheet) weight painting, and naturally I gave it some face tracking. I also finally had an excuse to use Poiyomi Pro's vertex glitch and vertex rounding features :D This was a super fun project and it feels great to see it finally completed C: Maybe next time I'll go for making an avatar with a higher poly count and more detail (Before anyone asks, I don't plan to make this clonable or share it since I don't own the design lol)

Threevee

46,903 views • 9 months ago

Here are some tips for those who want to practice face acting: ➡️U motion: Move your head in a "U" Shape so it's never stuck in the same place. This will help your movements look more interesting. ➡️Key points: When practicing with your model, learn to get to a "Key point." This is when you can automatically get to an expression without using toggles. I use surprised and angry expressions a lot, so I know exactly how to move my face to achieve that look, mainly for clips or comedic effect. I practiced enough so I know what it will look like on the model. ➡️Head tilts: If you struggle with face acting, a simple head tilt will go a long way. Overall, the movement and face acting of your model does matter. It can help it look more interesting, but also, it's okay if you can't face acting all the time. Using just key animations when you're gaming will work perfectly. Example: You died in a game, and you go to the key point of surprise. You know, making this face will make your model look shocked, so you will do a dramatic eye open and mouth agape to achieve this, to reflect onto your model. Lastly. The way your model moves is usually 30% rigging artist,20% tracking (webcam/iPhone), and 50% you. Your rigging artist can give you the tools, but only you can make your models' results reflect your emotions. As always, DO YOUR PARAMETERS AND SETTINGS IN VTUBE STUDIO. It will not be perfect to your face and camera settings unless you adjust the model, (This is an old video I did on parameters) Holy Yapfest.
0:36

Here are some tips for those who want to practice face acting: ➡️U motion: Move your head in a "U" Shape so it's never stuck in the same place. This will help your movements look more interesting. ➡️Key points: When practicing with your model, learn to get to a "Key point." This is when you can automatically get to an expression without using toggles. I use surprised and angry expressions a lot, so I know exactly how to move my face to achieve that look, mainly for clips or comedic effect. I practiced enough so I know what it will look like on the model. ➡️Head tilts: If you struggle with face acting, a simple head tilt will go a long way. Overall, the movement and face acting of your model does matter. It can help it look more interesting, but also, it's okay if you can't face acting all the time. Using just key animations when you're gaming will work perfectly. Example: You died in a game, and you go to the key point of surprise. You know, making this face will make your model look shocked, so you will do a dramatic eye open and mouth agape to achieve this, to reflect onto your model. Lastly. The way your model moves is usually 30% rigging artist,20% tracking (webcam/iPhone), and 50% you. Your rigging artist can give you the tools, but only you can make your models' results reflect your emotions. As always, DO YOUR PARAMETERS AND SETTINGS IN VTUBE STUDIO. It will not be perfect to your face and camera settings unless you adjust the model, (This is an old video I did on parameters) Holy Yapfest.

♥️Cutiepierin | L2D RIG ARTIST

94,422 views • 1 year ago

ChatGPT Work with GPT 6 Astra is incredible It is the best productivity tool on the planet right now I challenged myself this week to do all my work with JUST Work and I've never been more productive In this video I cover how to use it and how to super charge your productivity
18:15

ChatGPT Work with GPT 6 Astra is incredible It is the best productivity tool on the planet right now I challenged myself this week to do all my work with JUST Work and I've never been more productive In this video I cover how to use it and how to super charge your productivity

Alex Finn

59,838 views • 1 month ago

i made good money yesterday trading memes on ton. so I'm finally posting this video I've been sitting on. - a full walkthrough on how to trade memecoins on ton using a bot. - simple. fast. no complicated setup. - this is exactly how I do it. there's also a seed phrase hidden somewhere in the video. find it. claim whatever is in the wallet. first one to it wins. watch it now.
6:27

i made good money yesterday trading memes on ton. so I'm finally posting this video I've been sitting on. - a full walkthrough on how to trade memecoins on ton using a bot. - simple. fast. no complicated setup. - this is exactly how I do it. there's also a seed phrase hidden somewhere in the video. find it. claim whatever is in the wallet. first one to it wins. watch it now.

ELVIS ⭕️

38,776 views • 5 months ago