Loading video...

Video Failed to Load

Go Home

Tutorial video on how to test face tracking in Unity with face tracking hardware is here! This is probably the question I get asked the most, so I'm happy I finally got a chance to make a tutorial on this. This example demonstrates doing it with a Quest Pro...

darealthreevee's profile picture

Threevee

7,498 subscribers

32,667 views • 5 days ago •via X (Twitter)

LIVE

Anya Rossi• Live Now

Private livecam show

0 Comments

No comments available

Comments from the original post will appear here

Related Videos

This is native VRChat OSC Eyetracking using the Bigscreen Beyond 2e!! I can't believe how natural it looks... even without eyeblink or VRCFT. Only tweak was to increase my avatar's natural "eyelook" range in Unity. So hyped for the new updates to it too. #VRChat
0:25

This is native VRChat OSC Eyetracking using the Bigscreen Beyond 2e!! I can't believe how natural it looks... even without eyeblink or VRCFT. Only tweak was to increase my avatar's natural "eyelook" range in Unity. So hyped for the new updates to it too. #VRChat

PHIA ⭐️

25,006 views • 10 months ago

I posted unity footage of this yesterday in a reply to the person who inspired this but decided to record some jank footage ingame with finger tracking to show off the new nail material I'm working on, pretty happy with how it's looking so far
0:58

I posted unity footage of this yesterday in a reply to the person who inspired this but decided to record some jank footage ingame with finger tracking to show off the new nail material I'm working on, pretty happy with how it's looking so far

ScarlettKat🔞

13,099 views • 5 months ago

WIP I am currently integrating my "AI video texture" technique with face tracking scripts and active ragdoll physics in standalone VR. For this test video, I only applied the AI video texture to the face, but the body will look much more realistic once I apply the technique to the entire model. I've also figured out how to achieve highly detailed, realistic hair and foliage using the same technique.
0:52

WIP I am currently integrating my "AI video texture" technique with face tracking scripts and active ragdoll physics in standalone VR. For this test video, I only applied the AI video texture to the face, but the body will look much more realistic once I apply the technique to the entire model. I've also figured out how to achieve highly detailed, realistic hair and foliage using the same technique.

Alex

19,101 views • 3 months ago

This is the fastest way to edit any pictures using English. This is the first app I've seen supporting voice-controlled AI editing. I'm using the Genspark mobile app here, with their newly released Photo Genius feature. You can see how fast this works in the video below. Here is what I did: 1. I asked the agent to change my outfit to a suit 2. I asked it to make me wear a baseball hat 3. I asked it to make me smile 4. I asked it to change the background 5. I asked to show an old lady walking by
3:21

This is the fastest way to edit any pictures using English. This is the first app I've seen supporting voice-controlled AI editing. I'm using the Genspark mobile app here, with their newly released Photo Genius feature. You can see how fast this works in the video below. Here is what I did: 1. I asked the agent to change my outfit to a suit 2. I asked it to make me wear a baseball hat 3. I asked it to make me smile 4. I asked it to change the background 5. I asked to show an old lady walking by

Santiago

90,760 views • 9 months ago

Take any Python code and build a dynamic GUI on top of it by dragging and dropping components. Python is already the most popular language in the world. This makes it even better! The attached video is only 45 seconds. It will show you how it works. Here is the important part: You can now build an interface for your Python code without learning HTML, JavaScript, or CSS. Go to this link to try this: Remember to work smarter, not harder! Thanks to the team behind Taipy for partnering with me on this post.
0:45

Take any Python code and build a dynamic GUI on top of it by dragging and dropping components. Python is already the most popular language in the world. This makes it even better! The attached video is only 45 seconds. It will show you how it works. Here is the important part: You can now build an interface for your Python code without learning HTML, JavaScript, or CSS. Go to this link to try this: Remember to work smarter, not harder! Thanks to the team behind Taipy for partnering with me on this post.

Santiago

155,179 views • 2 years ago

Tongue tracking for pixel-peepers! I got tired of clipping and ugly mouth blends so I whole-assed the tongue system and now it's just so 😚👌 Coming soon to a VRChat avatar near you!! Also compatible with ANY face tracker, even if it doesn't have built-in tongue tracking. 😉
0:22

Tongue tracking for pixel-peepers! I got tired of clipping and ugly mouth blends so I whole-assed the tongue system and now it's just so 😚👌 Coming soon to a VRChat avatar near you!! Also compatible with ANY face tracker, even if it doesn't have built-in tongue tracking. 😉

Gillie Amanita 🍄❤️

44,126 views • 16 days ago

This is the most impressive tool I’ve tried in my 2 years working with generative AI. Kling AI gave me early access to their Custom Face Video Model, and yes, this is TEXT TO VIDEO. How does it work? I’ll break it all down in this thread (includes tutorial + prompts)🧵👇
0:48

This is the most impressive tool I’ve tried in my 2 years working with generative AI. Kling AI gave me early access to their Custom Face Video Model, and yes, this is TEXT TO VIDEO. How does it work? I’ll break it all down in this thread (includes tutorial + prompts)🧵👇

TechHalla

132,645 views • 1 year ago

This is definitely not a free energy device. This video does not show the step by step process on how to build one. It obviously doesn’t test it and prove it works. Do not share this video anywhere. Please.
33:34

This is definitely not a free energy device. This video does not show the step by step process on how to build one. It obviously doesn’t test it and prove it works. Do not share this video anywhere. Please.

Ted Logan

392,145 views • 2 years ago

We have to face it. Robots will ultimately have a face. But why? The human face transmits information in a far more rapid manner than any other system. Working face to face with robots are going to require this signal. This is the face from AheafFrom robotics. For robotics companies that do not have human faces, I say best to start now or encourage an after market hobby garage builder face market. This is the way of it.
1:21

We have to face it. Robots will ultimately have a face. But why? The human face transmits information in a far more rapid manner than any other system. Working face to face with robots are going to require this signal. This is the face from AheafFrom robotics. For robotics companies that do not have human faces, I say best to start now or encourage an after market hobby garage builder face market. This is the way of it.

Brian Roemmele

27,755 views • 8 months ago

i will not question how dduks able to do this or what kind of tracking they use or what tech behind this. i will just pretend dduks are a group of witches and accept it as it is
1:47

i will not question how dduks able to do this or what kind of tracking they use or what tech behind this. i will just pretend dduks are a group of witches and accept it as it is

sha ❤️💗

11,532 views • 6 months ago

I heard VRC was buggy, but this is RIDICULOUS Finally finished my low poly VRC avatar based on Adfree.EXE 👾⚠️【SVA】's design . Been working on this over the last few months off and on to study low poly modeling, and I can finally call it complete Everything is made from the ground up. Modeling, texture work (though referenced from Adfrees ref sheet) weight painting, and naturally I gave it some face tracking. I also finally had an excuse to use Poiyomi Pro's vertex glitch and vertex rounding features :D This was a super fun project and it feels great to see it finally completed C: Maybe next time I'll go for making an avatar with a higher poly count and more detail (Before anyone asks, I don't plan to make this clonable or share it since I don't own the design lol)
0:33

I heard VRC was buggy, but this is RIDICULOUS Finally finished my low poly VRC avatar based on Adfree.EXE 👾⚠️【SVA】's design . Been working on this over the last few months off and on to study low poly modeling, and I can finally call it complete Everything is made from the ground up. Modeling, texture work (though referenced from Adfrees ref sheet) weight painting, and naturally I gave it some face tracking. I also finally had an excuse to use Poiyomi Pro's vertex glitch and vertex rounding features :D This was a super fun project and it feels great to see it finally completed C: Maybe next time I'll go for making an avatar with a higher poly count and more detail (Before anyone asks, I don't plan to make this clonable or share it since I don't own the design lol)

Threevee

46,903 views • 5 months ago

Here are some tips for those who want to practice face acting: ➡️U motion: Move your head in a "U" Shape so it's never stuck in the same place. This will help your movements look more interesting. ➡️Key points: When practicing with your model, learn to get to a "Key point." This is when you can automatically get to an expression without using toggles. I use surprised and angry expressions a lot, so I know exactly how to move my face to achieve that look, mainly for clips or comedic effect. I practiced enough so I know what it will look like on the model. ➡️Head tilts: If you struggle with face acting, a simple head tilt will go a long way. Overall, the movement and face acting of your model does matter. It can help it look more interesting, but also, it's okay if you can't face acting all the time. Using just key animations when you're gaming will work perfectly. Example: You died in a game, and you go to the key point of surprise. You know, making this face will make your model look shocked, so you will do a dramatic eye open and mouth agape to achieve this, to reflect onto your model. Lastly. The way your model moves is usually 30% rigging artist,20% tracking (webcam/iPhone), and 50% you. Your rigging artist can give you the tools, but only you can make your models' results reflect your emotions. As always, DO YOUR PARAMETERS AND SETTINGS IN VTUBE STUDIO. It will not be perfect to your face and camera settings unless you adjust the model, (This is an old video I did on parameters) Holy Yapfest.
0:36

Here are some tips for those who want to practice face acting: ➡️U motion: Move your head in a "U" Shape so it's never stuck in the same place. This will help your movements look more interesting. ➡️Key points: When practicing with your model, learn to get to a "Key point." This is when you can automatically get to an expression without using toggles. I use surprised and angry expressions a lot, so I know exactly how to move my face to achieve that look, mainly for clips or comedic effect. I practiced enough so I know what it will look like on the model. ➡️Head tilts: If you struggle with face acting, a simple head tilt will go a long way. Overall, the movement and face acting of your model does matter. It can help it look more interesting, but also, it's okay if you can't face acting all the time. Using just key animations when you're gaming will work perfectly. Example: You died in a game, and you go to the key point of surprise. You know, making this face will make your model look shocked, so you will do a dramatic eye open and mouth agape to achieve this, to reflect onto your model. Lastly. The way your model moves is usually 30% rigging artist,20% tracking (webcam/iPhone), and 50% you. Your rigging artist can give you the tools, but only you can make your models' results reflect your emotions. As always, DO YOUR PARAMETERS AND SETTINGS IN VTUBE STUDIO. It will not be perfect to your face and camera settings unless you adjust the model, (This is an old video I did on parameters) Holy Yapfest.

♥️Cutiepierin | L2D RIG ARTIST

93,206 views • 9 months ago

i made good money yesterday trading memes on ton. so I'm finally posting this video I've been sitting on. - a full walkthrough on how to trade memecoins on ton using a bot. - simple. fast. no complicated setup. - this is exactly how I do it. there's also a seed phrase hidden somewhere in the video. find it. claim whatever is in the wallet. first one to it wins. watch it now.
6:27

i made good money yesterday trading memes on ton. so I'm finally posting this video I've been sitting on. - a full walkthrough on how to trade memecoins on ton using a bot. - simple. fast. no complicated setup. - this is exactly how I do it. there's also a seed phrase hidden somewhere in the video. find it. claim whatever is in the wallet. first one to it wins. watch it now.

ELVIS ⭕️

38,776 views • 2 months ago

can anybody knowledgeable about t5 help me understand what is going on here? im not familiar with the wakeup system or differences with bryan taunt in t5, but it seems less consistent at tracking techroll properly. am i doing something incorrect or is this just how it is in t5?
0:37

can anybody knowledgeable about t5 help me understand what is going on here? im not familiar with the wakeup system or differences with bryan taunt in t5, but it seems less consistent at tracking techroll properly. am i doing something incorrect or is this just how it is in t5?

ty

31,691 views • 1 year ago

Peter Thiel on $NVDA (about a year ago): It is probably quite tricky. If you had to concretize it, one thing that is very strange is if you just follow the money, at this point 80 to 85% of the money in AI is being made by one company, it is NVIDIA. It is all on this very weird hardware layer, which Silicon Valley does not even know very much about anymore. We do not really do hardware, we do not do silicon chips in Silicon Valley anymore. I get pitched on these companies once every three or four years, and it is always, I have no clue how to do this, it sounds like a pretty good idea, but man, I have no clue, and we never invest. There is this theory that the hardware piece makes the money initially, then gets more commodified over time, and it will shift to software. And the, I do not know, multi trillion dollar question is whether that is going to be true again this time, or whether NVIDIA will have this incredible monopoly. I suspect NVIDIA will. I think it will maintain its position for a while. I think the game theory on it is something like this. All the big tech companies are going to start trying to design their own AI chips so they do not have to pay the 10x markup to NVIDIA. How hard is it for them to do it? How long will it take? If they all do it, then the chips become a commodity and nobody makes money in chips. So do you go into hardware? You should do it if nobody else is doing it. If everybody does it, you should not do it. I am not sure how that nets out, but probably people stay stuck for a while and NVIDIA goes from strength to strength for a while.
1:55

Peter Thiel on $NVDA (about a year ago): It is probably quite tricky. If you had to concretize it, one thing that is very strange is if you just follow the money, at this point 80 to 85% of the money in AI is being made by one company, it is NVIDIA. It is all on this very weird hardware layer, which Silicon Valley does not even know very much about anymore. We do not really do hardware, we do not do silicon chips in Silicon Valley anymore. I get pitched on these companies once every three or four years, and it is always, I have no clue how to do this, it sounds like a pretty good idea, but man, I have no clue, and we never invest. There is this theory that the hardware piece makes the money initially, then gets more commodified over time, and it will shift to software. And the, I do not know, multi trillion dollar question is whether that is going to be true again this time, or whether NVIDIA will have this incredible monopoly. I suspect NVIDIA will. I think it will maintain its position for a while. I think the game theory on it is something like this. All the big tech companies are going to start trying to design their own AI chips so they do not have to pay the 10x markup to NVIDIA. How hard is it for them to do it? How long will it take? If they all do it, then the chips become a commodity and nobody makes money in chips. So do you go into hardware? You should do it if nobody else is doing it. If everybody does it, you should not do it. I am not sure how that nets out, but probably people stay stuck for a while and NVIDIA goes from strength to strength for a while.

Wall St Engine

824,879 views • 8 months ago

So..... is this a slap in the face? I got this without a Twitch account connected. I have tried to connect it over and over yet it never works.... soooooo what do you all think. I'm not upset with EVERYONE getting the card just wanna hear your POV
1:15

So..... is this a slap in the face? I got this without a Twitch account connected. I have tried to connect it over and over yet it never works.... soooooo what do you all think. I'm not upset with EVERYONE getting the card just wanna hear your POV

kneand

19,714 views • 9 months ago

Got introduced to , an AI code assistant specialised for Unity by Julian Park and after dabbling with it for a day, I am really impressed with how good it is for vibe coding on the Unity Game Engine. Bezi early impressions: - Bezi works direcly on Unity with a Plugin, this means that I don't need a Unity MCP - Because Bezi is built for Unity, the success rate of feature implementations is visibly higher than general coding models - It was able to integrate Unity store assets like a Weather system to this game pretty seamlessly - I was able to add a fishing database, lighting and weather systems into this game fairly quickly I'm very impressed with the results with Bezi so far. I feel that vibe coding a full indie game on Unity and releasing it on Steam, Mobile and Web is within reach. This also validates one thing that I have been suspecting: A specialised model designed for a specific use case can perform better than a general model at the particular domain. Very exciting!
0:30

Got introduced to , an AI code assistant specialised for Unity by Julian Park and after dabbling with it for a day, I am really impressed with how good it is for vibe coding on the Unity Game Engine. Bezi early impressions: - Bezi works direcly on Unity with a Plugin, this means that I don't need a Unity MCP - Because Bezi is built for Unity, the success rate of feature implementations is visibly higher than general coding models - It was able to integrate Unity store assets like a Weather system to this game pretty seamlessly - I was able to add a fishing database, lighting and weather systems into this game fairly quickly I'm very impressed with the results with Bezi so far. I feel that vibe coding a full indie game on Unity and releasing it on Steam, Mobile and Web is within reach. This also validates one thing that I have been suspecting: A specialised model designed for a specific use case can perform better than a general model at the particular domain. Very exciting!

Danny Limanseta

48,991 views • 4 months ago

Got the eye rig to work as well I'm really happy how it turned out. I do have a shrinkwrap modifier on the head to help the shape but it can be turned off for more extreme shapes. Next i'll work on some arkit shapes for face tracking.
0:33

Got the eye rig to work as well I'm really happy how it turned out. I do have a shrinkwrap modifier on the head to help the shape but it can be turned off for more extreme shapes. Next i'll work on some arkit shapes for face tracking.

Dead Carl

25,105 views • 2 months ago

The hand tracking on the Meta Quest 3S is seriously impressive. I just did a quick test to see how it performs in low light as well as complete darkness with amazing results!
0:43

The hand tracking on the Meta Quest 3S is seriously impressive. I just did a quick test to see how it performs in low light as well as complete darkness with amazing results!

Nathie

24,607 views • 1 year ago