Video wird geladen...

Video konnte nicht geladen werden

Zur Startseite

Codec Avatars can run on Quest 3 - the hardware is there. What’s missing is seamless face scanning and built-in eye & face tracking. Quest 4 will likely have eye tracking, and it may support codec avatars, but I really hope the lightweight headset in 2026 will do it first.

KognitaPoland's profile picture

Mixed Reality Guy

1,007 subscribers

10,490 Aufrufe • vor 1 Jahr •via X (Twitter)

LIVE

Anya Rossi• Live Now

Private livecam show

0 Kommentare

Keine Kommentare verfügbar

Kommentare vom Original-Post werden hier angezeigt

Ähnliche Videos

The Meta VR Glasses has face tracking! The downward facing cameras doesn't only track your hands but also your lower face. Together with eye tracking, that will power Hologram, Meta's new Codec Avatars. Found this watching Norman Chan's hands-on (great video) The Quest Pro already did face tracking 4 years ago. It was so far ahead of its time. Here's what that looked like.
0:32

The Meta VR Glasses has face tracking! The downward facing cameras doesn't only track your hands but also your lower face. Together with eye tracking, that will power Hologram, Meta's new Codec Avatars. Found this watching Norman Chan's hands-on (great video) The Quest Pro already did face tracking 4 years ago. It was so far ahead of its time. Here's what that looked like.

Cas and Chary XR

70,842 Aufrufe • vor 1 Monat

Face and eye tracking is finally here for VRChat Quest users!
4:41

Face and eye tracking is finally here for VRChat Quest users!

Chyado先生 - Japan Guy - That dude in VRChat gifs

71,758 Aufrufe • vor 6 Monaten

A simple tracking showcase using the Paper_Tracker Face + Eye Tracking Full Kit with Quest 3.
0:44

A simple tracking showcase using the Paper_Tracker Face + Eye Tracking Full Kit with Quest 3.

Paper_Tracker

53,910 Aufrufe • vor 5 Monaten

Tutorial video on how to test face tracking in Unity with face tracking hardware is here! This is probably the question I get asked the most, so I'm happy I finally got a chance to make a tutorial on this. This example demonstrates doing it with a Quest Pro using Virtual Desktop, but it should work with any headset. I've also done it with an iPhone and Bigscreen beyon 2e + Vive face tracker Next one I make will show how to do it without any hardware :D . . . . . Please keep in mind this video is intended for people who are already familiar with Unity and avatar creation or editing. This video does not go over troubleshooting face tracking, or teaching Unity basics, only how to test how it looks without needing to upload the avatar
2:43

Tutorial video on how to test face tracking in Unity with face tracking hardware is here! This is probably the question I get asked the most, so I'm happy I finally got a chance to make a tutorial on this. This example demonstrates doing it with a Quest Pro using Virtual Desktop, but it should work with any headset. I've also done it with an iPhone and Bigscreen beyon 2e + Vive face tracker Next one I make will show how to do it without any hardware :D . . . . . Please keep in mind this video is intended for people who are already familiar with Unity and avatar creation or editing. This video does not go over troubleshooting face tracking, or teaching Unity basics, only how to test how it looks without needing to upload the avatar

Threevee

40,399 Aufrufe • vor 3 Monaten

I tried face and eye tracking in VRChat
0:27

I tried face and eye tracking in VRChat

sbarky

24,541 Aufrufe • vor 11 Monaten

Meta AI strikes again, with Relightable Gaussian Codec Avatars This is an update to the Meta Codec Avatars 2.0, building on 3D Gaussian Splatting. As a result, we get fully relightable real-time avatars, accurate at the hair strand level 🤯 More details below ⬇️⬇️
0:27

Meta AI strikes again, with Relightable Gaussian Codec Avatars This is an update to the Meta Codec Avatars 2.0, building on 3D Gaussian Splatting. As a result, we get fully relightable real-time avatars, accurate at the hair strand level 🤯 More details below ⬇️⬇️

Alex Carlier

445,946 Aufrufe • vor 2 Jahren

The eye/face tracking will always be one of my favorite things
0:51

The eye/face tracking will always be one of my favorite things

Moon 🎼👁️‍🗨️💀🍵🐟🕯️

24,762 Aufrufe • vor 2 Monaten

Since VRChat has recently announced the addition of native Face Tracking to the SDK, I figured it couldn't possibly be a better time to showcase it and give my humble five cents that nobody really asked for: For the past couple of weeks, I have been testing a face tracking mod for the Meta Quest 3 (also available for Pico headsets, Q2, and Q3S) called Project Cymple. For roughly $140 on Taobao, you get two eye-tracking cameras, a mouth-tracking camera, and a little hub that connects everything and provides power pass-through so you can run the whole setup through your Quest's original power supply (or any Power Delivery-compatible power bank). At first, I was very worried whether it would work or not since I'm a bespectacled beauty in real life (I wear glasses), and - while not recommended by Project Cynple themselves -, I decided to take the risk and try it out regardless (didn't really wanna spend too much on prescription lenses). To my surprise, it tracks extremely well, at the expense of no longer being as comfortable as it used to be, but it's not a big deal, so to speak. Setting it up is very easy and straightforward, since the application that connects it to the computer is easily available in the Meta Quest Store, with no need to sideload anything into the headset. You just download Cymple Link, connect it to the headset via the hub (well, you update the firmware first on PC, but it's very quick and easy to do), and then you are golden. The Cymple software will automatically launch on PC whenever you spin up SteamVR and will work from the get-go. I had a few oddities in the eye-tracking behavior during the first run, but they were quickly resolved after recording a dataset and thoroughly calibrating again. The calibration process is very quick and so far seems to be something you only have to do during the first launch. I've only had to recalibrate a few times after the first calibration during longer sessions. So far, the overall experience with the product has been nothing short of stellar, requiring next to no troubleshooting despite not doing the recommended thing (using it without glasses). If you consider that a brand-new Quest 3 goes for like $550 and Cymple itself costs $140, it's really hard to beat that combo if you want full face tracking on a budget without buying a used Quest Pro. It works amazingly well! As for infrared eye strain, I can't say I've had any issues thus far, despite wearing it for prolonged times (I even sleep in VR). All in all, Project Cymple is a very competent full face tracking solution, with remarkable ease of use and with a very comprehensive feature set (individual eye tracking, solid eyebrow estimation, foveated rendering*). * Dominocs - Project Cymple's creator - has been developing a streamer client that allows you to use the eye tracking for foveated rendering, making full use of the cameras to improve your performance in lots of VR games. It's still in testing and development, but it's said to be coming to the Meta Store soon! As it couldn't have been any different, I have also recorded a short video demonstrating some of the expressions you can make. Enjoy roughly 7 minutes of raw silliness! It is also worth noting that I'm not a very expressive individual (my expressions are a bit stiff in real life), so you might get even better results than I do! Also, different face tracking packages will provide different experiences (I used Fermata on this Plum!). #VRChat #VRChatPhotography #FaceTracking #Plum3D
7:01

Since VRChat has recently announced the addition of native Face Tracking to the SDK, I figured it couldn't possibly be a better time to showcase it and give my humble five cents that nobody really asked for: For the past couple of weeks, I have been testing a face tracking mod for the Meta Quest 3 (also available for Pico headsets, Q2, and Q3S) called Project Cymple. For roughly $140 on Taobao, you get two eye-tracking cameras, a mouth-tracking camera, and a little hub that connects everything and provides power pass-through so you can run the whole setup through your Quest's original power supply (or any Power Delivery-compatible power bank). At first, I was very worried whether it would work or not since I'm a bespectacled beauty in real life (I wear glasses), and - while not recommended by Project Cynple themselves -, I decided to take the risk and try it out regardless (didn't really wanna spend too much on prescription lenses). To my surprise, it tracks extremely well, at the expense of no longer being as comfortable as it used to be, but it's not a big deal, so to speak. Setting it up is very easy and straightforward, since the application that connects it to the computer is easily available in the Meta Quest Store, with no need to sideload anything into the headset. You just download Cymple Link, connect it to the headset via the hub (well, you update the firmware first on PC, but it's very quick and easy to do), and then you are golden. The Cymple software will automatically launch on PC whenever you spin up SteamVR and will work from the get-go. I had a few oddities in the eye-tracking behavior during the first run, but they were quickly resolved after recording a dataset and thoroughly calibrating again. The calibration process is very quick and so far seems to be something you only have to do during the first launch. I've only had to recalibrate a few times after the first calibration during longer sessions. So far, the overall experience with the product has been nothing short of stellar, requiring next to no troubleshooting despite not doing the recommended thing (using it without glasses). If you consider that a brand-new Quest 3 goes for like $550 and Cymple itself costs $140, it's really hard to beat that combo if you want full face tracking on a budget without buying a used Quest Pro. It works amazingly well! As for infrared eye strain, I can't say I've had any issues thus far, despite wearing it for prolonged times (I even sleep in VR). All in all, Project Cymple is a very competent full face tracking solution, with remarkable ease of use and with a very comprehensive feature set (individual eye tracking, solid eyebrow estimation, foveated rendering*). * Dominocs - Project Cymple's creator - has been developing a streamer client that allows you to use the eye tracking for foveated rendering, making full use of the cameras to improve your performance in lots of VR games. It's still in testing and development, but it's said to be coming to the Meta Store soon! As it couldn't have been any different, I have also recorded a short video demonstrating some of the expressions you can make. Enjoy roughly 7 minutes of raw silliness! It is also worth noting that I'm not a very expressive individual (my expressions are a bit stiff in real life), so you might get even better results than I do! Also, different face tracking packages will provide different experiences (I used Fermata on this Plum!). #VRChat #VRChatPhotography #FaceTracking #Plum3D

Ara

12,759 Aufrufe • vor 1 Monat

Vision Pro will soon have the most immersive PCVR streaming app.. (Except for the lack of Eye and Face tracking APIs 🥲)
0:45

Vision Pro will soon have the most immersive PCVR streaming app.. (Except for the lack of Eye and Face tracking APIs 🥲)

Brad Lynch

19,954 Aufrufe • vor 22 Tagen

My new Free VRChat base! Full Face Tracking, and a little extra for those who may not have Face Tracking! Get it in the replies:
0:39

My new Free VRChat base! Full Face Tracking, and a little extra for those who may not have Face Tracking! Get it in the replies:

omatsu

107,343 Aufrufe • vor 2 Jahren

Here are some Paper_Tracker eye-tracking performance tests based on camera images from the Bigscreen Beyond 2e! Because the eye camera angle on the Bigscreen Beyond 2e is not ideal, and our compatibility algorithm for the Beyond 2e is still in an early validation stage, misrecognition, unstable recognition, or inconsistent tracking performance may occur in some cases. Everyone is welcome to download the software, try it out, and test the actual tracking performance. If you run into any issues during use, feel free to give us feedback on Discord. We also warmly welcome dataset submissions to help us further improve the algorithm and enhance eye-tracking performance on the Beyond 2e. Thank you all for your support and testing. We will continue improving the compatibility and tracking experience!
1:11

Here are some Paper_Tracker eye-tracking performance tests based on camera images from the Bigscreen Beyond 2e! Because the eye camera angle on the Bigscreen Beyond 2e is not ideal, and our compatibility algorithm for the Beyond 2e is still in an early validation stage, misrecognition, unstable recognition, or inconsistent tracking performance may occur in some cases. Everyone is welcome to download the software, try it out, and test the actual tracking performance. If you run into any issues during use, feel free to give us feedback on Discord. We also warmly welcome dataset submissions to help us further improve the algorithm and enhance eye-tracking performance on the Beyond 2e. Thank you all for your support and testing. We will continue improving the compatibility and tracking experience!

Paper_Tracker

14,966 Aufrufe • vor 4 Monaten

Bigscreen Beyond 2e Eye tracking test with vive facial tracker for face tracking, finally getting to use the tongue tracking on this avatar 🖤 first impressions in replies
0:59

Bigscreen Beyond 2e Eye tracking test with vive facial tracker for face tracking, finally getting to use the tongue tracking on this avatar 🖤 first impressions in replies

saintsakura 🌸🤍

53,062 Aufrufe • vor 1 Jahr

VRChat is down. Watch a video about upcoming eye and face tracking!
5:07

VRChat is down. Watch a video about upcoming eye and face tracking!

Chyado先生 - Japan Guy - That dude in VRChat gifs

27,948 Aufrufe • vor 5 Monaten

Got the eye rig to work as well I'm really happy how it turned out. I do have a shrinkwrap modifier on the head to help the shape but it can be turned off for more extreme shapes. Next i'll work on some arkit shapes for face tracking.
0:33

Got the eye rig to work as well I'm really happy how it turned out. I do have a shrinkwrap modifier on the head to help the shape but it can be turned off for more extreme shapes. Next i'll work on some arkit shapes for face tracking.

Dead Carl

25,673 Aufrufe • vor 5 Monaten

Here's a quick demo & first impressions of Samsung Galaxy XR's Microphone and Face/Eye tracking in VRChat using Virtual Desktop.
2:26

Here's a quick demo & first impressions of Samsung Galaxy XR's Microphone and Face/Eye tracking in VRChat using Virtual Desktop.

Nanochip

297,286 Aufrufe • vor 1 Jahr

VTubing from a standalone HMD sounds like a nightmare... But... I got to see a glimpse of potential there Someone is doing some pretty amazing things with what's called "VStreamer Live", coming to App Lab Quest Pro users can even use the Eye/Face tracking with their VRMs
0:43

VTubing from a standalone HMD sounds like a nightmare... But... I got to see a glimpse of potential there Someone is doing some pretty amazing things with what's called "VStreamer Live", coming to App Lab Quest Pro users can even use the Eye/Face tracking with their VRMs

Brad Lynch

26,887 Aufrufe • vor 3 Jahren

New Facetracking Add-On from Lunak and I, for one of my absolute favorite avatars, the Northern Aspil by ViviFae! Includes Face, Ear, and emulated Tongue Tracking Shop 🔗 is on my profile!
0:21

New Facetracking Add-On from Lunak and I, for one of my absolute favorite avatars, the Northern Aspil by ViviFae! Includes Face, Ear, and emulated Tongue Tracking Shop 🔗 is on my profile!

Royalty

16,331 Aufrufe • vor 3 Monaten