Butz Yung

@butz_yung • 5,119 subscribers

Dev of #XRAnimator, webcam mocap for VTubers✌️ ☕➡https://t.co/hdIbG08bDd FANBOX➡https://t.co/PLJaEOnpPG Discord➡https://t.co/SClGWuDxFF

Shorts

28,349 views

Videos

sweetdream.ai

Watch Anya Live

Anya is streaming live right now! Join her private show and enjoy exclusive content.

Private Show

Join now for exclusive access

Free preview available • Premium content

3,687,389 views • 1 year ago

361,624 views • 7 months ago

45,737 views • 1 month ago

183,329 views • 11 months ago

78,833 views • 7 months ago

33,931 views • 4 months ago

165,542 views • 2 years ago

13,463 views • 1 month ago

29,051 views • 5 months ago

23,119 views • 4 months ago

33,675 views • 9 months ago

33,421 views • 1 year ago

23,997 views • 9 months ago

27,136 views • 11 months ago

18,053 views • 1 year ago

30,211 views • 2 years ago

18,731 views • 1 year ago

Live Cam

Butz Yung

Shorts

The next update of #XRAnimator will support VMC protocol via WebSocket, which works on both web browser and native app. This allows interesting applications like running XRA on any browser of any platform, connecting to native XRA app, and relaying to apps like #Warudo as well

Videos

Watch Anya Live

This is an #XRAnimator demo I made a long time ago, by combining 2 separately recorded mocap video into 1. Now that #cluster supports OSC, imagine you can actually have a music collab like this on Cluster, in real time!🎻🎶

If you don't have $50k to buy a full-blown 3D mocap setup, it's nice to remind you that XR Animator is a FREE alternative which can do full body mocap, prop tracking, musical instrument mocap and more, all with just a simple webcam📷

The upcoming #XRAnimator will give you more control over how your whole avatar model responds to your mocap, even with just head motion. With the existing hip adjustment settings plus a few new, you can easily recreate Live2D-like motion, or just any style, better and smoother💃

Not gonna lie, it's kind of discouraging to realize that many VTubers still don't know that webcam can do more than just face tracking😔XR Animator has been doing webcam-based full body tracking, including fingers, for years, and it's FREE! ➡️

TIPS: Instrument mocap is a complicated task. It's more than just attaching the prop to your avatar model. #XRAnimator simplifies the process with specialized props that do the adjustments automatically. All you need is a webcam to be a 3D VTuber musician🎵📷

XR Animator EARLY ACCESS release (v0.40.0) ・💡VMC receiver for mobile/web app ・💡"Webcam sharing" between remotely connected apps📷 ・"Disable AGC" setting for lip sync ・"Shoulder tracking" setting changed to percentage based ・Other bug fixes #XRAnimator Details below🧵

Guitarist and violinist VTubers, assemble!🎻🎸 XR Animator release (v0.17.0) ・💡Support mocap for guitar and violin ・💡Support hand gesture control for props ・Support VMC camera for #Warudo ・Various updates and fixes #XRAnimator #VTuber Details👇🧵

XR Animator EARLY ACCESS release (v0.40.1) ・💡Add "Z smoothing" option for hip depth estimation ・Update depth estimation AI models ・Update electron (v43.1.1) ・Other bug fixes #XRAnimator Details below🧵

XR Animator EARLY ACCESS release (v0.39.0) ・💡Remote control via WebSocket🛜 ・Full UI control via keyboard ・Flip bone transform received from VMC for VRM1 model ・Update electron/three-vrm ・Other bug fixes #XRAnimator Details below🧵

The next update of #XRAnimator will support webcam sharing from your mobile. Use your mobile like a real selfie camera, with the camera feed shared with your PC app for mocap, without relying on 3rd party app to do the PC webcam part like in the past🤳

XR Animator EARLY ACCESS release (v0.37.2) ・💡Save/load different 3D camera📸 ・Improve processing speed of lip-sync ・Fix bug which broke pose switching ・Fix hotkey issues ・Update wLipSync (v1.3.0) #XRAnimator Details below🧵

XR Animator EARLY ACCESS release (v0.36.0) ・💡Animated 360° panorama ・💡Local web app for mobile ・Lite version body tracking (faster) ・"Inference device" setting for body tracking ・Setting to autoload face calibration ・Other updates &amp; fixes #XRAnimator Details below🧵

TIPS: Besides 3D wallpaper, the latest XR Animator also improves the performance of some Transformers-based AI models. For example, object detection AI based on Transformers is slower but more accurate, and this update makes these models more usable💨

Thank you all for the likes and shares on my previous post❤️Besides upper/full body mocap, you can do IRL object tracking among many other features, and sync everything with external apps like #Warudo. All you need is a webcam, and XR Animator✨

XR Animator EARLY ACCESS release (v0.35.0) ・💡Mobile app for Android📱 ・💡New "Hand camera" supporting motion sensor ・💡Local web app on any OS ・VMC protocol via WebSocket ・"Shoulder angle offset" setting added ・Other updates and fixes #XRAnimator Details below🧵

XR Animator release (v0.19.6) ・💡Fix forearm twisting at extreme angles ・Support changing pose order via drag and drop ・Fix prop display issue when motion tracking is lost #XRAnimator #VTuber Details below👇🧵

XR Animator EARLY ACCESS release (v0.36.0) ・💡Animated 360° panorama ・💡Local web app for mobile ・Lite version body tracking (faster) ・"Inference device" setting for body tracking ・Setting to autoload face calibration ・Other updates & fixes #XRAnimator Details below🧵