XR Animator EARLY ACCESS release (v0.35.0) ・💡Mobile app for Android📱 ・💡New "Hand camera" supporting motion sensor ・💡Local web app on any OS ・VMC protocol via WebSocket ・"Shoulder angle offset" setting added ・Other updates and fixes #XRAnimator Details below🧵

Members can download this early access version before its public release. Join membersip to support the development of XR Animator, and enjoy early access releases as well as other member-exclusive perks🎁

XR Animator is now available on Android platform! "XRA Mobile" basically has all the functons of the desktop app version, including mocap, but its main purpose is providing remote 3D camera control for the desktop app version.

"Hand camera" function of XRA Mobile is renewed to utilize motion sensors for 3D camera control. Once enabled, tab the screen to toggle between "Standing" and "Orbiting" rotation modes. "Standing" rotates around a fixed position. "Orbiting" revolves around the avatar.

By default, it works like you are using the front camera, ideal if you want to do 3D camera control like a camera man. Enable mocap on the mobile app (camera not needed) to turn "Orbiting" rotation mode into "selfie mode", making it possible to cotrol 3D camera like doing selfie.

Note that the default finger gestures for camera zoom and pan work as usual, making it possibe to do virtually any kind of 3D camera control when combined with the motion sensors.

To connect XRA Mobile with the desktop app, use the updated VMC protocol via WebSocket, designed for the mobile and web app version. Enable VMC receiver on desktop app side, and change protocol setting to "WebSocket".

Note that the updated VMC protocol feature allows you to enable sending 3D avatar and camera data separately. In the case of XRA Mobile, you may want to stick with sending just 3D camera data.

Once conected with "Send 3D camera data" on, 3D camera will be synced on both sides. If "selfie mode" is enabled on XRA Mobile, you can use this setup to do 3D selfie stream. To do so, you will need to turn your mobile into a webcam, with apps like "DroidCam" and "Iriun Webcam".

Technically speaking, you can use XRA Mobile alone to do a selfie stream, including the mocap part, but considering the limited power of mobile hardware, you may want to stick with face tracking only for mocap.

This update also adds support for running XR Animator as localhost web app. Localhost mode works on any OS that supports a web browser, making it possible to run XR Animator on virtually any OS, inculding those that are not currently supported by the desktop app version.

Moreover, unlike the conventional web app mode, what makes localhost mode unique is that it supports the new VMC WebSocket, making it possible to connect the localhost web app to another XR Animator app running on another computer.

There are many possible usage for localhost mode. For example, you can do XRA mocap on a standalone PC running on any OS, connect to desktop app via VMC (WebSocket) on another computer (possibly Windows), and then connecting to external apps like Warudo for the final display.

The free public version of XR Animator (v0.30.0) is also available as both web app for browsers and native app for Windows/Linux/macOS. Full details on updates of this version can be found on GitHub release page ・🌐Web➡ ・🖥️GitHub➡

Demo credits: ・キシトリ/Ouverzia MMD model by @quappael

This is insane!!! Do you plan on releasing an iOS version in the future? :000

I would love to, but I need to evaluate how difficult it will be to develop an iOS version without any Mac/iOS hardware lol

ahhhh 😂😂😂😂

Mobile app for Android? We are going places!!!

You all are constantly doing cool things and I appreciate it 💛 thank you

Thank you for your Amazing Tool and Hard Work, its super fun to use it🥰

its possible 2 connect it to Vtube Studio?

I think I once mentioned wanting support for wide angle cameras? Where is it best to formally request this feature? Have been using this application with cheap global shutter camera to great success. Otherwise I may just go ahead and write my own intermediate script.

XR Animator supports all kinds of camera, including wide angle. Or do you mean some certain specific case that doesn't work well right now?