an update on my little mic only tracking project! It now controls any live2d model in vtube studio!

WHAT THIS IS CRAZY GOOD WTH

thank u pwincess

this would be so helpful for artists that use drawing displays !! My camera never tracks my face while I'm drawing (bc my display is in the way)!!

Oooh! A use case I hadn’t even thought of!

bro this is cool af

I never cease to be amazed by how fluid the system is, you genuinely couldnt tell if you werent told. Have you made your mind on publishing the plugin or not?

I think eventually! Needs a lot of work first though!

what?? thats really cool!

You are so freaking cool, I love all these tech projects you get up to

Hehe thank you!!

This is really freaking cool. Being completely hands free is impressive enough on its own, I could even see this being used at a more micro level for those who want to finetune expressiveness on screen even more. Solid work.

w ellie

Ahhh omg you do have twitter I’ve herd your songs on Spotify a bunch I love them so much and this is so cool 🫶🏻

Thank you!

Have vedal test it and see if it registers any emotion

WAIT I am so curious

THIS IS HUGE So many people feel they can’t go from pngtubing to Vtubing because they don’t have a good method to track their face. This is AWESOME YOU ARE AWESOME OMG

Okay but minibot looks sooooooo cute as a Isatwothree model, their art is so solid. I can't wait to get my paws on this plug-in, it's a terrific concept.

this is SO cool!

THAT'S SO COOL!!! ✨

This is more proof that there are always cool people making cool things. W Ellie 🔥

OH! I briefly mentioned on stream the other day, I had an idea. Could I take the speech detecting stuff and plug that into voice filters? Example: it picks up angry and adds 15% of a mechanical growl, it picks up happy and it gives 10% artificial trill, or the main idea of I’m just making non words and it gives 80% static

OH MY GOD THIS IS SO COOL??

you freaking cooked, super amazing implementation

@CamoPolamo The cuteness matches perfectly with your Voice and Vibes you give Ellie >w< cheers

WHY IS IT ACTUALLY SO EXPRESIVE!? This is actually insane and personally, I'd go for this over the usual need of a camera of some sort in your face.

this is so cool. Also would give a lot of interesting ways to add stuff in live2d to enhance this

Holy this is insane.

That's so cool! I can't wait to one day hopefully mess around with this

A friend of mine has issues with her iphone disconnecting due to poor wifi and losing tracking of her model quite a bit. Would it be possible for it to detect the disconnect and use this as an automated backup?

This is genuinely so cool, I love this concept!

Because my room is not soundproofed, my mic sounds best when I am talking with my lips almost touchign the pop filter. But that also means that the whole lower half of my face is hidden. Luckily I'm js a PNGTuber, so "talking/not" is the only criterion my model currently needs.

@ST4RSP4CE This is dope. I kinda wanna try it out.

ellie you are so cool man, this is awesome!

It looks epic!! I'd love to have something like this for when I do cooking streams and whatnot 🤩

This is amazing!

Yay Ellie project!

This is so good! Smartest dumb lil robot. 😊

This is incredible Ellie! You said there's still so much left to do, but this is already astonishing! I'm excited to see further progress

Cute

I love this so so much I can't wait to see more! The model movement looks so good! Is is randomly cycling through those expressions/toggles or is audio in particular actually triggering certain expressions? :0

You can see the tone and language analysis at the bottom. That's what's triggering the expressions

Oh wow!! That's super interesting!