Mediapipe vs Reshot AI keypoints!

Planning to train a ControlNet using @reshotAI keypoints. @toyxyz3

@reshotAI Cool, next time I need the keypoints from an exorcism video, I'll know where to go 👍🏼

@reshotAI Haha, works also for normal faces 😆

@reshotAI amazing

@reshotAI Thanks! API for keypoints coming soon, and trained ControlNet will be released open-source on @huggingface 🤗

@reshotAI What is output of your AI? Is it Arkit, FACS or some other output system?

@reshotAI Currently raw kp coordinates, but ARKit blendshapes (+ rotation and camera transformation) coming by next week

@reshotAI controlnet wen

@reshotAI Next week! 🔥

@reshotAI I would love to see the affect this tracking would have on ab ARKit-based vtuber model. And if it would change the proportions of the models's face.

@reshotAI I’ll predict ARKit blendshapes for v2, it should disentangle identity & expression really well (so face proportions will be preserved). Will post results next week!