vibe coding metahuman with threejs and codex: first demo I mean it's still a long way to go, but i'm quite surprised myself, turned out way better than i expected and the character isn't too far from AAA? all textures generated by gpt image 2, the facial expressions and... target locking were fully written by codex in code, no pre baked animations. So this took about 4 evenings, of which 3 were wasted by clicking through endless blender menus, extruding faces to retopo the model generated with tripo Honestly, a proper AI integrated into blender would've compressed it probably down to a day Very sad to see blender turning away from the future! I have to use it for modeling for now, but will eventually drop it the second an AI boosted modeling software comes out (for free)show more

this was my day one rant, enjoy the crashout:

the most complex part of this work is getting FACS properly setup (source: i made a similar tool for EA in 2023) i bet you could get that up and running in under a week now just vibecoding though. brave new world

oh here we gooo thank you for the next rabbit hole!

the way every AAA studio does it is with a map of 2d sliders like this: enjoy the rabbit chase!

do i understand this correctly that i have to build a library of base expressions and use these as morph targets with sliders? sigh, isn't there like a fully programmatic way

you are understanding this correctly there is a fully programmatic way but it's a 70D math problem and an optimizer is going to get you a poor result

goddamn, alright pulling up the sleeves and getting to work

You could singlehandedly replace the entire staff at bethesda

lmao i'm not sure about that, i really enjoyed bethesda games

mr mogman i can't be mogging when i'm token poor wen free pro sub??

For lipsync and expressions u can check this:

here we goooo

he's more charismatic than 99% of X 🤪

i literally just prompted in chatgpt "given this UV map, pls generate a generic human skin"

Wow this is really awesome and I can see many use cases - please keep cooking and pushing this

will do :)

are you aware of the open source anny project and makehuman blender extension?

i saw it, but the fidelity of the humans was meh?

already on par with the next james bond lol

don't mock me 😭😭😭

lmaooo don't be rude they have a whole ass team on this 😭🤣

of course the actual meta part is completely missing for now! But i wanted to share some progress, been deep into 3D the past couple days 😭

damn, that's a fire result

awww

i've seen worse tbh, can't say it's slop!

Uh, Blender has an MCP plugin dude

man that's absolutely not the same

You want AI assist in Blender, that's your path of least resistance

the previous community MCP was absolute dogshit and the anthropic one was just the start with very light tools

If only there were a way to build one, maybe one that runs arbitrary Blender Python code...

again, you are looking at raw features retopology work can't be done by just writing a python script

could make a bioware style story driven game with tools like these. Unlocking new possibilities every week!

can't stop won't stop

i used unreal metahuman for a long time, the potential i see here is crazy considering it's a full web stack

robot delivers 🤝

it's still a million miles away from any studio work

true, but already miles ahead the average indie graphics, so it's a step forward

dunno what indies you're looking at but not any of the ones i see look like the characters got left out in the sun for a few weeks with no sunscreen

that's the hdr preset from drei

it's not just the hdr, the textures bug-eyes and mouth hanging open are certainly not helping it look good

alright lfg i guess

What are using for this?

what exactly do you want to know?

Oh I meant what are you using to build this, copilot like the old streams?

noo copilot rugpulled, codex app

Upgrades, love it. Hope you remember me when ur up

i have no idea who you are but remembering i was streaming on copilot makes me think you've been around for a while lol

lol i have been, just under a new name, dont say it out loud tho

the uncanny valley

i'm nots sure its the uncanny valley or just the fact that his eyeballs are about to pop into your hands while watching

can u guide i cant belive it to can u make a video regarding it

@SurajChawh79862 what? there is. a demo link

but codex cannot lipsync add visemse for a mesh build in tripo 3d

You call this garbage future????? LMAOOO the bar is really low nowadays as it seems; you will never get near the world class while you still keep trying to do everything in the most lazy way possible

hey coffeee where have you been man? you only show up when i get a lot of views :(

Sorry, I was kind of busy lately, so I haven't logged in

you can't just roast me on my highs, you gotta show up on my lows too man

Blender is already AI boosted 🤔🤷‍♂️

we're at garry's mod level 😂

THAT bad 😭😭😭

hey man, garry's mod WAS AAA in 2006, only 20 years ago! 20 years in AI time is maybe just 1-2 years?

u bitch

yooo nice, already looks solid af

thanks paddy!

there is a cool intersection between VRMs, 3d gaussian blendshapes, and metahuman ready to be exploited ;)

VRM facial muscles seemed very limited when i looked into it

they are just blendshapes My theory is that you can take a base model and create multiple blendshapes like from multiple 3d guassian splats and derive a few blendshape presets, you could have metahuman like functionality I will try it whenever am done with my VRM editor

i'm using actual bones here though

yeah, VRMs use bones too to drive skinned meshes I havent seen your code but am sure it's just using a Skeleton and a skinned mesh