Skip navigation
vibe coding metahuman with threejs and codex: first demo
0:00 / 0:31

vibe coding metahuman with threejs and codex: first demo

robot 2.0

@alightinastorm10K followers

Visit on X
131 likesDownloadOriginal post

11,121 views

vibe coding metahuman with threejs and codex: first demo I mean it's still a long way to go, but i'm quite surprised myself, turned out way better than i expected and the character isn't too far from AAA? all textures generated by gpt image 2, the facial expressions and target locking were fully written by codex in code, no pre baked animations. So this took about 4 evenings, of which 3 were wasted by clicking through endless blender menus, extruding faces to retopo the model generated with tripo Honestly, a proper AI integrated into blender would've compressed it probably down to a day Very sad to see blender turning away from the future! I have to use it for modeling for now, but will eventually drop it the second an AI boosted modeling software comes out (for free)

69 Comments

Comments from the original post on X (Twitter)

  • robot 2.0's profile picture

    @alightinastorm

    this was my day one rant, enjoy the crashout:

    5 likes

  • Astrid Wilde 🌞's profile picture

    @astridwilde

    the most complex part of this work is getting FACS properly setup (source: i made a similar tool for EA in 2023) i bet you could get that up and running in under a week now just vibecoding though. brave new world

    4 likes

  • robot 2.0's profile picture

    @alightinastorm

    oh here we gooo thank you for the next rabbit hole!

    1 like

  • Astrid Wilde 🌞's profile picture

    @astridwilde

    the way every AAA studio does it is with a map of 2d sliders like this: enjoy the rabbit chase!

    2 likes

  • robot 2.0's profile picture

    @alightinastorm

    do i understand this correctly that i have to build a library of base expressions and use these as morph targets with sliders? sigh, isn't there like a fully programmatic way

  • Astrid Wilde 🌞's profile picture

    @astridwilde

    you are understanding this correctly there is a fully programmatic way but it's a 70D math problem and an optimizer is going to get you a poor result

    1 like

  • robot 2.0's profile picture

    @alightinastorm

    goddamn, alright pulling up the sleeves and getting to work

  • King Stanky MBA's profile picture

    @TheKingOfStank

    You could singlehandedly replace the entire staff at bethesda

    4 likes

  • robot 2.0's profile picture

    @alightinastorm

    lmao i'm not sure about that, i really enjoyed bethesda games

    1 like

  • robot 2.0's profile picture

    @alightinastorm

    mr mogman i can't be mogging when i'm token poor wen free pro sub??

    2 likes

  • LEYVERSE's profile picture

    @leyverse_tv

    For lipsync and expressions u can check this:

    2 likes

  • robot 2.0's profile picture

    @alightinastorm

    here we goooo

    1 like

  • al's profile picture

    @alhuissi

    he's more charismatic than 99% of X 🤪

    2 likes

  • robot 2.0's profile picture

    @alightinastorm

    i literally just prompted in chatgpt "given this UV map, pls generate a generic human skin"

    5 likes

  • JERIC陳傑瑞's profile picture

    @jerictan

    Wow this is really awesome and I can see many use cases - please keep cooking and pushing this

    1 like

  • robot 2.0's profile picture

    @alightinastorm

    will do :)

    1 like

  • Reigen's profile picture

    @Reigen_Raju

    are you aware of the open source anny project and makehuman blender extension?

    1 like

  • robot 2.0's profile picture

    @alightinastorm

    i saw it, but the fidelity of the humans was meh?

    1 like

  • Rawlala's profile picture

    @Rawlala1

    already on par with the next james bond lol

    1 like

  • robot 2.0's profile picture

    @alightinastorm

    don't mock me 😭😭😭

    1 like