正在加载视频...

视频加载失败

Early R&D using our SP-6M dataset. Exploring image-to-3D reconstruction from single images, including heavily modified inputs (lighting, hair, etc). Still a work in progress.

53,370 次观看 • 5 个月前 •via X (Twitter)

56 条评论

Toby VirtualFilmer 的头像
Toby VirtualFilmer5 个月前

Oh my god. That… is… insanity. Currently all the ai image to 3d human services fail horribly 😂 but this could be the answer!

3D Scanstore 的头像
3D Scanstore5 个月前

Yep I know :) data and diversity are king when it comes to this kind of thing. We have over 7600 individual scans with 11 expressions each so around 80k scans across a hugely diverse group of people.

Vadim B 的头像
Vadim B5 个月前

Very cool, can't wait, this is actually an amazing use of all your scanned data

3D Scanstore 的头像
3D Scanstore5 个月前

Cheers Vadim!

MR3D-Dev 的头像
MR3D-Dev5 个月前

holy cow. Is this real?

3D Scanstore 的头像
3D Scanstore5 个月前

Yep! It's all we've been doing for the past 18 months. :)

Jscott 的头像
Jscott5 个月前

Fucking fantastic dude. I dont even want to know what your compute bill looks like 😅

3D Scanstore 的头像
3D Scanstore5 个月前

Ha ha wait till I show you what we're using to train. We will show that soon.

Luciano Daluz 的头像
Luciano Daluz5 个月前

It is too good to be true.

3D Scanstore 的头像
3D Scanstore5 个月前

Ha ha 🤣

Pierre Schiller 的头像
Pierre Schiller5 个月前

This is fantastic! Are you training your own model? What about topology?

3D Scanstore 的头像
3D Scanstore5 个月前

Yep we're training our own model from scratch with all of our own data. Topology is production ready consistant morphable geometry with 8k textures. This is the dataset we created for it.

Pierre Schiller 的头像
Pierre Schiller5 个月前

Instant sub. Way to go!!👍

racki 的头像
racki5 个月前

where can I buy the alpha?

3D Scanstore 的头像
3D Scanstore5 个月前

It's way to early for this I'm afraid.

Anthony R. Risen 的头像
Anthony R. Risen5 个月前

This is cool are you using flame smplx models with your textures overlayed? That’s pretty sweet!

3D Scanstore 的头像
3D Scanstore5 个月前

Thank you! no this isn't flame this is our own topology / model.

r2 的头像
r25 个月前

well this is

TheAlchemyRoom 的头像
TheAlchemyRoom5 个月前

Woah 😭

Progen 的头像
Progen5 个月前

Is the image-to-3d construction available to try yet?🤔

3D Scanstore 的头像
3D Scanstore5 个月前

No I'm afraid not. We have a lot of work still to do :)

Progen 的头像
Progen5 个月前

any timeline on date of release?

3D Scanstore 的头像
3D Scanstore5 个月前

No I'm afraid not. It's very early in development.

Divesh Naidoo 的头像
Divesh Naidoo5 个月前

Amazing!

3D Scanstore 的头像
3D Scanstore5 个月前

Thank you!

Juan 的头像
Juan5 个月前

How ! 🔥🔥🔥😭

3D Scanstore 的头像
3D Scanstore5 个月前

A lot of work :)

HighLegion 的头像
HighLegion5 个月前

My first question - when is the tool coming out and what would it be priced at? (genuinely want to know on behalf of 3d artists around the globe)

3D Scanstore 的头像
3D Scanstore5 个月前

Im afraid thats not something were announcing at the moment.

Leo Phiêu Diêu 的头像
Leo Phiêu Diêu4 个月前

Can you train more AI based on images of people/AI who are smiling, showing their teeth shape and dimples? Thank you. @Ten_24

Thomas Halpin 的头像
Thomas Halpin5 个月前

Do these work with MetaHuman?

3D Scanstore 的头像
3D Scanstore5 个月前

It will do yes but thats not its intended use :) more on that later in development.

Risichad 🦾 的头像
Risichad 🦾5 个月前

RIP Metahuman

3D Scanstore 的头像
3D Scanstore5 个月前

ha ha not quite :) but thanks for the confidence boost :)

Yousef | Developer | e/acc 的头像
Yousef | Developer | e/acc5 个月前

Does it produce a mesh?

3D Scanstore 的头像
3D Scanstore5 个月前

yes a fully retopologised production ready mesh

Joshua Johnson 的头像
Joshua Johnson5 个月前

Yes, more pls. 🔥🔥🔥

Key Thirteenth 的头像
Key Thirteenth5 个月前

Wow!

3D Scanstore 的头像
3D Scanstore5 个月前

Cheers!

Macroblock 的头像
Macroblock5 个月前

So impressive! Does this build it with the standard topology you've established for all your scans?

3D Scanstore 的头像
3D Scanstore5 个月前

Thank you and yes indeed it does :)

Macroblock 的头像
Macroblock5 个月前

That's great, really looking forward to trying it out!

Womp 的头像
Womp5 个月前

🔥🔥🔥🔥🔥🔥🔥

3D Scanstore 的头像
3D Scanstore5 个月前

Thank you! 🤩

Bad Uncle 的头像
Bad Uncle5 个月前

What????!!!

hx1984 的头像
hx19845 个月前

amazing, great job bro

3D Scanstore 的头像
3D Scanstore5 个月前

Thank you!

peculiar ohwodiasa 的头像
peculiar ohwodiasa5 个月前

WIll there be a ten 24 to Blender pipeline ?

Sky 的头像
Sky5 个月前

wtf this is crazy

3D Scanstore 的头像
3D Scanstore5 个月前

Yeah it's been an insane project. Just scanning this many people has been a full time job for 20 people for the last 18 months.

Sky 的头像
Sky5 个月前

I know you said elsewhere this is still early stages, but are you able to feed it any image and have it create a model? Or only specifically curated ones? I’m dying to see what it would do with a photo of me hahaha

3D Scanstore 的头像
3D Scanstore5 个月前

Yes the goal is any image :)

A.Robot 的头像
A.Robot5 个月前

Making good progress! Still some issues with noses, and some random tattoos (LOL), but good first steps

3D Scanstore 的头像
3D Scanstore5 个月前

Thank you! Yes we're learning as we go. It would be a lot easier if we built on top of another model but we're committed to using all our own data. Totally clean, not scraped, and GDPR compliant. There's a lot still to do and we have so much more to add to this. We expect to see a 50 - 100 fold increase in quality over the next 12 months :)

Roderick Weise 的头像
Roderick Weise5 个月前

@100PercentRobot Where can I invest in the company and the tech? This is definitely going to explode for sure.

3D Scanstore 的头像
3D Scanstore5 个月前

@100PercentRobot Cheers Roberick! I'm afraid there are no investment opportunities at the moment.

相关视频

📢📢 𝐀𝐯𝐚𝐭𝟑𝐫 📢📢 Avat3r creates high-quality 3D head avatars from just a few input images in a single forward pass with a new dynamic 3DGS reconstruction model. Video: Project: Our core idea is to make Gaussian Reconstruction Models animatable. We find that a simple cross-attention to an expression code sequence is already sufficient to model complex facial expressions. We then incorporate position maps from DUSt3R and feature maps from Sapiens to facilitate the prediction task. While DUSt3R's position maps act as a pixel-aligned initialization for the Gaussians' positions, the Sapiens feature maps help the cross-view transformer to match corresponding image tokens in the 4 input images. One major challenge in creating a 3D head avatar from smartphone images comes from inconsistent facial expressions when the subject could not remain perfectly static during the capture. We eliminate this static requirement by simply showing our model input images with different facial expressions during training. This technique makes our model robust to inconsistent input images later on. Finally, we show that despite the model has been trained with 4 input images, one can even create a 3D head avatar when only a single image is available. To achieve this, we employ a pre-trained 3D GAN to lift the single image to 3D and then render the 4 input images for our model. This allows us to create 3D head avatars from single images and even highly out-of-distribution examples like AI generated faces, paintings or statues. Great work by Tobias Kirschstein from his internship at Meta with Javier Romero, Artem Sevastopolsky, and Shunsuke Saito

Matthias Niessner

74,818 次观看 • 1 年前