Video yükleniyor...

Video Yüklenemedi

Ana Sayfaya Dön

Early R&D using our SP-6M dataset. Exploring image-to-3D reconstruction from single images, including heavily modified inputs (lighting, hair, etc). Still a work in progress.

53,370 görüntüleme • 5 ay önce •via X (Twitter)

56 Yorum

Toby VirtualFilmer profil fotoğrafı
Toby VirtualFilmer5 ay önce

Oh my god. That… is… insanity. Currently all the ai image to 3d human services fail horribly 😂 but this could be the answer!

3D Scanstore profil fotoğrafı
3D Scanstore5 ay önce

Yep I know :) data and diversity are king when it comes to this kind of thing. We have over 7600 individual scans with 11 expressions each so around 80k scans across a hugely diverse group of people.

Vadim B profil fotoğrafı
Vadim B5 ay önce

Very cool, can't wait, this is actually an amazing use of all your scanned data

3D Scanstore profil fotoğrafı
3D Scanstore5 ay önce

Cheers Vadim!

MR3D-Dev profil fotoğrafı
MR3D-Dev5 ay önce

holy cow. Is this real?

3D Scanstore profil fotoğrafı
3D Scanstore5 ay önce

Yep! It's all we've been doing for the past 18 months. :)

Jscott profil fotoğrafı
Jscott5 ay önce

Fucking fantastic dude. I dont even want to know what your compute bill looks like 😅

3D Scanstore profil fotoğrafı
3D Scanstore5 ay önce

Ha ha wait till I show you what we're using to train. We will show that soon.

Luciano Daluz profil fotoğrafı
Luciano Daluz5 ay önce

It is too good to be true.

3D Scanstore profil fotoğrafı
3D Scanstore5 ay önce

Ha ha 🤣

Pierre Schiller profil fotoğrafı
Pierre Schiller5 ay önce

This is fantastic! Are you training your own model? What about topology?

3D Scanstore profil fotoğrafı
3D Scanstore5 ay önce

Yep we're training our own model from scratch with all of our own data. Topology is production ready consistant morphable geometry with 8k textures. This is the dataset we created for it.

Pierre Schiller profil fotoğrafı
Pierre Schiller5 ay önce

Instant sub. Way to go!!👍

racki profil fotoğrafı
racki5 ay önce

where can I buy the alpha?

3D Scanstore profil fotoğrafı
3D Scanstore5 ay önce

It's way to early for this I'm afraid.

Anthony R. Risen profil fotoğrafı
Anthony R. Risen5 ay önce

This is cool are you using flame smplx models with your textures overlayed? That’s pretty sweet!

3D Scanstore profil fotoğrafı
3D Scanstore5 ay önce

Thank you! no this isn't flame this is our own topology / model.

r2 profil fotoğrafı
r25 ay önce

well this is

TheAlchemyRoom profil fotoğrafı
TheAlchemyRoom5 ay önce

Woah 😭

Progen profil fotoğrafı
Progen5 ay önce

Is the image-to-3d construction available to try yet?🤔

3D Scanstore profil fotoğrafı
3D Scanstore5 ay önce

No I'm afraid not. We have a lot of work still to do :)

Progen profil fotoğrafı
Progen5 ay önce

any timeline on date of release?

3D Scanstore profil fotoğrafı
3D Scanstore5 ay önce

No I'm afraid not. It's very early in development.

Divesh Naidoo profil fotoğrafı
Divesh Naidoo5 ay önce

Amazing!

3D Scanstore profil fotoğrafı
3D Scanstore5 ay önce

Thank you!

Juan profil fotoğrafı
Juan5 ay önce

How ! 🔥🔥🔥😭

3D Scanstore profil fotoğrafı
3D Scanstore5 ay önce

A lot of work :)

HighLegion profil fotoğrafı
HighLegion5 ay önce

My first question - when is the tool coming out and what would it be priced at? (genuinely want to know on behalf of 3d artists around the globe)

3D Scanstore profil fotoğrafı
3D Scanstore5 ay önce

Im afraid thats not something were announcing at the moment.

Leo Phiêu Diêu profil fotoğrafı
Leo Phiêu Diêu4 ay önce

Can you train more AI based on images of people/AI who are smiling, showing their teeth shape and dimples? Thank you. @Ten_24

Thomas Halpin profil fotoğrafı
Thomas Halpin5 ay önce

Do these work with MetaHuman?

3D Scanstore profil fotoğrafı
3D Scanstore5 ay önce

It will do yes but thats not its intended use :) more on that later in development.

Risichad 🦾 profil fotoğrafı
Risichad 🦾5 ay önce

RIP Metahuman

3D Scanstore profil fotoğrafı
3D Scanstore5 ay önce

ha ha not quite :) but thanks for the confidence boost :)

Yousef | Developer | e/acc profil fotoğrafı
Yousef | Developer | e/acc5 ay önce

Does it produce a mesh?

3D Scanstore profil fotoğrafı
3D Scanstore5 ay önce

yes a fully retopologised production ready mesh

Joshua Johnson profil fotoğrafı
Joshua Johnson5 ay önce

Yes, more pls. 🔥🔥🔥

Key Thirteenth profil fotoğrafı
Key Thirteenth5 ay önce

Wow!

3D Scanstore profil fotoğrafı
3D Scanstore5 ay önce

Cheers!

Macroblock profil fotoğrafı
Macroblock5 ay önce

So impressive! Does this build it with the standard topology you've established for all your scans?

3D Scanstore profil fotoğrafı
3D Scanstore5 ay önce

Thank you and yes indeed it does :)

Macroblock profil fotoğrafı
Macroblock5 ay önce

That's great, really looking forward to trying it out!

Womp profil fotoğrafı
Womp5 ay önce

🔥🔥🔥🔥🔥🔥🔥

3D Scanstore profil fotoğrafı
3D Scanstore5 ay önce

Thank you! 🤩

Bad Uncle profil fotoğrafı
Bad Uncle5 ay önce

What????!!!

hx1984 profil fotoğrafı
hx19845 ay önce

amazing, great job bro

3D Scanstore profil fotoğrafı
3D Scanstore5 ay önce

Thank you!

peculiar ohwodiasa profil fotoğrafı
peculiar ohwodiasa5 ay önce

WIll there be a ten 24 to Blender pipeline ?

Sky profil fotoğrafı
Sky5 ay önce

wtf this is crazy

3D Scanstore profil fotoğrafı
3D Scanstore5 ay önce

Yeah it's been an insane project. Just scanning this many people has been a full time job for 20 people for the last 18 months.

Sky profil fotoğrafı
Sky5 ay önce

I know you said elsewhere this is still early stages, but are you able to feed it any image and have it create a model? Or only specifically curated ones? I’m dying to see what it would do with a photo of me hahaha

3D Scanstore profil fotoğrafı
3D Scanstore5 ay önce

Yes the goal is any image :)

A.Robot profil fotoğrafı
A.Robot5 ay önce

Making good progress! Still some issues with noses, and some random tattoos (LOL), but good first steps

3D Scanstore profil fotoğrafı
3D Scanstore5 ay önce

Thank you! Yes we're learning as we go. It would be a lot easier if we built on top of another model but we're committed to using all our own data. Totally clean, not scraped, and GDPR compliant. There's a lot still to do and we have so much more to add to this. We expect to see a 50 - 100 fold increase in quality over the next 12 months :)

Roderick Weise profil fotoğrafı
Roderick Weise5 ay önce

@100PercentRobot Where can I invest in the company and the tech? This is definitely going to explode for sure.

3D Scanstore profil fotoğrafı
3D Scanstore5 ay önce

@100PercentRobot Cheers Roberick! I'm afraid there are no investment opportunities at the moment.

Benzer Videolar

📢📢 𝐀𝐯𝐚𝐭𝟑𝐫 📢📢 Avat3r creates high-quality 3D head avatars from just a few input images in a single forward pass with a new dynamic 3DGS reconstruction model. Video: Project: Our core idea is to make Gaussian Reconstruction Models animatable. We find that a simple cross-attention to an expression code sequence is already sufficient to model complex facial expressions. We then incorporate position maps from DUSt3R and feature maps from Sapiens to facilitate the prediction task. While DUSt3R's position maps act as a pixel-aligned initialization for the Gaussians' positions, the Sapiens feature maps help the cross-view transformer to match corresponding image tokens in the 4 input images. One major challenge in creating a 3D head avatar from smartphone images comes from inconsistent facial expressions when the subject could not remain perfectly static during the capture. We eliminate this static requirement by simply showing our model input images with different facial expressions during training. This technique makes our model robust to inconsistent input images later on. Finally, we show that despite the model has been trained with 4 input images, one can even create a 3D head avatar when only a single image is available. To achieve this, we employ a pre-trained 3D GAN to lift the single image to 3D and then render the 4 input images for our model. This allows us to create 3D head avatars from single images and even highly out-of-distribution examples like AI generated faces, paintings or statues. Great work by Tobias Kirschstein from his internship at Meta with Javier Romero, Artem Sevastopolsky, and Shunsuke Saito

Matthias Niessner

74,818 görüntüleme • 1 yıl önce