Загрузка видео...

Не удалось загрузить видео

На главную

Early R&D using our SP-6M dataset. Exploring image-to-3D reconstruction from single images, including heavily modified inputs (lighting, hair, etc). Still a work in progress.

53,370 просмотров • 5 месяцев назад •via X (Twitter)

Комментарии: 56

Фото профиля Toby VirtualFilmer
Toby VirtualFilmer5 месяцев назад

Oh my god. That… is… insanity. Currently all the ai image to 3d human services fail horribly 😂 but this could be the answer!

Фото профиля 3D Scanstore
3D Scanstore5 месяцев назад

Yep I know :) data and diversity are king when it comes to this kind of thing. We have over 7600 individual scans with 11 expressions each so around 80k scans across a hugely diverse group of people.

Фото профиля Vadim B
Vadim B5 месяцев назад

Very cool, can't wait, this is actually an amazing use of all your scanned data

Фото профиля 3D Scanstore
3D Scanstore5 месяцев назад

Cheers Vadim!

Фото профиля MR3D-Dev
MR3D-Dev5 месяцев назад

holy cow. Is this real?

Фото профиля 3D Scanstore
3D Scanstore5 месяцев назад

Yep! It's all we've been doing for the past 18 months. :)

Фото профиля Jscott
Jscott5 месяцев назад

Fucking fantastic dude. I dont even want to know what your compute bill looks like 😅

Фото профиля 3D Scanstore
3D Scanstore5 месяцев назад

Ha ha wait till I show you what we're using to train. We will show that soon.

Фото профиля Luciano Daluz
Luciano Daluz5 месяцев назад

It is too good to be true.

Фото профиля 3D Scanstore
3D Scanstore5 месяцев назад

Ha ha 🤣

Фото профиля Pierre Schiller
Pierre Schiller5 месяцев назад

This is fantastic! Are you training your own model? What about topology?

Фото профиля 3D Scanstore
3D Scanstore5 месяцев назад

Yep we're training our own model from scratch with all of our own data. Topology is production ready consistant morphable geometry with 8k textures. This is the dataset we created for it.

Фото профиля Pierre Schiller
Pierre Schiller5 месяцев назад

Instant sub. Way to go!!👍

Фото профиля racki
racki5 месяцев назад

where can I buy the alpha?

Фото профиля 3D Scanstore
3D Scanstore5 месяцев назад

It's way to early for this I'm afraid.

Фото профиля Anthony R. Risen
Anthony R. Risen5 месяцев назад

This is cool are you using flame smplx models with your textures overlayed? That’s pretty sweet!

Фото профиля 3D Scanstore
3D Scanstore5 месяцев назад

Thank you! no this isn't flame this is our own topology / model.

Фото профиля r2
r25 месяцев назад

well this is

Фото профиля TheAlchemyRoom
TheAlchemyRoom5 месяцев назад

Woah 😭

Фото профиля Progen
Progen5 месяцев назад

Is the image-to-3d construction available to try yet?🤔

Фото профиля 3D Scanstore
3D Scanstore5 месяцев назад

No I'm afraid not. We have a lot of work still to do :)

Фото профиля Progen
Progen5 месяцев назад

any timeline on date of release?

Фото профиля 3D Scanstore
3D Scanstore5 месяцев назад

No I'm afraid not. It's very early in development.

Фото профиля Divesh Naidoo
Divesh Naidoo5 месяцев назад

Amazing!

Фото профиля 3D Scanstore
3D Scanstore5 месяцев назад

Thank you!

Фото профиля Juan
Juan5 месяцев назад

How ! 🔥🔥🔥😭

Фото профиля 3D Scanstore
3D Scanstore5 месяцев назад

A lot of work :)

Фото профиля HighLegion
HighLegion5 месяцев назад

My first question - when is the tool coming out and what would it be priced at? (genuinely want to know on behalf of 3d artists around the globe)

Фото профиля 3D Scanstore
3D Scanstore5 месяцев назад

Im afraid thats not something were announcing at the moment.

Фото профиля Leo Phiêu Diêu
Leo Phiêu Diêu4 месяцев назад

Can you train more AI based on images of people/AI who are smiling, showing their teeth shape and dimples? Thank you. @Ten_24

Фото профиля Thomas Halpin
Thomas Halpin5 месяцев назад

Do these work with MetaHuman?

Фото профиля 3D Scanstore
3D Scanstore5 месяцев назад

It will do yes but thats not its intended use :) more on that later in development.

Фото профиля Risichad 🦾
Risichad 🦾5 месяцев назад

RIP Metahuman

Фото профиля 3D Scanstore
3D Scanstore5 месяцев назад

ha ha not quite :) but thanks for the confidence boost :)

Фото профиля Yousef | Developer | e/acc
Yousef | Developer | e/acc5 месяцев назад

Does it produce a mesh?

Фото профиля 3D Scanstore
3D Scanstore5 месяцев назад

yes a fully retopologised production ready mesh

Фото профиля Joshua Johnson
Joshua Johnson5 месяцев назад

Yes, more pls. 🔥🔥🔥

Фото профиля Key Thirteenth
Key Thirteenth5 месяцев назад

Wow!

Фото профиля 3D Scanstore
3D Scanstore5 месяцев назад

Cheers!

Фото профиля Macroblock
Macroblock5 месяцев назад

So impressive! Does this build it with the standard topology you've established for all your scans?

Фото профиля 3D Scanstore
3D Scanstore5 месяцев назад

Thank you and yes indeed it does :)

Фото профиля Macroblock
Macroblock5 месяцев назад

That's great, really looking forward to trying it out!

Фото профиля Womp
Womp5 месяцев назад

🔥🔥🔥🔥🔥🔥🔥

Фото профиля 3D Scanstore
3D Scanstore5 месяцев назад

Thank you! 🤩

Фото профиля Bad Uncle
Bad Uncle5 месяцев назад

What????!!!

Фото профиля hx1984
hx19845 месяцев назад

amazing, great job bro

Фото профиля 3D Scanstore
3D Scanstore5 месяцев назад

Thank you!

Фото профиля peculiar ohwodiasa
peculiar ohwodiasa5 месяцев назад

WIll there be a ten 24 to Blender pipeline ?

Фото профиля Sky
Sky5 месяцев назад

wtf this is crazy

Фото профиля 3D Scanstore
3D Scanstore5 месяцев назад

Yeah it's been an insane project. Just scanning this many people has been a full time job for 20 people for the last 18 months.

Фото профиля Sky
Sky5 месяцев назад

I know you said elsewhere this is still early stages, but are you able to feed it any image and have it create a model? Or only specifically curated ones? I’m dying to see what it would do with a photo of me hahaha

Фото профиля 3D Scanstore
3D Scanstore5 месяцев назад

Yes the goal is any image :)

Фото профиля A.Robot
A.Robot5 месяцев назад

Making good progress! Still some issues with noses, and some random tattoos (LOL), but good first steps

Фото профиля 3D Scanstore
3D Scanstore5 месяцев назад

Thank you! Yes we're learning as we go. It would be a lot easier if we built on top of another model but we're committed to using all our own data. Totally clean, not scraped, and GDPR compliant. There's a lot still to do and we have so much more to add to this. We expect to see a 50 - 100 fold increase in quality over the next 12 months :)

Фото профиля Roderick Weise
Roderick Weise5 месяцев назад

@100PercentRobot Where can I invest in the company and the tech? This is definitely going to explode for sure.

Фото профиля 3D Scanstore
3D Scanstore5 месяцев назад

@100PercentRobot Cheers Roberick! I'm afraid there are no investment opportunities at the moment.

Похожие видео

📢📢 𝐀𝐯𝐚𝐭𝟑𝐫 📢📢 Avat3r creates high-quality 3D head avatars from just a few input images in a single forward pass with a new dynamic 3DGS reconstruction model. Video: Project: Our core idea is to make Gaussian Reconstruction Models animatable. We find that a simple cross-attention to an expression code sequence is already sufficient to model complex facial expressions. We then incorporate position maps from DUSt3R and feature maps from Sapiens to facilitate the prediction task. While DUSt3R's position maps act as a pixel-aligned initialization for the Gaussians' positions, the Sapiens feature maps help the cross-view transformer to match corresponding image tokens in the 4 input images. One major challenge in creating a 3D head avatar from smartphone images comes from inconsistent facial expressions when the subject could not remain perfectly static during the capture. We eliminate this static requirement by simply showing our model input images with different facial expressions during training. This technique makes our model robust to inconsistent input images later on. Finally, we show that despite the model has been trained with 4 input images, one can even create a 3D head avatar when only a single image is available. To achieve this, we employ a pre-trained 3D GAN to lift the single image to 3D and then render the 4 input images for our model. This allows us to create 3D head avatars from single images and even highly out-of-distribution examples like AI generated faces, paintings or statues. Great work by Tobias Kirschstein from his internship at Meta with Javier Romero, Artem Sevastopolsky, and Shunsuke Saito

Matthias Niessner

74,818 просмотров • 1 год назад