Video wird geladen...

Video konnte nicht geladen werden

Zur Startseite

🌟 Create anything in 3D! 🌟 Introducing CAT3D: a new method that generates high-fidelity 3D scenes from any number of real or generated images in one minute, powered by multi-view diffusion models. w/ lovely coauthors Aleksander Holynski, Ben Poole and an amazing team!

RuiqiGao's profile picture

Ruiqi Gao

12,183 subscribers

152,867 Aufrufe • vor 2 Jahren •via X (Twitter)

Wissenschaft & TechnologieNachrichten & PolitikBildung
LIVE

Anya Rossi• Live Now

Private livecam show

10 Kommentare

Profilbild von Ruiqi Gao
Ruiqi Gaovor 2 Jahren

Website: Paper: Also, check out our gallery for hundreds of diverse generated 3D scenes!

Profilbild von Ruiqi Gao
Ruiqi Gaovor 2 Jahren

CAT3D uses a multi-view diffusion model to synthesize a large set of consistent novel views from the input image(s). These views are then used to reconstruct a detailed 3D scene using robust reconstruction methods.

Profilbild von Ruiqi Gao
Ruiqi Gaovor 2 Jahren

CAT3D can create entire 3D scenes in as little as one minute! ⚡ Plus, it achieves state-of-the-art performance for few-view 3D reconstruction.

Profilbild von Ruiqi Gao
Ruiqi Gaovor 2 Jahren

Big shout out to the incredible team: @holynski_ @philipphenzler @ArthurBrussee @rmbrualla @_pratul_ @jon_barron @poolio

Profilbild von Ruiqi Gao
Ruiqi Gaovor 2 Jahren

We are also sincerely thankful to @shlomifruchter, @sirbayes, @babaeizadeh, @Han_Zhang_ and Amir Hertz for training the base text-to-image model that supports our work!

Profilbild von Durk Kingma
Durk Kingmavor 2 Jahren

@holynski_ @poolio Congrats, great work!

Profilbild von Ruiqi Gao
Ruiqi Gaovor 2 Jahren

@holynski_ @poolio Thanks Durk! ☺️

Profilbild von Abubakar Abid
Abubakar Abidvor 2 Jahren

@holynski_ @poolio So cool! @Gradio demo when ;)

Profilbild von Rundi Wu
Rundi Wuvor 2 Jahren

@holynski_ @poolio Amazing results!!! Congrats!

Profilbild von Dejia Xu
Dejia Xuvor 2 Jahren

@holynski_ @poolio Congrats! Amazing results!

Ähnliche Videos

Check out CAT3D! Image(s)-to-3D in 1 minute! Given any number of real or generated images, CAT3D uses a multi-view diffusion prior to create consistent novel views. These views are used to reconstruct a 3D scene using NeRF/3DGS.
0:38

Check out CAT3D! Image(s)-to-3D in 1 minute! Given any number of real or generated images, CAT3D uses a multi-view diffusion prior to create consistent novel views. These views are used to reconstruct a 3D scene using NeRF/3DGS.

Philipp Henzler

12,737 Aufrufe • vor 2 Jahren

🔥 New Feature: Multi-View Images in One Click! 🎨 Turn text/image → consistent multi-views (powered by Flux Kontext) → high-accuracy 3D models in seconds! 🚀 Boost your 3D workflow today:
0:57

🔥 New Feature: Multi-View Images in One Click! 🎨 Turn text/image → consistent multi-views (powered by Flux Kontext) → high-accuracy 3D models in seconds! 🚀 Boost your 3D workflow today:

MeshyAI

10,429 Aufrufe • vor 11 Monaten

⚡️ Introducing Bolt3D ⚡️ Bolt3D generates interactive 3D scenes in less than 7 seconds on a single GPU from one or more images. It features a latent diffusion model that *directly* generates 3D Gaussians of seen and unseen regions, without any test time optimization. 🧵👇 (1/9)
0:20

⚡️ Introducing Bolt3D ⚡️ Bolt3D generates interactive 3D scenes in less than 7 seconds on a single GPU from one or more images. It features a latent diffusion model that *directly* generates 3D Gaussians of seen and unseen regions, without any test time optimization. 🧵👇 (1/9)

Stan Szymanowicz @ CVPR26

125,813 Aufrufe • vor 1 Jahr

Excited to share ReconFusion! 3D reconstruction of real-world scenes from only a few photos, powered by diffusion priors: w/ amazing team Rundi Wu Ben Mildenhall Philipp Henzler Keunhong Park Ruiqi Gao Daniel Watson Pratul Srinivasan Dor Verbin Jon Barron Ben Poole
0:24

Excited to share ReconFusion! 3D reconstruction of real-world scenes from only a few photos, powered by diffusion priors: w/ amazing team Rundi Wu Ben Mildenhall Philipp Henzler Keunhong Park Ruiqi Gao Daniel Watson Pratul Srinivasan Dor Verbin Jon Barron Ben Poole

Aleksander Holynski

87,471 Aufrufe • vor 2 Jahren

This is amazing! You can now create high-quality 3D Scenes from a single image using Multi-Instance Diffusion Models (MIDI) 🔥
0:43

This is amazing! You can now create high-quality 3D Scenes from a single image using Multi-Instance Diffusion Models (MIDI) 🔥

Gradio

41,770 Aufrufe • vor 1 Jahr

Upload single or multi-view images to ComfyUI’s HY 3D 3.0 nodes for high-fidelity 3D assets—from product displays to game dev, done in minutes!
0:24

Upload single or multi-view images to ComfyUI’s HY 3D 3.0 nodes for high-fidelity 3D assets—from product displays to game dev, done in minutes!

ComfyUI

25,153 Aufrufe • vor 1 Monat

Adobe is entering the image-to-3D game! Their new method, LRM, can create high-fidelity 3D meshes from a single image in just 5 seconds 🔥 It's trained on 1 million objects and is able to generate objects from real-world images and generative AI models.
0:28

Adobe is entering the image-to-3D game! Their new method, LRM, can create high-fidelity 3D meshes from a single image in just 5 seconds 🔥 It's trained on 1 million objects and is able to generate objects from real-world images and generative AI models.

Dreaming Tulpa 🥓👑

270,918 Aufrufe • vor 2 Jahren

Skyfall-GS: Synthesizing Immersive 3D Urban Scenes from Satellite Imagery TL;DR: Skyfall-GS converts satellite images to explorable 3D urban scenes using diffusion models, with real-time rendering performance. Contributions: • We introduce Skyfall-GS, the first method to synthesize immersive, real-time, free-flight navigable 3D urban scenes solely from multi-view satellite imagery using generative refinement. • An open-domain refinement approach leverages pre-trained text-to-image diffusion models without domain-specific training. • A curriculum-learning-based iterative refinement strategy progressively enhances reconstruction quality from higher to lower viewpoints, significantly improving visual fidelity in occluded areas.
1:05

Skyfall-GS: Synthesizing Immersive 3D Urban Scenes from Satellite Imagery TL;DR: Skyfall-GS converts satellite images to explorable 3D urban scenes using diffusion models, with real-time rendering performance. Contributions: • We introduce Skyfall-GS, the first method to synthesize immersive, real-time, free-flight navigable 3D urban scenes solely from multi-view satellite imagery using generative refinement. • An open-domain refinement approach leverages pre-trained text-to-image diffusion models without domain-specific training. • A curriculum-learning-based iterative refinement strategy progressively enhances reconstruction quality from higher to lower viewpoints, significantly improving visual fidelity in occluded areas.

MrNeRF

66,058 Aufrufe • vor 7 Monaten

Introducing Cube 2.0, a significant step towards controllable 3D game-world and video generation from any input. Powered by: 🌟 Image-to-3D in seconds w/ a new foundation model 🐎 Text-to-animation 🌎 AI rendering to create beautiful worlds (mesh+splats) Web app → Discord → Blog →
1:11

Introducing Cube 2.0, a significant step towards controllable 3D game-world and video generation from any input. Powered by: 🌟 Image-to-3D in seconds w/ a new foundation model 🐎 Text-to-animation 🌎 AI rendering to create beautiful worlds (mesh+splats) Web app → Discord → Blog →

Common Sense Machines

411,366 Aufrufe • vor 2 Jahren

Current 3D generative models are slow and low quality. We present GRM, a large-scale model that reconstructs 3D Gaussians in 0.1s and generates high-quality 3D assets from text or single images in a few seconds. Demo: 1/4
0:37

Current 3D generative models are slow and low quality. We present GRM, a large-scale model that reconstructs 3D Gaussians in 0.1s and generates high-quality 3D assets from text or single images in a few seconds. Demo: 1/4

Gordon Wetzstein

19,189 Aufrufe • vor 2 Jahren

Guidance on top of diffusion models can now be used to drag and manipulate images, create pose-conditioned images, and so much more! Check out Readout Guidance: Work w/ trevordarrell, Oliver Wang, Dan Goldman, Aleksander Holynski. More in thread 🧵.
0:20

Guidance on top of diffusion models can now be used to drag and manipulate images, create pose-conditioned images, and so much more! Check out Readout Guidance: Work w/ trevordarrell, Oliver Wang, Dan Goldman, Aleksander Holynski. More in thread 🧵.

Grace Luo

42,698 Aufrufe • vor 2 Jahren

MVDream: Multi-view Diffusion for 3D Generation paper page: propose MVDream, a multi-view diffusion model that is able to generate geometrically consistent multi-view images from a given text prompt. By leveraging image diffusion models pre-trained on large-scale web datasets and a multi-view dataset rendered from 3D assets, the resulting multi-view diffusion model can achieve both the generalizability of 2D diffusion and the consistency of 3D data. Such a model can thus be applied as a multi-view prior for 3D generation via Score Distillation Sampling, where it greatly improves the stability of existing 2D-lifting methods by solving the 3D consistency problem. Finally, we show that the multi-view diffusion model can also be fine-tuned under a few shot setting for personalized 3D generation, i.e. DreamBooth3D application, where the consistency can be maintained after learning the subject identity.
0:44

MVDream: Multi-view Diffusion for 3D Generation paper page: propose MVDream, a multi-view diffusion model that is able to generate geometrically consistent multi-view images from a given text prompt. By leveraging image diffusion models pre-trained on large-scale web datasets and a multi-view dataset rendered from 3D assets, the resulting multi-view diffusion model can achieve both the generalizability of 2D diffusion and the consistency of 3D data. Such a model can thus be applied as a multi-view prior for 3D generation via Score Distillation Sampling, where it greatly improves the stability of existing 2D-lifting methods by solving the 3D consistency problem. Finally, we show that the multi-view diffusion model can also be fine-tuned under a few shot setting for personalized 3D generation, i.e. DreamBooth3D application, where the consistency can be maintained after learning the subject identity.

AK

294,442 Aufrufe • vor 2 Jahren

Quickly create real-time dance content that you can choose to use directly for virtual live streaming or interactive experiences in VR. All it takes is capturing with a webcam, powered by an AI-generated 3D motion solution. 3D models from Warudo @ Hakuya Labs
1:29

Quickly create real-time dance content that you can choose to use directly for virtual live streaming or interactive experiences in VR. All it takes is capturing with a webcam, powered by an AI-generated 3D motion solution. 3D models from Warudo @ Hakuya Labs

CYANPUPPETS

16,462 Aufrufe • vor 2 Jahren

Self-Forcing++ for minute-scale video generation ByteDance's new method generates high-quality videos up to 4 min 15 sec! It scales diffusion models without long-video teachers or retraining, preserving fidelity and consistency.
1:40

Self-Forcing++ for minute-scale video generation ByteDance's new method generates high-quality videos up to 4 min 15 sec! It scales diffusion models without long-video teachers or retraining, preserving fidelity and consistency.

DailyPapers

17,720 Aufrufe • vor 8 Monaten

Google presents CAT4D Create Anything in 4D with Multi-View Video Diffusion Models
2:12

Google presents CAT4D Create Anything in 4D with Multi-View Video Diffusion Models

AK

61,949 Aufrufe • vor 1 Jahr

Excited to share our work on Neural Assets: a new method for enabling 3D asset-level control in image diffusion models – scalable & without any 3D inductive biases. Neural Assets goes beyond text or pixel-based control & provides an interface inspired by 3D graphics tools. 🧵
0:30

Excited to share our work on Neural Assets: a new method for enabling 3D asset-level control in image diffusion models – scalable & without any 3D inductive biases. Neural Assets goes beyond text or pixel-based control & provides an interface inspired by 3D graphics tools. 🧵

Thomas Kipf

97,924 Aufrufe • vor 2 Jahren

Introducing Stable Virtual Camera: This multi-view diffusion model transforms 2D images into immersive 3D videos with realistic depth and perspective—without complex reconstruction or scene-specific optimization.
0:39

Introducing Stable Virtual Camera: This multi-view diffusion model transforms 2D images into immersive 3D videos with realistic depth and perspective—without complex reconstruction or scene-specific optimization.

Stability AI

197,203 Aufrufe • vor 1 Jahr

Nvidia presents Edify 3D! The method can generate high-quality 3D assets from text descriptions. It uses a diffusion model to create detailed quad-mesh topologies and high-resolution textures in under 2 minutes.
0:43

Nvidia presents Edify 3D! The method can generate high-quality 3D assets from text descriptions. It uses a diffusion model to create detailed quad-mesh topologies and high-resolution textures in under 2 minutes.

Dreaming Tulpa 🥓👑

39,338 Aufrufe • vor 1 Jahr