正在加载视频...

视频加载失败

加载此视频时出现问题。这可能是由于临时网络问题，或视频可能不可用。

🌟 Create anything in 3D! 🌟 Introducing CAT3D: a new method that generates high-fidelity 3D scenes from any number of real or generated images in one minute, powered by multi-view diffusion models. w/ lovely coauthors Aleksander Holynski, Ben Poole and an amazing team!

Ruiqi Gao

12,183 subscribers

152,867 次观看 • 2 年前 •via X (Twitter)

科学技术新闻政治教育

Anya Rossi• Live Now

Private livecam show

10 条评论

Ruiqi Gao 的头像

Ruiqi Gao2 年前

Website: Paper: Also, check out our gallery for hundreds of diverse generated 3D scenes!

Ruiqi Gao 的头像

Ruiqi Gao2 年前

CAT3D uses a multi-view diffusion model to synthesize a large set of consistent novel views from the input image(s). These views are then used to reconstruct a detailed 3D scene using robust reconstruction methods.

Ruiqi Gao 的头像

Ruiqi Gao2 年前

CAT3D can create entire 3D scenes in as little as one minute! ⚡ Plus, it achieves state-of-the-art performance for few-view 3D reconstruction.

Ruiqi Gao 的头像

Ruiqi Gao2 年前

Big shout out to the incredible team: @holynski_ @philipphenzler @ArthurBrussee @rmbrualla @_pratul_ @jon_barron @poolio

Ruiqi Gao 的头像

Ruiqi Gao2 年前

We are also sincerely thankful to @shlomifruchter, @sirbayes, @babaeizadeh, @Han_Zhang_ and Amir Hertz for training the base text-to-image model that supports our work!

Durk Kingma 的头像

Durk Kingma2 年前

@holynski_ @poolio Congrats, great work!

Ruiqi Gao 的头像

Ruiqi Gao2 年前

@holynski_ @poolio Thanks Durk! ☺️

Abubakar Abid 的头像

Abubakar Abid2 年前

@holynski_ @poolio So cool! @Gradio demo when ;)

Rundi Wu 的头像

Rundi Wu2 年前

@holynski_ @poolio Amazing results!!! Congrats!

Dejia Xu 的头像

Dejia Xu2 年前

@holynski_ @poolio Congrats! Amazing results!

相关视频

Check out CAT3D! Image(s)-to-3D in 1 minute! Given any number of real or generated images, CAT3D uses a multi-view diffusion prior to create consistent novel views. These views are used to reconstruct a 3D scene using NeRF/3DGS.

Check out CAT3D! Image(s)-to-3D in 1 minute! Given any number of real or generated images, CAT3D uses a multi-view diffusion prior to create consistent novel views. These views are used to reconstruct a 3D scene using NeRF/3DGS.

Philipp Henzler

12,737 次观看 • 2 年前

🔥 New Feature: Multi-View Images in One Click! 🎨 Turn text/image → consistent multi-views (powered by Flux Kontext) → high-accuracy 3D models in seconds! 🚀 Boost your 3D workflow today:

🔥 New Feature: Multi-View Images in One Click! 🎨 Turn text/image → consistent multi-views (powered by Flux Kontext) → high-accuracy 3D models in seconds! 🚀 Boost your 3D workflow today:

MeshyAI

10,429 次观看 • 11 个月前

⚡️ Introducing Bolt3D ⚡️ Bolt3D generates interactive 3D scenes in less than 7 seconds on a single GPU from one or more images. It features a latent diffusion model that *directly* generates 3D Gaussians of seen and unseen regions, without any test time optimization. 🧵👇 (1/9)

⚡️ Introducing Bolt3D ⚡️ Bolt3D generates interactive 3D scenes in less than 7 seconds on a single GPU from one or more images. It features a latent diffusion model that directly generates 3D Gaussians of seen and unseen regions, without any test time optimization. 🧵👇 (1/9)

Stan Szymanowicz @ CVPR26

125,813 次观看 • 1 年前

Excited to share ReconFusion! 3D reconstruction of real-world scenes from only a few photos, powered by diffusion priors: w/ amazing team Rundi Wu Ben Mildenhall Philipp Henzler Keunhong Park Ruiqi Gao Daniel Watson Pratul Srinivasan Dor Verbin Jon Barron Ben Poole

Excited to share ReconFusion! 3D reconstruction of real-world scenes from only a few photos, powered by diffusion priors: w/ amazing team Rundi Wu Ben Mildenhall Philipp Henzler Keunhong Park Ruiqi Gao Daniel Watson Pratul Srinivasan Dor Verbin Jon Barron Ben Poole

Aleksander Holynski

87,471 次观看 • 2 年前

This is amazing! You can now create high-quality 3D Scenes from a single image using Multi-Instance Diffusion Models (MIDI) 🔥

This is amazing! You can now create high-quality 3D Scenes from a single image using Multi-Instance Diffusion Models (MIDI) 🔥

Gradio

41,770 次观看 • 1 年前

Upload single or multi-view images to ComfyUI’s HY 3D 3.0 nodes for high-fidelity 3D assets—from product displays to game dev, done in minutes!

Upload single or multi-view images to ComfyUI’s HY 3D 3.0 nodes for high-fidelity 3D assets—from product displays to game dev, done in minutes!

ComfyUI

25,153 次观看 • 1 个月前

Adobe is entering the image-to-3D game! Their new method, LRM, can create high-fidelity 3D meshes from a single image in just 5 seconds 🔥 It's trained on 1 million objects and is able to generate objects from real-world images and generative AI models.

Adobe is entering the image-to-3D game! Their new method, LRM, can create high-fidelity 3D meshes from a single image in just 5 seconds 🔥 It's trained on 1 million objects and is able to generate objects from real-world images and generative AI models.

Dreaming Tulpa 🥓👑

270,918 次观看 • 2 年前

Skyfall-GS: Synthesizing Immersive 3D Urban Scenes from Satellite Imagery TL;DR: Skyfall-GS converts satellite images to explorable 3D urban scenes using diffusion models, with real-time rendering performance. Contributions: • We introduce Skyfall-GS, the first method to synthesize immersive, real-time, free-flight navigable 3D urban scenes solely from multi-view satellite imagery using generative refinement. • An open-domain refinement approach leverages pre-trained text-to-image diffusion models without domain-specific training. • A curriculum-learning-based iterative refinement strategy progressively enhances reconstruction quality from higher to lower viewpoints, significantly improving visual fidelity in occluded areas.

Skyfall-GS: Synthesizing Immersive 3D Urban Scenes from Satellite Imagery TL;DR: Skyfall-GS converts satellite images to explorable 3D urban scenes using diffusion models, with real-time rendering performance. Contributions: • We introduce Skyfall-GS, the first method to synthesize immersive, real-time, free-flight navigable 3D urban scenes solely from multi-view satellite imagery using generative refinement. • An open-domain refinement approach leverages pre-trained text-to-image diffusion models without domain-specific training. • A curriculum-learning-based iterative refinement strategy progressively enhances reconstruction quality from higher to lower viewpoints, significantly improving visual fidelity in occluded areas.

MrNeRF

66,058 次观看 • 7 个月前

Introducing Cube 2.0, a significant step towards controllable 3D game-world and video generation from any input. Powered by: 🌟 Image-to-3D in seconds w/ a new foundation model 🐎 Text-to-animation 🌎 AI rendering to create beautiful worlds (mesh+splats) Web app → Discord → Blog →

Introducing Cube 2.0, a significant step towards controllable 3D game-world and video generation from any input. Powered by: 🌟 Image-to-3D in seconds w/ a new foundation model 🐎 Text-to-animation 🌎 AI rendering to create beautiful worlds (mesh+splats) Web app → Discord → Blog →

Common Sense Machines

411,366 次观看 • 2 年前

Current 3D generative models are slow and low quality. We present GRM, a large-scale model that reconstructs 3D Gaussians in 0.1s and generates high-quality 3D assets from text or single images in a few seconds. Demo: 1/4

Current 3D generative models are slow and low quality. We present GRM, a large-scale model that reconstructs 3D Gaussians in 0.1s and generates high-quality 3D assets from text or single images in a few seconds. Demo: 1/4

Gordon Wetzstein

19,189 次观看 • 2 年前

Guidance on top of diffusion models can now be used to drag and manipulate images, create pose-conditioned images, and so much more! Check out Readout Guidance: Work w/ trevordarrell, Oliver Wang, Dan Goldman, Aleksander Holynski. More in thread 🧵.

Guidance on top of diffusion models can now be used to drag and manipulate images, create pose-conditioned images, and so much more! Check out Readout Guidance: Work w/ trevordarrell, Oliver Wang, Dan Goldman, Aleksander Holynski. More in thread 🧵.

Grace Luo

42,698 次观看 • 2 年前

MVDream: Multi-view Diffusion for 3D Generation paper page: propose MVDream, a multi-view diffusion model that is able to generate geometrically consistent multi-view images from a given text prompt. By leveraging image diffusion models pre-trained on large-scale web datasets and a multi-view dataset rendered from 3D assets, the resulting multi-view diffusion model can achieve both the generalizability of 2D diffusion and the consistency of 3D data. Such a model can thus be applied as a multi-view prior for 3D generation via Score Distillation Sampling, where it greatly improves the stability of existing 2D-lifting methods by solving the 3D consistency problem. Finally, we show that the multi-view diffusion model can also be fine-tuned under a few shot setting for personalized 3D generation, i.e. DreamBooth3D application, where the consistency can be maintained after learning the subject identity.

MVDream: Multi-view Diffusion for 3D Generation paper page: propose MVDream, a multi-view diffusion model that is able to generate geometrically consistent multi-view images from a given text prompt. By leveraging image diffusion models pre-trained on large-scale web datasets and a multi-view dataset rendered from 3D assets, the resulting multi-view diffusion model can achieve both the generalizability of 2D diffusion and the consistency of 3D data. Such a model can thus be applied as a multi-view prior for 3D generation via Score Distillation Sampling, where it greatly improves the stability of existing 2D-lifting methods by solving the 3D consistency problem. Finally, we show that the multi-view diffusion model can also be fine-tuned under a few shot setting for personalized 3D generation, i.e. DreamBooth3D application, where the consistency can be maintained after learning the subject identity.

AK

294,442 次观看 • 2 年前

Quickly create real-time dance content that you can choose to use directly for virtual live streaming or interactive experiences in VR. All it takes is capturing with a webcam, powered by an AI-generated 3D motion solution. 3D models from Warudo @ Hakuya Labs

Quickly create real-time dance content that you can choose to use directly for virtual live streaming or interactive experiences in VR. All it takes is capturing with a webcam, powered by an AI-generated 3D motion solution. 3D models from Warudo @ Hakuya Labs

CYANPUPPETS

16,462 次观看 • 2 年前

Self-Forcing++ for minute-scale video generation ByteDance's new method generates high-quality videos up to 4 min 15 sec! It scales diffusion models without long-video teachers or retraining, preserving fidelity and consistency.

Self-Forcing++ for minute-scale video generation ByteDance's new method generates high-quality videos up to 4 min 15 sec! It scales diffusion models without long-video teachers or retraining, preserving fidelity and consistency.

DailyPapers

17,720 次观看 • 8 个月前

Google presents CAT4D Create Anything in 4D with Multi-View Video Diffusion Models

Google presents CAT4D Create Anything in 4D with Multi-View Video Diffusion Models

AK

61,949 次观看 • 1 年前

Excited to share our work on Neural Assets: a new method for enabling 3D asset-level control in image diffusion models – scalable & without any 3D inductive biases. Neural Assets goes beyond text or pixel-based control & provides an interface inspired by 3D graphics tools. 🧵

Excited to share our work on Neural Assets: a new method for enabling 3D asset-level control in image diffusion models – scalable & without any 3D inductive biases. Neural Assets goes beyond text or pixel-based control & provides an interface inspired by 3D graphics tools. 🧵

Thomas Kipf

97,924 次观看 • 2 年前

Introducing Stable Virtual Camera: This multi-view diffusion model transforms 2D images into immersive 3D videos with realistic depth and perspective—without complex reconstruction or scene-specific optimization.

Introducing Stable Virtual Camera: This multi-view diffusion model transforms 2D images into immersive 3D videos with realistic depth and perspective—without complex reconstruction or scene-specific optimization.

Stability AI

197,203 次观看 • 1 年前

Nvidia presents Edify 3D! The method can generate high-quality 3D assets from text descriptions. It uses a diffusion model to create detailed quad-mesh topologies and high-resolution textures in under 2 minutes.

Nvidia presents Edify 3D! The method can generate high-quality 3D assets from text descriptions. It uses a diffusion model to create detailed quad-mesh topologies and high-resolution textures in under 2 minutes.

Dreaming Tulpa 🥓👑

39,338 次观看 • 1 年前