正在加载视频...

视频加载失败

返回首页

SceneDreamer: Unbounded 3D Scene Generation from 2D Image Collections abs: project page:

_akhaliq's profile picture

AK

503,464 subscribers

317,619 次观看 • 3 年前 •via X (Twitter)

科学技术
LIVE

Anya Rossi• Live Now

Private livecam show

8 条评论

Alex Leiva 的头像
Alex Leiva3 年前

I'm doing this for Unreal Engine 5 but one biome at the time. I'll study their framework to see if I can implement it in my version. I should aslo put together a paper at some point

ajinkya 的头像
ajinkya3 年前

This reminded me of the Mandalorian show VFX breakdown: green screens just might disappear in a couple of years.

Bobcat 的头像
Bobcat3 年前

👀

Max 的头像
Max3 年前

🔥

Haitao Xiao 的头像
Haitao Xiao3 年前

😋

Ryan 的头像
Ryan3 年前

@SmokeAwayyy

Steve Mills 的头像
Steve Mills2 年前

This

Perttu Hämäläinen 的头像
Perttu Hämäläinen2 年前

Thanks for linking the original sources instead of a HF page! Reduces friction and makes your content much more repostable.

相关视频

3D-aware Conditional Image Synthesis abs: project page:
0:34

3D-aware Conditional Image Synthesis abs: project page:

AK

301,457 次观看 • 3 年前

Make-It-3D: High-Fidelity 3D Creation from A Single Image with Diffusion Prior abs: project page:
0:22

Make-It-3D: High-Fidelity 3D Creation from A Single Image with Diffusion Prior abs: project page:

AK

163,868 次观看 • 3 年前

Expressive Text-to-Image Generation with Rich Text abs: project page:
0:34

Expressive Text-to-Image Generation with Rich Text abs: project page:

AK

209,253 次观看 • 3 年前

DreamBooth3D: Subject-Driven Text-to-3D Generation Personalized 3D models from just a few casual photos, with text-driven modifications abs: project page:
1:49

DreamBooth3D: Subject-Driven Text-to-3D Generation Personalized 3D models from just a few casual photos, with text-driven modifications abs: project page:

AK

107,503 次观看 • 3 年前

SceneScape: Text-Driven Consistent Scene Generation abs: project page: text-driven perpetual view generation -- synthesizing long videos of arbitrary scenes solely from an input text describing the scene and camera poses
0:48

SceneScape: Text-Driven Consistent Scene Generation abs: project page: text-driven perpetual view generation -- synthesizing long videos of arbitrary scenes solely from an input text describing the scene and camera poses

AK

73,258 次观看 • 3 年前

Yay, finally! Introducing Vision Banana🍌 from Google DeepMind, our unified model that outperforms SoTA specialist models on various vision tasks! By treating 2D/3D vision tasks as image generation, we unlock a new foundation for CV. Project page: (1/5)
0:25

Yay, finally! Introducing Vision Banana🍌 from Google DeepMind, our unified model that outperforms SoTA specialist models on various vision tasks! By treating 2D/3D vision tasks as image generation, we unlock a new foundation for CV. Project page: (1/5)

Songyou Peng

283,229 次观看 • 1 个月前

Word-As-Image for Semantic Typography abs: project page:
1:46

Word-As-Image for Semantic Typography abs: project page:

AK

385,996 次观看 • 3 年前

Towards Realistic Generative 3D Face Models abs: project page:
0:53

Towards Realistic Generative 3D Face Models abs: project page:

AK

48,089 次观看 • 3 年前

Generative Novel View Synthesis with 3D-Aware Diffusion Models abs: project page:
0:24

Generative Novel View Synthesis with 3D-Aware Diffusion Models abs: project page:

AK

304,708 次观看 • 3 年前

(1/4) Excited to share our #ICCV2023 paper Text2Room! We generate scene-scale textured 3D meshes from a given text prompt leveraging 2D text-to-image models such as StableDiffusion. Project: Code: Video:
0:24

(1/4) Excited to share our #ICCV2023 paper Text2Room! We generate scene-scale textured 3D meshes from a given text prompt leveraging 2D text-to-image models such as StableDiffusion. Project: Code: Video:

Matthias Niessner

74,893 次观看 • 2 年前

WorldFlow3D: Unbounded 3D World Generation 🌍 by Flow Through Hierarchical Distributions, without VAEs ! We reformulate 3D generation as flowing through sequentially finer 3D distributions, cutting training time by more than half ⏱️ compared to existing approaches! Vectorized map layouts provide full scene controllability 🗺️, and a novel flow-field alignment process enables causally coherent, spatially unbounded generation 🌍. This generative method generalizes across both real and synthetic data distributions! Project: Project led by Amogh Joshi and Julian Ost — will be super fun to build on this! 🔥
0:53

WorldFlow3D: Unbounded 3D World Generation 🌍 by Flow Through Hierarchical Distributions, without VAEs ! We reformulate 3D generation as flowing through sequentially finer 3D distributions, cutting training time by more than half ⏱️ compared to existing approaches! Vectorized map layouts provide full scene controllability 🗺️, and a novel flow-field alignment process enables causally coherent, spatially unbounded generation 🌍. This generative method generalizes across both real and synthetic data distributions! Project: Project led by Amogh Joshi and Julian Ost — will be super fun to build on this! 🔥

Felix Heide

19,441 次观看 • 2 个月前

Rodin: A Generative Model for Sculpting 3D Digital Avatars Using Diffusion abs: project page:
1:22

Rodin: A Generative Model for Sculpting 3D Digital Avatars Using Diffusion abs: project page:

AK

262,780 次观看 • 3 年前

Direct3D-S2 Gigascale 3D Generation Made Easy with Spatial Sparse Attention high resolution 3D generation from image
0:28

Direct3D-S2 Gigascale 3D Generation Made Easy with Spatial Sparse Attention high resolution 3D generation from image

AK

59,173 次观看 • 1 年前

MusicLM: Generating Music From Text abs: project page:
2:16

MusicLM: Generating Music From Text abs: project page:

AK

434,142 次观看 • 3 年前

🚀 Introducing #DreamCraft3D, our breakthrough hierarchical technique for 3D content generation. Leading the way in AIGC, we're redefining 3D generation: Project page: Paper: Code:
1:34

🚀 Introducing #DreamCraft3D, our breakthrough hierarchical technique for 3D content generation. Leading the way in AIGC, we're redefining 3D generation: Project page: Paper: Code:

DeepSeek

16,400 次观看 • 2 年前

Semantically annotating 3D gaussian splats on the fly using gemini 3.1 + sparkjs 1. Load any 3D scene and hit scan 2. Get 2D detections from VLM 3. Cluster outputs & project into 3D world space 4. Save as a persistent 3D semantic layer Inspired by Alexander Chen's experiments with gemini visual intelligence. Just had to try to lift it from 2D to 3D!
0:21

Semantically annotating 3D gaussian splats on the fly using gemini 3.1 + sparkjs 1. Load any 3D scene and hit scan 2. Get 2D detections from VLM 3. Cluster outputs & project into 3D world space 4. Save as a persistent 3D semantic layer Inspired by Alexander Chen's experiments with gemini visual intelligence. Just had to try to lift it from 2D to 3D!

Bilawal Sidhu

56,330 次观看 • 1 个月前

🔥Unbounded 4D City Generation🔥 #CityDreamer4D is a generative model of unbounded 4D cities that decouples static and dynamic scenes with realism and controllability - Project: - Code: - CityTopia Dataset:
1:02

🔥Unbounded 4D City Generation🔥 #CityDreamer4D is a generative model of unbounded 4D cities that decouples static and dynamic scenes with realism and controllability - Project: - Code: - CityTopia Dataset:

Ziwei Liu

24,326 次观看 • 1 年前

Vibe creating a 3D scene in Blender got even easier. Just provide a 2D reference image — LLM deconstructs the scene, figures out what 3D assets are needed, generates them using Tripo, and arranges them to match your reference image. Pretty darn cool!
1:24

Vibe creating a 3D scene in Blender got even easier. Just provide a 2D reference image — LLM deconstructs the scene, figures out what 3D assets are needed, generates them using Tripo, and arranges them to match your reference image. Pretty darn cool!

Bilawal Sidhu

112,462 次观看 • 1 年前

📢Introducing 360Anything, our method for lifting any perspective image or video to gravity-aligned 360° panoramas without using any camera or 3D information. This enables consistent novel view synthesis and 3D scene reconstruction. Project page: 🧵
1:05

📢Introducing 360Anything, our method for lifting any perspective image or video to gravity-aligned 360° panoramas without using any camera or 3D information. This enables consistent novel view synthesis and 3D scene reconstruction. Project page: 🧵

Ziyi Wu

46,859 次观看 • 4 个月前

📢WorldAgents: 3D worlds only from 2D image models - without any training! We propose an agentic approach with a Director (VLM) to plan the scene, a Generator (Flux or NanoBanana) for new views, and a Verifier (VLM) for selection / 3D consistency. -> High-fidelity 3D worlds from a single text prompt. What's remarkable: our agents find consistent views from 2D image models to obtain 3D-consistent worlds; this shows that image models contain world priors - agents just need to find them! Great work by Ziya Erkoç Angela Dai
0:25

📢WorldAgents: 3D worlds only from 2D image models - without any training! We propose an agentic approach with a Director (VLM) to plan the scene, a Generator (Flux or NanoBanana) for new views, and a Verifier (VLM) for selection / 3D consistency. -> High-fidelity 3D worlds from a single text prompt. What's remarkable: our agents find consistent views from 2D image models to obtain 3D-consistent worlds; this shows that image models contain world priors - agents just need to find them! Great work by Ziya Erkoç Angela Dai

Matthias Niessner

18,878 次观看 • 2 个月前