Loading video...

Video Failed to Load

There was a problem loading this video. This could be due to a temporary network issue or the video might be unavailable.

Check out NVIDIA’s newest generative model for complex open-world 3D scenes. It will generate novel scenes, which you can then edit and style for a wide range of uses, including potential use cases in VR & robotics.

NVIDIA AI Developer

111,568 subscribers

51,391 views • 3 years ago •via X (Twitter)

Anya Rossi• Live Now

Private livecam show

0 Comments

No comments available

Comments from the original post will appear here

Related Videos

The moment we've all been waiting for! 🤖🔥 Introducing you ChainGPT, our first #AI incubation project and a game-changing solution for navigating the complex world of #crypto and #blockchain technology. Their advanced AI model offers a wide range of use cases:👇 (1/2)

The moment we've all been waiting for! 🤖🔥 Introducing you ChainGPT, our first #AI incubation project and a game-changing solution for navigating the complex world of #crypto and #blockchain technology. Their advanced AI model offers a wide range of use cases:👇 (1/2)

vibe/vibe

209,195 views • 3 years ago

📢📢📢 Check out XCube, a generative model for very-high resolution 3D shapes and scenes! Project Page: Project Video: Props to Xuanchi Ren for leading this project!!!! [1/N]

📢📢📢 Check out XCube, a generative model for very-high resolution 3D shapes and scenes! Project Page: Project Video: Props to Xuanchi Ren for leading this project!!!! [1/N]

Francis Williams

42,417 views • 2 years ago

ViewCrafter can generate high-quality 3D views from single or few images using a video diffusion model! It allows for precise camera control and is useful for real-time rendering and turning text into 3D scenes. Links ⬇️

ViewCrafter can generate high-quality 3D views from single or few images using a video diffusion model! It allows for precise camera control and is useful for real-time rendering and turning text into 3D scenes. Links ⬇️

Dreaming Tulpa 🥓👑

19,902 views • 2 years ago

This new Free & Local 3D AI workflow lets you create a game-ready 3D characters faster than ever before! It uses Pixal3D + Trellis2 locally in ComfyUI to generate, retopologize and texture your model. Then the open-source tool Skintokens rigs the character so you can animate it in UE 5.8

This new Free & Local 3D AI workflow lets you create a game-ready 3D characters faster than ever before! It uses Pixal3D + Trellis2 locally in ComfyUI to generate, retopologize and texture your model. Then the open-source tool Skintokens rigs the character so you can animate it in UE 5.8

PixelArtistry

22,629 views • 1 month ago

New vibecode project: 3D world generation on your phone ✨ Take a photo of a room or space, and transform it into a new style. Then generate a world you can explore. Made in Cursor using two new APIs - Flux.2 Klein (BlackForestLabsAI - Unofficial) and Marble (World Labs). How it works 👇

New vibecode project: 3D world generation on your phone ✨ Take a photo of a room or space, and transform it into a new style. Then generate a world you can explore. Made in Cursor using two new APIs - Flux.2 Klein (BlackForestLabsAI - Unofficial) and Marble (World Labs). How it works 👇

Justine Moore

42,665 views • 8 months ago

With Hunyuan3D World Model 1.0 now released and open-sourced, we're excited to showcase the technical highlights behind this impressive innovation: ✅360° Panoramic Generation: Creates complete, immersive “world scenes”, far beyond localized views. ✅Explorable 3D Scene Generation: Generates diverse, spatially consistent 3D worlds from text/image for truly immersive exploration. ✅Interactive/Editable: Achieves separation of foreground objects, background terrain, ground, and sky, for seamless secondary editing. ✅Exportable Mesh: Generated scenes can be exported as 3D meshes for direct import into mainstream game engines and modeling software. ✅Industry-Leading SOTA Evaluation: Surpasses state-of-the-art open-source models in generation quality. As the industry's first open-source model for physical simulation and explorable world generation, Hunyuan3D World Model 1.0 aims to foster a collaborative community ecosystem with developers and enthusiasts. ✨ Try it now: 🤗 Hugging Face:

With Hunyuan3D World Model 1.0 now released and open-sourced, we're excited to showcase the technical highlights behind this impressive innovation: ✅360° Panoramic Generation: Creates complete, immersive “world scenes”, far beyond localized views. ✅Explorable 3D Scene Generation: Generates diverse, spatially consistent 3D worlds from text/image for truly immersive exploration. ✅Interactive/Editable: Achieves separation of foreground objects, background terrain, ground, and sky, for seamless secondary editing. ✅Exportable Mesh: Generated scenes can be exported as 3D meshes for direct import into mainstream game engines and modeling software. ✅Industry-Leading SOTA Evaluation: Surpasses state-of-the-art open-source models in generation quality. As the industry's first open-source model for physical simulation and explorable world generation, Hunyuan3D World Model 1.0 aims to foster a collaborative community ecosystem with developers and enthusiasts. ✨ Try it now: 🤗 Hugging Face:

Tencent Hy

23,240 views • 1 year ago

Wonderland: Navigating 3D Scenes from a Single Image Contributions: • First, we introduce a representation for controllable 3D generation by leveraging the generative priors from camera-guided video diffusion models. Unlike image models, video diffusion models are trained on extensive video datasets. This enables them to capture comprehensive spatial relationships within scenes across multiple views and embed a form of "3D awareness" in their latent space, which allows us to maintain 3D consistency in novel view synthesis. • Second, to achieve controllable novel view generation, we empower video models with precise control over specified camera motions. We introduce a novel dual-branch conditioning mechanism that effectively incorporates desired diverse camera trajectories into the video diffusion model. This enables expansion of a single image into a multi-view consistent capture of a 3D scene with precise pose control. • Third, to achieve efficient 3D reconstruction, we directly transform video latents into 3DGS. We propose a novel latent-based large reconstruction model (LaLRM) that lifts video latents to 3D in a feed-forward manner. With this design, during inference, our model directly predicts 3DGS from a single input image, effectively aligning the generation and reconstruction tasks—and bridging image space and 3D space—through the video latent space. Compared with reconstructing scenes from images, the video latent space offers a 256× spatial-temporal reduction while retaining essential and consistent 3D structural details. Such a high degree of compression is crucial, as it allows the LaLRM to handle a wider range of 3D scenes within the reconstruction framework, with the same memory constraints.

Wonderland: Navigating 3D Scenes from a Single Image Contributions: • First, we introduce a representation for controllable 3D generation by leveraging the generative priors from camera-guided video diffusion models. Unlike image models, video diffusion models are trained on extensive video datasets. This enables them to capture comprehensive spatial relationships within scenes across multiple views and embed a form of "3D awareness" in their latent space, which allows us to maintain 3D consistency in novel view synthesis. • Second, to achieve controllable novel view generation, we empower video models with precise control over specified camera motions. We introduce a novel dual-branch conditioning mechanism that effectively incorporates desired diverse camera trajectories into the video diffusion model. This enables expansion of a single image into a multi-view consistent capture of a 3D scene with precise pose control. • Third, to achieve efficient 3D reconstruction, we directly transform video latents into 3DGS. We propose a novel latent-based large reconstruction model (LaLRM) that lifts video latents to 3D in a feed-forward manner. With this design, during inference, our model directly predicts 3DGS from a single input image, effectively aligning the generation and reconstruction tasks—and bridging image space and 3D space—through the video latent space. Compared with reconstructing scenes from images, the video latent space offers a 256× spatial-temporal reduction while retaining essential and consistent 3D structural details. Such a high degree of compression is crucial, as it allows the LaLRM to handle a wider range of 3D scenes within the reconstruction framework, with the same memory constraints.

MrNeRF

52,849 views • 1 year ago

🚀🌍🚀 Echo-2 is live! It generates high-quality physically grounded 3D scenes instead of just pixels. Check out the open demo to create and explore worlds in real-time! I gave it a picture from my Himalayas trek—it handles the massive scale range really well! 🏔️🌍

🚀🌍🚀 Echo-2 is live! It generates high-quality physically grounded 3D scenes instead of just pixels. Check out the open demo to create and explore worlds in real-time! I gave it a picture from my Himalayas trek—it handles the massive scale range really well! 🏔️🌍

David Novotny

11,503 views • 5 months ago

If you need consistent, reoccurring scenes for your story it's never been easier. A thread on how I go about blocking out a 3D scene that I can then use for any reoccurring environment shots. As always - if this helps you please kindly like and share! 🩵 🧵BELOW 🧵

If you need consistent, reoccurring scenes for your story it's never been easier. A thread on how I go about blocking out a 3D scene that I can then use for any reoccurring environment shots. As always - if this helps you please kindly like and share! 🩵 🧵BELOW 🧵

A.I.Warper

31,302 views • 1 year ago

✨ Any static 3D assets ➡️ 4D dynamic worlds. Introducing CHORD, a universal framework for generating scene-level 4D dynamic motion from any static 3D inputs. It generalizes surprisingly well across a wide range of objects 🤯 and can even be used to learn robotics manipulation policy 🤖! Project page: Dive deeper in a 🧵: 1/n

✨ Any static 3D assets ➡️ 4D dynamic worlds. Introducing CHORD, a universal framework for generating scene-level 4D dynamic motion from any static 3D inputs. It generalizes surprisingly well across a wide range of objects 🤯 and can even be used to learn robotics manipulation policy 🤖! Project page: Dive deeper in a 🧵: 1/n

Chen Geng

43,578 views • 8 months ago

👉 I created « Next Scene » for Qwen Image Edit 2509 and you can make next scenes keeping character, lighting, environment . And it’s totally open-source ( no restrictions !! ) Just use the prompt « Next scene: » and explain what you want. I trained it on hundreds of paired shots to preserve characters, lighting, and mood between scenes. ( Soon I will explain what tools I created that can manage classification and caption of data when you have more than 10 000 of items, using workers and a total new way to classify data ) . Built for storytellers working with ComfyUI or other diffusers pipe ;) ! ComfyUI

👉 I created « Next Scene » for Qwen Image Edit 2509 and you can make next scenes keeping character, lighting, environment . And it’s totally open-source ( no restrictions !! ) Just use the prompt « Next scene: » and explain what you want. I trained it on hundreds of paired shots to preserve characters, lighting, and mood between scenes. ( Soon I will explain what tools I created that can manage classification and caption of data when you have more than 10 000 of items, using workers and a total new way to classify data ) . Built for storytellers working with ComfyUI or other diffusers pipe ;) ! ComfyUI

Lovis Odin

66,941 views • 1 year ago

If you need to generate a target-specific wordlist, make sure to check out / XNL -н4cĸ3r (and @xnl-h4ck3r in the new Sky) GAP extension. It will scan for sus parameters and generate you a complete wordlist with one click of a button. See it in action 👇

If you need to generate a target-specific wordlist, make sure to check out / XNL -н4cĸ3r (and @xnl-h4ck3r in the new Sky) GAP extension. It will scan for sus parameters and generate you a complete wordlist with one click of a button. See it in action 👇

André Baptista

13,642 views • 10 months ago

🚨 Wait… I think I just discovered something HUGE about AI-generated 3D models. I found Hyper3D’s new Agentic Mode that can BUILD, EDIT & ANIMATE 3D models!! And there’s one thing that really surprised me. Unlike regular 3D generation, Agentic Mode can automatically filter and organize more informative input. You can give it different views, individual parts, or even a single reference image of separate components… And it can figure out how they fit together and generate a complete 3D model — with surprisingly accurate structure and details. That’s something I haven’t seen regular 3D generation handle this well. Check out this 3D windmill animation 👇 Hyper3D Agentic Mode lets you control 3D models with PARAMETERS !! Instead of rebuilding the sofa from scratch, you can change things like: → Parametric Control → Animation Pressets → Enhance Materials So you can generate the model once... and keep editing its geometry without starting from scratch

🚨 Wait… I think I just discovered something HUGE about AI-generated 3D models. I found Hyper3D’s new Agentic Mode that can BUILD, EDIT & ANIMATE 3D models!! And there’s one thing that really surprised me. Unlike regular 3D generation, Agentic Mode can automatically filter and organize more informative input. You can give it different views, individual parts, or even a single reference image of separate components… And it can figure out how they fit together and generate a complete 3D model — with surprisingly accurate structure and details. That’s something I haven’t seen regular 3D generation handle this well. Check out this 3D windmill animation 👇 Hyper3D Agentic Mode lets you control 3D models with PARAMETERS !! Instead of rebuilding the sofa from scratch, you can change things like: → Parametric Control → Animation Pressets → Enhance Materials So you can generate the model once... and keep editing its geometry without starting from scratch

SARAH

91,217 views • 14 days ago

Hy4 preview is now available on WorkBuddy, where users can switch between Work and Coding tasks. The model can execute a wide range of different tasks, including one-shotting complex artifacts. Black hole simulation 👀 Also, Hy4 preview has been compressed from 1.5TB to ~200GiB GGUF, so you can now run it locally if you have a proper setup!

Hy4 preview is now available on WorkBuddy, where users can switch between Work and Coding tasks. The model can execute a wide range of different tasks, including one-shotting complex artifacts. Black hole simulation 👀 Also, Hy4 preview has been compressed from 1.5TB to ~200GiB GGUF, so you can now run it locally if you have a proper setup!

🚨 AI News | TestingCatalog

19,407 views • 1 month ago

Two months ago, at an RSS workshop panel, I said that general real2sim reconstruction is still far from solved, especially for articulated objects, which will be a major bottleneck for robotics. But now that has totally changed with Astra; using several photos as input, we can easily reconstruct vivid articulated scenes. The result is so impressive! Excited to see how it will shift the paradigm of real2sim2real and agentic learning for robotics and humanoids.

Two months ago, at an RSS workshop panel, I said that general real2sim reconstruction is still far from solved, especially for articulated objects, which will be a major bottleneck for robotics. But now that has totally changed with Astra; using several photos as input, we can easily reconstruct vivid articulated scenes. The result is so impressive! Excited to see how it will shift the paradigm of real2sim2real and agentic learning for robotics and humanoids.

Siyuan Huang

19,239 views • 1 month ago

world models have their comfyui now. introducing alakazam studio, the first local, open source UI for world models. •⁠ ⁠sentence goes in => you edit the state graph => play •⁠ ⁠on a live model, yours, running in your browser •⁠ ⁠⁠apache-2.0, fully open source fork it and point it at your model 👇

world models have their comfyui now. introducing alakazam studio, the first local, open source UI for world models. •⁠ ⁠sentence goes in => you edit the state graph => play •⁠ ⁠on a live model, yours, running in your browser •⁠ ⁠⁠apache-2.0, fully open source fork it and point it at your model 👇

hugo

26,438 views • 2 months ago

Big news for everyone who loves making videos! 🎉 CapCut just dropped Seedance 2.5! Now you can generate your AI clips AND edit them in the exact same workspace. No hassle, just pure creativity! ✨ What’s fresh: Control scenes by timestamp Input up to 50 references Generate up to 90 seconds Green screen friendly Multi-language support Check it out ⬇️ 💻 Web: 📱 App: #CapCut #Seedance25 #CapCutai #CapCutDidThat

Big news for everyone who loves making videos! 🎉 CapCut just dropped Seedance 2.5! Now you can generate your AI clips AND edit them in the exact same workspace. No hassle, just pure creativity! ✨ What’s fresh: Control scenes by timestamp Input up to 50 references Generate up to 90 seconds Green screen friendly Multi-language support Check it out ⬇️ 💻 Web: 📱 App: #CapCut #Seedance25 #CapCutai #CapCutDidThat

NeuraFlow AI

56,537 views • 2 months ago

✨ 3d models are now LIVE on Photo AI 😊 You can now turn any AI photo you make into a 3d model by pressing [ 📦 Make 3d model ] And then you can view it inside Photo AI or download it as a .GLB 3d model file It's still very early in AI generated 3d model world but it's nice to have this feature working already As always, the models will keep improving, so this feature will keep getting better (like it did with video, it sucked before, now it's getting passable) Next would be nice to switch to .USDZ so you can load it straight into your iPhone with ARKit and put it in your room Available now for everyone on the Premium and Ultra plan

✨ 3d models are now LIVE on Photo AI 😊 You can now turn any AI photo you make into a 3d model by pressing [ 📦 Make 3d model ] And then you can view it inside Photo AI or download it as a .GLB 3d model file It's still very early in AI generated 3d model world but it's nice to have this feature working already As always, the models will keep improving, so this feature will keep getting better (like it did with video, it sucked before, now it's getting passable) Next would be nice to switch to .USDZ so you can load it straight into your iPhone with ARKit and put it in your room Available now for everyone on the Premium and Ultra plan

@levelsio

112,930 views • 1 year ago

I am blown away 🤯. Check this out! CameraCtrl II: Dynamic Scene Exploration via Camera-controlled Video Diffusion Models TL;DR: "To enable broader exploration of dynamic scenes, our model can generate new video clips of the same scene based on previously generated content and user-provided camera trajectories. This approach maintains dynamic capabilities, accurate camera control, and scene consistency throughout the extended exploration." "Our model enables precise camera control across diverse scenarios while preserving dynamic scene elements, e.g." "Our method can generate videos with strong 3D consistency, which enables high-quality 3D reconstruction using the camera-controlled videos." Contributions: 1) A systematic data curation pipeline for constructing a dynamic video dataset with camera trajectory annotations; 2) A lightweight camera control injection module and corresponding training strategy that preserves dynamic video generation capabilities while adding camera control effect; 3) A clip-wise autoregressive generation recipe that enables extended range exploration of generated scenes.

I am blown away 🤯. Check this out! CameraCtrl II: Dynamic Scene Exploration via Camera-controlled Video Diffusion Models TL;DR: "To enable broader exploration of dynamic scenes, our model can generate new video clips of the same scene based on previously generated content and user-provided camera trajectories. This approach maintains dynamic capabilities, accurate camera control, and scene consistency throughout the extended exploration." "Our model enables precise camera control across diverse scenarios while preserving dynamic scene elements, e.g." "Our method can generate videos with strong 3D consistency, which enables high-quality 3D reconstruction using the camera-controlled videos." Contributions: 1) A systematic data curation pipeline for constructing a dynamic video dataset with camera trajectory annotations; 2) A lightweight camera control injection module and corresponding training strategy that preserves dynamic video generation capabilities while adding camera control effect; 3) A clip-wise autoregressive generation recipe that enables extended range exploration of generated scenes.

MrNeRF

12,633 views • 1 year ago