Video wird geladen...

Video konnte nicht geladen werden

Zur Startseite

Check out NVIDIA’s newest generative model for complex open-world 3D scenes. It will generate novel scenes, which you can then edit and style for a wide range of uses, including potential use cases in VR & robotics.

NVIDIAAIDev's profile picture

NVIDIA AI Developer

111,568 subscribers

51,391 Aufrufe • vor 3 Jahren •via X (Twitter)

LIVE

Anya Rossi• Live Now

Private livecam show

0 Kommentare

Keine Kommentare verfügbar

Kommentare vom Original-Post werden hier angezeigt

Ähnliche Videos

The moment we've all been waiting for! 🤖🔥 Introducing you ChainGPT, our first #AI incubation project and a game-changing solution for navigating the complex world of #crypto and #blockchain technology. Their advanced AI model offers a wide range of use cases:👇 (1/2)
0:14

The moment we've all been waiting for! 🤖🔥 Introducing you ChainGPT, our first #AI incubation project and a game-changing solution for navigating the complex world of #crypto and #blockchain technology. Their advanced AI model offers a wide range of use cases:👇 (1/2)

Seedify

187,266 Aufrufe • vor 3 Jahren

📢📢📢 Check out XCube, a generative model for very-high resolution 3D shapes and scenes! Project Page: Project Video: Props to Xuanchi Ren for leading this project!!!! [1/N]
0:14

📢📢📢 Check out XCube, a generative model for very-high resolution 3D shapes and scenes! Project Page: Project Video: Props to Xuanchi Ren for leading this project!!!! [1/N]

Francis Williams

42,417 Aufrufe • vor 2 Jahren

ViewCrafter can generate high-quality 3D views from single or few images using a video diffusion model! It allows for precise camera control and is useful for real-time rendering and turning text into 3D scenes. Links ⬇️
0:15

ViewCrafter can generate high-quality 3D views from single or few images using a video diffusion model! It allows for precise camera control and is useful for real-time rendering and turning text into 3D scenes. Links ⬇️

Dreaming Tulpa 🥓👑

19,899 Aufrufe • vor 1 Jahr

New vibecode project: 3D world generation on your phone ✨ Take a photo of a room or space, and transform it into a new style. Then generate a world you can explore. Made in Cursor using two new APIs - Flux.2 Klein (BlackForestLabsAI - Unofficial) and Marble (World Labs). How it works 👇
0:15

New vibecode project: 3D world generation on your phone ✨ Take a photo of a room or space, and transform it into a new style. Then generate a world you can explore. Made in Cursor using two new APIs - Flux.2 Klein (BlackForestLabsAI - Unofficial) and Marble (World Labs). How it works 👇

Justine Moore

42,665 Aufrufe • vor 7 Monaten

With Hunyuan3D World Model 1.0 now released and open-sourced, we're excited to showcase the technical highlights behind this impressive innovation: ✅360° Panoramic Generation: Creates complete, immersive “world scenes”, far beyond localized views. ✅Explorable 3D Scene Generation: Generates diverse, spatially consistent 3D worlds from text/image for truly immersive exploration. ✅Interactive/Editable: Achieves separation of foreground objects, background terrain, ground, and sky, for seamless secondary editing. ✅Exportable Mesh: Generated scenes can be exported as 3D meshes for direct import into mainstream game engines and modeling software. ✅Industry-Leading SOTA Evaluation: Surpasses state-of-the-art open-source models in generation quality. As the industry's first open-source model for physical simulation and explorable world generation, Hunyuan3D World Model 1.0 aims to foster a collaborative community ecosystem with developers and enthusiasts. ✨ Try it now: 🤗 Hugging Face:
0:07

With Hunyuan3D World Model 1.0 now released and open-sourced, we're excited to showcase the technical highlights behind this impressive innovation: ✅360° Panoramic Generation: Creates complete, immersive “world scenes”, far beyond localized views. ✅Explorable 3D Scene Generation: Generates diverse, spatially consistent 3D worlds from text/image for truly immersive exploration. ✅Interactive/Editable: Achieves separation of foreground objects, background terrain, ground, and sky, for seamless secondary editing. ✅Exportable Mesh: Generated scenes can be exported as 3D meshes for direct import into mainstream game engines and modeling software. ✅Industry-Leading SOTA Evaluation: Surpasses state-of-the-art open-source models in generation quality. As the industry's first open-source model for physical simulation and explorable world generation, Hunyuan3D World Model 1.0 aims to foster a collaborative community ecosystem with developers and enthusiasts. ✨ Try it now: 🤗 Hugging Face:

Tencent Hy

23,203 Aufrufe • vor 1 Jahr

Wonderland: Navigating 3D Scenes from a Single Image Contributions: • First, we introduce a representation for controllable 3D generation by leveraging the generative priors from camera-guided video diffusion models. Unlike image models, video diffusion models are trained on extensive video datasets. This enables them to capture comprehensive spatial relationships within scenes across multiple views and embed a form of "3D awareness" in their latent space, which allows us to maintain 3D consistency in novel view synthesis. • Second, to achieve controllable novel view generation, we empower video models with precise control over specified camera motions. We introduce a novel dual-branch conditioning mechanism that effectively incorporates desired diverse camera trajectories into the video diffusion model. This enables expansion of a single image into a multi-view consistent capture of a 3D scene with precise pose control. • Third, to achieve efficient 3D reconstruction, we directly transform video latents into 3DGS. We propose a novel latent-based large reconstruction model (LaLRM) that lifts video latents to 3D in a feed-forward manner. With this design, during inference, our model directly predicts 3DGS from a single input image, effectively aligning the generation and reconstruction tasks—and bridging image space and 3D space—through the video latent space. Compared with reconstructing scenes from images, the video latent space offers a 256× spatial-temporal reduction while retaining essential and consistent 3D structural details. Such a high degree of compression is crucial, as it allows the LaLRM to handle a wider range of 3D scenes within the reconstruction framework, with the same memory constraints.
0:12

Wonderland: Navigating 3D Scenes from a Single Image Contributions: • First, we introduce a representation for controllable 3D generation by leveraging the generative priors from camera-guided video diffusion models. Unlike image models, video diffusion models are trained on extensive video datasets. This enables them to capture comprehensive spatial relationships within scenes across multiple views and embed a form of "3D awareness" in their latent space, which allows us to maintain 3D consistency in novel view synthesis. • Second, to achieve controllable novel view generation, we empower video models with precise control over specified camera motions. We introduce a novel dual-branch conditioning mechanism that effectively incorporates desired diverse camera trajectories into the video diffusion model. This enables expansion of a single image into a multi-view consistent capture of a 3D scene with precise pose control. • Third, to achieve efficient 3D reconstruction, we directly transform video latents into 3DGS. We propose a novel latent-based large reconstruction model (LaLRM) that lifts video latents to 3D in a feed-forward manner. With this design, during inference, our model directly predicts 3DGS from a single input image, effectively aligning the generation and reconstruction tasks—and bridging image space and 3D space—through the video latent space. Compared with reconstructing scenes from images, the video latent space offers a 256× spatial-temporal reduction while retaining essential and consistent 3D structural details. Such a high degree of compression is crucial, as it allows the LaLRM to handle a wider range of 3D scenes within the reconstruction framework, with the same memory constraints.

MrNeRF

52,849 Aufrufe • vor 1 Jahr

🚀🌍🚀 Echo-2 is live! It generates high-quality physically grounded 3D scenes instead of just pixels. Check out the open demo to create and explore worlds in real-time! I gave it a picture from my Himalayas trek—it handles the massive scale range really well! 🏔️🌍
0:12

🚀🌍🚀 Echo-2 is live! It generates high-quality physically grounded 3D scenes instead of just pixels. Check out the open demo to create and explore worlds in real-time! I gave it a picture from my Himalayas trek—it handles the massive scale range really well! 🏔️🌍

David Novotny

11,435 Aufrufe • vor 4 Monaten

If you need consistent, reoccurring scenes for your story it's never been easier. A thread on how I go about blocking out a 3D scene that I can then use for any reoccurring environment shots. As always - if this helps you please kindly like and share! 🩵 🧵BELOW 🧵
0:10

If you need consistent, reoccurring scenes for your story it's never been easier. A thread on how I go about blocking out a 3D scene that I can then use for any reoccurring environment shots. As always - if this helps you please kindly like and share! 🩵 🧵BELOW 🧵

A.I.Warper

31,301 Aufrufe • vor 1 Jahr

✨ Any static 3D assets ➡️ 4D dynamic worlds. Introducing CHORD, a universal framework for generating scene-level 4D dynamic motion from any static 3D inputs. It generalizes surprisingly well across a wide range of objects 🤯 and can even be used to learn robotics manipulation policy 🤖! Project page: Dive deeper in a 🧵: 1/n
0:12

✨ Any static 3D assets ➡️ 4D dynamic worlds. Introducing CHORD, a universal framework for generating scene-level 4D dynamic motion from any static 3D inputs. It generalizes surprisingly well across a wide range of objects 🤯 and can even be used to learn robotics manipulation policy 🤖! Project page: Dive deeper in a 🧵: 1/n

Chen Geng

43,382 Aufrufe • vor 7 Monaten

👉 I created « Next Scene » for Qwen Image Edit 2509 and you can make next scenes keeping character, lighting, environment . And it’s totally open-source ( no restrictions !! ) Just use the prompt « Next scene: » and explain what you want. I trained it on hundreds of paired shots to preserve characters, lighting, and mood between scenes. ( Soon I will explain what tools I created that can manage classification and caption of data when you have more than 10 000 of items, using workers and a total new way to classify data ) . Built for storytellers working with ComfyUI or other diffusers pipe ;) ! ComfyUI
0:17

👉 I created « Next Scene » for Qwen Image Edit 2509 and you can make next scenes keeping character, lighting, environment . And it’s totally open-source ( no restrictions !! ) Just use the prompt « Next scene: » and explain what you want. I trained it on hundreds of paired shots to preserve characters, lighting, and mood between scenes. ( Soon I will explain what tools I created that can manage classification and caption of data when you have more than 10 000 of items, using workers and a total new way to classify data ) . Built for storytellers working with ComfyUI or other diffusers pipe ;) ! ComfyUI

Lovis Odin

66,908 Aufrufe • vor 10 Monaten

If you need to generate a target-specific wordlist, make sure to check out / XNL -н4cĸ3r (and @xnl-h4ck3r in the new Sky) GAP extension. It will scan for sus parameters and generate you a complete wordlist with one click of a button. See it in action 👇
0:14

If you need to generate a target-specific wordlist, make sure to check out / XNL -н4cĸ3r (and @xnl-h4ck3r in the new Sky) GAP extension. It will scan for sus parameters and generate you a complete wordlist with one click of a button. See it in action 👇

André Baptista

13,642 Aufrufe • vor 9 Monaten

world models have their comfyui now. introducing alakazam studio, the first local, open source UI for world models. •⁠ ⁠sentence goes in => you edit the state graph => play •⁠ ⁠on a live model, yours, running in your browser •⁠ ⁠⁠apache-2.0, fully open source fork it and point it at your model 👇
0:19

world models have their comfyui now. introducing alakazam studio, the first local, open source UI for world models. •⁠ ⁠sentence goes in => you edit the state graph => play •⁠ ⁠on a live model, yours, running in your browser •⁠ ⁠⁠apache-2.0, fully open source fork it and point it at your model 👇

hugo

25,362 Aufrufe • vor 15 Tagen

Big news for everyone who loves making videos! 🎉 CapCut just dropped Seedance 2.5! Now you can generate your AI clips AND edit them in the exact same workspace. No hassle, just pure creativity! ✨ What’s fresh: Control scenes by timestamp Input up to 50 references Generate up to 90 seconds Green screen friendly Multi-language support Check it out ⬇️ 💻 Web: 📱 App: #CapCut #Seedance25 #CapCutai #CapCutDidThat
0:15

Big news for everyone who loves making videos! 🎉 CapCut just dropped Seedance 2.5! Now you can generate your AI clips AND edit them in the exact same workspace. No hassle, just pure creativity! ✨ What’s fresh: Control scenes by timestamp Input up to 50 references Generate up to 90 seconds Green screen friendly Multi-language support Check it out ⬇️ 💻 Web: 📱 App: #CapCut #Seedance25 #CapCutai #CapCutDidThat

NeuraFlow AI

56,537 Aufrufe • vor 21 Tagen

✨ 3d models are now LIVE on Photo AI 😊 You can now turn any AI photo you make into a 3d model by pressing [ 📦 Make 3d model ] And then you can view it inside Photo AI or download it as a .GLB 3d model file It's still very early in AI generated 3d model world but it's nice to have this feature working already As always, the models will keep improving, so this feature will keep getting better (like it did with video, it sucked before, now it's getting passable) Next would be nice to switch to .USDZ so you can load it straight into your iPhone with ARKit and put it in your room Available now for everyone on the Premium and Ultra plan
0:19

✨ 3d models are now LIVE on Photo AI 😊 You can now turn any AI photo you make into a 3d model by pressing [ 📦 Make 3d model ] And then you can view it inside Photo AI or download it as a .GLB 3d model file It's still very early in AI generated 3d model world but it's nice to have this feature working already As always, the models will keep improving, so this feature will keep getting better (like it did with video, it sucked before, now it's getting passable) Next would be nice to switch to .USDZ so you can load it straight into your iPhone with ARKit and put it in your room Available now for everyone on the Premium and Ultra plan

@levelsio

112,930 Aufrufe • vor 1 Jahr

A small update to the ChatGPT app: one place to add photos and files, open your camera, and try all the features the model can do for you. Check it out!
0:10

A small update to the ChatGPT app: one place to add photos and files, open your camera, and try all the features the model can do for you. Check it out!

Jesse Chand

43,326 Aufrufe • vor 1 Jahr

I am blown away 🤯. Check this out! CameraCtrl II: Dynamic Scene Exploration via Camera-controlled Video Diffusion Models TL;DR: "To enable broader exploration of dynamic scenes, our model can generate new video clips of the same scene based on previously generated content and user-provided camera trajectories. This approach maintains dynamic capabilities, accurate camera control, and scene consistency throughout the extended exploration." "Our model enables precise camera control across diverse scenarios while preserving dynamic scene elements, e.g." "Our method can generate videos with strong 3D consistency, which enables high-quality 3D reconstruction using the camera-controlled videos." Contributions: 1) A systematic data curation pipeline for constructing a dynamic video dataset with camera trajectory annotations; 2) A lightweight camera control injection module and corresponding training strategy that preserves dynamic video generation capabilities while adding camera control effect; 3) A clip-wise autoregressive generation recipe that enables extended range exploration of generated scenes.
0:10

I am blown away 🤯. Check this out! CameraCtrl II: Dynamic Scene Exploration via Camera-controlled Video Diffusion Models TL;DR: "To enable broader exploration of dynamic scenes, our model can generate new video clips of the same scene based on previously generated content and user-provided camera trajectories. This approach maintains dynamic capabilities, accurate camera control, and scene consistency throughout the extended exploration." "Our model enables precise camera control across diverse scenarios while preserving dynamic scene elements, e.g." "Our method can generate videos with strong 3D consistency, which enables high-quality 3D reconstruction using the camera-controlled videos." Contributions: 1) A systematic data curation pipeline for constructing a dynamic video dataset with camera trajectory annotations; 2) A lightweight camera control injection module and corresponding training strategy that preserves dynamic video generation capabilities while adding camera control effect; 3) A clip-wise autoregressive generation recipe that enables extended range exploration of generated scenes.

MrNeRF

12,633 Aufrufe • vor 1 Jahr

Terminal commands are now shown inline, so you can keep track of which commands were run. You can edit the suggested terminal command in the chat response before running it. Check out our release notes for more updates:
0:11

Terminal commands are now shown inline, so you can keep track of which commands were run. You can edit the suggested terminal command in the chat response before running it. Check out our release notes for more updates:

Visual Studio Code

32,694 Aufrufe • vor 1 Jahr

✨Hey #PortfolioDay ✨ Im Josh, 3D Artist, based in Germany and I specialize in Stylized Characters! Im open for Freelance jobs and looking for a fulltime position in the Gaming Industry! You can check out my Portfolio here! 🎨
0:05

✨Hey #PortfolioDay ✨ Im Josh, 3D Artist, based in Germany and I specialize in Stylized Characters! Im open for Freelance jobs and looking for a fulltime position in the Gaming Industry! You can check out my Portfolio here! 🎨

Hosh

42,095 Aufrufe • vor 2 Jahren

📢New in ScanNet++: High-Res 360° Panos! Chandan Yeshwanth & Yueh-Cheng Liu have added pano captures for 956 ScanNet++ scenes, fully aligned with the 3D meshes, DSLR, and iPhone data - multiple panos per scene Check it out: Docs Code
0:11

📢New in ScanNet++: High-Res 360° Panos! Chandan Yeshwanth & Yueh-Cheng Liu have added pano captures for 956 ScanNet++ scenes, fully aligned with the 3D meshes, DSLR, and iPhone data - multiple panos per scene Check it out: Docs Code

Angela Dai

12,890 Aufrufe • vor 10 Monaten