Загрузка видео...

Не удалось загрузить видео

На главную

Check out NVIDIA’s newest generative model for complex open-world 3D scenes. It will generate novel scenes, which you can then edit and style for a wide range of uses, including potential use cases in VR & robotics.

NVIDIAAIDev's profile picture

NVIDIA AI Developer

111,568 subscribers

51,391 просмотров • 3 лет назад •via X (Twitter)

LIVE

Anya Rossi• Live Now

Private livecam show

Комментарии: 0

Нет доступных комментариев

Здесь появятся комментарии из оригинального поста

Похожие видео

The moment we've all been waiting for! 🤖🔥 Introducing you ChainGPT, our first #AI incubation project and a game-changing solution for navigating the complex world of #crypto and #blockchain technology. Their advanced AI model offers a wide range of use cases:👇 (1/2)
0:14

The moment we've all been waiting for! 🤖🔥 Introducing you ChainGPT, our first #AI incubation project and a game-changing solution for navigating the complex world of #crypto and #blockchain technology. Their advanced AI model offers a wide range of use cases:👇 (1/2)

vibe/vibe

209,195 просмотров • 3 лет назад

📢📢📢 Check out XCube, a generative model for very-high resolution 3D shapes and scenes! Project Page: Project Video: Props to Xuanchi Ren for leading this project!!!! [1/N]
0:14

📢📢📢 Check out XCube, a generative model for very-high resolution 3D shapes and scenes! Project Page: Project Video: Props to Xuanchi Ren for leading this project!!!! [1/N]

Francis Williams

42,417 просмотров • 2 лет назад

ViewCrafter can generate high-quality 3D views from single or few images using a video diffusion model! It allows for precise camera control and is useful for real-time rendering and turning text into 3D scenes. Links ⬇️
0:15

ViewCrafter can generate high-quality 3D views from single or few images using a video diffusion model! It allows for precise camera control and is useful for real-time rendering and turning text into 3D scenes. Links ⬇️

Dreaming Tulpa 🥓👑

19,902 просмотров • 2 лет назад

This new Free & Local 3D AI workflow lets you create a game-ready 3D characters faster than ever before! It uses Pixal3D + Trellis2 locally in ComfyUI to generate, retopologize and texture your model. Then the open-source tool Skintokens rigs the character so you can animate it in UE 5.8
0:19

This new Free & Local 3D AI workflow lets you create a game-ready 3D characters faster than ever before! It uses Pixal3D + Trellis2 locally in ComfyUI to generate, retopologize and texture your model. Then the open-source tool Skintokens rigs the character so you can animate it in UE 5.8

PixelArtistry

22,629 просмотров • 1 месяц назад

New vibecode project: 3D world generation on your phone ✨ Take a photo of a room or space, and transform it into a new style. Then generate a world you can explore. Made in Cursor using two new APIs - Flux.2 Klein (BlackForestLabsAI - Unofficial) and Marble (World Labs). How it works 👇
0:15

New vibecode project: 3D world generation on your phone ✨ Take a photo of a room or space, and transform it into a new style. Then generate a world you can explore. Made in Cursor using two new APIs - Flux.2 Klein (BlackForestLabsAI - Unofficial) and Marble (World Labs). How it works 👇

Justine Moore

42,665 просмотров • 8 месяцев назад

With Hunyuan3D World Model 1.0 now released and open-sourced, we're excited to showcase the technical highlights behind this impressive innovation: ✅360° Panoramic Generation: Creates complete, immersive “world scenes”, far beyond localized views. ✅Explorable 3D Scene Generation: Generates diverse, spatially consistent 3D worlds from text/image for truly immersive exploration. ✅Interactive/Editable: Achieves separation of foreground objects, background terrain, ground, and sky, for seamless secondary editing. ✅Exportable Mesh: Generated scenes can be exported as 3D meshes for direct import into mainstream game engines and modeling software. ✅Industry-Leading SOTA Evaluation: Surpasses state-of-the-art open-source models in generation quality. As the industry's first open-source model for physical simulation and explorable world generation, Hunyuan3D World Model 1.0 aims to foster a collaborative community ecosystem with developers and enthusiasts. ✨ Try it now: 🤗 Hugging Face:
0:07

With Hunyuan3D World Model 1.0 now released and open-sourced, we're excited to showcase the technical highlights behind this impressive innovation: ✅360° Panoramic Generation: Creates complete, immersive “world scenes”, far beyond localized views. ✅Explorable 3D Scene Generation: Generates diverse, spatially consistent 3D worlds from text/image for truly immersive exploration. ✅Interactive/Editable: Achieves separation of foreground objects, background terrain, ground, and sky, for seamless secondary editing. ✅Exportable Mesh: Generated scenes can be exported as 3D meshes for direct import into mainstream game engines and modeling software. ✅Industry-Leading SOTA Evaluation: Surpasses state-of-the-art open-source models in generation quality. As the industry's first open-source model for physical simulation and explorable world generation, Hunyuan3D World Model 1.0 aims to foster a collaborative community ecosystem with developers and enthusiasts. ✨ Try it now: 🤗 Hugging Face:

Tencent Hy

23,240 просмотров • 1 год назад

Wonderland: Navigating 3D Scenes from a Single Image Contributions: • First, we introduce a representation for controllable 3D generation by leveraging the generative priors from camera-guided video diffusion models. Unlike image models, video diffusion models are trained on extensive video datasets. This enables them to capture comprehensive spatial relationships within scenes across multiple views and embed a form of "3D awareness" in their latent space, which allows us to maintain 3D consistency in novel view synthesis. • Second, to achieve controllable novel view generation, we empower video models with precise control over specified camera motions. We introduce a novel dual-branch conditioning mechanism that effectively incorporates desired diverse camera trajectories into the video diffusion model. This enables expansion of a single image into a multi-view consistent capture of a 3D scene with precise pose control. • Third, to achieve efficient 3D reconstruction, we directly transform video latents into 3DGS. We propose a novel latent-based large reconstruction model (LaLRM) that lifts video latents to 3D in a feed-forward manner. With this design, during inference, our model directly predicts 3DGS from a single input image, effectively aligning the generation and reconstruction tasks—and bridging image space and 3D space—through the video latent space. Compared with reconstructing scenes from images, the video latent space offers a 256× spatial-temporal reduction while retaining essential and consistent 3D structural details. Such a high degree of compression is crucial, as it allows the LaLRM to handle a wider range of 3D scenes within the reconstruction framework, with the same memory constraints.
0:12

Wonderland: Navigating 3D Scenes from a Single Image Contributions: • First, we introduce a representation for controllable 3D generation by leveraging the generative priors from camera-guided video diffusion models. Unlike image models, video diffusion models are trained on extensive video datasets. This enables them to capture comprehensive spatial relationships within scenes across multiple views and embed a form of "3D awareness" in their latent space, which allows us to maintain 3D consistency in novel view synthesis. • Second, to achieve controllable novel view generation, we empower video models with precise control over specified camera motions. We introduce a novel dual-branch conditioning mechanism that effectively incorporates desired diverse camera trajectories into the video diffusion model. This enables expansion of a single image into a multi-view consistent capture of a 3D scene with precise pose control. • Third, to achieve efficient 3D reconstruction, we directly transform video latents into 3DGS. We propose a novel latent-based large reconstruction model (LaLRM) that lifts video latents to 3D in a feed-forward manner. With this design, during inference, our model directly predicts 3DGS from a single input image, effectively aligning the generation and reconstruction tasks—and bridging image space and 3D space—through the video latent space. Compared with reconstructing scenes from images, the video latent space offers a 256× spatial-temporal reduction while retaining essential and consistent 3D structural details. Such a high degree of compression is crucial, as it allows the LaLRM to handle a wider range of 3D scenes within the reconstruction framework, with the same memory constraints.

MrNeRF

52,849 просмотров • 1 год назад

is it legal? NVIDIA and Microsoft just open-sourced the pieces of a full 3D studio for Opus 5.5 15 github repos, sorted by what you want to make: GENERATE 3D ASSETS 01. TRELLIS.2 by Microsoft: -> one image in, a fully textured 3D asset out, about 3 seconds on an H100 02. Hunyuan3D-2.1 by Tencent: -> production-ready 3D assets with PBR textures 03. stable-fast-3d by Stability AI: -> one photo to a clean UV-unwrapped mesh, built for speed 04. meshy-mcp-server by Meshy: -> text or image to 3D, then remesh, retexture, rig and animate from your agent BUILD SCENES AND WORLDS 05. mcp-for-blender: -> prompt-driven modeling, scene building and edits in a live Blender 06. HY-World-2.0 by Tencent: -> text or a single image to a navigable 3D world 07. supersplat by PlayCanvas: -> inspect, edit, optimize and publish 3D Gaussian splats in the browser 08. kit-usd-agents by NVIDIA: -> edit Omniverse USD scenes in plain English, plus MCP servers for Kit and Isaac Sim MAKE A GAME 09. unity-mcp: -> run the Unity Editor in plain English: scenes, C# scripts, assets, tests, builds 10. godot-ai: -> 46 tools for a live Godot editor: scenes, scripts, signals, UI, particles 11. unreal-engine-mcp: -> drive a live Unreal Editor: actors, world building, Blueprints 3D ON THE WEB 12. editor-mcp-server by PlayCanvas: -> your agent builds PlayCanvas scenes and checks they actually run 13. three.js: -> the JavaScript 3D library itself, 115k stars on GitHub 14. react-three-fiber: -> build three.js scenes as reusable React components 15. threejs-skills: -> 10 three.js skills for Claude Code, from shaders to post-processing a full 3D pipeline, and every piece of it lives on github
0:20

is it legal? NVIDIA and Microsoft just open-sourced the pieces of a full 3D studio for Opus 5.5 15 github repos, sorted by what you want to make: GENERATE 3D ASSETS 01. TRELLIS.2 by Microsoft: -> one image in, a fully textured 3D asset out, about 3 seconds on an H100 02. Hunyuan3D-2.1 by Tencent: -> production-ready 3D assets with PBR textures 03. stable-fast-3d by Stability AI: -> one photo to a clean UV-unwrapped mesh, built for speed 04. meshy-mcp-server by Meshy: -> text or image to 3D, then remesh, retexture, rig and animate from your agent BUILD SCENES AND WORLDS 05. mcp-for-blender: -> prompt-driven modeling, scene building and edits in a live Blender 06. HY-World-2.0 by Tencent: -> text or a single image to a navigable 3D world 07. supersplat by PlayCanvas: -> inspect, edit, optimize and publish 3D Gaussian splats in the browser 08. kit-usd-agents by NVIDIA: -> edit Omniverse USD scenes in plain English, plus MCP servers for Kit and Isaac Sim MAKE A GAME 09. unity-mcp: -> run the Unity Editor in plain English: scenes, C# scripts, assets, tests, builds 10. godot-ai: -> 46 tools for a live Godot editor: scenes, scripts, signals, UI, particles 11. unreal-engine-mcp: -> drive a live Unreal Editor: actors, world building, Blueprints 3D ON THE WEB 12. editor-mcp-server by PlayCanvas: -> your agent builds PlayCanvas scenes and checks they actually run 13. three.js: -> the JavaScript 3D library itself, 115k stars on GitHub 14. react-three-fiber: -> build three.js scenes as reusable React components 15. threejs-skills: -> 10 three.js skills for Claude Code, from shaders to post-processing a full 3D pipeline, and every piece of it lives on github

Mnimiy

106,339 просмотров • 1 день назад

🚀🌍🚀 Echo-2 is live! It generates high-quality physically grounded 3D scenes instead of just pixels. Check out the open demo to create and explore worlds in real-time! I gave it a picture from my Himalayas trek—it handles the massive scale range really well! 🏔️🌍
0:12

🚀🌍🚀 Echo-2 is live! It generates high-quality physically grounded 3D scenes instead of just pixels. Check out the open demo to create and explore worlds in real-time! I gave it a picture from my Himalayas trek—it handles the massive scale range really well! 🏔️🌍

David Novotny

11,503 просмотров • 5 месяцев назад

If you need consistent, reoccurring scenes for your story it's never been easier. A thread on how I go about blocking out a 3D scene that I can then use for any reoccurring environment shots. As always - if this helps you please kindly like and share! 🩵 🧵BELOW 🧵
0:10

If you need consistent, reoccurring scenes for your story it's never been easier. A thread on how I go about blocking out a 3D scene that I can then use for any reoccurring environment shots. As always - if this helps you please kindly like and share! 🩵 🧵BELOW 🧵

A.I.Warper

31,302 просмотров • 1 год назад

✨ Any static 3D assets ➡️ 4D dynamic worlds. Introducing CHORD, a universal framework for generating scene-level 4D dynamic motion from any static 3D inputs. It generalizes surprisingly well across a wide range of objects 🤯 and can even be used to learn robotics manipulation policy 🤖! Project page: Dive deeper in a 🧵: 1/n
0:12

✨ Any static 3D assets ➡️ 4D dynamic worlds. Introducing CHORD, a universal framework for generating scene-level 4D dynamic motion from any static 3D inputs. It generalizes surprisingly well across a wide range of objects 🤯 and can even be used to learn robotics manipulation policy 🤖! Project page: Dive deeper in a 🧵: 1/n

Chen Geng

43,578 просмотров • 9 месяцев назад

👉 I created « Next Scene » for Qwen Image Edit 2509 and you can make next scenes keeping character, lighting, environment . And it’s totally open-source ( no restrictions !! ) Just use the prompt « Next scene: » and explain what you want. I trained it on hundreds of paired shots to preserve characters, lighting, and mood between scenes. ( Soon I will explain what tools I created that can manage classification and caption of data when you have more than 10 000 of items, using workers and a total new way to classify data ) . Built for storytellers working with ComfyUI or other diffusers pipe ;) ! ComfyUI
0:17

👉 I created « Next Scene » for Qwen Image Edit 2509 and you can make next scenes keeping character, lighting, environment . And it’s totally open-source ( no restrictions !! ) Just use the prompt « Next scene: » and explain what you want. I trained it on hundreds of paired shots to preserve characters, lighting, and mood between scenes. ( Soon I will explain what tools I created that can manage classification and caption of data when you have more than 10 000 of items, using workers and a total new way to classify data ) . Built for storytellers working with ComfyUI or other diffusers pipe ;) ! ComfyUI

Lovis Odin

66,941 просмотров • 1 год назад

If you need to generate a target-specific wordlist, make sure to check out / XNL -н4cĸ3r (and @xnl-h4ck3r in the new Sky) GAP extension. It will scan for sus parameters and generate you a complete wordlist with one click of a button. See it in action 👇
0:14

If you need to generate a target-specific wordlist, make sure to check out / XNL -н4cĸ3r (and @xnl-h4ck3r in the new Sky) GAP extension. It will scan for sus parameters and generate you a complete wordlist with one click of a button. See it in action 👇

André Baptista

13,642 просмотров • 10 месяцев назад

🚨 Wait… I think I just discovered something HUGE about AI-generated 3D models. I found Hyper3D’s new Agentic Mode that can BUILD, EDIT & ANIMATE 3D models!! And there’s one thing that really surprised me. Unlike regular 3D generation, Agentic Mode can automatically filter and organize more informative input. You can give it different views, individual parts, or even a single reference image of separate components… And it can figure out how they fit together and generate a complete 3D model — with surprisingly accurate structure and details. That’s something I haven’t seen regular 3D generation handle this well. Check out this 3D windmill animation 👇 Hyper3D Agentic Mode lets you control 3D models with PARAMETERS !! Instead of rebuilding the sofa from scratch, you can change things like: → Parametric Control → Animation Pressets → Enhance Materials So you can generate the model once... and keep editing its geometry without starting from scratch
0:17

🚨 Wait… I think I just discovered something HUGE about AI-generated 3D models. I found Hyper3D’s new Agentic Mode that can BUILD, EDIT & ANIMATE 3D models!! And there’s one thing that really surprised me. Unlike regular 3D generation, Agentic Mode can automatically filter and organize more informative input. You can give it different views, individual parts, or even a single reference image of separate components… And it can figure out how they fit together and generate a complete 3D model — with surprisingly accurate structure and details. That’s something I haven’t seen regular 3D generation handle this well. Check out this 3D windmill animation 👇 Hyper3D Agentic Mode lets you control 3D models with PARAMETERS !! Instead of rebuilding the sofa from scratch, you can change things like: → Parametric Control → Animation Pressets → Enhance Materials So you can generate the model once... and keep editing its geometry without starting from scratch

SARAH

91,217 просмотров • 14 дней назад

Hy4 preview is now available on WorkBuddy, where users can switch between Work and Coding tasks. The model can execute a wide range of different tasks, including one-shotting complex artifacts. Black hole simulation 👀 Also, Hy4 preview has been compressed from 1.5TB to ~200GiB GGUF, so you can now run it locally if you have a proper setup!
0:11

Hy4 preview is now available on WorkBuddy, where users can switch between Work and Coding tasks. The model can execute a wide range of different tasks, including one-shotting complex artifacts. Black hole simulation 👀 Also, Hy4 preview has been compressed from 1.5TB to ~200GiB GGUF, so you can now run it locally if you have a proper setup!

🚨 AI News | TestingCatalog

19,407 просмотров • 1 месяц назад

Two months ago, at an RSS workshop panel, I said that general real2sim reconstruction is still far from solved, especially for articulated objects, which will be a major bottleneck for robotics. But now that has totally changed with Astra; using several photos as input, we can easily reconstruct vivid articulated scenes. The result is so impressive! Excited to see how it will shift the paradigm of real2sim2real and agentic learning for robotics and humanoids.
0:12

Two months ago, at an RSS workshop panel, I said that general real2sim reconstruction is still far from solved, especially for articulated objects, which will be a major bottleneck for robotics. But now that has totally changed with Astra; using several photos as input, we can easily reconstruct vivid articulated scenes. The result is so impressive! Excited to see how it will shift the paradigm of real2sim2real and agentic learning for robotics and humanoids.

Siyuan Huang

19,239 просмотров • 1 месяц назад

world models have their comfyui now. introducing alakazam studio, the first local, open source UI for world models. •⁠ ⁠sentence goes in => you edit the state graph => play •⁠ ⁠on a live model, yours, running in your browser •⁠ ⁠⁠apache-2.0, fully open source fork it and point it at your model 👇
0:19

world models have their comfyui now. introducing alakazam studio, the first local, open source UI for world models. •⁠ ⁠sentence goes in => you edit the state graph => play •⁠ ⁠on a live model, yours, running in your browser •⁠ ⁠⁠apache-2.0, fully open source fork it and point it at your model 👇

hugo

26,438 просмотров • 2 месяцев назад

Big news for everyone who loves making videos! 🎉 CapCut just dropped Seedance 2.5! Now you can generate your AI clips AND edit them in the exact same workspace. No hassle, just pure creativity! ✨ What’s fresh: Control scenes by timestamp Input up to 50 references Generate up to 90 seconds Green screen friendly Multi-language support Check it out ⬇️ 💻 Web: 📱 App: #CapCut #Seedance25 #CapCutai #CapCutDidThat
0:15

Big news for everyone who loves making videos! 🎉 CapCut just dropped Seedance 2.5! Now you can generate your AI clips AND edit them in the exact same workspace. No hassle, just pure creativity! ✨ What’s fresh: Control scenes by timestamp Input up to 50 references Generate up to 90 seconds Green screen friendly Multi-language support Check it out ⬇️ 💻 Web: 📱 App: #CapCut #Seedance25 #CapCutai #CapCutDidThat

NeuraFlow AI

56,537 просмотров • 2 месяцев назад

✨ 3d models are now LIVE on Photo AI 😊 You can now turn any AI photo you make into a 3d model by pressing [ 📦 Make 3d model ] And then you can view it inside Photo AI or download it as a .GLB 3d model file It's still very early in AI generated 3d model world but it's nice to have this feature working already As always, the models will keep improving, so this feature will keep getting better (like it did with video, it sucked before, now it's getting passable) Next would be nice to switch to .USDZ so you can load it straight into your iPhone with ARKit and put it in your room Available now for everyone on the Premium and Ultra plan
0:19

✨ 3d models are now LIVE on Photo AI 😊 You can now turn any AI photo you make into a 3d model by pressing [ 📦 Make 3d model ] And then you can view it inside Photo AI or download it as a .GLB 3d model file It's still very early in AI generated 3d model world but it's nice to have this feature working already As always, the models will keep improving, so this feature will keep getting better (like it did with video, it sucked before, now it's getting passable) Next would be nice to switch to .USDZ so you can load it straight into your iPhone with ARKit and put it in your room Available now for everyone on the Premium and Ultra plan

@levelsio

112,930 просмотров • 1 год назад