Video wird geladen...

Video konnte nicht geladen werden

Beim Laden dieses Videos ist ein Problem aufgetreten. Dies könnte an einem vorübergehenden Netzwerkproblem liegen oder das Video ist möglicherweise nicht verfügbar.

AI just took 3D modeling to a whole new level 🤯 Introducing Neuralangelo, a new AI model by NVIDIA that reconstructs mind-blowingly detailed 3D surfaces directly from 2D videos — like photogrammetry on steroids. 🧙🏻‍♂️ Keep reading to see this crazy magic for yourself 🧵

Bilawal Sidhu

118,566 subscribers

721,064 Aufrufe • vor 3 Jahren •via X (Twitter)

Kunst Wissenschaft & Technologie

Anya Rossi• Live Now

Private livecam show

11 Kommentare

Profilbild von Bilawal Sidhu

Bilawal Sidhuvor 3 Jahren

So, what the heck is is this "photogrammetry" thing NVIDIA is supercharging with AI? TL;DR photogrammetry is the art & science of measuring stuff in the real world using images and other sensors (e.g. LiDAR). Here's a 60 second primer:

Profilbild von Bilawal Sidhu

Bilawal Sidhuvor 3 Jahren

NVIDIA's new AI model is basically like photogrammetry on steroids. Why? Traditional photogrammetry can't handle repetitive structures, textureless surfaces or strong color variations. But Neuralangelo blends the tech behind Instant NeRF to capture every detail imaginable.

Profilbild von Bilawal Sidhu

Bilawal Sidhuvor 3 Jahren

Thus far, NeRFs & Photogrammetry have served different purposes: - NeRFs: Stunning visualizations (think flythroughs) but lack surface detail when turned into 3D meshes - Photogrammetry: Great for surface reconstruction (think measuring stuff) but not always visually appealing

Profilbild von Bilawal Sidhu

Bilawal Sidhuvor 3 Jahren

Neurangelo is the game-changer we've been waiting for. Its neural approach delivers the best of both worlds by bridging the gap between visuals and surface reconstruction. Say goodbye to blobby results: Neurangelo gives crisp 3D surfaces that make you salivate just seeing them.

Profilbild von Bilawal Sidhu

Bilawal Sidhuvor 3 Jahren

Neurangelo's coarse-to-fine optimization is like sculpting in 3D. First, a rough 3D scene emerges, just as a sculptor chisels a block and refines it bit by bit. Notice how details like the tree and bike rack may be missing at first, but they're successfully recovered later on.

Profilbild von Bilawal Sidhu

Bilawal Sidhuvor 3 Jahren

In summary, Neuralangelo represents a significant advance: achieving both realistic visuals + finely detailed 3D models that stay true to surfaces, unlocking new possibilities for digital twins, gaming and visual effects. NVIDIA is back at it again!

Profilbild von Bilawal Sidhu

Bilawal Sidhuvor 3 Jahren

Plus, @nvidia's got 30 more AI projects debuting at the top computer vision conference (CVPR) later this month. So brace yourself! Follow me @bilawalsidhu for the latest in AI, AR and 3D tech. And if you found this helpful, feel free to like/retweet to show your support ❤️

Profilbild von J Dakota Powell

J Dakota Powellvor 3 Jahren

But someone has to retopologize all that geo for it to be even remotely usable - even if there's AI to do the retopo, inevitably someone has to step in to correct that version. Need reality checks on AI this-that, it's not a silver bullet.

Profilbild von Bilawal Sidhu

Bilawal Sidhuvor 3 Jahren

Agreed, nothing is ever a silver bullet, but much cleaner geometry is a big step in the right direction. I’ve frequently tweet that retopo needs some AI magic — seems asset optimization is the one thing humans are still better at (for now).

Profilbild von Rushik

Rushikvor 3 Jahren

Apple's XR tech coupled with this tech can "create new worlds"

Profilbild von Bilawal Sidhu

Bilawal Sidhuvor 3 Jahren

Indeed. And Apple does have their own photogrammetry API (which folks like Polycam and others use in their 3d capture apps) -- will be interesting to see if they announce any updates to it.

Ähnliche Videos

✨Introducing Neuralangelo✨ A new #AI model to turn 2D video from any device -- cell phone to drone capture -- into 3D structures with intricate details. New from #NVIDIAResearch #CVPR2023 Read more:

✨Introducing Neuralangelo✨ A new #AI model to turn 2D video from any device -- cell phone to drone capture -- into 3D structures with intricate details. New from #NVIDIAResearch #CVPR2023 Read more:

NVIDIA AI Developer

498,074 Aufrufe • vor 3 Jahren

Generative AI is making big leaps every passing day. Found ChatGPT interesting, check out this new AI model from CMU that can bring your ideas to life. AI that can create brilliant 3D renders from 2D images in a matter of seconds 🤯

Generative AI is making big leaps every passing day. Found ChatGPT interesting, check out this new AI model from CMU that can bring your ideas to life. AI that can create brilliant 3D renders from 2D images in a matter of seconds 🤯

Shubham Saboo

100,813 Aufrufe • vor 3 Jahren

I see your text prompt and raise you my 3d to anything.. It's all about control if we want Gen ai to be a useful creative tool. Keep reading to see the finished images based on this technique.🧵 #ai #art

I see your text prompt and raise you my 3d to anything.. It's all about control if we want Gen ai to be a useful creative tool. Keep reading to see the finished images based on this technique.🧵 #ai #art

Martin Nebelong

129,015 Aufrufe • vor 2 Jahren

Introducing Eye Contact by NVIDIA 👀 NVIDIA just released a new Eye Contact feature that uses AI to make you look into the camera.

Introducing Eye Contact by NVIDIA 👀 NVIDIA just released a new Eye Contact feature that uses AI to make you look into the camera.

Jousef Murad

11,877,124 Aufrufe • vor 3 Jahren

Here's a look behind the scenes of how I used a 3d model, generated from an image, as a "driver" for ai animation. In the near future we'll see more 3d tools that support these types of workflows, with much more emphasis on enhancing user input instead of just letting the ai do everything. I used the 3d model to generate keyframes that I then animated in Luma Dream. By using a 3d model with a diffusion "layer" done with Krea, I got quite high quality frames with a relatively high consistency as well since the AI didn't have to "hallucinate" that much. I upscaled and detailed the frames using Magnific. Using semi-detailed 3d models as drivers for gen ai is very powerful, and it allows us to use models that are sculpted in a more free-flowing type of workflow that doesn't rely so much on high surface detailing or very time-consuming finish, but instead relies more on gestural 3d sculpting. #art #ai

Here's a look behind the scenes of how I used a 3d model, generated from an image, as a "driver" for ai animation. In the near future we'll see more 3d tools that support these types of workflows, with much more emphasis on enhancing user input instead of just letting the ai do everything. I used the 3d model to generate keyframes that I then animated in Luma Dream. By using a 3d model with a diffusion "layer" done with Krea, I got quite high quality frames with a relatively high consistency as well since the AI didn't have to "hallucinate" that much. I upscaled and detailed the frames using Magnific. Using semi-detailed 3d models as drivers for gen ai is very powerful, and it allows us to use models that are sculpted in a more free-flowing type of workflow that doesn't rely so much on high surface detailing or very time-consuming finish, but instead relies more on gestural 3d sculpting. #art #ai

Martin Nebelong

48,280 Aufrufe • vor 2 Jahren

You can build your 3D models directly from a prompt into Claude code. All thanks to this beautiful python project, build123 a parametric modeling framework for 2D and 3D CAD. It is built on the Open Cascade geometric kernel and it is suitable for 3D printing.

You can build your 3D models directly from a prompt into Claude code. All thanks to this beautiful python project, build123 a parametric modeling framework for 2D and 3D CAD. It is built on the Open Cascade geometric kernel and it is suitable for 3D printing.

Marco Franzon

20,869 Aufrufe • vor 6 Monaten

oh may.. 3D Gaussian Splat is so crazy now last time we need weeks to turn a room into a 3D model.. now with AI 3DGS, you do it in seconds… even zoom into the text and looks perfect give it like 6 months… you can turn a whole city into a full detailed 3D model

oh may.. 3D Gaussian Splat is so crazy now last time we need weeks to turn a room into a 3D model.. now with AI 3DGS, you do it in seconds… even zoom into the text and looks perfect give it like 6 months… you can turn a whole city into a full detailed 3D model

el.cine

143,676 Aufrufe • vor 10 Monaten

HOLY SHIT! Sparc 3D is INSANE! All they need to do now is enable PBR texture support, object separation and decimation and this in my opinion completely replaces photogrammetry. The quality of the reconstruction of these 3D objects from a single image is mind blowing to me. Yes, the model is insanely dense to allow all of this detail but the fact that AI can generate with this level of fidelity is CRAZY!!! You can try it for free on Huggingface

HOLY SHIT! Sparc 3D is INSANE! All they need to do now is enable PBR texture support, object separation and decimation and this in my opinion completely replaces photogrammetry. The quality of the reconstruction of these 3D objects from a single image is mind blowing to me. Yes, the model is insanely dense to allow all of this detail but the fact that AI can generate with this level of fidelity is CRAZY!!! You can try it for free on Huggingface

Travis Davids

18,230 Aufrufe • vor 1 Jahr

Introducing Cube 2.0, a significant step towards controllable 3D game-world and video generation from any input. Powered by: 🌟 Image-to-3D in seconds w/ a new foundation model 🐎 Text-to-animation 🌎 AI rendering to create beautiful worlds (mesh+splats) Web app → Discord → Blog →

Introducing Cube 2.0, a significant step towards controllable 3D game-world and video generation from any input. Powered by: 🌟 Image-to-3D in seconds w/ a new foundation model 🐎 Text-to-animation 🌎 AI rendering to create beautiful worlds (mesh+splats) Web app → Discord → Blog →

Common Sense Machines

411,413 Aufrufe • vor 2 Jahren

I want to give the vtuber community an affordable way to have a high quality 3D model, just like a Live2D customizable model, but for 3D! -^u^- Here's a sneak peak of the new hair art style, it's so detailed! This will be our biggest update yet!🩷

I want to give the vtuber community an affordable way to have a high quality 3D model, just like a Live2D customizable model, but for 3D! -^u^- Here's a sneak peak of the new hair art style, it's so detailed! This will be our biggest update yet!🩷

Pastell & Palette🤍 3D Customizable Model!

33,967 Aufrufe • vor 5 Monaten

📣 New research from GenAI at Meta, introducing Meta 3D Gen: A new system for end-to-end generation of 3D assets from text in <1min. Meta 3D Gen is a new combined AI system that can generate high-quality 3D assets, with both high-resolution textures and material maps end-to-end, producing results that are superior to existing solutions — at 3-10x the speed of existing work in this space. Details in the technical report ➡️

📣 New research from GenAI at Meta, introducing Meta 3D Gen: A new system for end-to-end generation of 3D assets from text in <1min. Meta 3D Gen is a new combined AI system that can generate high-quality 3D assets, with both high-resolution textures and material maps end-to-end, producing results that are superior to existing solutions — at 3-10x the speed of existing work in this space. Details in the technical report ➡️

AI at Meta

409,069 Aufrufe • vor 2 Jahren

🔴 Finally! NVIDIA has finally made the code for Neuralangelo public! It has the ability to transform any video into a highly detailed 3D environment, and it's a technology related to but DIFFERENT from NeRF. 💡 Here's how it works: It takes a 2D video as input, showing an object, monument, building, landscape, etc., from various perspectives and analyzes details such as depth, size, and the shapes of objects. From this, the AI sketches an initial 3D model, similar to how an artist molds a figure. This representation is then refined to highlight more details, just as an artist would make the final touches when sculpting. The result is a 3D environment/model, perfect for use in any environment. Imagine the applications it will have for video games, cinema, virtual environments, VR, and more! 📽️🎮 💡 More details: A year ago, an article was presented on a groundbreaking technique called NVIDIA's Instant NeRF. This technique turns images into stunning 3D scenes in a short time, ideal for creating realistic models for video games and other applications. Although Instant NeRF had a lot of potential, the generated models were not perfect and often lacked detailed structures, appearing somewhat cartoonish. A year on, NVIDIA releases a new technique based on Instant NeRF, named Neuralangelo. This enhances the fidelity of surface structures. While NeRF reconstructs real objects in virtual environments from images or videos, Instant NeRF speeds up this process, and Neuralangelo further improves the quality, making the generated objects appear even more realistic when examined up close. Neuralangelo improves Instant NeRF's approach in two key ways related to the hash grid encoding technique: 1⃣ Numerical gradients have been used to compute higher-order derivatives as a smoothing operation. This optimizes the "hash grid" encoding using numerical rather than analytical gradients, providing a smoother input to the network that produces the 3D model. 2⃣ A "coarse-to-fine" optimization has been implemented in the hash grids to control different levels of detail. That is, they first focus on a smoothed version of the scene, and then refine it with more detailed updates. Well, as Arthur C. Clarke said, "Any sufficiently advanced technology is indistinguishable from magic."

🔴 Finally! NVIDIA has finally made the code for Neuralangelo public! It has the ability to transform any video into a highly detailed 3D environment, and it's a technology related to but DIFFERENT from NeRF. 💡 Here's how it works: It takes a 2D video as input, showing an object, monument, building, landscape, etc., from various perspectives and analyzes details such as depth, size, and the shapes of objects. From this, the AI sketches an initial 3D model, similar to how an artist molds a figure. This representation is then refined to highlight more details, just as an artist would make the final touches when sculpting. The result is a 3D environment/model, perfect for use in any environment. Imagine the applications it will have for video games, cinema, virtual environments, VR, and more! 📽️🎮 💡 More details: A year ago, an article was presented on a groundbreaking technique called NVIDIA's Instant NeRF. This technique turns images into stunning 3D scenes in a short time, ideal for creating realistic models for video games and other applications. Although Instant NeRF had a lot of potential, the generated models were not perfect and often lacked detailed structures, appearing somewhat cartoonish. A year on, NVIDIA releases a new technique based on Instant NeRF, named Neuralangelo. This enhances the fidelity of surface structures. While NeRF reconstructs real objects in virtual environments from images or videos, Instant NeRF speeds up this process, and Neuralangelo further improves the quality, making the generated objects appear even more realistic when examined up close. Neuralangelo improves Instant NeRF's approach in two key ways related to the hash grid encoding technique: 1⃣ Numerical gradients have been used to compute higher-order derivatives as a smoothing operation. This optimizes the "hash grid" encoding using numerical rather than analytical gradients, providing a smoother input to the network that produces the 3D model. 2⃣ A "coarse-to-fine" optimization has been implemented in the hash grids to control different levels of detail. That is, they first focus on a smoothed version of the scene, and then refine it with more detailed updates. Well, as Arthur C. Clarke said, "Any sufficiently advanced technology is indistinguishable from magic."

Javi Lopez ⛩️

689,325 Aufrufe • vor 3 Jahren

We're currently working to enhance our 3D Modeling Generator with a new feature! ✨ 👕 Our aim is to streamline fashion designers' implementation of their designs into 3D modeling by generating ready-made models in just a few clicks. We also plan to use this tool for virtual fashion shows and to provide ready-made models on websites. 📈 We're counting on this to significantly increase the utilization of Rosnet 3D Modeling Generator! 🌐 Stay tuned there are plenty of exciting possibilities ahead! #Arbitrum #AI

We're currently working to enhance our 3D Modeling Generator with a new feature! ✨ 👕 Our aim is to streamline fashion designers' implementation of their designs into 3D modeling by generating ready-made models in just a few clicks. We also plan to use this tool for virtual fashion shows and to provide ready-made models on websites. 📈 We're counting on this to significantly increase the utilization of Rosnet 3D Modeling Generator! 🌐 Stay tuned there are plenty of exciting possibilities ahead! #Arbitrum #AI

Rosnet

24,532 Aufrufe • vor 2 Jahren

More Adobe Substance Modeler +AI experiments. Using quick, gestural 3d sketching to drive generative AI with much higher levels of creative control than you could ever get from a text prompt alone. The more detailed your 3d model is, the more you can leave the ai to just finish details like skin texture and individual strands of hair.. my model is obviously just a quick sketch😅 #art #ai

More Adobe Substance Modeler +AI experiments. Using quick, gestural 3d sketching to drive generative AI with much higher levels of creative control than you could ever get from a text prompt alone. The more detailed your 3d model is, the more you can leave the ai to just finish details like skin texture and individual strands of hair.. my model is obviously just a quick sketch😅 #art #ai

Martin Nebelong

56,612 Aufrufe • vor 2 Jahren

🚨 A single image → a fully editable UE5 world. Introducing Lumera: a turnkey pipeline that reconstructs an engine-native 3D scene directly from ONE image — not just pixels, point clouds, or Gaussians. It gives you: → object-level 3D meshes → editable 3D layouts → engine-native lights → HDR environment lighting → a scene ready for Unreal Engine 5 In other words: Image → 3D world → UE5. We believe the future of image-to-3D is not “generate something that looks 3D.” It is generate the actual world project. 🌐 📄

🚨 A single image → a fully editable UE5 world. Introducing Lumera: a turnkey pipeline that reconstructs an engine-native 3D scene directly from ONE image — not just pixels, point clouds, or Gaussians. It gives you: → object-level 3D meshes → editable 3D layouts → engine-native lights → HDR environment lighting → a scene ready for Unreal Engine 5 In other words: Image → 3D world → UE5. We believe the future of image-to-3D is not “generate something that looks 3D.” It is generate the actual world project. 🌐 📄

Hao Zhao

52,093 Aufrufe • vor 1 Monat

Mind blown by this new CVPR 2026 paper: tttLRM🤯 It introduces a Test-Time Training layer for long-context autoregressive 3D reconstruction with linear complexity. Multiple image observations are compressed into fast weights that keep updating during inference, forming an implicit scene representation that can be decoded into explicit formats such as 3D Gaussian Splats. Progressive 3D reconstruction from streaming inputs is getting wild🥳It’s interesting to see how AI inference and real-world capture are starting to converge.

Mind blown by this new CVPR 2026 paper: tttLRM🤯 It introduces a Test-Time Training layer for long-context autoregressive 3D reconstruction with linear complexity. Multiple image observations are compressed into fast weights that keep updating during inference, forming an implicit scene representation that can be decoded into explicit formats such as 3D Gaussian Splats. Progressive 3D reconstruction from streaming inputs is getting wild🥳It’s interesting to see how AI inference and real-world capture are starting to converge.

KIRI Engine - 3D Scanner App

16,949 Aufrufe • vor 6 Monaten

Can we learn a 3D world model that predicts object dynamics directly from videos? Introducing Particle-Grid Neural Dynamics: a learning-based simulator for deformable objects that trains from real-world videos. Website: ArXiv: Code: Demo: To appear at #RSS2025

Can we learn a 3D world model that predicts object dynamics directly from videos? Introducing Particle-Grid Neural Dynamics: a learning-based simulator for deformable objects that trains from real-world videos. Website: ArXiv: Code: Demo: To appear at #RSS2025

Kaifeng Zhang

46,359 Aufrufe • vor 1 Jahr

Been pushing Rive's new 3D and shader support to see what's possible 🚀 Using AI + scripting, I was able to: • Import 3D models • Generate cameras and lights • Create custom shaders (wireframe, AO, sketch, toon) • Build materials • Project animated textures onto 3D geometry • Place 2D components directly in 3D space It's pretty wild to see how quickly Rive is evolving into a true all-in-one platform for interactive design.

Been pushing Rive's new 3D and shader support to see what's possible 🚀 Using AI + scripting, I was able to: • Import 3D models • Generate cameras and lights • Create custom shaders (wireframe, AO, sketch, toon) • Build materials • Project animated textures onto 3D geometry • Place 2D components directly in 3D space It's pretty wild to see how quickly Rive is evolving into a true all-in-one platform for interactive design.

Sanu Sagar

18,218 Aufrufe • vor 3 Monaten

Yay, finally! Introducing Vision Banana🍌 from Google DeepMind, our unified model that outperforms SoTA specialist models on various vision tasks! By treating 2D/3D vision tasks as image generation, we unlock a new foundation for CV. Project page: (1/5)

Yay, finally! Introducing Vision Banana🍌 from Google DeepMind, our unified model that outperforms SoTA specialist models on various vision tasks! By treating 2D/3D vision tasks as image generation, we unlock a new foundation for CV. Project page: (1/5)

Songyou Peng

290,105 Aufrufe • vor 5 Monaten