Loading video...

Video Failed to Load

There was a problem loading this video. This could be due to a temporary network issue or the video might be unavailable.

✨Introducing Neuralangelo✨ A new #AI model to turn 2D video from any device -- cell phone to drone capture -- into 3D structures with intricate details. New from #NVIDIAResearch #CVPR2023 Read more:

NVIDIA AI Developer

111,635 subscribers

497,945 views • 3 years ago •via X (Twitter)

Science & Technology #AI #NVIDIAResearch #CVPR2023

Anya Rossi• Live Now

Private livecam show

10 Comments

NVIDIA AI Developer3 years ago

Link to the full research paper:

Multi AI3 years ago

Hey guys! Can we be helpful to each other? 🙃

Lhun3 years ago

So uhhhh, can I have the code? Like right now? Please. T.T When code?

Mr F3 years ago

@mmalex Apart from fancy marketing it is unclear how it compares to existing photogrammetry software... quality seems to be not noticeably superior (for a phone footage), also having similar problems with e.g. glass/foliage

Crystalwizard3 years ago

@mreflow

Simplifying AI3 years ago

@NVIDIAAI magic

MasteringMachines AI3 years ago

@NVIDIAAI @GetVideoBot

Crash3 years ago

So photogrammetry?

THE HUB3 years ago

Gotta say it .. #metaverse opportunities everywhere! 🚀

Jetbe3 years ago

Дивись, @IrenKotyk наскільки смачніше ніж FARO з хмарами точок 🤌🏻

Related Videos

AI just took 3D modeling to a whole new level 🤯 Introducing Neuralangelo, a new AI model by NVIDIA that reconstructs mind-blowingly detailed 3D surfaces directly from 2D videos — like photogrammetry on steroids. 🧙🏻‍♂️ Keep reading to see this crazy magic for yourself 🧵

AI just took 3D modeling to a whole new level 🤯 Introducing Neuralangelo, a new AI model by NVIDIA that reconstructs mind-blowingly detailed 3D surfaces directly from 2D videos — like photogrammetry on steroids. 🧙🏻‍♂️ Keep reading to see this crazy magic for yourself 🧵

Bilawal Sidhu

720,932 views • 3 years ago

Introducing Spell, a model to generate 3D worlds. A new era for 3D. ✨ (Thread - Link Below)

Introducing Spell, a model to generate 3D worlds. A new era for 3D. ✨ (Thread - Link Below)

Spline

381,852 views • 1 year ago

Google's Android XR is getting an AI feature that can turn any 2D content, including games streamed from your PC, into 3D. Details here:

Google's Android XR is getting an AI feature that can turn any 2D content, including games streamed from your PC, into 3D. Details here:

UploadVR

64,088 views • 7 months ago

Creativity unleashed 👨‍🎨🎨✨ 👀 Edify3D from #NVIDIAResearch explores a new way to generate text-to-#3D images. 📗 Project page: 📝 Paper: 🔊 sound on

Creativity unleashed 👨‍🎨🎨✨ 👀 Edify3D from #NVIDIAResearch explores a new way to generate text-to-#3D images. 📗 Project page: 📝 Paper: 🔊 sound on

NVIDIA AI Developer

177,497 views • 1 year ago

Introducing a new approach for editing images, now live in the Auto frame feature in Google Photos. Our method interprets 2D photos as 3D scenes, allowing you to re-capture moments from a new perspective after the photos have been taken. Read all about it:

Introducing a new approach for editing images, now live in the Auto frame feature in Google Photos. Our method interprets 2D photos as 3D scenes, allowing you to re-capture moments from a new perspective after the photos have been taken. Read all about it:

Google Research

23,793 views • 2 months ago

Introducing Cube 2.0, a significant step towards controllable 3D game-world and video generation from any input. Powered by: 🌟 Image-to-3D in seconds w/ a new foundation model 🐎 Text-to-animation 🌎 AI rendering to create beautiful worlds (mesh+splats) Web app → Discord → Blog →

Introducing Cube 2.0, a significant step towards controllable 3D game-world and video generation from any input. Powered by: 🌟 Image-to-3D in seconds w/ a new foundation model 🐎 Text-to-animation 🌎 AI rendering to create beautiful worlds (mesh+splats) Web app → Discord → Blog →

Common Sense Machines

411,381 views • 2 years ago

Introducing Lyria 3, our new music generation model in Gemini that lets you turn any idea, photo, or video into a high-fidelity track with custom lyrics. From funny jingles to lo-fi beats, you can create custom 30-second soundtracks for any moment.

Introducing Lyria 3, our new music generation model in Gemini that lets you turn any idea, photo, or video into a high-fidelity track with custom lyrics. From funny jingles to lo-fi beats, you can create custom 30-second soundtracks for any moment.

Google Gemini

19,824,726 views • 4 months ago

☕ The new LATTE3D model from #NVIDIAResearch turns text prompts into high-quality 3D representations of objects and animals within a second on a single RTX GPU. #GTC24 👀

☕ The new LATTE3D model from #NVIDIAResearch turns text prompts into high-quality 3D representations of objects and animals within a second on a single RTX GPU. #GTC24 👀

NVIDIA AI Developer

10,814 views • 2 years ago

✨ INTRODUCING the new adult novel from Jacqueline Wilson, a sequel to… ??? ✨ Signed copies:

✨ INTRODUCING the new adult novel from Jacqueline Wilson, a sequel to… ??? ✨ Signed copies:

Waterstones

22,912 views • 1 year ago

✨ Photo AI now has full integration with @kling_ai's new video model That means any AI photo you take of yourself, you can now turn into an AI video that actually gets very close to looking real It's the best AI video model out there and is now live for all Photo AI users 😊

✨ Photo AI now has full integration with @kling_ai's new video model That means any AI photo you take of yourself, you can now turn into an AI video that actually gets very close to looking real It's the best AI video model out there and is now live for all Photo AI users 😊

@levelsio

515,861 views • 1 year ago

Introducing Pixel To Poly, transform any 2D image into a stunning 3D game-ready avatar with ease, all for a simple flat fee of $199 USD. Orders can now be placed via: For more details, visit our Documentation:

Pixel To Poly

852,318 views • 2 years ago

🔴 Finally! NVIDIA has finally made the code for Neuralangelo public! It has the ability to transform any video into a highly detailed 3D environment, and it's a technology related to but DIFFERENT from NeRF. 💡 Here's how it works: It takes a 2D video as input, showing an object, monument, building, landscape, etc., from various perspectives and analyzes details such as depth, size, and the shapes of objects. From this, the AI sketches an initial 3D model, similar to how an artist molds a figure. This representation is then refined to highlight more details, just as an artist would make the final touches when sculpting. The result is a 3D environment/model, perfect for use in any environment. Imagine the applications it will have for video games, cinema, virtual environments, VR, and more! 📽️🎮 💡 More details: A year ago, an article was presented on a groundbreaking technique called NVIDIA's Instant NeRF. This technique turns images into stunning 3D scenes in a short time, ideal for creating realistic models for video games and other applications. Although Instant NeRF had a lot of potential, the generated models were not perfect and often lacked detailed structures, appearing somewhat cartoonish. A year on, NVIDIA releases a new technique based on Instant NeRF, named Neuralangelo. This enhances the fidelity of surface structures. While NeRF reconstructs real objects in virtual environments from images or videos, Instant NeRF speeds up this process, and Neuralangelo further improves the quality, making the generated objects appear even more realistic when examined up close. Neuralangelo improves Instant NeRF's approach in two key ways related to the hash grid encoding technique: 1⃣ Numerical gradients have been used to compute higher-order derivatives as a smoothing operation. This optimizes the "hash grid" encoding using numerical rather than analytical gradients, providing a smoother input to the network that produces the 3D model. 2⃣ A "coarse-to-fine" optimization has been implemented in the hash grids to control different levels of detail. That is, they first focus on a smoothed version of the scene, and then refine it with more detailed updates. Well, as Arthur C. Clarke said, "Any sufficiently advanced technology is indistinguishable from magic."

🔴 Finally! NVIDIA has finally made the code for Neuralangelo public! It has the ability to transform any video into a highly detailed 3D environment, and it's a technology related to but DIFFERENT from NeRF. 💡 Here's how it works: It takes a 2D video as input, showing an object, monument, building, landscape, etc., from various perspectives and analyzes details such as depth, size, and the shapes of objects. From this, the AI sketches an initial 3D model, similar to how an artist molds a figure. This representation is then refined to highlight more details, just as an artist would make the final touches when sculpting. The result is a 3D environment/model, perfect for use in any environment. Imagine the applications it will have for video games, cinema, virtual environments, VR, and more! 📽️🎮 💡 More details: A year ago, an article was presented on a groundbreaking technique called NVIDIA's Instant NeRF. This technique turns images into stunning 3D scenes in a short time, ideal for creating realistic models for video games and other applications. Although Instant NeRF had a lot of potential, the generated models were not perfect and often lacked detailed structures, appearing somewhat cartoonish. A year on, NVIDIA releases a new technique based on Instant NeRF, named Neuralangelo. This enhances the fidelity of surface structures. While NeRF reconstructs real objects in virtual environments from images or videos, Instant NeRF speeds up this process, and Neuralangelo further improves the quality, making the generated objects appear even more realistic when examined up close. Neuralangelo improves Instant NeRF's approach in two key ways related to the hash grid encoding technique: 1⃣ Numerical gradients have been used to compute higher-order derivatives as a smoothing operation. This optimizes the "hash grid" encoding using numerical rather than analytical gradients, providing a smoother input to the network that produces the 3D model. 2⃣ A "coarse-to-fine" optimization has been implemented in the hash grids to control different levels of detail. That is, they first focus on a smoothed version of the scene, and then refine it with more detailed updates. Well, as Arthur C. Clarke said, "Any sufficiently advanced technology is indistinguishable from magic."

Javi Lopez ⛩️

689,128 views • 2 years ago

✨INTRODUCING the new adult novel from Jacqueline Wilson, a sequel to… ???✨ Pre-order PICTURE IMPERFECT now:

Sensitive content

✨INTRODUCING the new adult novel from Jacqueline Wilson, a sequel to… ???✨ Pre-order PICTURE IMPERFECT now:

Jacqueline Wilson

47,953 views • 1 year ago

I dramatically shifted my stream's perspective from 2D to 3D. Chat thought we were starting the stream in our standard 2D overlay, until I zoomed out to reveal my new 3D vtuber model.

I dramatically shifted my stream's perspective from 2D to 3D. Chat thought we were starting the stream in our standard 2D overlay, until I zoomed out to reveal my new 3D vtuber model.

shindigs

89,867 views • 1 year ago

🎵 ✨The world’s most flexible sound machine? With text and audio inputs, this new #generativeAI model, named Fugatto, can create any combination of music, voices, and sounds.🎹 Read more in our blog by richardkerris ➡️ #NVIDIAResearch Note: Some music, sounds, and the voice of NVIDIA CEO Jensen Huang used in this video are AI generated.

🎵 ✨The world’s most flexible sound machine? With text and audio inputs, this new #generativeAI model, named Fugatto, can create any combination of music, voices, and sounds.🎹 Read more in our blog by richardkerris ➡️ #NVIDIAResearch Note: Some music, sounds, and the voice of NVIDIA CEO Jensen Huang used in this video are AI generated.

NVIDIA AI Developer

90,328 views • 1 year ago

✨ Commissions OPEN for 3D Models ✨ ⚜️Create 3D models with rich detail and refined visual effects. ⚜️More info: ⚜️Looking forward to hearing from you❤ ✨Let’s bring your 2D characters to life in 3D✨ #3DCG #Commission #Vtuber #warudo #VGenOpen

✨ Commissions OPEN for 3D Models ✨ ⚜️Create 3D models with rich detail and refined visual effects. ⚜️More info: ⚜️Looking forward to hearing from you❤ ✨Let’s bring your 2D characters to life in 3D✨ #3DCG #Commission #Vtuber #warudo #VGenOpen

Blaird_COMMOPEN

15,785 views • 5 months ago

Introducing Lyria 3, our new music generation model in Gemini that lets you turn any idea, photo, or video into a high-fidelity track with custom lyrics. From funny jingles to lo-fi beats, you can create custom 30-second soundtracks for any moment. See how it works. 🧵

Introducing Lyria 3, our new music generation model in Gemini that lets you turn any idea, photo, or video into a high-fidelity track with custom lyrics. From funny jingles to lo-fi beats, you can create custom 30-second soundtracks for any moment. See how it works. 🧵

Google Gemini

4,648,307 views • 4 months ago

Introducing Seedance 1.0 Pro Fast From concept to content in seconds, not minutes ByteDance’s fastest AI video model in the Freepik AI suite Read more below 👇🧵

Introducing Seedance 1.0 Pro Fast From concept to content in seconds, not minutes ByteDance’s fastest AI video model in the Freepik AI suite Read more below 👇🧵

Magnific (formerly Freepik)

84,431 views • 8 months ago