Loading video...

Video Failed to Load

There was a problem loading this video. This could be due to a temporary network issue or the video might be unavailable.

I finally got NVIDIA AI Developer's 3D Gaussian Unscented Transforms up and running natively on Windows via gsplat. Just in time for me to make a tutorial so people can enter NVIDIA's 3DGUT sweepstakes!!! Huge thanks to Ruilong Li for responding to my Github issues and solving my roadblocks... show more

Jonathan Stephens

12,151 subscribers

16,901 views • 1 year ago •via X (Twitter)

Arts Science & Technology Education

Anya Rossi• Live Now

Private livecam show

0 Comments

No comments available

Comments from the original post will appear here

Related Videos

As announced in partnership with NVIDIA at CES, we’re excited to introduce Stable Point Aware 3D (SPAR3D), setting a new standard in 3D generation. Ideal for running on NVIDIA RTX AI PCs, SPAR3D enables real-time editing and complete structure generation of 3D objects from a single image in under a second. You can download the weights on Hugging Face and code on GitHub, or access the model through the Stability AI API. Learn more here: (1/3)

As announced in partnership with NVIDIA at CES, we’re excited to introduce Stable Point Aware 3D (SPAR3D), setting a new standard in 3D generation. Ideal for running on NVIDIA RTX AI PCs, SPAR3D enables real-time editing and complete structure generation of 3D objects from a single image in under a second. You can download the weights on Hugging Face and code on GitHub, or access the model through the Stability AI API. Learn more here: (1/3)

Stability AI

181,479 views • 1 year ago

Finally got my Gaussian Splat picture up and running in Augmented Reality—all via the web This is how I want to capture places + memories 🖼️ Where should I hang it up?

Finally got my Gaussian Splat picture up and running in Augmented Reality—all via the web This is how I want to capture places + memories 🖼️ Where should I hang it up?

Ian Curtis

88,236 views • 1 year ago

forge3d just crossed 200 ⭐ on GitHub. I built this Rust and WebGPU 3D terrain engine for Python to render in high-quality maps in no time. Thank you to everyone who starred, tested, and filed issues. This is only the start.

forge3d just crossed 200 ⭐ on GitHub. I built this Rust and WebGPU 3D terrain engine for Python to render in high-quality maps in no time. Thank you to everyone who starred, tested, and filed issues. This is only the start.

Milos

16,773 views • 3 months ago

Open-Source Multi-Sensor Data Platform for Neural 3D Reconstruction and Physical AI [📍github] It handles cameras, LiDAR, radar, poses, calibrations & labels in one clean format. No more messy custom parsers. • Super efficient (non-redundant storage) • New .itar single-file format with lightning-fast random access • Streams straight from S3/GCS/Azure – perfect for huge datasets • Built-in converters for Waymo, ScanNet++ & more • Already powers NVIDIA NuRec, 3DGRUT & gsplat Saw this at Janick Martinez Esturo, thanks for sharing! Easy to try: • pip install nvidia-ncore • GitHub: • Docs & project page: NCore slashes data wrangling time, cuts storage waste, and makes large-scale neural 3D training faster and simpler than ever. A real standard for physical AI. ——- Weekly robotics and AI insights. Subscribe free:

Open-Source Multi-Sensor Data Platform for Neural 3D Reconstruction and Physical AI [📍github] It handles cameras, LiDAR, radar, poses, calibrations & labels in one clean format. No more messy custom parsers. • Super efficient (non-redundant storage) • New .itar single-file format with lightning-fast random access • Streams straight from S3/GCS/Azure – perfect for huge datasets • Built-in converters for Waymo, ScanNet++ & more • Already powers NVIDIA NuRec, 3DGRUT & gsplat Saw this at Janick Martinez Esturo, thanks for sharing! Easy to try: • pip install nvidia-ncore • GitHub: • Docs & project page: NCore slashes data wrangling time, cuts storage waste, and makes large-scale neural 3D training faster and simpler than ever. A real standard for physical AI. ——- Weekly robotics and AI insights. Subscribe free:

Ilir Aliu

32,717 views • 3 months ago

I don’t have the BRAM for a depth buffer so it’s time to get the memory controller up and running for this fjord torus. 100% FPGA logic 3D pipeline, no CPU.

I don’t have the BRAM for a depth buffer so it’s time to get the memory controller up and running for this fjord torus. 100% FPGA logic 3D pipeline, no CPU.

Ian Hanschen

29,249 views • 6 months ago

finally a perfect excuse to talk about me and my shadow, the fact dreamworks gave up this movie for their other 3d films is INSANE #cancelledcartoons

finally a perfect excuse to talk about me and my shadow, the fact dreamworks gave up this movie for their other 3d films is INSANE #cancelledcartoons

jorianne

267,734 views • 2 years ago

parakeet.cpp: native C++/ggml (ggml) inference for NVIDIA AI Developer's Parakeet, one of the best speech-to-text models out there, from the LocalAI team. Every Parakeet model (TDT/CTC/RNNT/hybrid + cache-aware streaming), byte-for-byte identical output to NeMo, now running anywhere with no Python and even a bit faster, on CPU and GPU. Quantized GGUF on Hugging Face 🤗 Huge thanks to Georgi Gerganov for ggml and to NVIDIA AI Developer for releasing Parakeet! 🧵

parakeet.cpp: native C++/ggml (ggml) inference for NVIDIA AI Developer's Parakeet, one of the best speech-to-text models out there, from the LocalAI team. Every Parakeet model (TDT/CTC/RNNT/hybrid + cache-aware streaming), byte-for-byte identical output to NeMo, now running anywhere with no Python and even a bit faster, on CPU and GPU. Quantized GGUF on Hugging Face 🤗 Huge thanks to Georgi Gerganov for ggml and to NVIDIA AI Developer for releasing Parakeet! 🧵

Ettore Di Giacinto

55,955 views • 2 months ago

3DTopia AI: This text-to-3D model can create an entire film scene in just minutes! 3D AI is progressing faster than ever! I truly believe AI Powered 3D will become the ultimate tool for AI filmmaking. We’ll finally have full creative controls without consistency issues. We’re not quite there yet, but we’re getting closer every day.

3DTopia AI: This text-to-3D model can create an entire film scene in just minutes! 3D AI is progressing faster than ever! I truly believe AI Powered 3D will become the ultimate tool for AI filmmaking. We’ll finally have full creative controls without consistency issues. We’re not quite there yet, but we’re getting closer every day.

el.cine

113,464 views • 1 year ago

✨ Made a new mini feature on Photo AI: [ Grab from 3d model ] So the problem is we're at that stage in time (typical for AI) where image-to-3d models are not good enough but are fun to play with, but we know they'll be good enough in 1-2 years With [ Make 3d model ] you already can turn any Photo AI pic into a 3d model but it still looks hyper clunky and deformed, but it works! One cool idea I had to make that more useful and made now: Let people make a 3d model then change the view of the it with the 3d viewer, then press [ o ] and it grabs a frame of the 3d That image you can then [ Remix ] (img2img), and it becomes a real photo again and that in turn you can then turn into a video again with [ Make video ] So that essentially gives you a fully freeform camera position control to take photos with One thing I need to fix is the background/skybox, I kinda need to take the original photo and remove the person and just get the background for the 3d model viewer, in this case it should be white, but it's a start!

✨ Made a new mini feature on Photo AI: [ Grab from 3d model ] So the problem is we're at that stage in time (typical for AI) where image-to-3d models are not good enough but are fun to play with, but we know they'll be good enough in 1-2 years With [ Make 3d model ] you already can turn any Photo AI pic into a 3d model but it still looks hyper clunky and deformed, but it works! One cool idea I had to make that more useful and made now: Let people make a 3d model then change the view of the it with the 3d viewer, then press [ o ] and it grabs a frame of the 3d That image you can then [ Remix ] (img2img), and it becomes a real photo again and that in turn you can then turn into a video again with [ Make video ] So that essentially gives you a fully freeform camera position control to take photos with One thing I need to fix is the background/skybox, I kinda need to take the original photo and remove the person and just get the background for the 3d model viewer, in this case it should be white, but it's a start!

@levelsio

119,210 views • 1 year ago

This season started with me changing my coach. I got a hip injury. It took me a long time to recover. It was hard to make up for lost time. But I'm glad I didn't give up and I continue to go towards my goals and dreams.🙏

This season started with me changing my coach. I got a hip injury. It took me a long time to recover. It was hard to make up for lost time. But I'm glad I didn't give up and I continue to go towards my goals and dreams.🙏

Oleksandr Nehurenko

18,318 views • 1 year ago

My village people are after me, I just got to the airport and found out my flight to America got cancelled and my new flight would mean I miss the Ronaldo game Luckily for me I got a new airline and I’ll still be there in time to watch the GOAT!!!❤️

My village people are after me, I just got to the airport and found out my flight to America got cancelled and my new flight would mean I miss the Ronaldo game Luckily for me I got a new airline and I’ll still be there in time to watch the GOAT!!!❤️

(fan) Trey

490,203 views • 1 month ago

JUMBO SIZE 3D PRINTED LEGO FORTNITE LLAMA parts list via @/legopenguin114 on reddit / 3d models via the website printablebricks WELCOME ALL NEW FOLLOWERS. I hope you stay and enjoy all silly FN projects we make .Thanks to @Darth_Maul06 for the massive boost in followers

JUMBO SIZE 3D PRINTED LEGO FORTNITE LLAMA parts list via @/legopenguin114 on reddit / 3d models via the website printablebricks WELCOME ALL NEW FOLLOWERS. I hope you stay and enjoy all silly FN projects we make .Thanks to @Darth_Maul06 for the massive boost in followers

PAISATHRASH 🇲🇽

83,424 views • 2 years ago

I used GPT-4o to create STL file for 3D model in ~ 20 seconds on my phone. Pretty remarkable what you can generate with AI and simple prompt now.

I used GPT-4o to create STL file for 3D model in ~ 20 seconds on my phone. Pretty remarkable what you can generate with AI and simple prompt now.

Min Choi

3,445,439 views • 2 years ago

More coming soon ! I manage to integrate for the first time volumetric 3D video made with Kartel.ai inside the AI world generated in gaussian splatting by World Labs !! I coded all in three.js! And it's possible to integrate elements on the fly ;) And so you can imagine soon what we will produce with that en AI : consistency of character and environment, relighting etc...

More coming soon ! I manage to integrate for the first time volumetric 3D video made with Kartel.ai inside the AI world generated in gaussian splatting by World Labs !! I coded all in three.js! And it's possible to integrate elements on the fly ;) And so you can imagine soon what we will produce with that en AI : consistency of character and environment, relighting etc...

Lovis Odin

33,984 views • 1 year ago

Experimenting with using gaussian splats to create VR worlds where people can watch my video in full 3D It's also for socializing and taking selfies in the locations that I record each video (or see the things that I show off) This is one part of my "XR Travel Vlogging" idea..

Experimenting with using gaussian splats to create VR worlds where people can watch my video in full 3D It's also for socializing and taking selfies in the locations that I record each video (or see the things that I show off) This is one part of my "XR Travel Vlogging" idea..

Brad Lynch

16,613 views • 6 months ago

Since I've been stagnant here the last few months, 🫠 💜♡ My commissions are open and empty! ♡💜 I make 3D Vtubers and Models for VRChat, I also teach people how to make them so they don't have to commission me🤡🤡 ✧ Checkout my Bio and Carrd ✧ #PortfolioDay

Since I've been stagnant here the last few months, 🫠 💜♡ My commissions are open and empty! ♡💜 I make 3D Vtubers and Models for VRChat, I also teach people how to make them so they don't have to commission me🤡🤡 ✧ Checkout my Bio and Carrd ✧ #PortfolioDay

RainHet ~*~ VRC/Vtube Comms ~*~

25,599 views • 9 months ago

In the summer of 2023, I cold emailed Jensen Huang and asked to capture a NeRF of him at SIGGRAPH. He responded in about an hour and said yes. A radiance field is, in the simplest terms, akin to a 3D photograph. A moment in time, so completely reconstructed that you can move through it and see it from angles the original cameras never occupied. NeRFs were the original method. Gaussian splatting, which debuted at that same SIGGRAPH, has since become the dominant form of radiance field. I called my late friend James, who told me we needed to begin practicing immediately. We ran capture after capture for weeks until we consistently got the capture time down to ~30 seconds with one camera. Later, in a hallway at the LA Convention Center during SIGGRAPH, I captured the portrait you're seeing now, a full 360° gaussian splat of Jensen, rendered here as a 2D flythrough. Afterward, I continued the conversation with him and members of his team to make the case for radiance fields as a foundational representation for imaging. To my surprise, they listened. Three years later, NVIDIA has several works, including NuRec, fVDB, 3DGRUT, and gsplat all utilizing radiance fields. The landscape has evolved enough that the reasoning is obvious. Gaussian splatting has begun to ship across some of the world’s largest industries, including autonomous vehicles, AEC, geospatial, media and entertainment, robotics, e-commerce, hospitality. It’s become clear that lifelike 3D is here to stay. And yet I think we will look back and be disappointed by how late we started taking 3D portraits of the people around us, just like how we have sparse 2D photos of our grandparents and great grandparents. We have billions of photographs of the people we know and love, but almost no radiance fields of them. I'll be returning to SIGGRAPH in LA where this was initially captured three years ago, with the landscape looking significantly different. Radiance fields are more under deployed than ever relative to what they can do. I'm excited for the future of imaging, and for 2D to transition into 3D. I have a few things up my sleeve that I think will make that case plainly.

In the summer of 2023, I cold emailed Jensen Huang and asked to capture a NeRF of him at SIGGRAPH. He responded in about an hour and said yes. A radiance field is, in the simplest terms, akin to a 3D photograph. A moment in time, so completely reconstructed that you can move through it and see it from angles the original cameras never occupied. NeRFs were the original method. Gaussian splatting, which debuted at that same SIGGRAPH, has since become the dominant form of radiance field. I called my late friend James, who told me we needed to begin practicing immediately. We ran capture after capture for weeks until we consistently got the capture time down to ~30 seconds with one camera. Later, in a hallway at the LA Convention Center during SIGGRAPH, I captured the portrait you're seeing now, a full 360° gaussian splat of Jensen, rendered here as a 2D flythrough. Afterward, I continued the conversation with him and members of his team to make the case for radiance fields as a foundational representation for imaging. To my surprise, they listened. Three years later, NVIDIA has several works, including NuRec, fVDB, 3DGRUT, and gsplat all utilizing radiance fields. The landscape has evolved enough that the reasoning is obvious. Gaussian splatting has begun to ship across some of the world’s largest industries, including autonomous vehicles, AEC, geospatial, media and entertainment, robotics, e-commerce, hospitality. It’s become clear that lifelike 3D is here to stay. And yet I think we will look back and be disappointed by how late we started taking 3D portraits of the people around us, just like how we have sparse 2D photos of our grandparents and great grandparents. We have billions of photographs of the people we know and love, but almost no radiance fields of them. I'll be returning to SIGGRAPH in LA where this was initially captured three years ago, with the landscape looking significantly different. Radiance fields are more under deployed than ever relative to what they can do. I'm excited for the future of imaging, and for 2D to transition into 3D. I have a few things up my sleeve that I think will make that case plainly.

Radiance Fields

18,025 views • 2 months ago

make nanochat multimodal for < $10! this evening, i trained nanochatVL: via a projection model (llava-style) between SigLIP ViT and Andrej Karpathy nanochat to extend its understanding to images it's a huge wip rn, but have a few promising results! now i can finally sleep

make nanochat multimodal for < $10! this evening, i trained nanochatVL: via a projection model (llava-style) between SigLIP ViT and Andrej Karpathy nanochat to extend its understanding to images it's a huge wip rn, but have a few promising results! now i can finally sleep

rajan agarwal

104,885 views • 10 months ago