Loading video...

Video Failed to Load

There was a problem loading this video. This could be due to a temporary network issue or the video might be unavailable.

Depth-aware light injection in TypeGPU I got a 448x448 monocular depth model down to ~8 ms on my M4 Pro across ~250 dispatches, which is fast enough to use in realtime :D Since the inference is written directly in TypeGPU, I can just feed the depth buffer straight into... show more

Konrad Reczko

6,987 subscribers

9,750,435 views • 2 days ago •via X (Twitter)

Science & Technology Education

Anya Rossi• Live Now

Private livecam show

0 Comments

No comments available

Comments from the original post will appear here

Related Videos

IN NEWS: Baseten raises a $150M series D round. Tuhin Srivastava (Founder & CEO, Baseten) on the future of inference: “I think the token price goes down and inference should get cheaper over time. And that really just means there is going to be more inference.” “Every time we lower prices or optimize models to make it cheaper, four months later customers are spending more anyway.” “Inference prices will go down, but if the world is run by AI in 10 years, there is going to be a lot of inference. It better be cheap.”

IN NEWS: Baseten raises a $150M series D round. Tuhin Srivastava (Founder & CEO, Baseten) on the future of inference: “I think the token price goes down and inference should get cheaper over time. And that really just means there is going to be more inference.” “Every time we lower prices or optimize models to make it cheaper, four months later customers are spending more anyway.” “Inference prices will go down, but if the world is run by AI in 10 years, there is going to be a lot of inference. It better be cheap.”

TBPN

17,057 views • 11 months ago

Anybody remember this game? Just got the game and going to break it down & go in-depth like you’ve never seen before on my YouTube Page The game that got us to #1 in the country! 2007 MU vs ku game at Arrowhead.

Anybody remember this game? Just got the game and going to break it down & go in-depth like you’ve never seen before on my YouTube Page The game that got us to #1 in the country! 2007 MU vs ku game at Arrowhead.

Chase Daniel

228,535 views • 2 years ago

My biggest annoyances with VS Code (and in turn Cursor) is I've never been able to get Find + Multi-Cursor with arrow keys working like I did in Sublime Text I use it a lot to edit lists of text fast I go Cmd+Find "SGD" for example, then Find All, then I literally have 10 cursors on every SGD, I can arrow key through the letters around it, or use Option/Alt-Left or Right to skip through words, or Command-Left or Right to to the beginning or the end of the line Then I can use Shift to select I'm super fast at editing like that but none of the shortcuts work in VS Code or Cursor similarly The internet says use Cmd+Shift+L to do it, but all that happens in Cursor is I end up in the AI chat and I don't wanna go there

My biggest annoyances with VS Code (and in turn Cursor) is I've never been able to get Find + Multi-Cursor with arrow keys working like I did in Sublime Text I use it a lot to edit lists of text fast I go Cmd+Find "SGD" for example, then Find All, then I literally have 10 cursors on every SGD, I can arrow key through the letters around it, or use Option/Alt-Left or Right to skip through words, or Command-Left or Right to to the beginning or the end of the line Then I can use Shift to select I'm super fast at editing like that but none of the shortcuts work in VS Code or Cursor similarly The internet says use Cmd+Shift+L to do it, but all that happens in Cursor is I end up in the AI chat and I don't wanna go there

@levelsio

177,684 views • 1 year ago

After playing empulse i think its a little disappointing how accessible the movement is. It lacks depth and skill. Any 1 can be moving fast without much effort. Games like titanfall or quake have incredible depth in its movement to the point where you can spend hours (1/3)

After playing empulse i think its a little disappointing how accessible the movement is. It lacks depth and skill. Any 1 can be moving fast without much effort. Games like titanfall or quake have incredible depth in its movement to the point where you can spend hours (1/3)

GetQuakedOn

60,668 views • 2 months ago

This is insane!🔥 This is a 720p (2D) video I shot of my kids 15 years ago! I used AI to upscale it, depth-map it, & used the depth map to convert it to 3D SBS, & then converted that to Spatial Video for Apple Vision Pro (MV-HEVC). My son is currently a senior in high school, and my daughter is a sophomore in college. This video has complete spatial depth when viewed in the Apple Vision Pro. Obviously, you can't appreciate that via this post. But it's like I'm there & I can see into this room. Talk about giving you the feels.🥹 This can be done with ANY video. 🤯 I'm working on refining the workflow, as it's a bit cumbersome. I plan to share it, but holy cow! I had to post this.

This is insane!🔥 This is a 720p (2D) video I shot of my kids 15 years ago! I used AI to upscale it, depth-map it, & used the depth map to convert it to 3D SBS, & then converted that to Spatial Video for Apple Vision Pro (MV-HEVC). My son is currently a senior in high school, and my daughter is a sophomore in college. This video has complete spatial depth when viewed in the Apple Vision Pro. Obviously, you can't appreciate that via this post. But it's like I'm there & I can see into this room. Talk about giving you the feels.🥹 This can be done with ANY video. 🤯 I'm working on refining the workflow, as it's a bit cumbersome. I plan to share it, but holy cow! I had to post this.

Blaine Brown

1,468,678 views • 2 years ago

Arteta speaking after the draw to Wolves: “I think we need to go through the pain and you need to go through that looking in the mirror and understanding what the game requires now and the next action is on Sunday. We need to keep all that in our tummies to show it on Sunday.”

Arteta speaking after the draw to Wolves: “I think we need to go through the pain and you need to go through that looking in the mirror and understanding what the game requires now and the next action is on Sunday. We need to keep all that in our tummies to show it on Sunday.”

Connor Humm

60,050 views • 6 months ago

PowerInfer - a high-speed inference engine for deploying LLMs locally. Just came across this super interesting project on speeding up inference. It's not MoE but it's a simple approach that exploits the high locality in LLM inference to design a GPU-CPU hybrid inference engine. Hot-activated neurons are preloaded onto the GPU for fast access, while cold-activated neurons (the majority) are computed on the CPU. This approach significantly reduces GPU memory demands and CPU-GPU data transfer. It achieves an average token generation rate of 13.20 tokens/s, with a peak of 29.08 tokens/s, across various LLMs on a single NVIDIA RTX 4090 GPU. It's on only 18% lower than that achieved by a top-tier server-grade A100 GPU. It also significantly outperforms llama.cpp by up to 11.69x while retaining model accuracy. There is a lot more innovation around inference that's coming fast. Really encouraged by the study on sparse computation to enhance the computational efficiency of LLMs. It's now possible to use PowerInfer with Llama 2 and Faclon 40B. Mistral-7B support is coming soon!

PowerInfer - a high-speed inference engine for deploying LLMs locally. Just came across this super interesting project on speeding up inference. It's not MoE but it's a simple approach that exploits the high locality in LLM inference to design a GPU-CPU hybrid inference engine. Hot-activated neurons are preloaded onto the GPU for fast access, while cold-activated neurons (the majority) are computed on the CPU. This approach significantly reduces GPU memory demands and CPU-GPU data transfer. It achieves an average token generation rate of 13.20 tokens/s, with a peak of 29.08 tokens/s, across various LLMs on a single NVIDIA RTX 4090 GPU. It's on only 18% lower than that achieved by a top-tier server-grade A100 GPU. It also significantly outperforms llama.cpp by up to 11.69x while retaining model accuracy. There is a lot more innovation around inference that's coming fast. Really encouraged by the study on sparse computation to enhance the computational efficiency of LLMs. It's now possible to use PowerInfer with Llama 2 and Faclon 40B. Mistral-7B support is coming soon!

elvis

261,622 views • 2 years ago

$I was wrong. I used to tell people that I would never go to a medical doctor unless it was for a broken bone, fracture or some form of structural damage. After having an experience like that I decided I really don't wanna go to a hospital or medical doctor because all they're gonna do is put my bone back in place and then put it in a cast for the next couple months and I'm gonna wonder later on why it never feels the same after locking my bone into the same position. It doesn't make sense to me. Animals in the wild break bones all of the time and fully recover, as long as they don't get eaten by a predator. If I ever have any structural damage again in the future or broken bones I'm gonna use the animal method: just fast, lay down in the sun and let nature heal me.$

I was wrong. I used to tell people that I would never go to a medical doctor unless it was for a broken bone, fracture or some form of structural damage. After having an experience like that I decided I really don't wanna go to a hospital or medical doctor because all they're gonna do is put my bone back in place and then put it in a cast for the next couple months and I'm gonna wonder later on why it never feels the same after locking my bone into the same position. It doesn't make sense to me. Animals in the wild break bones all of the time and fully recover, as long as they don't get eaten by a predator. If I ever have any structural damage again in the future or broken bones I'm gonna use the animal method: just fast, lay down in the sun and let nature heal me.

Riley Check

23,107 views • 4 months ago

Was farming first encounter of ghosts to get the helmet I was missing (yeah I know it sucked) and I noticed that there are actually A LOT of details and stuff I just never bothered to notice in these play spaces. For example. Did you you know you can actually SEE Ahsa in this area before dropping down into the methane ocean for the first time? It honestly wants me to go back through all the dungeons in the game and take proper time to look through all the stuff in the world. Is that something you guys would be interested in?

Was farming first encounter of ghosts to get the helmet I was missing (yeah I know it sucked) and I noticed that there are actually A LOT of details and stuff I just never bothered to notice in these play spaces. For example. Did you you know you can actually SEE Ahsa in this area before dropping down into the methane ocean for the first time? It honestly wants me to go back through all the dungeons in the game and take proper time to look through all the stuff in the world. Is that something you guys would be interested in?

NAPainter_ GCX 2026 ✈️

154,528 views • 2 months ago

.c0mpute just connected with Pod the Squire and turns staked $ZERO into useable OR sellable inference 49.39M $ZERO is currently staked (ATH) The dual mechanic: - Stake $ZERO, earn daily inference rights - Sell unused inference through - Every staked token has a yield path $15K in $ZERO has also been bought back or burned + $15K has been paid out to stakers

.c0mpute just connected with Pod the Squire and turns staked $ZERO into useable OR sellable inference 49.39M $ZERO is currently staked (ATH) The dual mechanic: - Stake $ZERO, earn daily inference rights - Sell unused inference through - Every staked token has a yield path $15K in $ZERO has also been bought back or burned + $15K has been paid out to stakers

MCG

17,791 views • 1 month ago

🚨Oreshnik Nightmare is COMING 🚨Russia will take action, sooner rather than later. 🚨We are in a very dangerous situation. 🚨🚨🚨🚨🚨🚨🚨🚨🚨 Scott Ritter: If nuclear-armed states provide strike capacity to a non-nuclear state and use that to strike the strategic depth of Russia, Russia will have to use nuclear weapons preemptively against that threat. The Russian government put the Ukrainians on notice that if drones struck Moscow, Kiev would disappear. NATO missiles on Ukrainian soil striking into the Russian depth. The Flamingo, the FP5, is a British-made missile using German guidance equipment, brought to their target by American and NATO intelligence. Without this, Ukraine would not have this weapon. Ukraine's other weapons are using corridors that go through Poland into the Baltics so they can strike, ... in the vicinity of Saint Petersburg or through Kazakhstan so they can strike into the strategic depth.

🚨Oreshnik Nightmare is COMING 🚨Russia will take action, sooner rather than later. 🚨We are in a very dangerous situation. 🚨🚨🚨🚨🚨🚨🚨🚨🚨 Scott Ritter: If nuclear-armed states provide strike capacity to a non-nuclear state and use that to strike the strategic depth of Russia, Russia will have to use nuclear weapons preemptively against that threat. The Russian government put the Ukrainians on notice that if drones struck Moscow, Kiev would disappear. NATO missiles on Ukrainian soil striking into the Russian depth. The Flamingo, the FP5, is a British-made missile using German guidance equipment, brought to their target by American and NATO intelligence. Without this, Ukraine would not have this weapon. Ukraine's other weapons are using corridors that go through Poland into the Baltics so they can strike, ... in the vicinity of Saint Petersburg or through Kazakhstan so they can strike into the strategic depth.

Ignorance, the root and stem of all evil

37,607 views • 3 months ago

Jane Fonda: “This is the first time in the history of the US that an authoritarian regime has broken through. Worldwide historians who study these things all agree it has never happened so fast in any industrialized democracy. He is moving to consolidate very very fast which means right now we have to use the tools we have to stop it”

Jane Fonda: “This is the first time in the history of the US that an authoritarian regime has broken through. Worldwide historians who study these things all agree it has never happened so fast in any industrialized democracy. He is moving to consolidate very very fast which means right now we have to use the tools we have to stop it”

Marco Foster

831,426 views • 4 months ago

Want to use Depth Anything, but need metric depth rather than relative depth? Thrilled to introduce Prompt Depth Anything, a new paradigm for accurate metric depth estimation with up to 4K resolution. 👉Key Message: Depth foundation models like DA have already internalized rich geometric knowledge of the 3D world but lack a proper way to elicit it. Inspired by the success of prompting in LLMs, we propose prompting Depth Anything with metric cues to produce metric depth. This method proves to be very effective when using a low-cost lidar (e.g., iPhone's LiDAR), which is widely available, as prompts. We believe the prompt can generalize to other forms as long as scale information is provided. Prompt Depth Anything offers 1⃣A series of models for iPhone lidars. 2⃣4D reconstruction from monocular videos (captured with iPhone). 3⃣Improved generalization ability for robot manipulation, e.g. Training on cans but generalizing on glasses. 4⃣More detailed depth annotations for the ScanNet++ dataset. The first author is our excellent intern Haotong Lin. Paper: Huggingface: Project Page: Code:

Want to use Depth Anything, but need metric depth rather than relative depth? Thrilled to introduce Prompt Depth Anything, a new paradigm for accurate metric depth estimation with up to 4K resolution. 👉Key Message: Depth foundation models like DA have already internalized rich geometric knowledge of the 3D world but lack a proper way to elicit it. Inspired by the success of prompting in LLMs, we propose prompting Depth Anything with metric cues to produce metric depth. This method proves to be very effective when using a low-cost lidar (e.g., iPhone's LiDAR), which is widely available, as prompts. We believe the prompt can generalize to other forms as long as scale information is provided. Prompt Depth Anything offers 1⃣A series of models for iPhone lidars. 2⃣4D reconstruction from monocular videos (captured with iPhone). 3⃣Improved generalization ability for robot manipulation, e.g. Training on cans but generalizing on glasses. 4⃣More detailed depth annotations for the ScanNet++ dataset. The first author is our excellent intern Haotong Lin. Paper: Huggingface: Project Page: Code:

Bingyi Kang

67,604 views • 1 year ago

I got a behind the scenes tour of The Boring Company! The project is far more impressive than anticipated, and I did my best to share that with this in-depth video. You can tell how passionate the entire team is. Huge thank you to The Boring Company!

I got a behind the scenes tour of The Boring Company! The project is far more impressive than anticipated, and I did my best to share that with this in-depth video. You can tell how passionate the entire team is. Huge thank you to The Boring Company!

Dirty Tesla

187,847 views • 1 month ago

Ripgrep is slow. Nowgrep is fast, because I bypass the Windows slop and go straight to NTFS. Here's Ripgrep vs. Nowgrep searching through 300k files on a drive with 2M+. Nowgrep is written from scratch in C99. No borrow checker.

Ripgrep is slow. Nowgrep is fast, because I bypass the Windows slop and go straight to NTFS. Here's Ripgrep vs. Nowgrep searching through 300k files on a drive with 2M+. Nowgrep is written from scratch in C99. No borrow checker.

Charlie Malmqvist

305,541 views • 10 months ago

Since the quoted post is blowing up, here is a more in-depth breakdown of why I personally believe post contact direction & channeling all of your energy “through” w/ medball movement prep is vital to creating efficient movement patterns & direction in the swing. Listen below👇

Since the quoted post is blowing up, here is a more in-depth breakdown of why I personally believe post contact direction & channeling all of your energy “through” w/ medball movement prep is vital to creating efficient movement patterns & direction in the swing. Listen below👇

Anderson Miller

65,314 views • 10 months ago

For people who don’t get the 2D gaming on virtual monitors in VR use case: HMDs have the potential to be the ultimate monitor for any content. Any aspect ratio, any resolution, any size, it’s all “native” in vr I get to play my game on a massive screen while I have spatial awareness, see my wife, take a sip of coffee, and have depth correct rendering content in my room. If and when I choose to, I can “turn off” my surrounds and go into a virtual environment. It’s MR by default, VR by choice Nobody has really taken this use case all that seriously and optimized the hardware/software around it. Now, it seems like Valve is. Also some context: I’m streaming SW Jedi Fallen Order at 4k 90fps my PC to my Vision Pro, and playing the audio thru my surround sound speakers. It’s the best of ALL worlds

For people who don’t get the 2D gaming on virtual monitors in VR use case: HMDs have the potential to be the ultimate monitor for any content. Any aspect ratio, any resolution, any size, it’s all “native” in vr I get to play my game on a massive screen while I have spatial awareness, see my wife, take a sip of coffee, and have depth correct rendering content in my room. If and when I choose to, I can “turn off” my surrounds and go into a virtual environment. It’s MR by default, VR by choice Nobody has really taken this use case all that seriously and optimized the hardware/software around it. Now, it seems like Valve is. Also some context: I’m streaming SW Jedi Fallen Order at 4k 90fps my PC to my Vision Pro, and playing the audio thru my surround sound speakers. It’s the best of ALL worlds

Azad Balabanian

616,738 views • 9 months ago

I put an entire codebase in a text file and gave it to Gemini 1.5 Pro. I gave it a task that required updating ~10 files across the entire codebase - so decently complex. It got about 80% of the work done for me on a 1st attempt. Watch to see in-depth on how it performed.

I put an entire codebase in a text file and gave it to Gemini 1.5 Pro. I gave it a task that required updating ~10 files across the entire codebase - so decently complex. It got about 80% of the work done for me on a 1st attempt. Watch to see in-depth on how it performed.

Mckay Wrigley

85,724 views • 2 years ago