Video yükleniyor...

Video Yüklenemedi

Ana Sayfaya Dön

ELON: DATA COMPRESSION IS TESLA’S BIGGEST AI CHALLENGE "The single biggest technical challenge of Tesla self-driving AI is context compression of 1.5GB/s of video to ~2kB/s of control outputs using a puny inference computer without making any mistakes. Super hard to avoid overly lossy compression at any given step."

MarioNawfal's profile picture

Mario Nawfal

3,609,010 subscribers

486,215 görüntüleme • 8 ay önce •via X (Twitter)

Haberler & PolitikaBilim & Teknoloji
LIVE

Anya Rossi• Live Now

Private livecam show

0 Yorum

Yorum bulunmuyor

Orijinal gönderinin yorumları burada görünecek

Benzer Videolar

Ai is just massive data compression.
1:12

Ai is just massive data compression.

MERICA MEMED

168,953 görüntüleme • 1 yıl önce

AI has a "last-mile problem" similar to self-driving cars. With self-driving cars, early demos impressed, but real-world deployment took years. It's easy to hack up a prototype, but making it work reliably at scale is hard. If each step of an AI agent is only 95% accurate, none of the 30-step workflows will work reliably. Going from 95% to 99.9% accuracy is the real challenge.
1:33

AI has a "last-mile problem" similar to self-driving cars. With self-driving cars, early demos impressed, but real-world deployment took years. It's easy to hack up a prototype, but making it work reliably at scale is hard. If each step of an AI agent is only 95% accurate, none of the 30-step workflows will work reliably. Going from 95% to 99.9% accuracy is the real challenge.

Richard Socher

14,926 görüntüleme • 1 yıl önce

A simple way to check the compression density of a machine. Good compression tear paper ⬇️
0:31

A simple way to check the compression density of a machine. Good compression tear paper ⬇️

MAr'S

827,538 görüntüleme • 5 ay önce

Elon Musk explains why AI could be capable of discovering new physics. “You can think of intelligence like a compression problem. For any given field, it can be physics, or any field, you can distill things down to their most basic axiomatic elements, the things that are extremely likely to be true. And then, you can reason up from there to reach a cogent conclusion. I think if you apply that sort of first-principles compression to a field, and then you decompress it and contest the results against reality, then AI is capable of innovation and discovering new physics.” Town Hall in Philadelphia, October 18, 2024
0:37

Elon Musk explains why AI could be capable of discovering new physics. “You can think of intelligence like a compression problem. For any given field, it can be physics, or any field, you can distill things down to their most basic axiomatic elements, the things that are extremely likely to be true. And then, you can reason up from there to reach a cogent conclusion. I think if you apply that sort of first-principles compression to a field, and then you decompress it and contest the results against reality, then AI is capable of innovation and discovering new physics.” Town Hall in Philadelphia, October 18, 2024

ELON CLIPS

1,054,036 görüntüleme • 1 yıl önce

Elon Musk says Tesla swallows 1.5 GB of video into 2 KB of control. "We really are photons in, controls out. That is the vast majority of your life: vision, photons in, and then motor controls out." Musk reduced the human nervous system to a single equation. That theory runs in every Tesla on the road. "Your Tesla is taking in one and a half gigabytes a second of video and outputting two kilobytes a second of control outputs with the video at 36 hertz and the control frequency at 18." A 750,000-to-1 compression ratio. The car decides which photons matter. "You don't care about the details of the leaves on the tree on the side of the road, but you care a lot about the road signs and the traffic lights, the pedestrians, and even whether someone in another car is looking at you or not looking at you." Then Musk extended the equation past Tesla. The same architecture runs Optimus. **Photons in. Controls out.** Different number of degrees of freedom. A car has steering and acceleration. A robot arm has dozens of joints. Same compression. More fingers on the other side. Musk, who built one Tesla AI engine across two products: "AI is mostly compression and correlation of two bitstreams." The implication: a human, a Tesla, and an Optimus all run the same loop. Musk, looking back at the human equation: "This is what happens with humans." If you're new here, GeniusThinking is a gallery for the greatest minds in economics, psychology, and history. Follow along for more similar content. P.S. I made a playbook breaking down 100+ mental models used by history's greatest thinkers. 5,000+ downloads. 113 five-star reviews. Comment "MODELS" + Follow GeniusThinking and I'll send it to you. — Elon Musk ( Elon Musk ), CEO of Tesla and SpaceX, on Dwarkesh Patel's ( Dwarkesh Patel ) podcast
2:45

Elon Musk says Tesla swallows 1.5 GB of video into 2 KB of control. "We really are photons in, controls out. That is the vast majority of your life: vision, photons in, and then motor controls out." Musk reduced the human nervous system to a single equation. That theory runs in every Tesla on the road. "Your Tesla is taking in one and a half gigabytes a second of video and outputting two kilobytes a second of control outputs with the video at 36 hertz and the control frequency at 18." A 750,000-to-1 compression ratio. The car decides which photons matter. "You don't care about the details of the leaves on the tree on the side of the road, but you care a lot about the road signs and the traffic lights, the pedestrians, and even whether someone in another car is looking at you or not looking at you." Then Musk extended the equation past Tesla. The same architecture runs Optimus. **Photons in. Controls out.** Different number of degrees of freedom. A car has steering and acceleration. A robot arm has dozens of joints. Same compression. More fingers on the other side. Musk, who built one Tesla AI engine across two products: "AI is mostly compression and correlation of two bitstreams." The implication: a human, a Tesla, and an Optimus all run the same loop. Musk, looking back at the human equation: "This is what happens with humans." If you're new here, GeniusThinking is a gallery for the greatest minds in economics, psychology, and history. Follow along for more similar content. P.S. I made a playbook breaking down 100+ mental models used by history's greatest thinkers. 5,000+ downloads. 113 five-star reviews. Comment "MODELS" + Follow GeniusThinking and I'll send it to you. — Elon Musk ( Elon Musk ), CEO of Tesla and SpaceX, on Dwarkesh Patel's ( Dwarkesh Patel ) podcast

GeniusThinking

160,972 görüntüleme • 1 ay önce

Jeff Dean says models hallucinate because their training data is “squishy.” But what’s in the context window is sharp, the exact text or video frame right in front of them. The goal is to bring more of the world into that context. Compression gives it intuition. Context gives it precision.
2:00

Jeff Dean says models hallucinate because their training data is “squishy.” But what’s in the context window is sharp, the exact text or video frame right in front of them. The goal is to bring more of the world into that context. Compression gives it intuition. Context gives it precision.

vitrupo

41,352 görüntüleme • 2 ay önce

Matryoshka Representation Learning (MRL) is a super exciting approach to improving the quality and efficiency of embedding models and strategies ✨ MRL allows models to store more information in the earlier dimensions of their data vectors. This method not only boosts performance in tasks like classification and retrieval, but is also a super cool compression technique! Paper: For compression: It’s been so much fun learning and making this video with @DanielW966, thanks for all your help!
2:39

Matryoshka Representation Learning (MRL) is a super exciting approach to improving the quality and efficiency of embedding models and strategies ✨ MRL allows models to store more information in the earlier dimensions of their data vectors. This method not only boosts performance in tasks like classification and retrieval, but is also a super cool compression technique! Paper: For compression: It’s been so much fun learning and making this video with @DanielW966, thanks for all your help!

Victoria Slocum

120,436 görüntüleme • 1 yıl önce

Elon: "Tesla AI is where the rubber hits the road. 'Make no mistakes' is not just a meme joke for self-driving AI. Tesla AI saves lives every day, at large scale. No other AI team can yet make that claim." Tesla
0:21

Elon: "Tesla AI is where the rubber hits the road. 'Make no mistakes' is not just a meme joke for self-driving AI. Tesla AI saves lives every day, at large scale. No other AI team can yet make that claim." Tesla

Mario Nawfal

300,137 görüntüleme • 2 ay önce

Russian military personnel check the armor of a Ukrainian HMMWV vehicle - Ai upscaled 150% + dehalo + compression reverse + 30 to 60 FPS + Stabilization
0:38

Russian military personnel check the armor of a Ukrainian HMMWV vehicle - Ai upscaled 150% + dehalo + compression reverse + 30 to 60 FPS + Stabilization

Dariusz Zawadzki

34,371 görüntüleme • 2 yıl önce

DOJO: ELON’S AI GAME-CHANGER Elon: “[Tesla’s Dojo] is the biggest computer overhaul since Cray”—and he’s not kidding. Cray ruled the ‘70s, but Dojo is here to crush AI tasks at scale, training Tesla’s Full Self-Driving system to make cars smarter, safer, and greener. And it’s not just about cars. Dojo’s insane power (shoutout to Tesla’s D1 chip) could spark breakthroughs in healthcare, finance, and chip design. From jobs to science, Dojo isn’t just a computer—it’s a revolution!
0:23

DOJO: ELON’S AI GAME-CHANGER Elon: “[Tesla’s Dojo] is the biggest computer overhaul since Cray”—and he’s not kidding. Cray ruled the ‘70s, but Dojo is here to crush AI tasks at scale, training Tesla’s Full Self-Driving system to make cars smarter, safer, and greener. And it’s not just about cars. Dojo’s insane power (shoutout to Tesla’s D1 chip) could spark breakthroughs in healthcare, finance, and chip design. From jobs to science, Dojo isn’t just a computer—it’s a revolution!

Mario Nawfal

115,934 görüntüleme • 1 yıl önce

The power of compression shirt 🔥
0:39

The power of compression shirt 🔥

Brandon Chai

384,435 görüntüleme • 3 yıl önce

Imitating translucent shadows using dithering is quite a neat technique! I decided to use Bayer dithering instead of Temporal, and video compression is helping a lot here :D #vfx #UnrealEngine
0:22

Imitating translucent shadows using dithering is quite a neat technique! I decided to use Bayer dithering instead of Temporal, and video compression is helping a lot here :D #vfx #UnrealEngine

Krystian Komisarek

32,975 görüntüleme • 1 yıl önce

"Tesla is by far the best in the world at real world AI. Tesla is actually much better than anyone at real world AI. Tesla also has the highest intelligence density of any AI by far." 一 Elon Musk
1:25

"Tesla is by far the best in the world at real world AI. Tesla is actually much better than anyone at real world AI. Tesla also has the highest intelligence density of any AI by far." 一 Elon Musk

DogeDesigner

64,559 görüntüleme • 3 ay önce

Minecraft effect for the Rings of Saturn using over 1,000,000 instanced moving blocks/cubes (RIP video compression) made this in May for RAT 🐀 's Reach for the Stars
0:41

Minecraft effect for the Rings of Saturn using over 1,000,000 instanced moving blocks/cubes (RIP video compression) made this in May for RAT 🐀 's Reach for the Stars

Ryan

38,532 görüntüleme • 1 yıl önce

A banger just got released 💥 Here is a snapshot of L2D, the biggest self-driving dataset by far! - 90 TeraBytes of data - 5000 hours of driving - 6 surrounding HD cameras - OPENLY AVAILABLE - Train your car to drive like Tesla at home 🧵 More details in thread
0:46

A banger just got released 💥 Here is a snapshot of L2D, the biggest self-driving dataset by far! - 90 TeraBytes of data - 5000 hours of driving - 6 surrounding HD cameras - OPENLY AVAILABLE - Train your car to drive like Tesla at home 🧵 More details in thread

Remi Cadene

171,802 görüntüleme • 1 yıl önce