Loading video...

Video Failed to Load

Go Home

I wanted to understand the structural and philosophical differences between GPUs, TPUs and newer alternatives (like Groq LPUs) without getting drowned in specs and jargon. Mispronunciation of the day: "soldered" 🤦‍♀️... 0:00 Intro 0:56 The origin story of TPUs 3:42 The first TPU: an ASIC for matrix multiplication 5:21...

97,852 views • 5 days ago •via X (Twitter)

8 Comments

Miguel Ríos Berríos's profile picture
Miguel Ríos Berríos5 days ago

Another banger. Thank you! Also appreciate the vid was the exact length of the morning commute.

Sam Bessalah's profile picture
Sam Bessalah5 days ago

Wow. Congratulations this really good. Thanks

Behnam's profile picture
Behnam5 days ago

Great work, the hardware engineering behind models is the next unlock that we're only scratching the surface of. Looking forward to more of these videos!

Alex Xander's profile picture
Alex Xander5 days ago

Useful as always. Keep on the good work!

Ash's profile picture
Ash5 days ago

Thank you for your work!

N̷̞̬̫̆͑i̶̢͊͊̾k̸͉͉̣̀ą̵͛'s profile picture
N̷̞̬̫̆͑i̶̢͊͊̾k̸͉͉̣̀ą̵͛4 days ago

@luuuqqh

yeab.superint's profile picture
yeab.superint4 days ago

or IPUs (Inference Processing Units)

Shantanu Goel's profile picture
Shantanu Goel4 days ago

Really well presented! Reminded me of my time working on Google's 1st and 2nd gen Mobile TPUs, writing their firmware/kernel drivers to coordinate different workloads' required memory hitting the SRAM just at the right time. We've come a long way from there.

Related Videos