Loading video...

Video Failed to Load

Go Home

i trained Llama 2 on a $5 computer with less processing power than a thermostat. it’s called 🥧 PiTorch: an ML library for Raspberry Pi Zeros. i cover how to make it from scratch, from writing assembly GPU kernels to sending bytes over wires. (no hardware background needed!)

masonwang025's profile picture

Mason Wang

3,964 subscribers

131,102 views • 7 months ago •via X (Twitter)

Science & Technology
LIVE

Anya Rossi• Live Now

Private livecam show

0 Comments

No comments available

Comments from the original post will appear here

Related Videos

I built gpu-pii, inspired by Shu's gpu-lexer. A small model, trained from scratch, runs on WebGPU in your browser to detect personal information in any text
0:15

I built gpu-pii, inspired by Shu's gpu-lexer. A small model, trained from scratch, runs on WebGPU in your browser to detect personal information in any text

Duncan

10,488 views • 1 month ago

decided to build the instant cam from scratch with a raspberry pi + thermal printer - part 1: camera is working 😌
0:13

decided to build the instant cam from scratch with a raspberry pi + thermal printer - part 1: camera is working 😌

tigris

10,313 views • 2 years ago

My course is finally OUT! I spent over a year on Creating Creatures for Games and I honestly couldn’t be prouder of the result. It covers how to build this kaiju from scratch, with all steps shown: sculpting, retopo, baking, texturing and unreal lighting. This shot is from Unreal with a bit of post processing on it Anim and rig by Kiel Figgins Shot lighting by Elpida Kyriakou Audio by BloodYuki
0:11

My course is finally OUT! I spent over a year on Creating Creatures for Games and I honestly couldn’t be prouder of the result. It covers how to build this kaiju from scratch, with all steps shown: sculpting, retopo, baking, texturing and unreal lighting. This shot is from Unreal with a bit of post processing on it Anim and rig by Kiel Figgins Shot lighting by Elpida Kyriakou Audio by BloodYuki

Henning Sanden

38,425 views • 4 months ago

How to Make a Cool Money Clip From Scratch
0:14

How to Make a Cool Money Clip From Scratch

arthur

11,538,251 views • 10 months ago

Trained the first ever Makiina arms to assemble a raspberry Pi into its case
0:15

Trained the first ever Makiina arms to assemble a raspberry Pi into its case

Victor Oldensand

211,390 views • 5 months ago

Running minecraft on a raspberry pi 5 with a circular screen hehe
0:15

Running minecraft on a raspberry pi 5 with a circular screen hehe

˗ˏˋmewtru´ˎ˗

32,751 views • 7 months ago

we trained a fruit fly to understand emotion We created a neural network from the male drosophila connectome, then trained it on human emotions. It was shocking to see how good it was at identification (better than some humans I know)
0:15

we trained a fruit fly to understand emotion We created a neural network from the male drosophila connectome, then trained it on human emotions. It was shocking to see how good it was at identification (better than some humans I know)

Nathan Roll

614,513 views • 2 months ago

Here's how fast it is to send USDC in Family on Base, for less than $0.01, all from within a conversation.
0:13

Here's how fast it is to send USDC in Family on Base, for less than $0.01, all from within a conversation.

Benji Taylor

100,931 views • 2 years ago

i've been paying 200$/month for AI tools for a while now claude, chatgpt, all of it thought that was just the price of doing things properly then i read this and had to close my laptop for a second someone bought a used GPU from eBay for $700 five years old. RTX 3090. the kind of card people sell when they upgrade for gaming plugged in a free model called Qwen 3.6 that alibaba quietly dropped last month and it scored 84.1 on vision tasks claude 4.5 opus scored 77.0 the 200$/month subscription lost to a free model running on old hardware the math gets worse after 4 months you've paid off the GPU from month 5 onwards you pay $8 for electricity that's it no subscription. no per message cost. nothing leaves your computer. ever. turns out i didn't have to is anyone else just finding out about this or was i the last one to know?
0:15

i've been paying 200$/month for AI tools for a while now claude, chatgpt, all of it thought that was just the price of doing things properly then i read this and had to close my laptop for a second someone bought a used GPU from eBay for $700 five years old. RTX 3090. the kind of card people sell when they upgrade for gaming plugged in a free model called Qwen 3.6 that alibaba quietly dropped last month and it scored 84.1 on vision tasks claude 4.5 opus scored 77.0 the 200$/month subscription lost to a free model running on old hardware the math gets worse after 4 months you've paid off the GPU from month 5 onwards you pay $8 for electricity that's it no subscription. no per message cost. nothing leaves your computer. ever. turns out i didn't have to is anyone else just finding out about this or was i the last one to know?

Crypto Mavka

14,126 views • 4 months ago

A few months ago, I picked 2 people from over 100 applicants to teach vocal mixing from scratch - completely free! :) After 12+ weekly 1-on-1 lessons, here's how RiRi 🌟🛰️ and mix on their own now! 🧵
0:15

A few months ago, I picked 2 people from over 100 applicants to teach vocal mixing from scratch - completely free! :) After 12+ weekly 1-on-1 lessons, here's how RiRi 🌟🛰️ and mix on their own now! 🧵

Coffee Run ☕🏃

32,611 views • 1 year ago

Hey fable, design a building with interior and then destroy it with a giant wrecking ball Also, create a nice GPU renderer and simulator from scratch and make it run super fast
0:17

Hey fable, design a building with interior and then destroy it with a giant wrecking ball Also, create a nice GPU renderer and simulator from scratch and make it run super fast

Lucky Iyinbor

32,635 views • 5 months ago

I gave Devin (an AI agent) my Netify key & asked it to build a website on how to rebuild civilization from scratch It built a site with react quizzes, downloadable preparedness documents & free images. Kind of impressive, actually. Try it, all just Devin:
0:16

I gave Devin (an AI agent) my Netify key & asked it to build a website on how to rebuild civilization from scratch It built a site with react quizzes, downloadable preparedness documents & free images. Kind of impressive, actually. Try it, all just Devin:

Ethan Mollick

135,696 views • 2 years ago

Christian McCaffrey on the interception inside Seattle’s 5 yard line: “It’s a play I absolutely have to make. I expect nothing less, but to make that play. That’s completely on me.”
0:14

Christian McCaffrey on the interception inside Seattle’s 5 yard line: “It’s a play I absolutely have to make. I expect nothing less, but to make that play. That’s completely on me.”

Coach Yac 🗣

88,044 views • 10 months ago

Perplexity Computer just opened a PR on my repo, starting with a simple task... improving SEO What stands out is how it executes. Exploring with Gemini, then switching to Opus when it’s time to actually write code (I haven’t seen it use Codex or Grok) I’m going to ramp up the complexity from here. So far, it’s delivered on every task. I have a few more in progress that I’ll be sharing over the next few days.
0:18

Perplexity Computer just opened a PR on my repo, starting with a simple task... improving SEO What stands out is how it executes. Exploring with Gemini, then switching to Opus when it’s time to actually write code (I haven’t seen it use Codex or Grok) I’m going to ramp up the complexity from here. So far, it’s delivered on every task. I have a few more in progress that I’ll be sharing over the next few days.

Daniel San

15,317 views • 8 months ago

First time in my life I understand how neural networks work. It’s wild they are all just math 😂 You can learn anything now, just ask Opus to teach you. I trained a 6K parameters CNN model from scratch to do a 3-object-classification at 30fps:
0:19

First time in my life I understand how neural networks work. It’s wild they are all just math 😂 You can learn anything now, just ask Opus to teach you. I trained a 6K parameters CNN model from scratch to do a 3-object-classification at 30fps:

Tony Dinh

15,696 views • 21 days ago

I trained a tiny language model to write bad tech jokes and run on a microcontroller 19M parameters 11 MB runs on a conference badge (RP2350), no internet, about 2 tokens a second it learned English from half a billion tokens of tiny kids stories, then I trained it on about 22,000 jokes
0:18

I trained a tiny language model to write bad tech jokes and run on a microcontroller 19M parameters 11 MB runs on a conference badge (RP2350), no internet, about 2 tokens a second it learned English from half a billion tokens of tiny kids stories, then I trained it on about 22,000 jokes

Sam Meech Ward

17,799 views • 26 days ago

Did you know there is a train that runs over 100mph less than 10 miles from Notre Dame? ☘️ I just learned this and had to see it for myself!
0:13

Did you know there is a train that runs over 100mph less than 10 miles from Notre Dame? ☘️ I just learned this and had to see it for myself!

ND Wine n Cheese

13,559 views • 6 months ago

Last month, I built an AI influencer from scratch in under 2 minutes. Now it’s making $3,000 a month. Let me show you how you can create your own:
0:10

Last month, I built an AI influencer from scratch in under 2 minutes. Now it’s making $3,000 a month. Let me show you how you can create your own:

Jaynit Makwana

479,274 views • 2 years ago