Loading video...

Video Failed to Load

Go Home

I built an LLM from scratch. Here's everything I learned along the way.

CodingGarden's profile picture

CJ (Coding Garden)

12,995 subscribers

257,086 views • 1 month ago •via X (Twitter)

Science & TechnologyEducation
LIVE

Anya Rossi• Live Now

Private livecam show

0 Comments

No comments available

Comments from the original post will appear here

Related Videos

Met a guy making $1.6 million/year as an LLM engineer. I asked him how he learned LLMs from scratch. He sent me the exact video that got him in. A 1 hour course on how LLMs actually work. He shows how transformers inside LLMs like ChatGPT & Claude are actually built. I watched it last night. Halfway through, I realized LLM architecture is way simpler than they make it look. Bookmark this and read the article below. • 00:00 - LLM foundations • 04:21 - LLM tokenization • 05:43 - LLMs vector embeddings • 22:16 - attention mechanism of LLM • 43:42 - LLM multi head attention
57:39

Met a guy making $1.6 million/year as an LLM engineer. I asked him how he learned LLMs from scratch. He sent me the exact video that got him in. A 1 hour course on how LLMs actually work. He shows how transformers inside LLMs like ChatGPT & Claude are actually built. I watched it last night. Halfway through, I realized LLM architecture is way simpler than they make it look. Bookmark this and read the article below. • 00:00 - LLM foundations • 04:21 - LLM tokenization • 05:43 - LLMs vector embeddings • 22:16 - attention mechanism of LLM • 43:42 - LLM multi head attention

Roan

80,961 views • 1 month ago

"I did not inherit any money from my father. I built everything from scratch to where I am." - Aliko Dangote
1:36

"I did not inherit any money from my father. I built everything from scratch to where I am." - Aliko Dangote

YabaLeftOnline

81,519 views • 9 months ago

“I did not inherit any money from my father. I built everything from scratch to where I am.” – Aliko Dangote
1:36

“I did not inherit any money from my father. I built everything from scratch to where I am.” – Aliko Dangote

Oyindamola🙄

200,021 views • 1 year ago

Evan Spiegel sat down with Guy Raz on the latest episode of How I Built This! Tune in to hear how the team built Snapchat from the ground up, lessons learned along the way, and where we’re now headed:
0:30

Evan Spiegel sat down with Guy Raz on the latest episode of How I Built This! Tune in to hear how the team built Snapchat from the ground up, lessons learned along the way, and where we’re now headed:

Snap Inc.

73,666 views • 1 year ago

Everything I learned about drinking beer, I learned from Butthead
0:20

Everything I learned about drinking beer, I learned from Butthead

Historic Vids

1,167,246 views • 2 years ago

I feel a mess. My hard work. The tools tailored to me, bought along the way. I’ve done EVERYTHING from scratch. Who does this to people? Who steals their livelihoods? I’m devastated. From the loss and the damage. This is how I make my living. #GardeningTwitter
1:22

I feel a mess. My hard work. The tools tailored to me, bought along the way. I’ve done EVERYTHING from scratch. Who does this to people? Who steals their livelihoods? I’m devastated. From the loss and the damage. This is how I make my living. #GardeningTwitter

Dirty Garden Hoe 🌱

1,187,130 views • 3 years ago

I Built My Own Underground Bunker From Scratch 🚆
1:14

I Built My Own Underground Bunker From Scratch 🚆

Grace Gym🏋️‍♀️

27,043 views • 16 days ago

This is How I Built My House From The Scratch. God is Good 🫶
1:28

This is How I Built My House From The Scratch. God is Good 🫶

Pro Heed

27,138 views • 2 years ago

With gratitude, I hereby resign from Congress effective midnight tonight. It was an incredible honor. Here's some of what I learned:
2:16

With gratitude, I hereby resign from Congress effective midnight tonight. It was an incredible honor. Here's some of what I learned:

Jeff Jackson

2,282,928 views • 1 year ago

A month ago, I got sentenced to 30 days of documenting @Fhenix. Looking back, I don't think I got the worst sentence. Here's a quick recap of everything that happened along the way. ⚖️🫡
0:44

A month ago, I got sentenced to 30 days of documenting @Fhenix. Looking back, I don't think I got the worst sentence. Here's a quick recap of everything that happened along the way. ⚖️🫡

HEISGIFT

26,538 views • 2 months ago

I spent months illustrating how Transformers actually work. Not just what they do, but why they’re built this way. The history, design choices, and intuition behind every layer. From RNNs → Attention → Multi-Head → FFNs → Positional Encoding. Here's everything I wish I knew:
1:16

I spent months illustrating how Transformers actually work. Not just what they do, but why they’re built this way. The history, design choices, and intuition behind every layer. From RNNs → Attention → Multi-Head → FFNs → Positional Encoding. Here's everything I wish I knew:

krupa

251,165 views • 10 months ago

Here's how I created this CLOVER commercial from scratch. I also added how much I spent at the end. Hope you enjoy.
21:17

Here's how I created this CLOVER commercial from scratch. I also added how much I spent at the end. Hope you enjoy.

Stella Soribe ❤️

13,809 views • 1 month ago

Finished painting this mini from TwinGoddessMinis! Learned lots along the way 🥳
0:22

Finished painting this mini from TwinGoddessMinis! Learned lots along the way 🥳

Starflare

22,999 views • 2 years ago

Here is how I use agent teams for AI research. I use an LLM Council. It’s not just about creating multiple agents. You need to set roles and goals carefully. Here's how I built it with Raft:
0:35

Here is how I use agent teams for AI research. I use an LLM Council. It’s not just about creating multiple agents. You need to set roles and goals carefully. Here's how I built it with Raft:

elvis

18,158 views • 1 month ago

“I left EME with zero naira and I had to start everything from the scratch as a result” Wizkid
0:48

“I left EME with zero naira and I had to start everything from the scratch as a result” Wizkid

ÌKÀ NATION 🇳🇬

119,134 views • 9 months ago

Claude Fable 5 is unreal. I gave it one prompt and it literally built a BioShock-esque FPS game from scratch weapons, enemies, sound effects, everything.
0:39

Claude Fable 5 is unreal. I gave it one prompt and it literally built a BioShock-esque FPS game from scratch weapons, enemies, sound effects, everything.

Yaseen Khan Gul

204,168 views • 2 months ago