Video yükleniyor...

Video Yüklenemedi

Ana Sayfaya Dön

llm.c by Hand✍️ C programming + matrix multiplication by hand This combination is perhaps as low as we can get to explain how the Transformer works. Special thanks to Andrej Karpathy for encouraging early feedback and tetsuo //: 👾 for helping me understand the pragma magic. I hope this...

ProfTomYeh's profile picture

Tom Yeh

55,973 subscribers

302,625 görüntüleme • 2 yıl önce •via X (Twitter)

EğitimHaberler & PolitikaBilim & Teknoloji
LIVE

Anya Rossi• Live Now

Private livecam show

11 Yorum

Yuchen Jin profil fotoğrafı
Yuchen Jin2 yıl önce

@karpathy @7etsuo Awesome! Looking forward to an llm.c Attention episode

Tom Yeh profil fotoğrafı
Tom Yeh2 yıl önce

@karpathy @7etsuo This is a great suggestion! Thanks!

Antonio Linares profil fotoğrafı
Antonio Linares2 yıl önce

@karpathy @7etsuo Is there a way to load a single layer of a LLM (in example Llama3-70B) and process it layer by layer so it fits on a normal PC memory ? Could you explain how to do it ?

Tom Yeh profil fotoğrafı
Tom Yeh2 yıl önce

@karpathy @7etsuo It is possible. But it would be quite slow. To generate each token, the model has to evaluate every one of the hundreds of layers. Say loading each layer takes 1 second. It would take 100 seconds to load 100 layers for one token. Then you multiple that by 1000 tokens. Very slow.

rakesh profil fotoğrafı
rakesh2 yıl önce

@karpathy @7etsuo Goated acc

ed profil fotoğrafı
ed2 yıl önce

@karpathy @7etsuo Amazing 🔥

Cuhmunity Notes profil fotoğrafı
Cuhmunity Notes2 yıl önce

@karpathy @7etsuo 🔥

Byron Hsu profil fotoğrafı
Byron Hsu2 yıl önce

@karpathy @7etsuo This is awesome

Filippo Broggini profil fotoğrafı
Filippo Broggini2 yıl önce

@karpathy @7etsuo Is this also available elsewhere online?

George D Gregory profil fotoğrafı
George D Gregory2 yıl önce

@karpathy @7etsuo Can these be made into the notebooks!? That would be awesome.

Tom Yeh profil fotoğrafı
Tom Yeh2 yıl önce

@karpathy @7etsuo I am waiting for a notebook ninja to step up to help.😄

Benzer Videolar

[Transformer] by Hand✍️📺 5-minute Video Tutorial Anna Rahn made this short video to explain the Transformer exercise for my Computer Vision course last spring. In 5 minutes, she demonstrates the key calculations of the Transformer by hand with pen and paper! Anna is a fantastic student. I am lucky to have her in my lab!
4:55

[Transformer] by Hand✍️📺 5-minute Video Tutorial Anna Rahn made this short video to explain the Transformer exercise for my Computer Vision course last spring. In 5 minutes, she demonstrates the key calculations of the Transformer by hand with pen and paper! Anna is a fantastic student. I am lucky to have her in my lab!

Tom Yeh

133,460 görüntüleme • 1 yıl önce

Self-Attention by hand ✍️ Excel ~ I designed this exercise for students to practice the QKV math. I also created a medium and a large version to show how the attention matrix grows quadratically as the sequence gets longer. 👇Join the 'AI Math' community. Download xlsx.
0:20

Self-Attention by hand ✍️ Excel ~ I designed this exercise for students to practice the QKV math. I also created a medium and a large version to show how the attention matrix grows quadratically as the sequence gets longer. 👇Join the 'AI Math' community. Download xlsx.

Tom Yeh

125,616 görüntüleme • 1 yıl önce

Transformer by hand ✍️ Given input X, this exercise goes through the key equations behind the 𝗦𝗲𝗹𝗳 𝗔𝘁𝘁𝗲𝗻𝘁𝗶𝗼𝗻 layer and the 𝗙𝗲𝗲𝗱 𝗙𝗼𝗿𝘄𝗮𝗿𝗱 layer, showing you how X is transformed into Y.
0:29

Transformer by hand ✍️ Given input X, this exercise goes through the key equations behind the 𝗦𝗲𝗹𝗳 𝗔𝘁𝘁𝗲𝗻𝘁𝗶𝗼𝗻 layer and the 𝗙𝗲𝗲𝗱 𝗙𝗼𝗿𝘄𝗮𝗿𝗱 layer, showing you how X is transformed into Y.

Tom Yeh

15,488 görüntüleme • 11 ay önce

Anna Rahn's video demonstration of Multi-Layer Perceptron (MLP) by hand ✍️ Anna made this short video for my computer vision course in the spring semester. Together with the spreadsheet exercise I posted yesterday, I hope they help more people understand deep neural networks!
3:35

Anna Rahn's video demonstration of Multi-Layer Perceptron (MLP) by hand ✍️ Anna made this short video for my computer vision course in the spring semester. Together with the spreadsheet exercise I posted yesterday, I hope they help more people understand deep neural networks!

Tom Yeh

120,405 görüntüleme • 1 yıl önce

Mamba by hand ✍️ ~ I made this exercise as I studied the math in the Mamba paper. It is a small yet complete Mamba implementation. Thanks Albert Gu for answering my questions and checking. 👇Join the 'AI Math' community. Download xlsx.
0:21

Mamba by hand ✍️ ~ I made this exercise as I studied the math in the Mamba paper. It is a small yet complete Mamba implementation. Thanks Albert Gu for answering my questions and checking. 👇Join the 'AI Math' community. Download xlsx.

Tom Yeh

55,438 görüntüleme • 1 yıl önce

We all smoke our way, for now I have mastered the art of the glass tip cone style. It’s not a specialty roll by any means, but it’s consistent for me. I don’t have the fine hand coordination nor the patience to fuck up a hand roll when I can do this pretty easily and it smokes as proper as a good hand roll. When I have more time away from serving, I’ll practice hand rolling but this is how I smoke.
0:18

We all smoke our way, for now I have mastered the art of the glass tip cone style. It’s not a specialty roll by any means, but it’s consistent for me. I don’t have the fine hand coordination nor the patience to fuck up a hand roll when I can do this pretty easily and it smokes as proper as a good hand roll. When I have more time away from serving, I’ll practice hand rolling but this is how I smoke.

Don

22,510 görüntüleme • 3 ay önce

Can you calculate a Vision Transformer (ViT) by hand? ✍️ If you can, come join me next week at the LLM Paper Club. I will extend ViT to Llama 1 -> 2 -> 3 -> 4 live. Event link below.
0:34

Can you calculate a Vision Transformer (ViT) by hand? ✍️ If you can, come join me next week at the LLM Paper Club. I will extend ViT to Llama 1 -> 2 -> 3 -> 4 live. Event link below.

Tom Yeh

77,689 görüntüleme • 1 yıl önce

Temperature 🌡️ by hand ✍️ ~ I designed this Excel exercise to help you study how temperature influences the sampling process of a language model. Download xlsx 👇
0:23

Temperature 🌡️ by hand ✍️ ~ I designed this Excel exercise to help you study how temperature influences the sampling process of a language model. Download xlsx 👇

Tom Yeh

18,685 görüntüleme • 1 yıl önce

Matrix Multiplication on GPU/TPU by hand ✍️ I drew 91 frames to show how to divide large matrices into "tiles" to use accelerators such as GPU/TPU. If you like to learn more, check out our weekly workshops. Link 👇
1:30

Matrix Multiplication on GPU/TPU by hand ✍️ I drew 91 frames to show how to divide large matrices into "tiles" to use accelerators such as GPU/TPU. If you like to learn more, check out our weekly workshops. Link 👇

Tom Yeh

77,774 görüntüleme • 11 ay önce

It’s hard to post this cruelty, this hate, this evil, as it makes me so angry - but it needs to be seen. We need to show what Trump is doing to our people. We are fighting Trump and ICE by getting into the hands of as many immigrants and allies as possible. As well as lawful and constitutional immigration advice, PAXIS can help people prepare for conflict, and can help defuse situations. FIGHT ICE, FIGHT TRUMP, FIGHT FASCISM:
1:51

It’s hard to post this cruelty, this hate, this evil, as it makes me so angry - but it needs to be seen. We need to show what Trump is doing to our people. We are fighting Trump and ICE by getting into the hands of as many immigrants and allies as possible. As well as lawful and constitutional immigration advice, PAXIS can help people prepare for conflict, and can help defuse situations. FIGHT ICE, FIGHT TRUMP, FIGHT FASCISM:

Joe Walsh

19,776 görüntüleme • 2 ay önce

The London promise is simple. If you work hard, and get a helping hand, you can achieve anything. That's why I'm running again as Mayor: so City Hall can continue to be that helping hand for every Londoner.
0:34

The London promise is simple. If you work hard, and get a helping hand, you can achieve anything. That's why I'm running again as Mayor: so City Hall can continue to be that helping hand for every Londoner.

Sadiq Khan

198,607 görüntüleme • 2 yıl önce

"I've been told by multiple sources that we can expect [Joe Biden] to make his announcement as early as the weekend, perhaps next week, and to clear the way for Kamala Harris and perhaps others to compete for the nomination." — Mark Halperin, political analyst Rob Finnerty
5:00

"I've been told by multiple sources that we can expect [Joe Biden] to make his announcement as early as the weekend, perhaps next week, and to clear the way for Kamala Harris and perhaps others to compete for the nomination." — Mark Halperin, political analyst Rob Finnerty

NEWSMAX

65,255 görüntüleme • 1 yıl önce

1/ Mortgage rates in Mozambique have reached as high as 22%. Much of the population along the coastline can’t get a loan to buy a house, and shelters built by hand get destroyed by cyclones. A quick look at how crypto can update the system to help get people in safer homes.🧵
1:00

1/ Mortgage rates in Mozambique have reached as high as 22%. Much of the population along the coastline can’t get a loan to buy a house, and shelters built by hand get destroyed by cyclones. A quick look at how crypto can update the system to help get people in safer homes.🧵

Coinbase 🛡️

613,468 görüntüleme • 3 yıl önce

CUDA MODE hackathon today! Here's Andrej Karpathy on the 🏖️ origin story of llm.c, and what it hints at for the fast, simple, llm-compiled future of custom software.
23:28

CUDA MODE hackathon today! Here's Andrej Karpathy on the 🏖️ origin story of llm.c, and what it hints at for the fast, simple, llm-compiled future of custom software.

swyx

97,440 görüntüleme • 1 yıl önce

"Law-abiding people get crushed, because the laws get more and more draconian for the people willing to abide by them." "Unfairness is something that really will rile people." Katie Lam explains how anarcho-tyranny works. Encouraging to see some MPs understand the problem.
2:12

"Law-abiding people get crushed, because the laws get more and more draconian for the people willing to abide by them." "Unfairness is something that really will rile people." Katie Lam explains how anarcho-tyranny works. Encouraging to see some MPs understand the problem.

Connor Tomlinson

64,667 görüntüleme • 11 ay önce

It’s time to understand why 63% enrichment of uranium is the magic number. I’ll let Maryam Shani explain as only she can. Don’t know about you but I am so much wiser for her bite size contributions to this important conversation as the U.S. looks to further talks in Islamabad. 🎥 TikTok -
2:59

It’s time to understand why 63% enrichment of uranium is the magic number. I’ll let Maryam Shani explain as only she can. Don’t know about you but I am so much wiser for her bite size contributions to this important conversation as the U.S. looks to further talks in Islamabad. 🎥 TikTok -

𝔗𝔯𝔲𝔱𝔥 𝔐𝔞𝔱𝔱𝔢𝔯𝔰

10,488 görüntüleme • 2 ay önce

MLP by hand✍️Excel ~ I designed this exercise to show how to calculate a four-level network by hand, along with a graph and matching pytorch code. Also, I made a medium and a large version to show how it scales. 👇Join the 'AI Math' community. Download xlsx.
0:21

MLP by hand✍️Excel ~ I designed this exercise to show how to calculate a four-level network by hand, along with a graph and matching pytorch code. Also, I made a medium and a large version to show how it scales. 👇Join the 'AI Math' community. Download xlsx.

Tom Yeh

62,207 görüntüleme • 1 yıl önce

The London promise: if you work hard, and get a helping hand, you can achieve anything. If I'm re-elected as Mayor, I'll continue to be that helping hand. Today I launched my manifesto for a fairer, safer, greener London.
0:23

The London promise: if you work hard, and get a helping hand, you can achieve anything. If I'm re-elected as Mayor, I'll continue to be that helping hand. Today I launched my manifesto for a fairer, safer, greener London.

Sadiq Khan

102,065 görüntüleme • 2 yıl önce

llm.c by hand is next level. i wonder sometimes how the brain of people who master things in unbelievably deep levels comprehend subjects differently.
1:17

llm.c by hand is next level. i wonder sometimes how the brain of people who master things in unbelievably deep levels comprehend subjects differently.

ℏεsam

190,358 görüntüleme • 7 ay önce

'Is that the sound of a penny dropping? Or is that the sound of a skull too thick to understand something as simple as that?' James O'Brien explains to this anonymous texter how foreign aid works hand in hand with 'stopping the boats'.
0:52

'Is that the sound of a penny dropping? Or is that the sound of a skull too thick to understand something as simple as that?' James O'Brien explains to this anonymous texter how foreign aid works hand in hand with 'stopping the boats'.

LBC

71,229 görüntüleme • 1 yıl önce