Loading video...

Video Failed to Load

Go Home

Transformer by hand✍️

ProfTomYeh's profile picture

Tom Yeh

55,528 subscribers

29,650 views • 6 months ago •via X (Twitter)

LIVE

Anya Rossi• Live Now

Private livecam show

0 Comments

No comments available

Comments from the original post will appear here

Related Videos

Transformer by hand ✍️ in Excel ~ I just released my first-ever "Full-Stack" implementation of the Transformer model. 👇Download xlsx to give it a try!
1:02

Transformer by hand ✍️ in Excel ~ I just released my first-ever "Full-Stack" implementation of the Transformer model. 👇Download xlsx to give it a try!

Tom Yeh

2,997,355 views • 1 year ago

[Transformer] by Hand✍️📺 5-minute Video Tutorial Anna Rahn made this short video to explain the Transformer exercise for my Computer Vision course last spring. In 5 minutes, she demonstrates the key calculations of the Transformer by hand with pen and paper! Anna is a fantastic student. I am lucky to have her in my lab!
4:55

[Transformer] by Hand✍️📺 5-minute Video Tutorial Anna Rahn made this short video to explain the Transformer exercise for my Computer Vision course last spring. In 5 minutes, she demonstrates the key calculations of the Transformer by hand with pen and paper! Anna is a fantastic student. I am lucky to have her in my lab!

Tom Yeh

133,441 views • 1 year ago

Multihead Attention by hand ✍️ in Excel ~ Download ⬇️
0:50

Multihead Attention by hand ✍️ in Excel ~ Download ⬇️

Tom Yeh

49,542 views • 1 year ago

Can you calculate a Vision Transformer (ViT) by hand? ✍️ If you can, come join me next week at the LLM Paper Club. I will extend ViT to Llama 1 -> 2 -> 3 -> 4 live. Event link below.
0:34

Can you calculate a Vision Transformer (ViT) by hand? ✍️ If you can, come join me next week at the LLM Paper Club. I will extend ViT to Llama 1 -> 2 -> 3 -> 4 live. Event link below.

Tom Yeh

77,689 views • 1 year ago

12 deep learning architectures to study in 2025, by hand✍️
0:58

12 deep learning architectures to study in 2025, by hand✍️

Tom Yeh

107,068 views • 1 year ago

Can you calculate a one-node neural network by hand ✍️
2:46

Can you calculate a one-node neural network by hand ✍️

Tom Yeh

10,344 views • 6 months ago

llm.c by Hand✍️ C programming + matrix multiplication by hand This combination is perhaps as low as we can get to explain how the Transformer works. Special thanks to Andrej Karpathy for encouraging early feedback and tetsuo //: 👾 for helping me understand the pragma magic. I hope this exercise can help people peak further into the LLM black box.
0:44

llm.c by Hand✍️ C programming + matrix multiplication by hand This combination is perhaps as low as we can get to explain how the Transformer works. Special thanks to Andrej Karpathy for encouraging early feedback and tetsuo //: 👾 for helping me understand the pragma magic. I hope this exercise can help people peak further into the LLM black box.

Tom Yeh

302,625 views • 2 years ago

Seq2Seq by hand✍️Ilya Sutskever Congrats! Test of Time Award 🏆 #NeurIPS2024
0:21

Seq2Seq by hand✍️Ilya Sutskever Congrats! Test of Time Award 🏆 #NeurIPS2024

Tom Yeh

53,797 views • 1 year ago

I made a 2025 calendar, featuring 12 key deep learning architectures I drew and calculated by hand ✍️
0:25

I made a 2025 calendar, featuring 12 key deep learning architectures I drew and calculated by hand ✍️

Tom Yeh

18,927 views • 1 year ago

This Kashmiri man wrote the entire Quran by hand on a single 500-metre scroll of paper ✍️
1:47

This Kashmiri man wrote the entire Quran by hand on a single 500-metre scroll of paper ✍️

Al Jazeera English

298,293 views • 3 years ago

Evolution of Deep Learning by Hand ✍️ As my tribute to Geoff Hinton's Nobel Prize, I drew this animation to illustrate the key idea behind Hinton's major contributions to deep learning over the years, with artistic liberty. ---- 100% original, made by hand ✍️ Join 40k readers of my newsletter:
1:05

Evolution of Deep Learning by Hand ✍️ As my tribute to Geoff Hinton's Nobel Prize, I drew this animation to illustrate the key idea behind Hinton's major contributions to deep learning over the years, with artistic liberty. ---- 100% original, made by hand ✍️ Join 40k readers of my newsletter:

Tom Yeh

110,690 views • 7 months ago

MCP by hand ✍️ This exercise walks you through the key elements of the 𝗠𝗼𝗱𝗲𝗹 𝗖𝗼𝗻𝘁𝗲𝘅𝘁 𝗣𝗿𝗼𝘁𝗼𝗰𝗼𝗹 (MCP). Learn more at our workshop. Link below. 👇
0:23

MCP by hand ✍️ This exercise walks you through the key elements of the 𝗠𝗼𝗱𝗲𝗹 𝗖𝗼𝗻𝘁𝗲𝘅𝘁 𝗣𝗿𝗼𝘁𝗼𝗰𝗼𝗹 (MCP). Learn more at our workshop. Link below. 👇

Tom Yeh

33,683 views • 11 months ago

Temperature 🌡️ by hand ✍️ ~ I designed this Excel exercise to help you study how temperature influences the sampling process of a language model. Download xlsx 👇
0:23

Temperature 🌡️ by hand ✍️ ~ I designed this Excel exercise to help you study how temperature influences the sampling process of a language model. Download xlsx 👇

Tom Yeh

18,685 views • 1 year ago

King Charles (77 yrs old) held the hand of Tinubu (73 yrs) to assist him in walking down the stairs. Is Tinubu too frail to walk by himself?✍️
0:30

King Charles (77 yrs old) held the hand of Tinubu (73 yrs) to assist him in walking down the stairs. Is Tinubu too frail to walk by himself?✍️

Obiasogu David

428,176 views • 2 months ago

MLP by hand✍️Excel ~ I designed this exercise to show how to calculate a four-level network by hand, along with a graph and matching pytorch code. Also, I made a medium and a large version to show how it scales. 👇Join the 'AI Math' community. Download xlsx.
0:21

MLP by hand✍️Excel ~ I designed this exercise to show how to calculate a four-level network by hand, along with a graph and matching pytorch code. Also, I made a medium and a large version to show how it scales. 👇Join the 'AI Math' community. Download xlsx.

Tom Yeh

62,205 views • 1 year ago

How to multiply two matrices on a GPU or TPU by hand ✍️? Learn more at my keynote lecture next week 👉 (hosted by Together AI) I drew 91 frames in total to create this animation. 💪
1:30

How to multiply two matrices on a GPU or TPU by hand ✍️? Learn more at my keynote lecture next week 👉 (hosted by Together AI) I drew 91 frames in total to create this animation. 💪

Tom Yeh

50,876 views • 7 months ago

What handmade actually means in clothing: not only was this pattern drafted and cut by hand, the interior seams finished by hand, the collar and sleeves attached by hand, and the coat pressed by hand, but the fabric was even woven by hand (or by foot, depending on your view).
0:44

What handmade actually means in clothing: not only was this pattern drafted and cut by hand, the interior seams finished by hand, the collar and sleeves attached by hand, and the coat pressed by hand, but the fabric was even woven by hand (or by foot, depending on your view).

derek guy

69,486 views • 6 months ago

Peak writing by ARM ✍️
1:52

Peak writing by ARM ✍️

Xenomorph

238,183 views • 5 months ago