Video yükleniyor...

Video Yüklenemedi

Ana Sayfaya Dön

I calculated a poster-size Transformer model by hand✍️

ProfTomYeh's profile picture

Tom Yeh

56,046 subscribers

112,781 görüntüleme • 1 yıl önce •via X (Twitter)

SanatBilim & TeknolojiEğitim
LIVE

Anya Rossi• Live Now

Private livecam show

10 Yorum

Tom Yeh profil fotoğrafı
Tom Yeh1 yıl önce

Q: How long did it take? A: A long time. Q: Why? A: It was never done before. Q: Any error? A: Probably some, since it was done by hand. 😅 Q: What next? A: Please suggest.

LΞOZC profil fotoğrafı
LΞOZC1 yıl önce

Get a huge pdf to allow us to print - or please sell a poster

Tom Yeh profil fotoğrafı
Tom Yeh1 yıl önce

🙏 I will look into this possibility. Thanks!

Akil Tipu profil fotoğrafı
Akil Tipu1 yıl önce

I wish I could hang it on my wall. This is so cool!

Tom Yeh profil fotoğrafı
Tom Yeh1 yıl önce

I will look into it. Thanks!

yash 📖 profil fotoğrafı
yash 📖1 yıl önce

Damm it must have been mentally draining ?

Tom Yeh profil fotoğrafı
Tom Yeh1 yıl önce

Also physically draining. My hand was sore.

Chaitali profil fotoğrafı
Chaitali1 yıl önce

You are really motivating me to use my hand as a gpu to train my transformer Prof.

Tom Yeh profil fotoğrafı
Tom Yeh1 yıl önce

Of course, I often use two hands to illustrate matrix multiplication, putting one 90 degree rotated to another and using fingers to show how rows and columns intersect. Try it!

David Rosenberger profil fotoğrafı
David Rosenberger1 yıl önce

Wow

Benzer Videolar

Transformer by hand ✍️ in Excel ~ I just released my first-ever "Full-Stack" implementation of the Transformer model. 👇Download xlsx to give it a try!
1:02

Transformer by hand ✍️ in Excel ~ I just released my first-ever "Full-Stack" implementation of the Transformer model. 👇Download xlsx to give it a try!

Tom Yeh

2,997,355 görüntüleme • 1 yıl önce

I made a 2025 calendar, featuring 12 key deep learning architectures I drew and calculated by hand ✍️
0:25

I made a 2025 calendar, featuring 12 key deep learning architectures I drew and calculated by hand ✍️

Tom Yeh

18,927 görüntüleme • 1 yıl önce

[Transformer] by Hand✍️📺 5-minute Video Tutorial Anna Rahn made this short video to explain the Transformer exercise for my Computer Vision course last spring. In 5 minutes, she demonstrates the key calculations of the Transformer by hand with pen and paper! Anna is a fantastic student. I am lucky to have her in my lab!
4:55

[Transformer] by Hand✍️📺 5-minute Video Tutorial Anna Rahn made this short video to explain the Transformer exercise for my Computer Vision course last spring. In 5 minutes, she demonstrates the key calculations of the Transformer by hand with pen and paper! Anna is a fantastic student. I am lucky to have her in my lab!

Tom Yeh

133,442 görüntüleme • 1 yıl önce

Temperature 🌡️ by hand ✍️ ~ I designed this Excel exercise to help you study how temperature influences the sampling process of a language model. Download xlsx 👇
0:23

Temperature 🌡️ by hand ✍️ ~ I designed this Excel exercise to help you study how temperature influences the sampling process of a language model. Download xlsx 👇

Tom Yeh

18,685 görüntüleme • 1 yıl önce

I built a working transformer model in Excel using Shortcut
0:59

I built a working transformer model in Excel using Shortcut

nico

50,372 görüntüleme • 9 ay önce

Given an embedding vector, you can tell which model produced it. I trained a 0.8M transformer that fingerprints embedding models by reading raw float digits (vocab size: 15). Full end-to-end, zero feature engineering.
0:30

Given an embedding vector, you can tell which model produced it. I trained a 0.8M transformer that fingerprints embedding models by reading raw float digits (vocab size: 15). Full end-to-end, zero feature engineering.

Han Xiao

19,688 görüntüleme • 3 ay önce

Can you calculate a Vision Transformer (ViT) by hand? ✍️ If you can, come join me next week at the LLM Paper Club. I will extend ViT to Llama 1 -> 2 -> 3 -> 4 live. Event link below.
0:34

Can you calculate a Vision Transformer (ViT) by hand? ✍️ If you can, come join me next week at the LLM Paper Club. I will extend ViT to Llama 1 -> 2 -> 3 -> 4 live. Event link below.

Tom Yeh

77,689 görüntüleme • 1 yıl önce

Movie poster legend Drew Struzan creating the "Star Wars: Episode I: The Phantom Menace" poster Every stroke, every highlight, every face — all done by hand.
2:53

Movie poster legend Drew Struzan creating the "Star Wars: Episode I: The Phantom Menace" poster Every stroke, every highlight, every face — all done by hand.

Movies Scenes 🎫

56,776 görüntüleme • 6 ay önce

Can you calculate a one-node neural network by hand ✍️
2:46

Can you calculate a one-node neural network by hand ✍️

Tom Yeh

10,344 görüntüleme • 6 ay önce

Malaysian influencers visited Qingdao and stumbled upon a vintage poster machine by the sea. One second, one click — a souvenir poster in hand. Simple joy, unforgettable memory. The sea breeze remembers. The poster does too. #Qingdao #Malaysia
0:36

Malaysian influencers visited Qingdao and stumbled upon a vintage poster machine by the sea. One second, one click — a souvenir poster in hand. Simple joy, unforgettable memory. The sea breeze remembers. The poster does too. #Qingdao #Malaysia

Qingdao Feel

21,462 görüntüleme • 1 ay önce

llm.c by Hand✍️ C programming + matrix multiplication by hand This combination is perhaps as low as we can get to explain how the Transformer works. Special thanks to Andrej Karpathy for encouraging early feedback and tetsuo //: 👾 for helping me understand the pragma magic. I hope this exercise can help people peak further into the LLM black box.
0:44

llm.c by Hand✍️ C programming + matrix multiplication by hand This combination is perhaps as low as we can get to explain how the Transformer works. Special thanks to Andrej Karpathy for encouraging early feedback and tetsuo //: 👾 for helping me understand the pragma magic. I hope this exercise can help people peak further into the LLM black box.

Tom Yeh

302,625 görüntüleme • 2 yıl önce

Multihead Attention by hand ✍️ in Excel ~ Download ⬇️
0:50

Multihead Attention by hand ✍️ in Excel ~ Download ⬇️

Tom Yeh

49,542 görüntüleme • 1 yıl önce

outchea at Oklahoma Women's Gym! come get a poster and autograph ✍️
0:17

outchea at Oklahoma Women's Gym! come get a poster and autograph ✍️

Oklahoma Baseball

11,857 görüntüleme • 1 yıl önce

MLP by hand✍️Excel ~ I designed this exercise to show how to calculate a four-level network by hand, along with a graph and matching pytorch code. Also, I made a medium and a large version to show how it scales. 👇Join the 'AI Math' community. Download xlsx.
0:21

MLP by hand✍️Excel ~ I designed this exercise to show how to calculate a four-level network by hand, along with a graph and matching pytorch code. Also, I made a medium and a large version to show how it scales. 👇Join the 'AI Math' community. Download xlsx.

Tom Yeh

62,205 görüntüleme • 1 yıl önce

12 deep learning architectures to study in 2025, by hand✍️
0:58

12 deep learning architectures to study in 2025, by hand✍️

Tom Yeh

107,068 görüntüleme • 1 yıl önce

This Kashmiri man wrote the entire Quran by hand on a single 500-metre scroll of paper ✍️
1:47

This Kashmiri man wrote the entire Quran by hand on a single 500-metre scroll of paper ✍️

Al Jazeera English

298,293 görüntüleme • 3 yıl önce

Back in days i was searching for a tool create me poster.. Trying to many tools, I found this toool That could create 4k HD poster in Seconds….. Meet Dreamina AI → 4.0 Model; New Model launched Upload. Prompt. Done. Your next ad is ready. #Dreamina #Dreaminapartner #posterdesign #seedream4
0:28

Back in days i was searching for a tool create me poster.. Trying to many tools, I found this toool That could create 4k HD poster in Seconds….. Meet Dreamina AI → 4.0 Model; New Model launched Upload. Prompt. Done. Your next ad is ready. #Dreamina #Dreaminapartner #posterdesign #seedream4

Fakhr

69,178 görüntüleme • 8 ay önce

Seq2Seq by hand✍️Ilya Sutskever Congrats! Test of Time Award 🏆 #NeurIPS2024
0:21

Seq2Seq by hand✍️Ilya Sutskever Congrats! Test of Time Award 🏆 #NeurIPS2024

Tom Yeh

53,797 görüntüleme • 1 yıl önce

#3D model using Gaussian splatting with approx. 1400 photos of a drone flight over the Kastel-Staadt hermitage near #Trier. I had already calculated a photogrammetry model last year, the details of the plants in this model are fantastic.
0:20

#3D model using Gaussian splatting with approx. 1400 photos of a drone flight over the Kastel-Staadt hermitage near #Trier. I had already calculated a photogrammetry model last year, the details of the plants in this model are fantastic.

Sven Schroeter

16,655 görüntüleme • 1 yıl önce