Video yükleniyor...

Video Yüklenemedi

Ana Sayfaya Dön

Transformer by hand ✍️ in Excel ~ I just released my first-ever "Full-Stack" implementation of the Transformer model. 👇Download xlsx to give it a try!

ProfTomYeh's profile picture

Tom Yeh

55,972 subscribers

2,997,355 görüntüleme • 1 yıl önce •via X (Twitter)

Bilim & TeknolojiEğitimSanat
LIVE

Anya Rossi• Live Now

Private livecam show

8 Yorum

Covertbox profil fotoğrafı
Covertbox1 yıl önce

@ProfTomYeh please can you recommend any beginners book for LLM and Transformers in general?

mandeep profil fotoğrafı
mandeep1 yıl önce

People are crazy good at stuff

Ezekiel Macharia profil fotoğrafı
Ezekiel Macharia1 yıl önce

X should not be free. Thank you.

\backslash profil fotoğrafı
\backslash1 yıl önce

Thanks for sharing. This is huge!

Henning Sittler profil fotoğrafı
Henning Sittler1 yıl önce

Yes

Geter Pabriel profil fotoğrafı
Geter Pabriel1 yıl önce

You're a rockstar

Narayana tantry profil fotoğrafı
Narayana tantry1 yıl önce

Amazing, this helps out a lot !!

Infinite Growth profil fotoğrafı
Infinite Growth1 yıl önce

Amazing! I also once found a 3d visualization of several LLM transformer models. I think GPT-3, GPT-4 were included there. Would be fun to find them.

Benzer Videolar

Temperature 🌡️ by hand ✍️ ~ I designed this Excel exercise to help you study how temperature influences the sampling process of a language model. Download xlsx 👇
0:23

Temperature 🌡️ by hand ✍️ ~ I designed this Excel exercise to help you study how temperature influences the sampling process of a language model. Download xlsx 👇

Tom Yeh

18,685 görüntüleme • 1 yıl önce

I calculated a poster-size Transformer model by hand✍️
0:29

I calculated a poster-size Transformer model by hand✍️

Tom Yeh

112,781 görüntüleme • 1 yıl önce

Mamba by hand ✍️ ~ I made this exercise as I studied the math in the Mamba paper. It is a small yet complete Mamba implementation. Thanks Albert Gu for answering my questions and checking. 👇Join the 'AI Math' community. Download xlsx.
0:21

Mamba by hand ✍️ ~ I made this exercise as I studied the math in the Mamba paper. It is a small yet complete Mamba implementation. Thanks Albert Gu for answering my questions and checking. 👇Join the 'AI Math' community. Download xlsx.

Tom Yeh

55,438 görüntüleme • 1 yıl önce

[Transformer] by Hand✍️📺 5-minute Video Tutorial Anna Rahn made this short video to explain the Transformer exercise for my Computer Vision course last spring. In 5 minutes, she demonstrates the key calculations of the Transformer by hand with pen and paper! Anna is a fantastic student. I am lucky to have her in my lab!
4:55

[Transformer] by Hand✍️📺 5-minute Video Tutorial Anna Rahn made this short video to explain the Transformer exercise for my Computer Vision course last spring. In 5 minutes, she demonstrates the key calculations of the Transformer by hand with pen and paper! Anna is a fantastic student. I am lucky to have her in my lab!

Tom Yeh

133,441 görüntüleme • 1 yıl önce

I built a working transformer model in Excel using Shortcut
0:59

I built a working transformer model in Excel using Shortcut

nico

50,372 görüntüleme • 9 ay önce

Transformer by hand✍️
0:29

Transformer by hand✍️

Tom Yeh

29,650 görüntüleme • 6 ay önce

MLP by hand✍️Excel ~ I designed this exercise to show how to calculate a four-level network by hand, along with a graph and matching pytorch code. Also, I made a medium and a large version to show how it scales. 👇Join the 'AI Math' community. Download xlsx.
0:21

MLP by hand✍️Excel ~ I designed this exercise to show how to calculate a four-level network by hand, along with a graph and matching pytorch code. Also, I made a medium and a large version to show how it scales. 👇Join the 'AI Math' community. Download xlsx.

Tom Yeh

62,205 görüntüleme • 1 yıl önce

Self-Attention by hand ✍️ Excel ~ I designed this exercise for students to practice the QKV math. I also created a medium and a large version to show how the attention matrix grows quadratically as the sequence gets longer. 👇Join the 'AI Math' community. Download xlsx.
0:20

Self-Attention by hand ✍️ Excel ~ I designed this exercise for students to practice the QKV math. I also created a medium and a large version to show how the attention matrix grows quadratically as the sequence gets longer. 👇Join the 'AI Math' community. Download xlsx.

Tom Yeh

125,595 görüntüleme • 1 yıl önce

Multihead Attention by hand ✍️ in Excel ~ Download ⬇️
0:50

Multihead Attention by hand ✍️ in Excel ~ Download ⬇️

Tom Yeh

49,542 görüntüleme • 1 yıl önce

Inception Labs just killed the transformer. They released Mercury 2, the world's first "diffusion" reasoning model. It's fast, and it uses a completely new model architecture... just watch this 11 min video to find out more:
11:35

Inception Labs just killed the transformer. They released Mercury 2, the world's first "diffusion" reasoning model. It's fast, and it uses a completely new model architecture... just watch this 11 min video to find out more:

David Ondrej

45,692 görüntüleme • 3 ay önce

Introducing Lemon Slice Live: the first real-time audio-video AI model Anyone can video chat with any character by just uploading a single photo. Every pixel on the screen is rendered at 25fps in real-time by a transformer model. Here’s how we built it + a live demo! 👇
0:23

Introducing Lemon Slice Live: the first real-time audio-video AI model Anyone can video chat with any character by just uploading a single photo. Every pixel on the screen is rendered at 25fps in real-time by a transformer model. Here’s how we built it + a live demo! 👇

LemonSlice

170,779 görüntüleme • 1 yıl önce

Transformer Explainer Really cool interactive tool to learn about the inner workings of a Transformer model. Apparently, it runs a GPT-2 instance locally in the user's browser and allows you to experiment with your own inputs. This is a nice tool to learn more about the different components inside the Transformer and the transformations that occur. Tool:
0:29

Transformer Explainer Really cool interactive tool to learn about the inner workings of a Transformer model. Apparently, it runs a GPT-2 instance locally in the user's browser and allows you to experiment with your own inputs. This is a nice tool to learn more about the different components inside the Transformer and the transformations that occur. Tool:

elvis

121,867 görüntüleme • 1 yıl önce

Microsoft just released Agent Mode in Excel. It created a financial model in minutes:
1:53

Microsoft just released Agent Mode in Excel. It created a financial model in minutes:

Alex Banks

43,106 görüntüleme • 8 ay önce

the transformer architecture in full detail
1:25

the transformer architecture in full detail

ℏεsam

113,272 görüntüleme • 1 yıl önce

GUYS!! NIGERIA, AEDC, AND TINUBU HAPPENED TO MY SMALL COMMUNITY IN LUGBE YESTERDAY!!!😥 For almost 3 years since I built my small hut in this community, we have been battling with epileptic power situation due to the overloaded Transformer which has been serving 3 communities including mine. In December 2025, after myself and a few community members spearheaded a regime change and ensured a proper election was conducted. After the election, we told the newly elected chairman (who happens to be my very very good friend) that the priority is for us to get our own dedicated Transformer for the community. Initially, we were thinking of buying. But considering it will cost over N20million to buy a 500KVA Transformer and another N15million plus for accessories and installation, the mission looked impossible. Then I and others told the Chairman that we can actually give it a try an reach out to the aedcelectricity for a Transformer given that the NERC Nigeria has told Nigerians that it is the responsibility of the DISCOs to provide Transformer and any power related infrastructure to any community or area in need of such infrastructure. Considering the Nigerian factor, many, infact, almost the entire community said it was never going to be possible for AEDC to give us a Transformer free of charge. But as someone who has been an advocate of government and who has always benefited from government by following due process, I encouraged my community and the Chairman that this is actually worth a try. In January 2026, we drafted a Transformer request letter and submitted to the AEDC Head Office at Wuse Zone 4, and the processes began. Low and behold, in less than 4 months, the AEDC, yesterday, delivered a brand new 500KVA Transformer with complete accessories to my community FREE-OF-CHARGE!🤸‍♂️🕺 I have told my community people that we have started benefitting our own share of the N3.3trillion approved by President Bola Ahmed Tinubu to GENCOs and all of us have agreed that come 2027, it is TINUBU OR NOTHING!!!🤗💪🏾 God bless the AEDC! God bless NERC!! God bless President Tinubu!!! God bless Nigeria 🇳🇬🙏🏾
0:08

GUYS!! NIGERIA, AEDC, AND TINUBU HAPPENED TO MY SMALL COMMUNITY IN LUGBE YESTERDAY!!!😥 For almost 3 years since I built my small hut in this community, we have been battling with epileptic power situation due to the overloaded Transformer which has been serving 3 communities including mine. In December 2025, after myself and a few community members spearheaded a regime change and ensured a proper election was conducted. After the election, we told the newly elected chairman (who happens to be my very very good friend) that the priority is for us to get our own dedicated Transformer for the community. Initially, we were thinking of buying. But considering it will cost over N20million to buy a 500KVA Transformer and another N15million plus for accessories and installation, the mission looked impossible. Then I and others told the Chairman that we can actually give it a try an reach out to the aedcelectricity for a Transformer given that the NERC Nigeria has told Nigerians that it is the responsibility of the DISCOs to provide Transformer and any power related infrastructure to any community or area in need of such infrastructure. Considering the Nigerian factor, many, infact, almost the entire community said it was never going to be possible for AEDC to give us a Transformer free of charge. But as someone who has been an advocate of government and who has always benefited from government by following due process, I encouraged my community and the Chairman that this is actually worth a try. In January 2026, we drafted a Transformer request letter and submitted to the AEDC Head Office at Wuse Zone 4, and the processes began. Low and behold, in less than 4 months, the AEDC, yesterday, delivered a brand new 500KVA Transformer with complete accessories to my community FREE-OF-CHARGE!🤸‍♂️🕺 I have told my community people that we have started benefitting our own share of the N3.3trillion approved by President Bola Ahmed Tinubu to GENCOs and all of us have agreed that come 2027, it is TINUBU OR NOTHING!!!🤗💪🏾 God bless the AEDC! God bless NERC!! God bless President Tinubu!!! God bless Nigeria 🇳🇬🙏🏾

𝒀𝑨𝑺𝑺𝑬𝑹 𝑨𝑺𝑬𝑲𝑶𝑴𝑬 𝑮𝑨𝑹𝑩𝑨, PGD, MLSCM

52,764 görüntüleme • 2 ay önce

🇬🇭 “After fixing the transformer, you didn’t close it.” — An individual recorded the aftermath of ECG officials fixing a transformer in his community but failing to close it, warning that rainwater could enter and cause damage.
0:22

🇬🇭 “After fixing the transformer, you didn’t close it.” — An individual recorded the aftermath of ECG officials fixing a transformer in his community but failing to close it, warning that rainwater could enter and cause damage.

THE STATE NEWS

39,648 görüntüleme • 1 ay önce

Can you calculate a Vision Transformer (ViT) by hand? ✍️ If you can, come join me next week at the LLM Paper Club. I will extend ViT to Llama 1 -> 2 -> 3 -> 4 live. Event link below.
0:34

Can you calculate a Vision Transformer (ViT) by hand? ✍️ If you can, come join me next week at the LLM Paper Club. I will extend ViT to Llama 1 -> 2 -> 3 -> 4 live. Event link below.

Tom Yeh

77,689 görüntüleme • 1 yıl önce

Can we give this father a prize? He blocks a transformer from using the woman’s room! I wanna give a personal thanks to any man who stand in the way!!!
0:41

Can we give this father a prize? He blocks a transformer from using the woman’s room! I wanna give a personal thanks to any man who stand in the way!!!

Clerpatriot

76,479 görüntüleme • 3 ay önce

Transformer Explainer Interactive Learning of Text-Generative Models discuss: Transformers have revolutionized machine learning, yet their inner workings remain opaque to many. We present Transformer Explainer, an interactive visualization tool designed for non-experts to learn about Transformers through the GPT-2 model. Our tool helps users understand complex Transformer concepts by integrating a model overview and enabling smooth transitions across abstraction levels of mathematical operations and model structures. It runs a live GPT-2 instance locally in the user's browser, empowering users to experiment with their own input and observe in real-time how the internal components and parameters of the Transformer work together to predict the next tokens. Our tool requires no installation or special hardware, broadening the public's education access to modern generative AI techniques.
1:27

Transformer Explainer Interactive Learning of Text-Generative Models discuss: Transformers have revolutionized machine learning, yet their inner workings remain opaque to many. We present Transformer Explainer, an interactive visualization tool designed for non-experts to learn about Transformers through the GPT-2 model. Our tool helps users understand complex Transformer concepts by integrating a model overview and enabling smooth transitions across abstraction levels of mathematical operations and model structures. It runs a live GPT-2 instance locally in the user's browser, empowering users to experiment with their own input and observe in real-time how the internal components and parameters of the Transformer work together to predict the next tokens. Our tool requires no installation or special hardware, broadening the public's education access to modern generative AI techniques.

AK

90,723 görüntüleme • 1 yıl önce