Loading video...

Video Failed to Load

There was a problem loading this video. This could be due to a temporary network issue or the video might be unavailable.

Transformer by hand ✍️ in Excel ~ I just released my first-ever "Full-Stack" implementation of the Transformer model. 👇Download xlsx to give it a try!

Tom Yeh

55,972 subscribers

2,997,355 views • 1 year ago •via X (Twitter)

Science & Technology Education Arts

Anya Rossi• Live Now

Private livecam show

8 Comments

Covertbox1 year ago

@ProfTomYeh please can you recommend any beginners book for LLM and Transformers in general?

mandeep1 year ago

People are crazy good at stuff

Ezekiel Macharia1 year ago

X should not be free. Thank you.

$\backslash's profile picture$

\backslash1 year ago

Thanks for sharing. This is huge!

Henning Sittler1 year ago

Yes

Geter Pabriel1 year ago

You're a rockstar

Narayana tantry1 year ago

Amazing, this helps out a lot !!

Infinite Growth1 year ago

Amazing! I also once found a 3d visualization of several LLM transformer models. I think GPT-3, GPT-4 were included there. Would be fun to find them.

Related Videos

Temperature 🌡️ by hand ✍️ ~ I designed this Excel exercise to help you study how temperature influences the sampling process of a language model. Download xlsx 👇

Temperature 🌡️ by hand ✍️ ~ I designed this Excel exercise to help you study how temperature influences the sampling process of a language model. Download xlsx 👇

Tom Yeh

18,685 views • 1 year ago

I calculated a poster-size Transformer model by hand✍️

I calculated a poster-size Transformer model by hand✍️

Tom Yeh

112,781 views • 1 year ago

Mamba by hand ✍️ ~ I made this exercise as I studied the math in the Mamba paper. It is a small yet complete Mamba implementation. Thanks Albert Gu for answering my questions and checking. 👇Join the 'AI Math' community. Download xlsx.

Mamba by hand ✍️ ~ I made this exercise as I studied the math in the Mamba paper. It is a small yet complete Mamba implementation. Thanks Albert Gu for answering my questions and checking. 👇Join the 'AI Math' community. Download xlsx.

Tom Yeh

55,438 views • 1 year ago

[Transformer] by Hand✍️📺 5-minute Video Tutorial Anna Rahn made this short video to explain the Transformer exercise for my Computer Vision course last spring. In 5 minutes, she demonstrates the key calculations of the Transformer by hand with pen and paper! Anna is a fantastic student. I am lucky to have her in my lab!

[Transformer] by Hand✍️📺 5-minute Video Tutorial Anna Rahn made this short video to explain the Transformer exercise for my Computer Vision course last spring. In 5 minutes, she demonstrates the key calculations of the Transformer by hand with pen and paper! Anna is a fantastic student. I am lucky to have her in my lab!

Tom Yeh

133,441 views • 1 year ago

I built a working transformer model in Excel using Shortcut

I built a working transformer model in Excel using Shortcut

nico

50,372 views • 9 months ago

Transformer by hand✍️

Transformer by hand✍️

Tom Yeh

29,650 views • 6 months ago

MLP by hand✍️Excel ~ I designed this exercise to show how to calculate a four-level network by hand, along with a graph and matching pytorch code. Also, I made a medium and a large version to show how it scales. 👇Join the 'AI Math' community. Download xlsx.

MLP by hand✍️Excel ~ I designed this exercise to show how to calculate a four-level network by hand, along with a graph and matching pytorch code. Also, I made a medium and a large version to show how it scales. 👇Join the 'AI Math' community. Download xlsx.

Tom Yeh

62,205 views • 1 year ago

Self-Attention by hand ✍️ Excel ~ I designed this exercise for students to practice the QKV math. I also created a medium and a large version to show how the attention matrix grows quadratically as the sequence gets longer. 👇Join the 'AI Math' community. Download xlsx.

Self-Attention by hand ✍️ Excel ~ I designed this exercise for students to practice the QKV math. I also created a medium and a large version to show how the attention matrix grows quadratically as the sequence gets longer. 👇Join the 'AI Math' community. Download xlsx.

Tom Yeh

125,595 views • 1 year ago

Multihead Attention by hand ✍️ in Excel ~ Download ⬇️

Multihead Attention by hand ✍️ in Excel ~ Download ⬇️

Tom Yeh

49,542 views • 1 year ago

Inception Labs just killed the transformer. They released Mercury 2, the world's first "diffusion" reasoning model. It's fast, and it uses a completely new model architecture... just watch this 11 min video to find out more:

Inception Labs just killed the transformer. They released Mercury 2, the world's first "diffusion" reasoning model. It's fast, and it uses a completely new model architecture... just watch this 11 min video to find out more:

David Ondrej

45,692 views • 3 months ago

Introducing Lemon Slice Live: the first real-time audio-video AI model Anyone can video chat with any character by just uploading a single photo. Every pixel on the screen is rendered at 25fps in real-time by a transformer model. Here’s how we built it + a live demo! 👇

Introducing Lemon Slice Live: the first real-time audio-video AI model Anyone can video chat with any character by just uploading a single photo. Every pixel on the screen is rendered at 25fps in real-time by a transformer model. Here’s how we built it + a live demo! 👇

LemonSlice

170,779 views • 1 year ago

Transformer Explainer Really cool interactive tool to learn about the inner workings of a Transformer model. Apparently, it runs a GPT-2 instance locally in the user's browser and allows you to experiment with your own inputs. This is a nice tool to learn more about the different components inside the Transformer and the transformations that occur. Tool:

Transformer Explainer Really cool interactive tool to learn about the inner workings of a Transformer model. Apparently, it runs a GPT-2 instance locally in the user's browser and allows you to experiment with your own inputs. This is a nice tool to learn more about the different components inside the Transformer and the transformations that occur. Tool:

elvis

121,867 views • 1 year ago

Microsoft just released Agent Mode in Excel. It created a financial model in minutes:

Microsoft just released Agent Mode in Excel. It created a financial model in minutes:

Alex Banks

43,106 views • 8 months ago

the transformer architecture in full detail

the transformer architecture in full detail

ℏεsam

113,272 views • 1 year ago

GUYS!! NIGERIA, AEDC, AND TINUBU HAPPENED TO MY SMALL COMMUNITY IN LUGBE YESTERDAY!!!😥 For almost 3 years since I built my small hut in this community, we have been battling with epileptic power situation due to the overloaded Transformer which has been serving 3 communities including mine. In December 2025, after myself and a few community members spearheaded a regime change and ensured a proper election was conducted. After the election, we told the newly elected chairman (who happens to be my very very good friend) that the priority is for us to get our own dedicated Transformer for the community. Initially, we were thinking of buying. But considering it will cost over N20million to buy a 500KVA Transformer and another N15million plus for accessories and installation, the mission looked impossible. Then I and others told the Chairman that we can actually give it a try an reach out to the aedcelectricity for a Transformer given that the NERC Nigeria has told Nigerians that it is the responsibility of the DISCOs to provide Transformer and any power related infrastructure to any community or area in need of such infrastructure. Considering the Nigerian factor, many, infact, almost the entire community said it was never going to be possible for AEDC to give us a Transformer free of charge. But as someone who has been an advocate of government and who has always benefited from government by following due process, I encouraged my community and the Chairman that this is actually worth a try. In January 2026, we drafted a Transformer request letter and submitted to the AEDC Head Office at Wuse Zone 4, and the processes began. Low and behold, in less than 4 months, the AEDC, yesterday, delivered a brand new 500KVA Transformer with complete accessories to my community FREE-OF-CHARGE!🤸‍♂️🕺 I have told my community people that we have started benefitting our own share of the N3.3trillion approved by President Bola Ahmed Tinubu to GENCOs and all of us have agreed that come 2027, it is TINUBU OR NOTHING!!!🤗💪🏾 God bless the AEDC! God bless NERC!! God bless President Tinubu!!! God bless Nigeria 🇳🇬🙏🏾

𝒀𝑨𝑺𝑺𝑬𝑹 𝑨𝑺𝑬𝑲𝑶𝑴𝑬 𝑮𝑨𝑹𝑩𝑨, PGD, MLSCM

52,764 views • 2 months ago

🇬🇭 “After fixing the transformer, you didn’t close it.” — An individual recorded the aftermath of ECG officials fixing a transformer in his community but failing to close it, warning that rainwater could enter and cause damage.

🇬🇭 “After fixing the transformer, you didn’t close it.” — An individual recorded the aftermath of ECG officials fixing a transformer in his community but failing to close it, warning that rainwater could enter and cause damage.

THE STATE NEWS

39,648 views • 1 month ago

Can you calculate a Vision Transformer (ViT) by hand? ✍️ If you can, come join me next week at the LLM Paper Club. I will extend ViT to Llama 1 -> 2 -> 3 -> 4 live. Event link below.

Can you calculate a Vision Transformer (ViT) by hand? ✍️ If you can, come join me next week at the LLM Paper Club. I will extend ViT to Llama 1 -> 2 -> 3 -> 4 live. Event link below.

Tom Yeh

77,689 views • 1 year ago

Can we give this father a prize? He blocks a transformer from using the woman’s room! I wanna give a personal thanks to any man who stand in the way!!!

Can we give this father a prize? He blocks a transformer from using the woman’s room! I wanna give a personal thanks to any man who stand in the way!!!

Clerpatriot

76,479 views • 3 months ago

Transformer Explainer Interactive Learning of Text-Generative Models discuss: Transformers have revolutionized machine learning, yet their inner workings remain opaque to many. We present Transformer Explainer, an interactive visualization tool designed for non-experts to learn about Transformers through the GPT-2 model. Our tool helps users understand complex Transformer concepts by integrating a model overview and enabling smooth transitions across abstraction levels of mathematical operations and model structures. It runs a live GPT-2 instance locally in the user's browser, empowering users to experiment with their own input and observe in real-time how the internal components and parameters of the Transformer work together to predict the next tokens. Our tool requires no installation or special hardware, broadening the public's education access to modern generative AI techniques.

Transformer Explainer Interactive Learning of Text-Generative Models discuss: Transformers have revolutionized machine learning, yet their inner workings remain opaque to many. We present Transformer Explainer, an interactive visualization tool designed for non-experts to learn about Transformers through the GPT-2 model. Our tool helps users understand complex Transformer concepts by integrating a model overview and enabling smooth transitions across abstraction levels of mathematical operations and model structures. It runs a live GPT-2 instance locally in the user's browser, empowering users to experiment with their own input and observe in real-time how the internal components and parameters of the Transformer work together to predict the next tokens. Our tool requires no installation or special hardware, broadening the public's education access to modern generative AI techniques.

AK

90,723 views • 1 year ago