Video wird geladen...

Video konnte nicht geladen werden

Beim Laden dieses Videos ist ein Problem aufgetreten. Dies könnte an einem vorübergehenden Netzwerkproblem liegen oder das Video ist möglicherweise nicht verfügbar.

[Transformer] by Hand✍️📺 5-minute Video Tutorial Anna Rahn made this short video to explain the Transformer exercise for my Computer Vision course last spring. In 5 minutes, she demonstrates the key calculations of the Transformer by hand with pen and paper! Anna is a fantastic student. I am lucky... show more

Tom Yeh

55,873 subscribers

133,460 Aufrufe • vor 2 Jahren •via X (Twitter)

Gesundheit & Wellness Bildung Wissenschaft & Technologie

Anya Rossi• Live Now

Private livecam show

10 Kommentare

Profilbild von Rob Freeman

Rob Freemanvor 2 Jahren

Nice illustration of the two dimensions. Though obscuring prediction as unsupervised learning parameter. Ironically I often cite the impossibility of ordering people simultaneously by height and weight to argue why transformers fail to capture all the information in a data set.

Profilbild von Tom Yeh

Tom Yehvor 2 Jahren

One way is to use multi head. But it still has limits.

Profilbild von Tameva baman

Tameva bamanvor 2 Jahren

Very nice it helped me understand the transformer. Can I seek your permission to translate it in hindi and publish it please?

Profilbild von Tom Yeh

Tom Yehvor 2 Jahren

Yes. You have my full support.

Profilbild von daved

davedvor 2 Jahren

This seems like a wonderful explanation of what. It feels like there's a lack of an explanation of why.

Profilbild von memerinski

memerinskivor 2 Jahren

This app has destroyed my attention span

Profilbild von Sachin Kumar

Sachin Kumarvor 2 Jahren

Fantastic Explanation @ProfTomYeh Sir👍

Profilbild von iskender

iskendervor 2 Jahren

Hello, it is a very nice training video. Would you mind if I translated the video into Turkish and published it on YouTube?

Profilbild von Tom Yeh

Tom Yehvor 2 Jahren

Great idea! I fully support your effort.

Profilbild von Maxin 🇬🇭

Maxin 🇬🇭vor 2 Jahren

🔥🔥

Ähnliche Videos

Anna Rahn's video demonstration of Multi-Layer Perceptron (MLP) by hand ✍️ Anna made this short video for my computer vision course in the spring semester. Together with the spreadsheet exercise I posted yesterday, I hope they help more people understand deep neural networks!

Anna Rahn's video demonstration of Multi-Layer Perceptron (MLP) by hand ✍️ Anna made this short video for my computer vision course in the spring semester. Together with the spreadsheet exercise I posted yesterday, I hope they help more people understand deep neural networks!

Tom Yeh

120,487 Aufrufe • vor 2 Jahren

Transformer by hand ✍️ in Excel ~ I just released my first-ever "Full-Stack" implementation of the Transformer model. 👇Download xlsx to give it a try!

Transformer by hand ✍️ in Excel ~ I just released my first-ever "Full-Stack" implementation of the Transformer model. 👇Download xlsx to give it a try!

Tom Yeh

2,998,168 Aufrufe • vor 1 Jahr

llm.c by Hand✍️ C programming + matrix multiplication by hand This combination is perhaps as low as we can get to explain how the Transformer works. Special thanks to Andrej Karpathy for encouraging early feedback and tetsuo //: 👾 for helping me understand the pragma magic. I hope this exercise can help people peak further into the LLM black box.

llm.c by Hand✍️ C programming + matrix multiplication by hand This combination is perhaps as low as we can get to explain how the Transformer works. Special thanks to Andrej Karpathy for encouraging early feedback and tetsuo //: 👾 for helping me understand the pragma magic. I hope this exercise can help people peak further into the LLM black box.

Tom Yeh

311,499 Aufrufe • vor 2 Jahren

Can you calculate a Vision Transformer (ViT) by hand? ✍️ If you can, come join me next week at the LLM Paper Club. I will extend ViT to Llama 1 -> 2 -> 3 -> 4 live. Event link below.

Can you calculate a Vision Transformer (ViT) by hand? ✍️ If you can, come join me next week at the LLM Paper Club. I will extend ViT to Llama 1 -> 2 -> 3 -> 4 live. Event link below.

Tom Yeh

79,441 Aufrufe • vor 1 Jahr

Mamba by hand ✍️ ~ I made this exercise as I studied the math in the Mamba paper. It is a small yet complete Mamba implementation. Thanks Albert Gu for answering my questions and checking. 👇Join the 'AI Math' community. Download xlsx.

Mamba by hand ✍️ ~ I made this exercise as I studied the math in the Mamba paper. It is a small yet complete Mamba implementation. Thanks Albert Gu for answering my questions and checking. 👇Join the 'AI Math' community. Download xlsx.

Tom Yeh

55,460 Aufrufe • vor 1 Jahr

Two years ago Anna made our first-ever AI by Hand ✍️ video, calculating one neuron. Next Wednesday (11/5) Anna will lead our 20th AI by Hand workshop! RSVP: To celebrate this milestone, we are following up with two international workshops: 21st Workshop in Arabic (11/12) 22nd Workshop in BR Portuguese (11/19) We are planning more global learning opportunities like these. Join the 20th AI by Hand workshop 🔗

Two years ago Anna made our first-ever AI by Hand ✍️ video, calculating one neuron. Next Wednesday (11/5) Anna will lead our 20th AI by Hand workshop! RSVP: To celebrate this milestone, we are following up with two international workshops: 21st Workshop in Arabic (11/12) 22nd Workshop in BR Portuguese (11/19) We are planning more global learning opportunities like these. Join the 20th AI by Hand workshop 🔗

Tom Yeh

11,685 Aufrufe • vor 10 Monaten

Evolution of Deep Learning by Hand ✍️ As my tribute to Geoff Hinton's Nobel Prize, I drew this animation to illustrate the key idea behind Hinton's major contributions to deep learning over the years, with artistic liberty. ---- 100% original, made by hand ✍️ Join 40k readers of my newsletter:

Evolution of Deep Learning by Hand ✍️ As my tribute to Geoff Hinton's Nobel Prize, I drew this animation to illustrate the key idea behind Hinton's major contributions to deep learning over the years, with artistic liberty. ---- 100% original, made by hand ✍️ Join 40k readers of my newsletter:

Tom Yeh

110,830 Aufrufe • vor 10 Monaten

1/4 LLMs solve research grade math problems but struggle with basic calculations. We bridge this gap by turning them to computers. We built a computer INSIDE a transformer that can run programs for millions of steps in seconds solving even the hardest Sudokus with 100% accuracy

1/4 LLMs solve research grade math problems but struggle with basic calculations. We bridge this gap by turning them to computers. We built a computer INSIDE a transformer that can run programs for millions of steps in seconds solving even the hardest Sudokus with 100% accuracy

Christos Tzamos

1,825,175 Aufrufe • vor 5 Monaten

GUYS!! NIGERIA, AEDC, AND TINUBU HAPPENED TO MY SMALL COMMUNITY IN LUGBE YESTERDAY!!!😥 For almost 3 years since I built my small hut in this community, we have been battling with epileptic power situation due to the overloaded Transformer which has been serving 3 communities including mine. In December 2025, after myself and a few community members spearheaded a regime change and ensured a proper election was conducted. After the election, we told the newly elected chairman (who happens to be my very very good friend) that the priority is for us to get our own dedicated Transformer for the community. Initially, we were thinking of buying. But considering it will cost over N20million to buy a 500KVA Transformer and another N15million plus for accessories and installation, the mission looked impossible. Then I and others told the Chairman that we can actually give it a try an reach out to the aedcelectricity for a Transformer given that the NERC Nigeria has told Nigerians that it is the responsibility of the DISCOs to provide Transformer and any power related infrastructure to any community or area in need of such infrastructure. Considering the Nigerian factor, many, infact, almost the entire community said it was never going to be possible for AEDC to give us a Transformer free of charge. But as someone who has been an advocate of government and who has always benefited from government by following due process, I encouraged my community and the Chairman that this is actually worth a try. In January 2026, we drafted a Transformer request letter and submitted to the AEDC Head Office at Wuse Zone 4, and the processes began. Low and behold, in less than 4 months, the AEDC, yesterday, delivered a brand new 500KVA Transformer with complete accessories to my community FREE-OF-CHARGE!🤸‍♂️🕺 I have told my community people that we have started benefitting our own share of the N3.3trillion approved by President Bola Ahmed Tinubu to GENCOs and all of us have agreed that come 2027, it is TINUBU OR NOTHING!!!🤗💪🏾 God bless the AEDC! God bless NERC!! God bless President Tinubu!!! God bless Nigeria 🇳🇬🙏🏾

𝒀𝑨𝑺𝑺𝑬𝑹 𝑨𝑺𝑬𝑲𝑶𝑴𝑬 𝑮𝑨𝑹𝑩𝑨, PGD, MLSCM

54,130 Aufrufe • vor 4 Monaten

I am finally "putting pen to paper", so to speak, on my magnum opus Video Essay, "The Untold Midwestern Origins of Speedrunning". I have a script I like, and am working through the editing process now. Enjoy this short content which is a sort of teaser, in the meantime.

I am finally "putting pen to paper", so to speak, on my magnum opus Video Essay, "The Untold Midwestern Origins of Speedrunning". I have a script I like, and am working through the editing process now. Enjoy this short content which is a sort of teaser, in the meantime.

Goose

13,449 Aufrufe • vor 6 Monaten

“My marriage to PM Nikol Pashinyan has ended. I am leaving the government residence,” Anna Hakobyan said in a video statement. In response, Nikol Pashinyan wrote: “I treat Anna’s decision with respect. Over the past 30 years, on all my most difficult days, she has been by my side, my support and my pillar. I am not sure whether I have been the same for her. Perhaps I have caused her more bitterness, for which I apologize.”

“My marriage to PM Nikol Pashinyan has ended. I am leaving the government residence,” Anna Hakobyan said in a video statement. In response, Nikol Pashinyan wrote: “I treat Anna’s decision with respect. Over the past 30 years, on all my most difficult days, she has been by my side, my support and my pillar. I am not sure whether I have been the same for her. Perhaps I have caused her more bitterness, for which I apologize.”

Alphanews Armenian Network

39,727 Aufrufe • vor 6 Monaten

Announcing How Transformer LLMs Work, created with Jay Alammar and Maarten Grootendorst, co-authors of the beautifully illustrated book, “Hands-On Large Language Models.” This course offers a deep dive into the inner workings of the transformer architecture that powers large language models (LLMs). The transformer architecture revolutionized generative AI; in fact, the "GPT" in ChatGPT stands for "Generative Pre-Trained Transformer." Originally introduced in the Google Brain team's groundbreaking 2017 paper "Attention Is All You Need," by Vaswani and others, transformers were a highly scalable model for machine translation tasks. Variants of this architecture now power today’s LLMs such as those from OpenAI, Google, Meta, Cohere, Anthropic and DeepSeek. In this course, you’ll learn in detail how LLMs process text. You'll also work through code examples that illustrate that transformer's individual components. In details, you’ll learn: - How the representation of language has evolved, from Bag-of-Words to Word2Vec embeddings to the transformer architecture that captures a word's meanings taking into account the context of other words in the input. - How inputs are broken down into tokens before they are sent to the language model. - The details of a transformer's main stages: Tokenization and embedding, the stack of transformer blocks, and the language model head. - The inner workings of the transformer block, including attention, which calculates relevance scores, and the feedforward layer, which incorporates stored information learned in training. - How cached calculations make transformers faster. - Some of the most recent ideas in the latest models such as Mixture-of-Experts (MoE) which uses multiple sub-models and a router on each layer to improve the quality of LLMs. By the end of this course, you’ll have a deep understanding of how LLMs actually process text and be able to read through papers describing the latest models and understand the details. Gaining this intuition will improve your approach to building LLM applications. Please sign up here:

Announcing How Transformer LLMs Work, created with Jay Alammar and Maarten Grootendorst, co-authors of the beautifully illustrated book, “Hands-On Large Language Models.” This course offers a deep dive into the inner workings of the transformer architecture that powers large language models (LLMs). The transformer architecture revolutionized generative AI; in fact, the "GPT" in ChatGPT stands for "Generative Pre-Trained Transformer." Originally introduced in the Google Brain team's groundbreaking 2017 paper "Attention Is All You Need," by Vaswani and others, transformers were a highly scalable model for machine translation tasks. Variants of this architecture now power today’s LLMs such as those from OpenAI, Google, Meta, Cohere, Anthropic and DeepSeek. In this course, you’ll learn in detail how LLMs process text. You'll also work through code examples that illustrate that transformer's individual components. In details, you’ll learn: - How the representation of language has evolved, from Bag-of-Words to Word2Vec embeddings to the transformer architecture that captures a word's meanings taking into account the context of other words in the input. - How inputs are broken down into tokens before they are sent to the language model. - The details of a transformer's main stages: Tokenization and embedding, the stack of transformer blocks, and the language model head. - The inner workings of the transformer block, including attention, which calculates relevance scores, and the feedforward layer, which incorporates stored information learned in training. - How cached calculations make transformers faster. - Some of the most recent ideas in the latest models such as Mixture-of-Experts (MoE) which uses multiple sub-models and a router on each layer to improve the quality of LLMs. By the end of this course, you’ll have a deep understanding of how LLMs actually process text and be able to read through papers describing the latest models and understand the details. Gaining this intuition will improve your approach to building LLM applications. Please sign up here:

Andrew Ng

259,920 Aufrufe • vor 1 Jahr

Advanced RAG techniques by Hand ✍️ ~ Watch my lecture: Last year, I delivered a keynote lecture titled “Beginner’s Guide to RAG” sponsored by Sarah Torres. But don’t be fooled by the name. I walked through several advanced techniques the AI by Hand ✍️ way, breaking them down conceptually the the AI by Hand way. Today, many of those techniques are already powering real production systems. Had I filled my lecture with API calls and library-specific syntax, the content would have already become obsolete months ago. Fortunately, I focused on the fundamentals and concepts. My lecture is still as fresh and relevant as ever. Watch: ---- 100% original, made by hand ✍️ Join 40k readers of my newsletter:

Advanced RAG techniques by Hand ✍️ ~ Watch my lecture: Last year, I delivered a keynote lecture titled “Beginner’s Guide to RAG” sponsored by Sarah Torres. But don’t be fooled by the name. I walked through several advanced techniques the AI by Hand ✍️ way, breaking them down conceptually the the AI by Hand way. Today, many of those techniques are already powering real production systems. Had I filled my lecture with API calls and library-specific syntax, the content would have already become obsolete months ago. Fortunately, I focused on the fundamentals and concepts. My lecture is still as fresh and relevant as ever. Watch: ---- 100% original, made by hand ✍️ Join 40k readers of my newsletter:

Tom Yeh

20,685 Aufrufe • vor 10 Monaten

After decades of being a film maker and nearly 5 years of working with AI and Video I have finally decided it's time to drop a video tutorial course on my workflow and technique for you all. Details in the clip yo

After decades of being a film maker and nearly 5 years of working with AI and Video I have finally decided it's time to drop a video tutorial course on my workflow and technique for you all. Details in the clip yo

Trisha Code

41,005 Aufrufe • vor 9 Monaten

This is a video sharing my thoughts on #bitcoin, and the levels I am interested in trading long and short. (My computer crashed at the 10 minute mark for about 30 seconds, so the video freezes, but works after that). $BTC

This is a video sharing my thoughts on #bitcoin, and the levels I am interested in trading long and short. (My computer crashed at the 10 minute mark for about 30 seconds, so the video freezes, but works after that). $BTC

Lucky Chart Ape

36,130 Aufrufe • vor 5 Monaten

In this short video, I explain the concept of RAG (Retrieval-Augmented Generation) in a simple and easy-to-understand way. I hope it helps! Let me know your thoughts. The material is based on Prof. Tom Yeh's 'AI by Hand' resources.

In this short video, I explain the concept of RAG (Retrieval-Augmented Generation) in a simple and easy-to-understand way. I hope it helps! Let me know your thoughts. The material is based on Prof. Tom Yeh's 'AI by Hand' resources.

Cornelius Adejoro

28,210 Aufrufe • vor 1 Jahr

This is my entry for the Anomaly art contest. 🎨 She’s not just another NFT character she’s an Anomaly. I used the base reference and redrew her by hand in my own style. I wanted to give her motion, personality, and energy so she feels alive not just standing still, but in action. This piece shows what Anomaly is about: artist-led creation and phygital wearable art made to go beyond the screen. The reference vs My hand sketch ✍️

This is my entry for the Anomaly art contest. 🎨 She’s not just another NFT character she’s an Anomaly. I used the base reference and redrew her by hand in my own style. I wanted to give her motion, personality, and energy so she feels alive not just standing still, but in action. This piece shows what Anomaly is about: artist-led creation and phygital wearable art made to go beyond the screen. The reference vs My hand sketch ✍️

Miss.ayo.artss

23,136 Aufrufe • vor 4 Monaten

I used her short tutorial for my last voiceover video. Honestly, this is the best time to be alive for anyone curious and willing to learn. Too much free knowledge everywhere. If you love her tutorial, reward her with a follow.🙏

I used her short tutorial for my last voiceover video. Honestly, this is the best time to be alive for anyone curious and willing to learn. Too much free knowledge everywhere. If you love her tutorial, reward her with a follow.🙏

Toyyib Adewale Adelodun

38,685 Aufrufe • vor 1 Jahr

In this video, one of our keepers is shrouded in a costume and can be seen hand-feeding our king vulture chick using a custom made hand puppet created by artists in the Bronx Zoo’s Exhibition and Graphic Arts Department. (1/5)

In this video, one of our keepers is shrouded in a costume and can be seen hand-feeding our king vulture chick using a custom made hand puppet created by artists in the Bronx Zoo’s Exhibition and Graphic Arts Department. (1/5)

Bronx Zoo

99,479 Aufrufe • vor 1 Jahr