Loading video...

Video Failed to Load

Go Home

Backpropagation by hand✍️ ~ spreadsheet. I designed this exercise to show it is possible to calculate backpropagation for a non-trivial, three-layer network by hand. p.s. I just started this community to share useful resources on AI math. 👇 Join the community.

ProfTomYeh's profile picture

Tom Yeh

55,966 subscribers

121,825 views • 1 year ago •via X (Twitter)

Science & TechnologyEducation
LIVE

Anya Rossi• Live Now

Private livecam show

0 Comments

No comments available

Comments from the original post will appear here

Related Videos

LSTM by hand✍️Excel ~ I designed this exercise to show it is possible to calculate a simple LSTM by hand. Green🟩: Short Term. Blue🟦: Long Term. +equations. +medium.👇Join the 'AI Math' community. Download xlsx.
0:15

LSTM by hand✍️Excel ~ I designed this exercise to show it is possible to calculate a simple LSTM by hand. Green🟩: Short Term. Blue🟦: Long Term. +equations. +medium.👇Join the 'AI Math' community. Download xlsx.

Tom Yeh

41,607 views • 1 year ago

Transformer by hand✍️ Excel ~ I designed this exercise to show the core math of a Transformer model is to combine columns (attention), combine rows (feed forward), and repeat.👇Join the 'AI Math' community. 👇Download xlsx.
0:17

Transformer by hand✍️ Excel ~ I designed this exercise to show the core math of a Transformer model is to combine columns (attention), combine rows (feed forward), and repeat.👇Join the 'AI Math' community. 👇Download xlsx.

Tom Yeh

66,770 views • 1 year ago

Autoencoder by hand✍️Excel~ I designed this exercise to show how an Encoder-Decoder network convert input to code and reconstruct input from code. It is annotated with equations, PyTorch, and graphs. 👇Join the 'AI Math' community. Download xlsx.
0:15

Autoencoder by hand✍️Excel~ I designed this exercise to show how an Encoder-Decoder network convert input to code and reconstruct input from code. It is annotated with equations, PyTorch, and graphs. 👇Join the 'AI Math' community. Download xlsx.

Tom Yeh

101,555 views • 1 year ago

Autoencoder by hand✍️Excel~ I designed this exercise to show how an Encoder-Decoder network convert input to code and reconstruct input from code. It is annotated with equations, PyTorch, and graphs. I also made a medium version.👇Join the 'AI Math' community. Download xlsx.
0:15

Autoencoder by hand✍️Excel~ I designed this exercise to show how an Encoder-Decoder network convert input to code and reconstruct input from code. It is annotated with equations, PyTorch, and graphs. I also made a medium version.👇Join the 'AI Math' community. Download xlsx.

Tom Yeh

54,482 views • 1 year ago

ResNet by hand✍️Excel~ I designed this exercise to compare a ResNet to an MLP and show skip-connections are simply identity matrices next to weights and biases. I also made a medium version to show how it scales. 👇Join the 'AI Math' community. Download xlsx.
0:15

ResNet by hand✍️Excel~ I designed this exercise to compare a ResNet to an MLP and show skip-connections are simply identity matrices next to weights and biases. I also made a medium version to show how it scales. 👇Join the 'AI Math' community. Download xlsx.

Tom Yeh

29,925 views • 1 year ago

AlphaFold by hand✍️ Excel ~ I designed this exercise to show (1) MSA multi-head attention, (2) Pair triangular update, two key components of the EvoFormer architecture.👇Join the AI Math community. Download xlsx.
0:18

AlphaFold by hand✍️ Excel ~ I designed this exercise to show (1) MSA multi-head attention, (2) Pair triangular update, two key components of the EvoFormer architecture.👇Join the AI Math community. Download xlsx.

Tom Yeh

104,965 views • 1 year ago

FC is designed to reflect the network’s long-term development. Its value is shaped by how many people actually use the network and how much they rely on it. In other words, the growth of the community goes hand in hand with the value of FC. → As the community grows, activity increases. As activity increases, FC becomes more significant.
0:10

FC is designed to reflect the network’s long-term development. Its value is shaped by how many people actually use the network and how much they rely on it. In other words, the growth of the community goes hand in hand with the value of FC. → As the community grows, activity increases. As activity increases, FC becomes more significant.

Unich.com 🆓

81,077 views • 6 months ago

🚨 COMMUNITY WATCH GRIMSBY 🚨 Big shout out to Tony Cox for taking over 400 door stopper alarms and around 100 personal safety alarms from me to hand out to local community for free after so many people asked for them after I offered them out for free on the community watch Grimsby page on Facebook I may join him and make a little community spirit video Our community is so strong and united at the minute 💪🏻
0:19

🚨 COMMUNITY WATCH GRIMSBY 🚨 Big shout out to Tony Cox for taking over 400 door stopper alarms and around 100 personal safety alarms from me to hand out to local community for free after so many people asked for them after I offered them out for free on the community watch Grimsby page on Facebook I may join him and make a little community spirit video Our community is so strong and united at the minute 💪🏻

Active Patriot

65,033 views • 1 year ago

[New] - AI-Powered Search for Business Central Community I made a thing 😉 Free AI search designed for #MSDyn365BC community, trained on #MSLearn and blogs (15K+ pages), powered by OpenAI Try it, send feedback. Blog coming...
0:14

[New] - AI-Powered Search for Business Central Community I made a thing 😉 Free AI search designed for #MSDyn365BC community, trained on #MSLearn and blogs (15K+ pages), powered by OpenAI Try it, send feedback. Blog coming...

Dmitry Katson

14,821 views • 3 years ago

Retrieval Weighting RAG by hand ✍️ + Langflow . I am designing a series of exercises to teach advanced RAG techniques. This is No. 5. Previous exercises are in the comment.
0:14

Retrieval Weighting RAG by hand ✍️ + Langflow . I am designing a series of exercises to teach advanced RAG techniques. This is No. 5. Previous exercises are in the comment.

Tom Yeh

48,408 views • 1 year ago

🟢 This Week’s Featured Community Content 🟢 Built by Community. Driven by creativity. Powered by APEPE. Huge shoutout to our community member for creating this 🔥 Community-made content continues to shape the culture, identity, and energy of APEPE. Show some love 👉 Nefiten #APEPE #BuiltByCommunity #MemeCommunity #Polygon
0:18

🟢 This Week’s Featured Community Content 🟢 Built by Community. Driven by creativity. Powered by APEPE. Huge shoutout to our community member for creating this 🔥 Community-made content continues to shape the culture, identity, and energy of APEPE. Show some love 👉 Nefiten #APEPE #BuiltByCommunity #MemeCommunity #Polygon

APEPE

48,042 views • 1 month ago

The Diamond Nuts Community is going global I told you guys I am on a mission to change as many lived as possible. I have a vision to help everyone on this Planet!! King of Crypto is reaching every corner of this Earth and finding people in need to help. This is just the beginning
0:14

The Diamond Nuts Community is going global I told you guys I am on a mission to change as many lived as possible. I have a vision to help everyone on this Planet!! King of Crypto is reaching every corner of this Earth and finding people in need to help. This is just the beginning

Diamond Nuts

314,018 views • 1 year ago

From 30 years ago, a spacecraft I designed and rendered using POVRay for an animation I created portraying the diversion of a comet using a nuclear weapon. This wasn't designed in a modeling program, it was hand drafted and the geometry transcribed into POV Scene description language by hand.
0:16

From 30 years ago, a spacecraft I designed and rendered using POVRay for an animation I created portraying the diversion of a comet using a nuclear weapon. This wasn't designed in a modeling program, it was hand drafted and the geometry transcribed into POV Scene description language by hand.

Scott Manley

36,089 views • 4 months ago

super excited to share i’m joining @cloudflare! inspired by the incredible work, pace, and mission to build a better internet. grateful for everyone who made this possible and i can’t wait to get started 🧡
0:15

super excited to share i’m joining @cloudflare! inspired by the incredible work, pace, and mission to build a better internet. grateful for everyone who made this possible and i can’t wait to get started 🧡

Matt Simpson

79,221 views • 6 months ago

IS YOUR COMMUNITY COMPLETELY BEING SLEPT ON? NOT GETTING THE SUPPORT IT NEEDS? PULL UP ON THIS POST TO GET THE EXPOSURE IT DESERVES. WHO KNOWS I MAY JUST JOIN YOU 🫵🏽
0:16

IS YOUR COMMUNITY COMPLETELY BEING SLEPT ON? NOT GETTING THE SUPPORT IT NEEDS? PULL UP ON THIS POST TO GET THE EXPOSURE IT DESERVES. WHO KNOWS I MAY JUST JOIN YOU 🫵🏽

///Steki🧲

16,884 views • 2 years ago

At MIT, I learned about RNNs in my NLP class with Prof. Michael Collins. He built a model from my keystrokes to predict who I was. To me, it felt like a magic box. Years later, when I had to teach RNNs, I forced myself to go inside the box. ⬇️ Download: First, with a tiny example on paper by hand ✍️. Then, a slightly larger one in Excel. That’s when it finally clicked: 👉 The weights are reused (weight matrices on the left side) 👉 The hidden states are passed down (H's) When I built it by hand and saw everything visually, it clicked, just math you can actually trace. Now I try to give others the same “aha!” moment I had. ⬇️ Download Excel:
0:19

At MIT, I learned about RNNs in my NLP class with Prof. Michael Collins. He built a model from my keystrokes to predict who I was. To me, it felt like a magic box. Years later, when I had to teach RNNs, I forced myself to go inside the box. ⬇️ Download: First, with a tiny example on paper by hand ✍️. Then, a slightly larger one in Excel. That’s when it finally clicked: 👉 The weights are reused (weight matrices on the left side) 👉 The hidden states are passed down (H's) When I built it by hand and saw everything visually, it clicked, just math you can actually trace. Now I try to give others the same “aha!” moment I had. ⬇️ Download Excel:

Tom Yeh

220,671 views • 8 months ago

I’ve implemented SVMs three times in my life — first in MATLAB as a grad student, again in C++ during my postdoc, and finally by hand ✍️ as a professor who needed to truly understand it well enough to teach it. If you’re curious, here’s my full 19-step walkthrough: ---- 100% original, made by hand ✍️ Join 52K+ readers of my newsletter:
0:14

I’ve implemented SVMs three times in my life — first in MATLAB as a grad student, again in C++ during my postdoc, and finally by hand ✍️ as a professor who needed to truly understand it well enough to teach it. If you’re curious, here’s my full 19-step walkthrough: ---- 100% original, made by hand ✍️ Join 52K+ readers of my newsletter:

Tom Yeh

103,824 views • 6 months ago

We all smoke our way, for now I have mastered the art of the glass tip cone style. It’s not a specialty roll by any means, but it’s consistent for me. I don’t have the fine hand coordination nor the patience to fuck up a hand roll when I can do this pretty easily and it smokes as proper as a good hand roll. When I have more time away from serving, I’ll practice hand rolling but this is how I smoke.
0:18

We all smoke our way, for now I have mastered the art of the glass tip cone style. It’s not a specialty roll by any means, but it’s consistent for me. I don’t have the fine hand coordination nor the patience to fuck up a hand roll when I can do this pretty easily and it smokes as proper as a good hand roll. When I have more time away from serving, I’ll practice hand rolling but this is how I smoke.

Don

22,510 views • 3 months ago

ARB8i 💛 Lab - is LIVE 🚀 This started as a speed tool for my @Doodles edits, I turned it into an editor anyone can use in seconds! Live with my packs + 2 overlays by artdood. Now opening to community artists - more to come! 👀 Link in the first reply 👇
0:15

ARB8i 💛 Lab - is LIVE 🚀 This started as a speed tool for my @Doodles edits, I turned it into an editor anyone can use in seconds! Live with my packs + 2 overlays by artdood. Now opening to community artists - more to come! 👀 Link in the first reply 👇

ARB8i 💛 ‎

40,071 views • 9 months ago

Bluwhale Milestone Alert! 🌊 We’re thrilled to share some incredible stats that show just how far our AI network has come: ✨ 100,000 minutes/day of user spending time in our platform ✨ 60-70% users returned every 3-6 weeks ✨ 20M+ transactions/month powering our intelligence layer This is more than just numbers, it’s a testament to the trust and commitment our community brings every day. Thank you for making Bluwhale the vibrant, fastest-growing intelligence layer out there! Here’s to scaling decentralized AI to new heights, together. Let’s go 🐳s
0:15

Bluwhale Milestone Alert! 🌊 We’re thrilled to share some incredible stats that show just how far our AI network has come: ✨ 100,000 minutes/day of user spending time in our platform ✨ 60-70% users returned every 3-6 weeks ✨ 20M+ transactions/month powering our intelligence layer This is more than just numbers, it’s a testament to the trust and commitment our community brings every day. Thank you for making Bluwhale the vibrant, fastest-growing intelligence layer out there! Here’s to scaling decentralized AI to new heights, together. Let’s go 🐳s

Bluwhale

17,242 views • 1 year ago