Backpropagation by hand✍️ ~ spreadsheet. I designed this exercise... to show it is possible to calculate backpropagation for a non-trivial, three-layer network by hand. p.s. I just started this community to share useful resources on AI math. 👇 Join the community.show more

LSTM by hand✍️Excel ~ I designed this exercise to... show it is possible to calculate a simple LSTM by hand. Green🟩: Short Term. Blue🟦: Long Term. +equations. +medium.👇Join the 'AI Math' community. Download xlsx.show more

Transformer by hand✍️ Excel ~ I designed this exercise... to show the core math of a Transformer model is to combine columns (attention), combine rows (feed forward), and repeat.👇Join the 'AI Math' community. 👇Download xlsx.show more

Autoencoder by hand✍️Excel~ I designed this exercise to show... how an Encoder-Decoder network convert input to code and reconstruct input from code. It is annotated with equations, PyTorch, and graphs. 👇Join the 'AI Math' community. Download xlsx.show more

Autoencoder by hand✍️Excel~ I designed this exercise to show... how an Encoder-Decoder network convert input to code and reconstruct input from code. It is annotated with equations, PyTorch, and graphs. I also made a medium version.👇Join the 'AI Math' community. Download xlsx.show more

ResNet by hand✍️Excel~ I designed this exercise to compare... a ResNet to an MLP and show skip-connections are simply identity matrices next to weights and biases. I also made a medium version to show how it scales. 👇Join the 'AI Math' community. Download xlsx.show more

AlphaFold by hand✍️ Excel ~ I designed this exercise... to show (1) MSA multi-head attention, (2) Pair triangular update, two key components of the EvoFormer architecture.👇Join the AI Math community. Download xlsx.show more

MLP in PyTorch by hand ✍️ ~ 7 steps... walkthrough below Goal: fill in every blank in the PyTorch code to build a multi-layer perceptron. 1. Given Let us start with a code template on the left and the network it is supposed to build on the right. Every blank in the code can be worked out from the picture. 2. Linear layer We count: 3 features in, 4 features out. So the weight matrix is 4 by 3. There is an extra column for the biases, which means bias = T. 3. ReLU Let us apply the activation. ReLU crosses out the negatives, so -1 becomes 0. 4. Linear layer The input size is 4, because that is what the previous layer put out. The output size is 2. A 2 by 4 weight matrix, and this time no extra column, so bias = F. 5. ReLU We cross out the negatives again. 6. Linear layer Two features in, five out. A 5 by 2 weight matrix, with a bias column, so bias = T. 7. Sigmoid Let us finish. Sigmoid squashes the raw scores (3, 0, -2, 5, -5) into probabilities between 0 and 1. You have just implemented a three-layer deep neural network by hand. ✍️ == Story == Three years ago I gave this exercise to my students, to connect the code to the math. They found it odd. Every other AI course they were taking lived inside a Jupyter notebook, and here I was handing out paper. Three years later, my colleagues are the ones rushing to move their materials to paper. The exercise has not changed. Paper still asks the one thing a notebook lets you skip: do you actually understand what the code is doing? If you can tell me why the weight matrix is 4 by 3, and why bias is F on the second layer, you understand nn.Linear better than someone who has been copy-pasting it for a year. 💾 Save this post! #AIbyHand #PyTorch #DeepLearningshow more

old - 1 (you can ignore this, i just... want to keep some memory that I took it by my hand)show more

A new network is forming. Not just for storage.... Not just for compute. Not just for AI agents. But for a world where intelligence is: distributed, owned, coordinated, and rewarded. If you believe AI should be open, peer-to-peer, and community-powered, this is your signal. Join the movement. Join the network. Build with DRIVE369.show more

[New] - AI-Powered Search for Business Central Community I... made a thing 😉 Free AI search designed for #MSDyn365BC community, trained on #MSLearn and blogs (15K+ pages), powered by OpenAI Try it, send feedback. Blog coming...show more

Retrieval Weighting RAG by hand ✍️ + Langflow .... I am designing a series of exercises to teach advanced RAG techniques. This is No. 5. Previous exercises are in the comment.show more

🟢 This Week’s Featured Community Content 🟢 Built by... Community. Driven by creativity. Powered by APEPE. Huge shoutout to our community member for creating this 🔥 Community-made content continues to shape the culture, identity, and energy of APEPE. Show some love 👉 Nefiten #APEPE #BuiltByCommunity #MemeCommunity #Polygonshow more

The Diamond Nuts Community is going global I told... you guys I am on a mission to change as many lived as possible. I have a vision to help everyone on this Planet!! King of Crypto is reaching every corner of this Earth and finding people in need to help. This is just the beginningshow more

How long will it take for this video to... get a community note that this is fake and AI and this never actually happened on the Brady Bunch?! 🤦🏻‍♀️🤣Community Notesshow more

From 30 years ago, a spacecraft I designed and... rendered using POVRay for an animation I created portraying the diversion of a comet using a nuclear weapon. This wasn't designed in a modeling program, it was hand drafted and the geometry transcribed into POV Scene description language by hand.show more

super excited to share i’m joining @cloudflare! inspired by... the incredible work, pace, and mission to build a better internet. grateful for everyone who made this possible and i can’t wait to get started 🧡show more

IS YOUR COMMUNITY COMPLETELY BEING SLEPT ON? NOT GETTING... THE SUPPORT IT NEEDS? PULL UP ON THIS POST TO GET THE EXPOSURE IT DESERVES. WHO KNOWS I MAY JUST JOIN YOU 🫵🏽show more

I designed these worksheets to turn Agentic AI concepts... into simple math problems you can do by hand. ✍️ Download PDF: Problems 1 to 5: 1. Count the tokens: split on spaces, one word per box 2. Subword splitting: when one word is three tokens 3. Punctuation counts: the marks are tokens too 4. Tokens per word: the ratio that turns words into a bill 5. Will it fit? A document against a context window Why am I making these worksheets? AI is making people (including me) think less. It's just too easy to ask AI a few questions about a new AI concept and start to believe I get it. Until recently, we could use a coding problem to practice a new AI concept. But now it has become too easy to ask AI to write the code, and we start to think we must know the concept, since we technically solved a coding problem. Thus, my approach is to recast AI concepts as simple math problems we must solve with pen and paper. Using our hands is one way to motivate ourselves to start thinking again. ✍️ ~ Prof. Tom Yehshow more

At MIT, I learned about RNNs in my NLP... class with Prof. Michael Collins. He built a model from my keystrokes to predict who I was. To me, it felt like a magic box. Years later, when I had to teach RNNs, I forced myself to go inside the box. ⬇️ Download: First, with a tiny example on paper by hand ✍️. Then, a slightly larger one in Excel. That’s when it finally clicked: 👉 The weights are reused (weight matrices on the left side) 👉 The hidden states are passed down (H's) When I built it by hand and saw everything visually, it clicked, just math you can actually trace. Now I try to give others the same “aha!” moment I had. ⬇️ Download Excel:show more