Autoencoder by hand✍️Excel~ I designed this exercise to show... how an Encoder-Decoder network convert input to code and reconstruct input from code. It is annotated with equations, PyTorch, and graphs. 👇Join the 'AI Math' community. Download xlsx.show more

Transformer by hand✍️ Excel ~ I designed this exercise... to show the core math of a Transformer model is to combine columns (attention), combine rows (feed forward), and repeat.👇Join the 'AI Math' community. 👇Download xlsx.show more

ResNet by hand✍️Excel~ I designed this exercise to compare... a ResNet to an MLP and show skip-connections are simply identity matrices next to weights and biases. I also made a medium version to show how it scales. 👇Join the 'AI Math' community. Download xlsx.show more

AlphaFold by hand✍️ Excel ~ I designed this exercise... to show (1) MSA multi-head attention, (2) Pair triangular update, two key components of the EvoFormer architecture.👇Join the AI Math community. Download xlsx.show more

Backpropagation by hand✍️ ~ spreadsheet. I designed this exercise... to show it is possible to calculate backpropagation for a non-trivial, three-layer network by hand. p.s. I just started this community to share useful resources on AI math. 👇 Join the community.show more

Transformer: Multi-Head Attention ~ Math vs Code 🔢💻 ~... I made this visualization to show you how to implement the multi-head attention math in PyTorch within 50 LoC. Multi-Head Attention is what makes the Transformer's performance outstanding. It captures and represents more diverse linguistic relationships and patterns, and attends to different learned input embedding spaces. The parallel computing design also makes the model more efficient.show more

understand AI like this: if your input is dumb,... your output will be dumb, and if your input is creative, your output will be creative. this is it. so, you need to provide about 70% of the context from your own brain to the ai to get the best outputs.show more

Introducing Visual Copilot ✨🧵👇 Convert designs into clean, responsive... code with AI: ➡️ Run the Builder Figma plugin ➡️ Convert code to your framework ➡️ Chat to refine the code ➡️ Sync the code to your site or app Learn more:show more

Here's what happen when you try to input any... cheat code from the first Tomb Raider into the second one This was used to troll gamers who wanted the infamous nude codeshow more

The new controller input UI in VTube Studio was... designed by Girutea ✨ Look at how cute it is!!!!!!show more

By now, you've probably heard about Gemini Omni, our... new model designed to create anything from any input, starting with video. But... what's the big deal? Let’s break it down 🧵👇show more

At MIT, I learned about RNNs in my NLP... class with Prof. Michael Collins. He built a model from my keystrokes to predict who I was. To me, it felt like a magic box. Years later, when I had to teach RNNs, I forced myself to go inside the box. ⬇️ Download: First, with a tiny example on paper by hand ✍️. Then, a slightly larger one in Excel. That’s when it finally clicked: 👉 The weights are reused (weight matrices on the left side) 👉 The hidden states are passed down (H's) When I built it by hand and saw everything visually, it clicked, just math you can actually trace. Now I try to give others the same “aha!” moment I had. ⬇️ Download Excel:show more

🧵 Go from nature to code with Gemini 2.5... Pro 🍃 Each of these were created with the same prompt: Transform this image into a code-based representation of its natural behavior. Original input image on the left. Gemini output on the right.show more

FC is designed to reflect the network’s long-term development.... Its value is shaped by how many people actually use the network and how much they rely on it. In other words, the growth of the community goes hand in hand with the value of FC. → As the community grows, activity increases. As activity increases, FC becomes more significant.show more

when our precious things are born from code, they... may take our inputshow more

When Ghostty detects a password input prompt, it now... changes the cursor to a lock and on macOS enables the secure input API. When the secure input API is enabled, we show a neat, animated icon that explains what's going on when clicked. Another example of native UI wins (imo). Secure Input is the macOS system API that prevents accessibility APIs from reading your keystrokes, so things like screen recording software and so on can't read your passwords. Other terminals on macOS support secure input. I think only iTerm also supports secure input on password detection. So as a disclaimer, I'm not trying to claim this as a huge innovation, I just think our implementation is nice. 😊show more

I'M RUNNING A NICE SALE FOR MY COMMISSIONS THIS... CHRISTMAS! Input my code "DOPPCHRISTMAS" to get 15% off and get a free chibi as well!show more

This animation is what kickstarted Code Blue's development, and... I wanted to use a version of this as an intro to Code Blue, but I ultimately decided against it as Code Blue was already late, and requiring a partial re-render, and I didn't think this scene would hit quite the sameshow more

✍️ I wrote an article on programming blur shaders... for beginners. You do not need to be adept at either math or programming to understand how it works :) Going from the most basic/straightforward type of blur, to what you see below, and more! Lots of pretty pictures, media, and interactive code to learn from. -- Box blur, with clipping and radial weighting. (So, no longer really a box blur...?) 🔍 #gamedev #indiedev #unity3dshow more

Here’s half a dozen telesnaps fed to a AI... with no other input. Yes, it’s obviously an uncanny mess, and I know AI stuff is a controversial topic, but this route for recons definitely has future potential as image-to-video continues to improve.show more