Autoencoder by hand✍️Excel~ I designed this exercise to show... how an Encoder-Decoder network convert input to code and reconstruct input from code. It is annotated with equations, PyTorch, and graphs. I also made a medium version.👇Join the 'AI Math' community. Download xlsx.show more

ResNet by hand✍️Excel~ I designed this exercise to compare... a ResNet to an MLP and show skip-connections are simply identity matrices next to weights and biases. I also made a medium version to show how it scales. 👇Join the 'AI Math' community. Download xlsx.show more

Transformer by hand✍️ Excel ~ I designed this exercise... to show the core math of a Transformer model is to combine columns (attention), combine rows (feed forward), and repeat.👇Join the 'AI Math' community. 👇Download xlsx.show more

AlphaFold by hand✍️ Excel ~ I designed this exercise... to show (1) MSA multi-head attention, (2) Pair triangular update, two key components of the EvoFormer architecture.👇Join the AI Math community. Download xlsx.show more

Backpropagation by hand✍️ ~ spreadsheet. I designed this exercise... to show it is possible to calculate backpropagation for a non-trivial, three-layer network by hand. p.s. I just started this community to share useful resources on AI math. 👇 Join the community.show more

Transformer: Multi-Head Attention ~ Math vs Code 🔢💻 ~... I made this visualization to show you how to implement the multi-head attention math in PyTorch within 50 LoC. Multi-Head Attention is what makes the Transformer's performance outstanding. It captures and represents more diverse linguistic relationships and patterns, and attends to different learned input embedding spaces. The parallel computing design also makes the model more efficient.show more

This animation is what kickstarted Code Blue's development, and... I wanted to use a version of this as an intro to Code Blue, but I ultimately decided against it as Code Blue was already late, and requiring a partial re-render, and I didn't think this scene would hit quite the sameshow more

At MIT, I learned about RNNs in my NLP... class with Prof. Michael Collins. He built a model from my keystrokes to predict who I was. To me, it felt like a magic box. Years later, when I had to teach RNNs, I forced myself to go inside the box. ⬇️ Download: First, with a tiny example on paper by hand ✍️. Then, a slightly larger one in Excel. That’s when it finally clicked: 👉 The weights are reused (weight matrices on the left side) 👉 The hidden states are passed down (H's) When I built it by hand and saw everything visually, it clicked, just math you can actually trace. Now I try to give others the same “aha!” moment I had. ⬇️ Download Excel:show more

When Ghostty detects a password input prompt, it now... changes the cursor to a lock and on macOS enables the secure input API. When the secure input API is enabled, we show a neat, animated icon that explains what's going on when clicked. Another example of native UI wins (imo). Secure Input is the macOS system API that prevents accessibility APIs from reading your keystrokes, so things like screen recording software and so on can't read your passwords. Other terminals on macOS support secure input. I think only iTerm also supports secure input on password detection. So as a disclaimer, I'm not trying to claim this as a huge innovation, I just think our implementation is nice. 😊show more

I FOUND AN INPUT FOR RAGING DEMON (I cant... believe I'm actually labbing in MH...) When there's a wound > ⏹️+⏹️ +🔼 +⏺️ Here's also my camera focusing on the controller to show how it works THIS IS CRAZY, ARE WE PLAYING SF6?!show more

understand AI like this: if your input is dumb,... your output will be dumb, and if your input is creative, your output will be creative. this is it. so, you need to provide about 70% of the context from your own brain to the ai to get the best outputs.show more

They said they made input buffer when start round... but is it my input problem? I used db1+2 with Bryanshow more

Introducing Visual Copilot ✨🧵👇 Convert designs into clean, responsive... code with AI: ➡️ Run the Builder Figma plugin ➡️ Convert code to your framework ➡️ Chat to refine the code ➡️ Sync the code to your site or app Learn more:show more

Here's what happen when you try to input any... cheat code from the first Tomb Raider into the second one This was used to troll gamers who wanted the infamous nude codeshow more

I wrote down my thoughts on how AI turned... me from a designer to a builder, how I’ve kept my taste, and how the process naturally pushes me to understand code I also have this totally unrelated ascii editor at the top if you like having something to fidget with while readingshow more

Everyone is going nuts for this cursor following eyeball... effect. I break it all down: how it's made, the code behind it and how we made it 3D with depth mapsshow more

We (Claude and I) made a new package: voxmlx... It's an MLX implementation of Mistral's Voxtral mini realtime speech recognition model. It supports streaming audio and runs pretty fast on a laptop. To use it, simply: `uvx voxmlx` Also I did not write a single line of code for this package. Every line of code was written by Claude Code. More on that in thread.show more

Here’s half a dozen telesnaps fed to a AI... with no other input. Yes, it’s obviously an uncanny mess, and I know AI stuff is a controversial topic, but this route for recons definitely has future potential as image-to-video continues to improve.show more

The new controller input UI in VTube Studio was... designed by Girutea ✨ Look at how cute it is!!!!!!show more

I loved this video so much I vibe coded... a simple playable version of it in four hours. Code and link to play is below.show more