Video yükleniyor...

Video Yüklenemedi

Ana Sayfaya Dön

Autoencoder by hand✍️Excel~ I designed this exercise to show how an Encoder-Decoder network convert input to code and reconstruct input from code. It is annotated with equations, PyTorch, and graphs. I also made a medium version.👇Join the 'AI Math' community. Download xlsx.

ProfTomYeh's profile picture

Tom Yeh

55,901 subscribers

54,482 görüntüleme • 1 yıl önce •via X (Twitter)

EğitimBilim & Teknoloji
LIVE

Anya Rossi• Live Now

Private livecam show

0 Yorum

Yorum bulunmuyor

Orijinal gönderinin yorumları burada görünecek

Benzer Videolar

ResNet by hand✍️Excel~ I designed this exercise to compare a ResNet to an MLP and show skip-connections are simply identity matrices next to weights and biases. I also made a medium version to show how it scales. 👇Join the 'AI Math' community. Download xlsx.
0:15

ResNet by hand✍️Excel~ I designed this exercise to compare a ResNet to an MLP and show skip-connections are simply identity matrices next to weights and biases. I also made a medium version to show how it scales. 👇Join the 'AI Math' community. Download xlsx.

Tom Yeh

29,925 görüntüleme • 1 yıl önce

Transformer by hand✍️ Excel ~ I designed this exercise to show the core math of a Transformer model is to combine columns (attention), combine rows (feed forward), and repeat.👇Join the 'AI Math' community. 👇Download xlsx.
0:17

Transformer by hand✍️ Excel ~ I designed this exercise to show the core math of a Transformer model is to combine columns (attention), combine rows (feed forward), and repeat.👇Join the 'AI Math' community. 👇Download xlsx.

Tom Yeh

66,770 görüntüleme • 1 yıl önce

AlphaFold by hand✍️ Excel ~ I designed this exercise to show (1) MSA multi-head attention, (2) Pair triangular update, two key components of the EvoFormer architecture.👇Join the AI Math community. Download xlsx.
0:18

AlphaFold by hand✍️ Excel ~ I designed this exercise to show (1) MSA multi-head attention, (2) Pair triangular update, two key components of the EvoFormer architecture.👇Join the AI Math community. Download xlsx.

Tom Yeh

104,965 görüntüleme • 1 yıl önce

Backpropagation by hand✍️ ~ spreadsheet. I designed this exercise to show it is possible to calculate backpropagation for a non-trivial, three-layer network by hand. p.s. I just started this community to share useful resources on AI math. 👇 Join the community.
0:11

Backpropagation by hand✍️ ~ spreadsheet. I designed this exercise to show it is possible to calculate backpropagation for a non-trivial, three-layer network by hand. p.s. I just started this community to share useful resources on AI math. 👇 Join the community.

Tom Yeh

121,825 görüntüleme • 1 yıl önce

Transformer: Multi-Head Attention ~ Math vs Code 🔢💻 ~ I made this visualization to show you how to implement the multi-head attention math in PyTorch within 50 LoC. Multi-Head Attention is what makes the Transformer's performance outstanding. It captures and represents more diverse linguistic relationships and patterns, and attends to different learned input embedding spaces. The parallel computing design also makes the model more efficient.
0:10

Transformer: Multi-Head Attention ~ Math vs Code 🔢💻 ~ I made this visualization to show you how to implement the multi-head attention math in PyTorch within 50 LoC. Multi-Head Attention is what makes the Transformer's performance outstanding. It captures and represents more diverse linguistic relationships and patterns, and attends to different learned input embedding spaces. The parallel computing design also makes the model more efficient.

Yan Chen

33,255 görüntüleme • 1 yıl önce

This animation is what kickstarted Code Blue's development, and I wanted to use a version of this as an intro to Code Blue, but I ultimately decided against it as Code Blue was already late, and requiring a partial re-render, and I didn't think this scene would hit quite the same
0:10

Sensitive content

This animation is what kickstarted Code Blue's development, and I wanted to use a version of this as an intro to Code Blue, but I ultimately decided against it as Code Blue was already late, and requiring a partial re-render, and I didn't think this scene would hit quite the same

Qualtro 🔞

129,861 görüntüleme • 3 yıl önce

When Ghostty detects a password input prompt, it now changes the cursor to a lock and on macOS enables the secure input API. When the secure input API is enabled, we show a neat, animated icon that explains what's going on when clicked. Another example of native UI wins (imo). Secure Input is the macOS system API that prevents accessibility APIs from reading your keystrokes, so things like screen recording software and so on can't read your passwords. Other terminals on macOS support secure input. I think only iTerm also supports secure input on password detection. So as a disclaimer, I'm not trying to claim this as a huge innovation, I just think our implementation is nice. 😊
0:13

When Ghostty detects a password input prompt, it now changes the cursor to a lock and on macOS enables the secure input API. When the secure input API is enabled, we show a neat, animated icon that explains what's going on when clicked. Another example of native UI wins (imo). Secure Input is the macOS system API that prevents accessibility APIs from reading your keystrokes, so things like screen recording software and so on can't read your passwords. Other terminals on macOS support secure input. I think only iTerm also supports secure input on password detection. So as a disclaimer, I'm not trying to claim this as a huge innovation, I just think our implementation is nice. 😊

Mitchell Hashimoto

81,633 görüntüleme • 1 yıl önce

At MIT, I learned about RNNs in my NLP class with Prof. Michael Collins. He built a model from my keystrokes to predict who I was. To me, it felt like a magic box. Years later, when I had to teach RNNs, I forced myself to go inside the box. ⬇️ Download: First, with a tiny example on paper by hand ✍️. Then, a slightly larger one in Excel. That’s when it finally clicked: 👉 The weights are reused (weight matrices on the left side) 👉 The hidden states are passed down (H's) When I built it by hand and saw everything visually, it clicked, just math you can actually trace. Now I try to give others the same “aha!” moment I had. ⬇️ Download Excel:
0:19

At MIT, I learned about RNNs in my NLP class with Prof. Michael Collins. He built a model from my keystrokes to predict who I was. To me, it felt like a magic box. Years later, when I had to teach RNNs, I forced myself to go inside the box. ⬇️ Download: First, with a tiny example on paper by hand ✍️. Then, a slightly larger one in Excel. That’s when it finally clicked: 👉 The weights are reused (weight matrices on the left side) 👉 The hidden states are passed down (H's) When I built it by hand and saw everything visually, it clicked, just math you can actually trace. Now I try to give others the same “aha!” moment I had. ⬇️ Download Excel:

Tom Yeh

220,671 görüntüleme • 8 ay önce

understand AI like this: if your input is dumb, your output will be dumb, and if your input is creative, your output will be creative. this is it. so, you need to provide about 70% of the context from your own brain to the ai to get the best outputs.
0:15

understand AI like this: if your input is dumb, your output will be dumb, and if your input is creative, your output will be creative. this is it. so, you need to provide about 70% of the context from your own brain to the ai to get the best outputs.

ViralOps

128,487 görüntüleme • 4 ay önce

I FOUND AN INPUT FOR RAGING DEMON (I cant believe I'm actually labbing in MH...) When there's a wound > ⏹️+⏹️ +🔼 +⏺️ Here's also my camera focusing on the controller to show how it works THIS IS CRAZY, ARE WE PLAYING SF6?!
0:11

I FOUND AN INPUT FOR RAGING DEMON (I cant believe I'm actually labbing in MH...) When there's a wound > ⏹️+⏹️ +🔼 +⏺️ Here's also my camera focusing on the controller to show how it works THIS IS CRAZY, ARE WE PLAYING SF6?!

Shincry

468,017 görüntüleme • 1 yıl önce

They said they made input buffer when start round but is it my input problem? I used db1+2 with Bryan
0:13

They said they made input buffer when start round but is it my input problem? I used db1+2 with Bryan

DRX LowHigh

40,393 görüntüleme • 1 yıl önce

Introducing Visual Copilot ✨🧵👇 Convert designs into clean, responsive code with AI: ➡️ Run the Builder Figma plugin ➡️ Convert code to your framework ➡️ Chat to refine the code ➡️ Sync the code to your site or app Learn more:
0:14

Introducing Visual Copilot ✨🧵👇 Convert designs into clean, responsive code with AI: ➡️ Run the Builder Figma plugin ➡️ Convert code to your framework ➡️ Chat to refine the code ➡️ Sync the code to your site or app Learn more:

Builder.io

68,712 görüntüleme • 2 yıl önce

Here's what happen when you try to input any cheat code from the first Tomb Raider into the second one This was used to troll gamers who wanted the infamous nude code
0:19

Here's what happen when you try to input any cheat code from the first Tomb Raider into the second one This was used to troll gamers who wanted the infamous nude code

𝐋𝐨𝐰 𝐏𝐨𝐥𝐲 𝐃𝐞𝐩𝐫𝐞𝐬𝐬𝐢𝐨𝐧

115,608 görüntüleme • 3 yıl önce

I wrote down my thoughts on how AI turned me from a designer to a builder, how I’ve kept my taste, and how the process naturally pushes me to understand code I also have this totally unrelated ascii editor at the top if you like having something to fidget with while reading
0:10

I wrote down my thoughts on how AI turned me from a designer to a builder, how I’ve kept my taste, and how the process naturally pushes me to understand code I also have this totally unrelated ascii editor at the top if you like having something to fidget with while reading

Fay

50,136 görüntüleme • 2 ay önce

Everyone is going nuts for this cursor following eyeball effect. I break it all down: how it's made, the code behind it and how we made it 3D with depth maps
0:14

Everyone is going nuts for this cursor following eyeball effect. I break it all down: how it's made, the code behind it and how we made it 3D with depth maps

Wes Bos

127,804 görüntüleme • 7 ay önce

We (Claude and I) made a new package: voxmlx It's an MLX implementation of Mistral's Voxtral mini realtime speech recognition model. It supports streaming audio and runs pretty fast on a laptop. To use it, simply: `uvx voxmlx` Also I did not write a single line of code for this package. Every line of code was written by Claude Code. More on that in thread.
0:16

We (Claude and I) made a new package: voxmlx It's an MLX implementation of Mistral's Voxtral mini realtime speech recognition model. It supports streaming audio and runs pretty fast on a laptop. To use it, simply: `uvx voxmlx` Also I did not write a single line of code for this package. Every line of code was written by Claude Code. More on that in thread.

Awni Hannun

32,410 görüntüleme • 4 ay önce

Here’s half a dozen telesnaps fed to a AI with no other input. Yes, it’s obviously an uncanny mess, and I know AI stuff is a controversial topic, but this route for recons definitely has future potential as image-to-video continues to improve.
0:10

Here’s half a dozen telesnaps fed to a AI with no other input. Yes, it’s obviously an uncanny mess, and I know AI stuff is a controversial topic, but this route for recons definitely has future potential as image-to-video continues to improve.

Gav Rymill 🤖

103,603 görüntüleme • 2 yıl önce

The new controller input UI in VTube Studio was designed by Girutea ✨ Look at how cute it is!!!!!!
0:11

The new controller input UI in VTube Studio was designed by Girutea ✨ Look at how cute it is!!!!!!

Denchi ⚒ Iron Vertex

42,448 görüntüleme • 2 ay önce

I loved this video so much I vibe coded a simple playable version of it in four hours. Code and link to play is below.
0:14

I loved this video so much I vibe coded a simple playable version of it in four hours. Code and link to play is below.

Chris Albon

14,416 görüntüleme • 11 ay önce