Video yükleniyor...

Video Yüklenemedi

Ana Sayfaya Dön

Transformer by hand ✍️ Given input X, this exercise goes through the key equations behind the 𝗦𝗲𝗹𝗳 𝗔𝘁𝘁𝗲𝗻𝘁𝗶𝗼𝗻 layer and the 𝗙𝗲𝗲𝗱 𝗙𝗼𝗿𝘄𝗮𝗿𝗱 layer, showing you how X is transformed into Y.

ProfTomYeh's profile picture

Tom Yeh

45,567 subscribers

15,488 görüntüleme • 1 yıl önce •via X (Twitter)

LIVE

Anya Rossi• Live Now

Private livecam show

3 Yorum

EcoAstronomer profil fotoğrafı
EcoAstronomer1 yıl önce

Shouldn't V = Wv x chi?

Tom Yeh profil fotoğrafı
Tom Yeh1 yıl önce

You are right! Thanks for spotting the error. 😅 You are really paying attention. 👍

SFTP.Callum profil fotoğrafı
SFTP.Callum1 yıl önce

Beautiful to see love laid out as a transformer

Benzer Videolar

[Transformer] by Hand✍️📺 5-minute Video Tutorial Anna Rahn made this short video to explain the Transformer exercise for my Computer Vision course last spring. In 5 minutes, she demonstrates the key calculations of the Transformer by hand with pen and paper! Anna is a fantastic student. I am lucky to have her in my lab!
4:55

[Transformer] by Hand✍️📺 5-minute Video Tutorial Anna Rahn made this short video to explain the Transformer exercise for my Computer Vision course last spring. In 5 minutes, she demonstrates the key calculations of the Transformer by hand with pen and paper! Anna is a fantastic student. I am lucky to have her in my lab!

Tom Yeh

133,460 görüntüleme • 2 yıl önce

MCP by hand ✍️ This exercise walks you through the key elements of the 𝗠𝗼𝗱𝗲𝗹 𝗖𝗼𝗻𝘁𝗲𝘅𝘁 𝗣𝗿𝗼𝘁𝗼𝗰𝗼𝗹 (MCP). Learn more at our workshop. Link below. 👇
0:23

MCP by hand ✍️ This exercise walks you through the key elements of the 𝗠𝗼𝗱𝗲𝗹 𝗖𝗼𝗻𝘁𝗲𝘅𝘁 𝗣𝗿𝗼𝘁𝗼𝗰𝗼𝗹 (MCP). Learn more at our workshop. Link below. 👇

Tom Yeh

33,683 görüntüleme • 1 yıl önce

QuickSwap is now live on X Layer Mainnet ⚡️ The birth of a new Citadel on the dragon DEX, expanding the Polygon CDK family. Swap and LP on X Layer (farms coming soon) via QuickSwap to experience DeFi on the network at its very best. X Layer is ZK-powered Layer 2 network designed to connect the OKX and Ethereum communities, built using the Polygon CDK tech stack. It's designed to have seamless interoperability with other Layer 2 chains. Now plugged into the AggLayer, OKX’s massive community of 50+ million users is fully interoperable with all interconnected chains and can now tap into its unified liquidity. The network also uses zk-SNARK to make transactions significantly cheaper and far more compact. X Layer brings other benefits to users, such as near-instant finality, unified liquidity, robust security, high scalability... the list goes on. With this mainnet deployment and more to come, QuickSwap is leading the charge to ignite activity and growth on X Layer at rapid speeds. Going full throttle to further unite the Polygon | POL and OKX communities. This is only the beginning of a bright future for QuickSwap, X Layer, and the broader Polygon and Ethereum ecosystems. Get ready to rumble.
0:27

QuickSwap is now live on X Layer Mainnet ⚡️ The birth of a new Citadel on the dragon DEX, expanding the Polygon CDK family. Swap and LP on X Layer (farms coming soon) via QuickSwap to experience DeFi on the network at its very best. X Layer is ZK-powered Layer 2 network designed to connect the OKX and Ethereum communities, built using the Polygon CDK tech stack. It's designed to have seamless interoperability with other Layer 2 chains. Now plugged into the AggLayer, OKX’s massive community of 50+ million users is fully interoperable with all interconnected chains and can now tap into its unified liquidity. The network also uses zk-SNARK to make transactions significantly cheaper and far more compact. X Layer brings other benefits to users, such as near-instant finality, unified liquidity, robust security, high scalability... the list goes on. With this mainnet deployment and more to come, QuickSwap is leading the charge to ignite activity and growth on X Layer at rapid speeds. Going full throttle to further unite the Polygon | POL and OKX communities. This is only the beginning of a bright future for QuickSwap, X Layer, and the broader Polygon and Ethereum ecosystems. Get ready to rumble.

QuickSwap 🐲 DragonFi 2.0

20,857 görüntüleme • 2 yıl önce

Straight from #CES2026 Hear how the team at X leverages Grok, the core intelligence layer on X.
0:54

Straight from #CES2026 Hear how the team at X leverages Grok, the core intelligence layer on X.

Business

79,167 görüntüleme • 6 ay önce

The sweat, effort, and emotion behind this poster were worth every second and you guys took it to another level! ♥️ Here’s a sneak peek into the layer by layer breakdown of one of my favourite posters from the #OG campaign!!!
0:34

The sweat, effort, and emotion behind this poster were worth every second and you guys took it to another level! ♥️ Here’s a sneak peek into the layer by layer breakdown of one of my favourite posters from the #OG campaign!!!

Suryahhh

21,244 görüntüleme • 8 ay önce

llm.c by Hand✍️ C programming + matrix multiplication by hand This combination is perhaps as low as we can get to explain how the Transformer works. Special thanks to Andrej Karpathy for encouraging early feedback and tetsuo //: 👾 for helping me understand the pragma magic. I hope this exercise can help people peak further into the LLM black box.
0:44

llm.c by Hand✍️ C programming + matrix multiplication by hand This combination is perhaps as low as we can get to explain how the Transformer works. Special thanks to Andrej Karpathy for encouraging early feedback and tetsuo //: 👾 for helping me understand the pragma magic. I hope this exercise can help people peak further into the LLM black box.

Tom Yeh

302,688 görüntüleme • 2 yıl önce

This is how a freehand is born - layer by layer, painted by the artist’s hand, with no decals and no shortcuts. Want to add a freehand to your army, vehicle, or model? Message us: service@denofimagination.com #Freehand #Warhammer30k #HorusHeresy #Miniature #WarhammerCommunity
0:22

This is how a freehand is born - layer by layer, painted by the artist’s hand, with no decals and no shortcuts. Want to add a freehand to your army, vehicle, or model? Message us: [email protected] #Freehand #Warhammer30k #HorusHeresy #Miniature #WarhammerCommunity

Den of Imagination

12,191 görüntüleme • 23 gün önce

I gave the keynote at UC Berkeley's ProductCon - "How to Become an Elite AI-Powered Product Manager" This is the full talk + behind-the-scenes footage: 0:00 - Why This Matters 4:11 - Layer 1: Prompting Fundamentals 10:46 - Layer 2: AI Co-pilots 19:45 - Layer 3: AI Agents 27:00 - Layer 4: AI Prototyping 31:45 - Layer 5: AI Discovery 39:37 - Layer 6: Evals & Observability 42:53 - Layer 7: Vibe Experimentation 50:56 - Behind the Scenes
55:24

I gave the keynote at UC Berkeley's ProductCon - "How to Become an Elite AI-Powered Product Manager" This is the full talk + behind-the-scenes footage: 0:00 - Why This Matters 4:11 - Layer 1: Prompting Fundamentals 10:46 - Layer 2: AI Co-pilots 19:45 - Layer 3: AI Agents 27:00 - Layer 4: AI Prototyping 31:45 - Layer 5: AI Discovery 39:37 - Layer 6: Evals & Observability 42:53 - Layer 7: Vibe Experimentation 50:56 - Behind the Scenes

Aakash Gupta

410,662 görüntüleme • 5 ay önce

Breaking down my @Fogo inspired technique. Layer by layer, building the 🔥 How I turned inspiration into fire on rocks.
1:12

Breaking down my @Fogo inspired technique. Layer by layer, building the 🔥 How I turned inspiration into fire on rocks.

Perpetual

35,481 görüntüleme • 7 ay önce

Pearls are the oyster's way of turning irritation into perfection. Layer by layer. Watch how pearls actually form. sound on 🔊
0:51

Pearls are the oyster's way of turning irritation into perfection. Layer by layer. Watch how pearls actually form. sound on 🔊

Muse

12,098 görüntüleme • 3 ay önce

hyperliquids data layer allows you to see everyones positions look at the power of these api calls and this is how you can get a free api key
7:47

hyperliquids data layer allows you to see everyones positions look at the power of these api calls and this is how you can get a free api key

Moon Dev

16,476 görüntüleme • 5 ay önce

Examining the brain layer by layer
0:32

Examining the brain layer by layer

Science & Tech

11,422 görüntüleme • 6 ay önce

A “few” holes punched into a couple of problem greens today showing just how much water is trapped within the rootzone layer and zeolight added to improve infiltration rates through periods of high rainfall.
0:27

A “few” holes punched into a couple of problem greens today showing just how much water is trapped within the rootzone layer and zeolight added to improve infiltration rates through periods of high rainfall.

Prestbury GC Greens

50,410 görüntüleme • 2 yıl önce

Have you ever seen the decapsulating of a microchip layer by layer using a 30W JPT Fiber Laser? Well now you have and the the precision is wild to see.
0:32

Have you ever seen the decapsulating of a microchip layer by layer using a 30W JPT Fiber Laser? Well now you have and the the precision is wild to see.

Bluntly Put Philosopher (BPP)

83,778 görüntüleme • 3 ay önce

Anna Rahn's video demonstration of Multi-Layer Perceptron (MLP) by hand ✍️ Anna made this short video for my computer vision course in the spring semester. Together with the spreadsheet exercise I posted yesterday, I hope they help more people understand deep neural networks!
3:35

Anna Rahn's video demonstration of Multi-Layer Perceptron (MLP) by hand ✍️ Anna made this short video for my computer vision course in the spring semester. Together with the spreadsheet exercise I posted yesterday, I hope they help more people understand deep neural networks!

Tom Yeh

120,405 görüntüleme • 1 yıl önce

Gemma 4 by hand ✍️ in Excel tomorrow RSVP 👉 == Outline == 1. Attention 1.1 Scaled Product Dot-Product Attention (SDPA) 1.2 Global Attention 1.3 Causal Attention 1.4 Local Attention 2. KV Cache 2.1 Decoding (no caching) 2.2 Decoding with KV Cache 3. Mixture of Experts (MoE) 3.1 Feed Forward Layer 3.2 Router 3.3 Experts 3.4 Mixture 4. Per-Layer Embedding (PLE) 4.1 Input Embedding 4.2 Residual Stream 4.3 Layer Embedding 4.4 Low-Rank Layer Embedding 4.5 Dynamic Low-Rank Layer Embedding 4.6 Static + Dynamic Layer Embedding #aibyhand ---- AI Math, Algorithms, Architectures by hand ✍️ Subscribe to my 60K+ reader newsletter 👉
0:53

Gemma 4 by hand ✍️ in Excel tomorrow RSVP 👉 == Outline == 1. Attention 1.1 Scaled Product Dot-Product Attention (SDPA) 1.2 Global Attention 1.3 Causal Attention 1.4 Local Attention 2. KV Cache 2.1 Decoding (no caching) 2.2 Decoding with KV Cache 3. Mixture of Experts (MoE) 3.1 Feed Forward Layer 3.2 Router 3.3 Experts 3.4 Mixture 4. Per-Layer Embedding (PLE) 4.1 Input Embedding 4.2 Residual Stream 4.3 Layer Embedding 4.4 Low-Rank Layer Embedding 4.5 Dynamic Low-Rank Layer Embedding 4.6 Static + Dynamic Layer Embedding #aibyhand ---- AI Math, Algorithms, Architectures by hand ✍️ Subscribe to my 60K+ reader newsletter 👉

Tom Yeh

10,765 görüntüleme • 2 ay önce

OKX Integrates Chainlink To Unlock $80 Trillion RWA Opportunity On X Layer OKX officially adopts Chainlink to anchor the Real-World Asset (RWA) infrastructure on its X Layer network. The integration provides the high-speed data feeds and cross-chain interoperability necessary to capture an estimated $80T in tokenized global markets. As a "Chainlink Scale" member, X Layer is now positioned as a primary destination for sovereign institutional-grade asset migration. The collaboration enables developers to build advanced decentralized applications that bridge legacy financial value with the "AI Agent Economy" on X Layer.
0:30

OKX Integrates Chainlink To Unlock $80 Trillion RWA Opportunity On X Layer OKX officially adopts Chainlink to anchor the Real-World Asset (RWA) infrastructure on its X Layer network. The integration provides the high-speed data feeds and cross-chain interoperability necessary to capture an estimated $80T in tokenized global markets. As a "Chainlink Scale" member, X Layer is now positioned as a primary destination for sovereign institutional-grade asset migration. The collaboration enables developers to build advanced decentralized applications that bridge legacy financial value with the "AI Agent Economy" on X Layer.

BSCN

16,358 görüntüleme • 21 gün önce

3/ How do you experience the GRID? The GRID unifies global intelligence into one layer, accessible through Sentient Chat. Every query to the GRID is addressed through complex workflows that draw on multiple agents, search, data sources, and tools within the network.
0:24

3/ How do you experience the GRID? The GRID unifies global intelligence into one layer, accessible through Sentient Chat. Every query to the GRID is addressed through complex workflows that draw on multiple agents, search, data sources, and tools within the network.

Sentient

157,793 görüntüleme • 10 ay önce

No, this isn’t a Transformer. It’s a Leopard 2 Leguan, folding its 26-meter bridge. This bridge layer is operated by engineers of the Royal Netherlands Army.
1:44

No, this isn’t a Transformer. It’s a Leopard 2 Leguan, folding its 26-meter bridge. This bridge layer is operated by engineers of the Royal Netherlands Army.

Klaas Meijer

48,417 görüntüleme • 1 yıl önce

How to invest across every layer of $NVDA CEO Jensen Huang’s five-layer cake: • Layer 1 Energy (The Fuel): $CEG, $VST • Layer 2 Chips (The Engine): $TSM, $MU • Layer 3 Infrastructure (The Factory): $NBIS, $VRT • Layer 4 Models (The Intelligence): $GOOGL, $META • Layer 5 Applications (Where Value Is Proven): $PLTR, $NET
3:11

How to invest across every layer of $NVDA CEO Jensen Huang’s five-layer cake: • Layer 1 Energy (The Fuel): $CEG, $VST • Layer 2 Chips (The Engine): $TSM, $MU • Layer 3 Infrastructure (The Factory): $NBIS, $VRT • Layer 4 Models (The Intelligence): $GOOGL, $META • Layer 5 Applications (Where Value Is Proven): $PLTR, $NET

Shay Boloor

337,849 görüntüleme • 3 ay önce