Video wird geladen...
Video konnte nicht geladen werden
Self-Attention by hand ✍️ Excel ~ I designed this exercise for students to practice the QKV math. I also created a medium and a large version to show how the attention matrix grows quadratically as the sequence gets longer. 👇Join the 'AI Math' community. Download xlsx.
125,723 Aufrufe • vor 2 Jahren •via X (Twitter)
9 Kommentare

Tom Yehvor 2 Jahren
Download xlsx from Github:

tetsuo.ai - e/accvor 2 Jahren
🤍

Yu Yangvor 2 Jahren
This is cool! Finally my project is now related to LLM, and I got time to read those high impact papers. Your approach of using excel file provides a solid step to understand attention mechanism!

Gene Shvor 2 Jahren
Love this hands-on approach! Practicing self-attention mechanics in Excel really helps solidify understanding. Anyone tried the medium or large versions? #AILearning

Frank Dellaertvor 2 Jahren
These are really great!

Kandyvor 2 Jahren
invaluable work

Brokvor 2 Jahren
Very helpful, keep up the great work👏👏

Fredd Villabona C.vor 2 Jahren
This looks amazing, thanks for sharing! 💯

Jie Wangvor 2 Jahren
another wtf moment during my ML study journey it is creative and interesting to see such an interactable transformer

