正在加载视频...
视频加载失败
Self-Attention by hand ✍️ Excel ~ I designed this exercise for students to practice the QKV math. I also created a medium and a large version to show how the attention matrix grows quadratically as the sequence gets longer. 👇Join the 'AI Math' community. Download xlsx.
9 条评论

Tom Yeh1 年前
Download xlsx from Github:

tetsuo.ai - e/acc1 年前
🤍

Yu Yang1 年前
This is cool! Finally my project is now related to LLM, and I got time to read those high impact papers. Your approach of using excel file provides a solid step to understand attention mechanism!

Gene Sh1 年前
Love this hands-on approach! Practicing self-attention mechanics in Excel really helps solidify understanding. Anyone tried the medium or large versions? #AILearning

Frank Dellaert1 年前
These are really great!

Kandy1 年前
invaluable work

Brok1 年前
Very helpful, keep up the great work👏👏

Fredd Villabona C.1 年前
This looks amazing, thanks for sharing! 💯

Jie Wang1 年前
another wtf moment during my ML study journey it is creative and interesting to see such an interactable transformer
