Video yükleniyor...
Video Yüklenemedi
Understanding LLMs by Building One 👉 We use large language models every day, but what actually happens inside them?
15,053 görüntüleme • 7 ay önce •via X (Twitter)
13 Yorum

This is golden 🔥🔥🔥

Thank you! If/when you have time, please tell me what you like and what can be improved! I am planning to add new labs and maybe a new separate agentic course with its own labs.

Some the internals explain the behavior (and issues) we observe. That’s why I build these online labs, initially inspired by Andrej Karpathy's microGPT, to help explore simple code bases that train, fine-tune, and explore present and future grands of LLMs.

The interactive web tutorial is powered by walk-the-code, a standalone line-by-line code tutorial viewer with multi-language support, chapters, Mermaid diagrams with per-line node highlighting, and stale annotation detection:

You can use the web tutorial online or clone/fork the repo to run the code as in the video. Let me know here or in an issue if something is not clear or should be improved!

Love the format of this (code with annotations)! The explanations feel a bit AI-ish though? For example, on a variable named "BOS", the annotation says "A special token marking where names begin and end" without ever answering what BOS stands for ("beginning of sequence")!

That’s for spotting that and for the feedback! Yes AI helps and slops :) I reviewed the content but some weird comments slipped through.

This was also an attempt to create a framework for sharing code with annotations (text and diagrams) in a “standard” way. Again, I think AI can make that easier but cannot be left alone.

Amazon Korea B2C "Me"

walk-the-code as the spine for a tutorial like this is so right — line by line is where the intuition actually lands

Agreed! I am thinking of investing more time on the walk-the-code component to make it more “reusable”.

Amazing sir,, My next project will be on LLMs only,, this video really help me to go on & build with a new start!!

prayer for our idea & We're building a new way to shop by giving quality reducing waste, promote sustainable shopping, and deliver amazing value to customers #SustainableShopping #MysteryBox

