Video wird geladen...

Video konnte nicht geladen werden

Zur Startseite

Benjamin Bycroft’s 3D interactive tool visualizes an LLM’s layers, weights and matrix operations. This is the best educational tool to understand how an LLM works i've seen. httpx://bbycroft.net/llm

30,150 Aufrufe • vor 3 Monaten •via X (Twitter)

14 Kommentare

Profilbild von Learn German
Learn Germanvor 3 Monaten

This is genuinely one of the best LLM explainers I've seen. The way it shows attention turning raw tokens into structured meaning through nothing but matrix multiplies and layer norms is hypnotic. Makes you realize we're just watching a giant optimized calculator hallucinate coherence in real time.

Profilbild von Flash ⚡️
Flash ⚡️vor 3 Monaten

Learning

Profilbild von the dirty framed pepe
the dirty framed pepevor 3 Monaten

Nice song

Profilbild von 0x999dev
0x999devvor 3 Monaten

what gets me is watching the residual stream branch at attention heads in real time. most diagrams flatten that into arrows. wish it showed KV cache behavior too, that's where half the inference cost hides

Profilbild von Andrej Szontagh
Andrej Szontaghvor 3 Monaten

I think I will finally take some time to get over this. No more guessing.

Profilbild von JETLAB-X
JETLAB-Xvor 3 Monaten

This visualization is really incredible 😎💯

Profilbild von Vito Botta
Vito Bottavor 3 Monaten

Bookmarked. The 3D attention head visualisation finally made transformers click for me visually.

Profilbild von DigitalDaisy
DigitalDaisyvor 3 Monaten

No idea, but the way you slam it together, ok ☕️🥞🍊

Profilbild von mitch morales | xp/acc
mitch morales | xp/accvor 3 Monaten

matrix ops you can actually click through is the killer learning tool

Profilbild von Tyco Kayson
Tyco Kaysonvor 3 Monaten

This is incredible

Profilbild von Aetheron
Aetheronvor 3 Monaten

Wow, awesome! 🙌🏻

Profilbild von Andrej Szontagh
Andrej Szontaghvor 3 Monaten

So I have finally went through this and I have to say that despite the visualization is really nice I didn't learn much. This literally goes over the lowest level, but tells you nothing about 'WHY?'

Profilbild von AlphaOmegaAm1
AlphaOmegaAm1vor 3 Monaten

Oh heck yeah! These demos are 🔥

Profilbild von 上来透口气
上来透口气vor 3 Monaten

Deep-dive content

Ähnliche Videos