正在加载视频...

视频加载失败

Benjamin Bycroft’s 3D interactive tool visualizes an LLM’s layers, weights and matrix operations. This is the best educational tool to understand how an LLM works i've seen. httpx://bbycroft.net/llm

30,150 次观看 • 3 个月前 •via X (Twitter)

14 条评论

Learn German 的头像
Learn German3 个月前

This is genuinely one of the best LLM explainers I've seen. The way it shows attention turning raw tokens into structured meaning through nothing but matrix multiplies and layer norms is hypnotic. Makes you realize we're just watching a giant optimized calculator hallucinate coherence in real time.

Flash ⚡️ 的头像
Flash ⚡️3 个月前

Learning

the dirty framed pepe 的头像
the dirty framed pepe3 个月前

Nice song

0x999dev 的头像
0x999dev3 个月前

what gets me is watching the residual stream branch at attention heads in real time. most diagrams flatten that into arrows. wish it showed KV cache behavior too, that's where half the inference cost hides

Andrej Szontagh 的头像
Andrej Szontagh3 个月前

I think I will finally take some time to get over this. No more guessing.

JETLAB-X 的头像
JETLAB-X3 个月前

This visualization is really incredible 😎💯

Vito Botta 的头像
Vito Botta3 个月前

Bookmarked. The 3D attention head visualisation finally made transformers click for me visually.

DigitalDaisy 的头像
DigitalDaisy3 个月前

No idea, but the way you slam it together, ok ☕️🥞🍊

mitch morales | xp/acc 的头像
mitch morales | xp/acc3 个月前

matrix ops you can actually click through is the killer learning tool

Tyco Kayson 的头像
Tyco Kayson3 个月前

This is incredible

Aetheron 的头像
Aetheron3 个月前

Wow, awesome! 🙌🏻

Andrej Szontagh 的头像
Andrej Szontagh3 个月前

So I have finally went through this and I have to say that despite the visualization is really nice I didn't learn much. This literally goes over the lowest level, but tells you nothing about 'WHY?'

AlphaOmegaAm1 的头像
AlphaOmegaAm13 个月前

Oh heck yeah! These demos are 🔥

上来透口气 的头像
上来透口气3 个月前

Deep-dive content

相关视频