Video wird geladen...
Video konnte nicht geladen werden
Concept GPT2 interface showing each layer's parameters and their influence on activations (essentially data flowing through the network) Made with WebGPU and bits of three.js
147,810 Aufrufe • vor 2 Jahren •via X (Twitter)
9 Kommentare

🥭humanvor 2 Jahren
looks amazing. can you transform this gravity basin visualization technique into a next token prediction visualization? I'm thinking we might be able to unlock performance increases with it somehow.

Brandonvor 2 Jahren
I’ll have to look into this more, thanks!

Joe Peavor 2 Jahren
Neat! What exactly can we infer from the visual at different points?

Brandonvor 2 Jahren
A lot of it is unexplained/complex math, but also… well, more on this soon 😉

Perry Demskovor 2 Jahren
@jxmnop That's hot.

GOON MASTER SOPHONT SIMPvor 2 Jahren
We need this but for gpt 4

Johnvor 2 Jahren
this is awesome work

☐꩜🧬🏳️⚧️💎vor 2 Jahren
it would be nice to see it in smooth transitions too. i feel like i can learn so much by just looking at this 😵💫

vorpsvor 2 Jahren
this is awesome


