Loading video...
Video Failed to Load
Concept GPT2 interface showing each layer's parameters and their influence on activations (essentially data flowing through the network) Made with WebGPU and bits of three.js
147,810 views • 2 years ago •via X (Twitter)
9 Comments

🥭human2 years ago
looks amazing. can you transform this gravity basin visualization technique into a next token prediction visualization? I'm thinking we might be able to unlock performance increases with it somehow.

Brandon2 years ago
I’ll have to look into this more, thanks!

Joe Pea2 years ago
Neat! What exactly can we infer from the visual at different points?

Brandon2 years ago
A lot of it is unexplained/complex math, but also… well, more on this soon 😉

Perry Demsko2 years ago
@jxmnop That's hot.

GOON MASTER SOPHONT SIMP2 years ago
We need this but for gpt 4

John2 years ago
this is awesome work

☐꩜🧬🏳️⚧️💎2 years ago
it would be nice to see it in smooth transitions too. i feel like i can learn so much by just looking at this 😵💫

vorps2 years ago
this is awesome


