Loading video...

Video Failed to Load

Go Home

Concept GPT2 interface showing each layer's parameters and their influence on activations (essentially data flowing through the network) Made with WebGPU and bits of three.js

147,810 views • 2 years ago •via X (Twitter)

9 Comments

🥭human's profile picture
🥭human2 years ago

looks amazing. can you transform this gravity basin visualization technique into a next token prediction visualization? I'm thinking we might be able to unlock performance increases with it somehow.

Brandon's profile picture
Brandon2 years ago

I’ll have to look into this more, thanks!

Joe Pea's profile picture
Joe Pea2 years ago

Neat! What exactly can we infer from the visual at different points?

Brandon's profile picture
Brandon2 years ago

A lot of it is unexplained/complex math, but also… well, more on this soon 😉

Perry Demsko's profile picture
Perry Demsko2 years ago

@jxmnop That's hot.

GOON MASTER SOPHONT SIMP's profile picture
GOON MASTER SOPHONT SIMP2 years ago

We need this but for gpt 4

John's profile picture
John2 years ago

this is awesome work

☐꩜🧬🏳️‍⚧️💎's profile picture
☐꩜🧬🏳️‍⚧️💎2 years ago

it would be nice to see it in smooth transitions too. i feel like i can learn so much by just looking at this 😵‍💫

vorps's profile picture
vorps2 years ago

this is awesome

Related Videos