正在加载视频...
视频加载失败
Concept GPT2 interface showing each layer's parameters and their influence on activations (essentially data flowing through the network) Made with WebGPU and bits of three.js
9 条评论

🥭human2 年前
looks amazing. can you transform this gravity basin visualization technique into a next token prediction visualization? I'm thinking we might be able to unlock performance increases with it somehow.

Brandon2 年前
I’ll have to look into this more, thanks!

Joe Pea2 年前
Neat! What exactly can we infer from the visual at different points?

Brandon2 年前
A lot of it is unexplained/complex math, but also… well, more on this soon 😉

Perry Demsko2 年前
@jxmnop That's hot.

GOON MASTER SOPHONT SIMP2 年前
We need this but for gpt 4

John2 年前
this is awesome work

☐꩜🧬🏳️⚧️💎2 年前
it would be nice to see it in smooth transitions too. i feel like i can learn so much by just looking at this 😵💫

vorps2 年前
this is awesome


