Concept GPT2 interface showing each layer's parameters and their influence on activations…
147,810 次观看
9 条评论
评论来自 X (Twitter) 上的原帖

@tinycrops
looks amazing. can you transform this gravity basin visualization technique into a next token prediction visualization? I'm thinking we might be able to unlock performance increases with it somehow.
13 个赞

@brandon_xyzw
I’ll have to look into this more, thanks!
3 个赞

@trusktr
Neat! What exactly can we infer from the visual at different points?
3 个赞

@brandon_xyzw
A lot of it is unexplained/complex math, but also… well, more on this soon 😉
4 个赞

@nandgatesonly
@jxmnop That's hot.
3 个赞

@SOPHONTSIMP
We need this but for gpt 4
2 个赞

@jrysana
this is awesome work
2 个赞

@SlayersFuture
it would be nice to see it in smooth transitions too. i feel like i can learn so much by just looking at this 😵💫
2 个赞

@vorpal_strikes
this is awesome
2 个赞
