跳过导航
Concept GPT2 interface showing each layer's parameters and their influence on activations…
0:00 / 0:32

Concept GPT2 interface showing each layer's parameters and their influence on activations…

Brandon

@brandon_xyzw6901 位关注者

在 X 上查看
1,723 个赞下载原帖

147,810 次观看

Concept GPT2 interface showing each layer's parameters and their influence on activations (essentially data flowing through the network) Made with WebGPU and bits of three.js

9 条评论

评论来自 X (Twitter) 上的原帖

  • 🥭human 的头像

    @tinycrops

    looks amazing. can you transform this gravity basin visualization technique into a next token prediction visualization? I'm thinking we might be able to unlock performance increases with it somehow.

    13 个赞

  • Brandon 的头像

    @brandon_xyzw

    I’ll have to look into this more, thanks!

    3 个赞

  • Joe Pea 的头像

    @trusktr

    Neat! What exactly can we infer from the visual at different points?

    3 个赞

  • Brandon 的头像

    @brandon_xyzw

    A lot of it is unexplained/complex math, but also… well, more on this soon 😉

    4 个赞

  • Perry Demsko 的头像

    @nandgatesonly

    @jxmnop That's hot.

    3 个赞

  • GOON MASTER SOPHONT SIMP 的头像

    @SOPHONTSIMP

    We need this but for gpt 4

    2 个赞

  • John 的头像

    @jrysana

    this is awesome work

    2 个赞

  • ☐꩜🧬🏳️‍⚧️💎 的头像

    @SlayersFuture

    it would be nice to see it in smooth transitions too. i feel like i can learn so much by just looking at this 😵‍💫

    2 个赞

  • vorps 的头像

    @vorpal_strikes

    this is awesome

    2 个赞