正在加载视频...

视频加载失败

Concept GPT2 interface showing each layer's parameters and their influence on activations (essentially data flowing through the network) Made with WebGPU and bits of three.js

147,810 次观看 • 2 年前 •via X (Twitter)

9 条评论

🥭human 的头像
🥭human2 年前

looks amazing. can you transform this gravity basin visualization technique into a next token prediction visualization? I'm thinking we might be able to unlock performance increases with it somehow.

Brandon 的头像
Brandon2 年前

I’ll have to look into this more, thanks!

Joe Pea 的头像
Joe Pea2 年前

Neat! What exactly can we infer from the visual at different points?

Brandon 的头像
Brandon2 年前

A lot of it is unexplained/complex math, but also… well, more on this soon 😉

Perry Demsko 的头像
Perry Demsko2 年前

@jxmnop That's hot.

GOON MASTER SOPHONT SIMP 的头像
GOON MASTER SOPHONT SIMP2 年前

We need this but for gpt 4

John 的头像
John2 年前

this is awesome work

☐꩜🧬🏳️‍⚧️💎 的头像
☐꩜🧬🏳️‍⚧️💎2 年前

it would be nice to see it in smooth transitions too. i feel like i can learn so much by just looking at this 😵‍💫

vorps 的头像
vorps2 年前

this is awesome

相关视频