Video wird geladen...

Video konnte nicht geladen werden

Zur Startseite

Concept GPT2 interface showing each layer's parameters and their influence on activations (essentially data flowing through the network) Made with WebGPU and bits of three.js

147,810 Aufrufe • vor 2 Jahren •via X (Twitter)

9 Kommentare

Profilbild von 🥭human
🥭humanvor 2 Jahren

looks amazing. can you transform this gravity basin visualization technique into a next token prediction visualization? I'm thinking we might be able to unlock performance increases with it somehow.

Profilbild von Brandon
Brandonvor 2 Jahren

I’ll have to look into this more, thanks!

Profilbild von Joe Pea
Joe Peavor 2 Jahren

Neat! What exactly can we infer from the visual at different points?

Profilbild von Brandon
Brandonvor 2 Jahren

A lot of it is unexplained/complex math, but also… well, more on this soon 😉

Profilbild von Perry Demsko
Perry Demskovor 2 Jahren

@jxmnop That's hot.

Profilbild von GOON MASTER SOPHONT SIMP
GOON MASTER SOPHONT SIMPvor 2 Jahren

We need this but for gpt 4

Profilbild von John
Johnvor 2 Jahren

this is awesome work

Profilbild von ☐꩜🧬🏳️‍⚧️💎
☐꩜🧬🏳️‍⚧️💎vor 2 Jahren

it would be nice to see it in smooth transitions too. i feel like i can learn so much by just looking at this 😵‍💫

Profilbild von vorps
vorpsvor 2 Jahren

this is awesome

Ähnliche Videos