Video wird geladen...

Video konnte nicht geladen werden

Zur Startseite

How Large Language Models Store Facts

51,698 Aufrufe • vor 1 Jahr •via X (Twitter)

8 Kommentare

Profilbild von Ronen Lahat
Ronen Lahatvor 1 Jahr

@3blue1brown This is what the internet is for, watching two 3blue1brown llm videos simultaneously

Profilbild von Mohan LM
Mohan LMvor 1 Jahr

@3blue1brown thx where iz the rest of the video, pls.

Profilbild von Girish
Girishvor 1 Jahr

@3blue1brown What a coincidence, i was just discussing this very topic last night

Profilbild von lxos.xivs
lxos.xivsvor 1 Jahr

@3blue1brown Honestly if you need these animation to understand these concepts. You don’t need to understand them

Profilbild von josejuan
josejuanvor 1 Jahr

@3blue1brown It describes a config of weights, usually tied to a layer/embedding. The "facts" in an ANN are distributed across the network, with nonlinearity between layers being crucial for capturing relationships like "big fish eats little fish," which can't be stored in a single embedding.

Profilbild von Quentin Munch
Quentin Munchvor 1 Jahr

@3blue1brown Store data* (not facts)

Profilbild von Dannie Sim
Dannie Simvor 1 Jahr

@3blue1brown nailed it

Profilbild von Light 𓆩𓆩♡𓆪𓆪
Light 𓆩𓆩♡𓆪𓆪vor 1 Jahr

@3blue1brown nearly perpendicular

Ähnliche Videos