正在加载视频...

视频加载失败

How Large Language Models Store Facts

51,698 次观看 • 1 年前 •via X (Twitter)

8 条评论

Ronen Lahat 的头像
Ronen Lahat1 年前

@3blue1brown This is what the internet is for, watching two 3blue1brown llm videos simultaneously

Mohan LM 的头像
Mohan LM1 年前

@3blue1brown thx where iz the rest of the video, pls.

Girish 的头像
Girish1 年前

@3blue1brown What a coincidence, i was just discussing this very topic last night

lxos.xivs 的头像
lxos.xivs1 年前

@3blue1brown Honestly if you need these animation to understand these concepts. You don’t need to understand them

josejuan 的头像
josejuan1 年前

@3blue1brown It describes a config of weights, usually tied to a layer/embedding. The "facts" in an ANN are distributed across the network, with nonlinearity between layers being crucial for capturing relationships like "big fish eats little fish," which can't be stored in a single embedding.

Quentin Munch 的头像
Quentin Munch1 年前

@3blue1brown Store data* (not facts)

Dannie Sim 的头像
Dannie Sim1 年前

@3blue1brown nailed it

Light 𓆩𓆩♡𓆪𓆪 的头像
Light 𓆩𓆩♡𓆪𓆪1 年前

@3blue1brown nearly perpendicular

相关视频