正在加载视频...

视频加载失败

llm.c by Hand✍️ C programming + matrix multiplication by hand This combination is perhaps as low as we can get to explain how the Transformer works. Special thanks to Andrej Karpathy for encouraging early feedback and tetsuo //: 👾 for helping me understand the pragma magic. I hope this...

302,625 次观看 • 2 年前 •via X (Twitter)

11 条评论

Yuchen Jin 的头像
Yuchen Jin2 年前

@karpathy @7etsuo Awesome! Looking forward to an llm.c Attention episode

Tom Yeh 的头像
Tom Yeh2 年前

@karpathy @7etsuo This is a great suggestion! Thanks!

Antonio Linares 的头像
Antonio Linares2 年前

@karpathy @7etsuo Is there a way to load a single layer of a LLM (in example Llama3-70B) and process it layer by layer so it fits on a normal PC memory ? Could you explain how to do it ?

Tom Yeh 的头像
Tom Yeh2 年前

@karpathy @7etsuo It is possible. But it would be quite slow. To generate each token, the model has to evaluate every one of the hundreds of layers. Say loading each layer takes 1 second. It would take 100 seconds to load 100 layers for one token. Then you multiple that by 1000 tokens. Very slow.

rakesh 的头像
rakesh2 年前

@karpathy @7etsuo Goated acc

ed 的头像
ed2 年前

@karpathy @7etsuo Amazing 🔥

Cuhmunity Notes 的头像
Cuhmunity Notes2 年前

@karpathy @7etsuo 🔥

Byron Hsu 的头像
Byron Hsu2 年前

@karpathy @7etsuo This is awesome

Filippo Broggini 的头像
Filippo Broggini2 年前

@karpathy @7etsuo Is this also available elsewhere online?

George D Gregory 的头像
George D Gregory2 年前

@karpathy @7etsuo Can these be made into the notebooks!? That would be awesome.

Tom Yeh 的头像
Tom Yeh2 年前

@karpathy @7etsuo I am waiting for a notebook ninja to step up to help.😄

相关视频