Nat Friedman's banner
Nat Friedman's profile picture

Nat Friedman

@natfriedman • 289,296 subscribers

https://t.co/Lhh178sIjq

Shorts

Watching llama.cpp do 40 tok/s inference of the 7B model on my M2 Max, with 0% CPU usage, and using all 38 GPU cores. Congratulations Georgi Gerganov ! This is a triumph.

Watching llama.cpp do 40 tok/s inference of the 7B model on my M2 Max, with 0% CPU usage, and using all 38 GPU cores. Congratulations Georgi Gerganov ! This is a triumph.

1,764,005 görüntüleme

Inside a fiber-labeled scroll

Inside a fiber-labeled scroll

66,478 görüntüleme

More scroll fibers

More scroll fibers

23,643 görüntüleme

Videos

LIVE
1.2k

Anya Rossi

sweetdream.ai

SweetDream.aiSponsored•Livecam
Streaming Now

Watch Anya Live

Anya is streaming live right now! Join her private show and enjoy exclusive content.

HD live stream
Exclusive private shows
1.2k viewers online

Free preview available • Premium content

The LLM playground that's hosted at is now open source: Enjoy!
0:46
natfriedman's profile picture

The LLM playground that's hosted at is now open source: Enjoy!

Nat Friedman

402,342 görüntüleme • 3 yıl önce

Daha fazla içerik yok.