Loki (cute/acc)'s banner
Loki (cute/acc)'s profile picture

Loki (cute/acc)

@chillgates_ • 5,507 subscribers

script kiddie neet, extraordinary advocate 𝚖𝚒𝚕𝚊𝚍𝚢, smooth miladyos operator, degen ai quant ops, dyson spheres, buidler @ogmilady BDFL @miladyos🚀

Videos

LIVE
1.2k

Anya Rossi

sweetdream.ai

SweetDream.aiSponsored•Livecam
Streaming Now

Watch Anya Live

Anya is streaming live right now! Join her private show and enjoy exclusive content.

HD live stream
Exclusive private shows
1.2k viewers online

Free preview available • Premium content

Yeah. I have ChatGPT at home. Not a silly 7b model. A full-on 65B model that runs on my pi cluster, watch how the model gets loaded across the cluster with mmap and does round-robin inferencing 🫡 (10 seconds/token) (sped up 16x)
1:34
chillgates_'s profile picture

Yeah. I have ChatGPT at home. Not a silly 7b model. A full-on 65B model that runs on my pi cluster, watch how the model gets loaded across the cluster with mmap and does round-robin inferencing 🫡 (10 seconds/token) (sped up 16x)

Loki (cute/acc)

453,068 Aufrufe • vor 3 Jahren

Keine weiteren Inhalte verfügbar