Causally running Grok-1 at home

PR pending

Nice work

Wow, this is super impressive!

for those wondering, this is iq3_s, 130gb metal buffer, 9 t/s

Amazing, well done!

Ready for M3 Ultra with 256GB 😎

Apples Macs with 192 GB ram are really interesting machines for use cases like that.

@ibab_ml whoa 😲 I just watched that clip and have many questions....... Does not look like the average user "causally running Grok" from home 🤣

Lovely, can it run on NVIDIA as well?

@gentle_warfare yes