AI Coding, Agents, Local AI, RTX 3090
Youtube https://t.co/HRuCdgLym5
AI Devt https://t.co/MtiGBNIqKS
Free Grok Bot templates https://t.co/MFK1z3RsKI
Shorts
This is awesome. Thanks Mia for this Was able to run with the RTX 3090 use this .env config DRAFT=mtp CONTEXT_SIZE=262144 CACHE_QUANT=8,4 GPU_MEM_GB=22 262K context: - Run 1: 65.98 tok/s - Run 2: 63.23 tok/s - Run 3: 64.41 tok/s Average: ~64.5 tok/s.