GooGZ AI

This is my MacBook Air M2 (16GB) with Hermes Agent powered by MiniCPM5-2B. 96k context, and a very respectable output of 20-24 tok/s. This is totally usable, and MiniCPM5 can do all the tool calls to manage the basics with Hermes in a personal agent context. I wouldn't use it to build the next Salesforce, but for the home enthusiast this is a powerful and fast local model that can really punch above its weight, and runs on almost anything. Look at it go.. Amazing!

23,255 Aufrufe