Video wird geladen...
Video konnte nicht geladen werden
Gemma 3 27B + Ollama + Open WebUI + M3 Ultra ๐ฅ What a model! Great release Google! ๐๐ป
60,764 Aufrufe โข vor 1 Jahr โขvia X (Twitter)
11 Kommentare

This model is INCREDIBLE! I love it!

Togoda is Google on Steroids with AI summaries . ๐ The only thematic AI search engine.๐ It's 100% private with third party proxy. ๐งจ Try it today & experience the difference! ๐Follow us @togoda_com ๐ ๐Help us grow & share this post!๐

what is the terminal in the video

iTerm 2. I play with it and Ghostty.

It got an emotional breakdown when it catastrophically failed to create create an amazing animation using p5jsโฆ I just asked it to correct the errorโฆ 27B fp16โฆ hilarious ๐

Ikr? I just switched my client local LLM from DeepSeek r1 32b to this one and the difference is huge.

Whatโs that frontend youโre using?

Totally agree - awesome model!

Iโm only getting 14 tk/s when I run the MLX version in LM Studio. Seems faster for you

I used Ollama with the Q4 version here.

I've tried everything to improve the time to first token on this running on Apple Silicon but something's amiss. Your demo also shows that. Not sure how to optimize it.


