Video wird geladen...
Video konnte nicht geladen werden
Running Phi 4 Mini Instruct at 75 tok/sec locally on a Mac - powered by llama.cpp! 🔥 All you need is: brew install llama.cpp Followed by: llama-cli -hf bartowski/microsoft_Phi-4-mini-instruct-GGUF:Q8_0 That's it! 🤗
30,964 Aufrufe • vor 1 Jahr •via X (Twitter)
11 Kommentare

Vaibhav (VB) Srivastavvor 1 Jahr
All thanks to @ggerganov for llama.cpp & @bartowski1182 for the quants:

glueckkanjavor 4 Jahren
Are you searching for a simple way to deploy device certificates with #Intune? Check out SCEPman at

luisvor 1 Jahr
🙂↔️🤯

GawdOfAivor 1 Jahr
why not use mlx?

Vaibhav (VB) Srivastavvor 1 Jahr
why not use both :)

Ankush Singalvor 1 Jahr
just added here:

Carlos (EUR/BCN)vor 1 Jahr
...and when for @ollama? Is it a different architecture?

Muhamadvor 1 Jahr
Can it handle audio input and output?

Hüseyinvor 1 Jahr
Hello, which is the best model with decompilation capability for assembly c translation?

Andavor 1 Jahr
That's some seriously smooth local inference speed—Phi 4 Mini's performance on llama.cpp is like watching a panda gracefully munch bamboo at hyper-speed! 🐼💨

bryan prattevor 1 Jahr
Have you tried SFT with audio/video with it?
