Загрузка видео...

Не удалось загрузить видео

На главную

Local AI to the max! Hermes Agent + Computer Use + Reachy Mini + llamacpp + Gemma E4B QAT (multimodal) + speech-to-speech = FUN! Video extracted and produced by super Stefano from last live done on X.

ivanfioravanti's profile picture

Ivan Fioravanti ᯅ

40,100 subscribers

17,269 просмотров • 1 месяц назад •via X (Twitter)

LIVE

Anya Rossi• Live Now

Private livecam show

Комментарии: 0

Нет доступных комментариев

Здесь появятся комментарии из оригинального поста

Похожие видео

Local Reachy Mini conversations wireless looks like magic! You can bring your friend around the house and get WOW effect from anyone! 🔥 Thanks Andi Marafioti for the blog post on how to set this up: Open-source Realtime API powered by llama.cpp: Parakeet -> Gemma 4 E4B -> Qwen3TTS. Just perfect on M5! Pictures, audio and content remain local and private! Next step adding some tools to search on the web or even better interfacing with my Hermes Agent! 🔥
1:07

Local Reachy Mini conversations wireless looks like magic! You can bring your friend around the house and get WOW effect from anyone! 🔥 Thanks Andi Marafioti for the blog post on how to set this up: Open-source Realtime API powered by llama.cpp: Parakeet -> Gemma 4 E4B -> Qwen3TTS. Just perfect on M5! Pictures, audio and content remain local and private! Next step adding some tools to search on the web or even better interfacing with my Hermes Agent! 🔥

Ivan Fioravanti ᯅ

22,458 просмотров • 3 месяцев назад

Real-time social robotics, from the cloud to your local device. Watch Ian from our DevX team use Gemini Live for a seamless voice chat with Reachy Mini. Then, stick around until the end to see the robot running locally on Gemma 4!
2:52

Real-time social robotics, from the cloud to your local device. Watch Ian from our DevX team use Gemini Live for a seamless voice chat with Reachy Mini. Then, stick around until the end to see the robot running locally on Gemma 4!

Google Gemma

113,530 просмотров • 2 месяцев назад

Introducing local Reachy Mini conversations: free chats forever! So fast that we had to hardcode delays to stop it from interrupting you mid-sentence. We built an open-source Realtime API powered by llama.cpp: Parakeet -> Gemma 4 E4B -> Qwen3TTS Run it anywhere you run local LMs. Video shows DGX Spark and a 36GB M3 Pro MacBook. Blog:
0:59

Introducing local Reachy Mini conversations: free chats forever! So fast that we had to hardcode delays to stop it from interrupting you mid-sentence. We built an open-source Realtime API powered by llama.cpp: Parakeet -> Gemma 4 E4B -> Qwen3TTS Run it anywhere you run local LMs. Video shows DGX Spark and a 36GB M3 Pro MacBook. Blog:

Andi Marafioti

76,922 просмотров • 3 месяцев назад

Perplexity just launched "Personal Computer", an always-on AI agent that merges their cloud-based Computer system with a Mac Mini. It accesses local files, apps, and sessions, orchestrates 19+ AI models, and can run 24/7. The Mac Mini continues to have its AI moment:
1:27

Perplexity just launched "Personal Computer", an always-on AI agent that merges their cloud-based Computer system with a Mac Mini. It accesses local files, apps, and sessions, orchestrates 19+ AI models, and can run 24/7. The Mac Mini continues to have its AI moment:

The Rundown AI

20,854 просмотров • 5 месяцев назад

Hermes Agent Nous Research + Gemma 4 26B Google DeepMind, fully working on local Mac 🤯: one prompt → full CLI app + tests + pytest passing tool calls firing back to back — local Claude Code vibes Gemma 4 MoE is fast AND smart, and tool calling just works — powered by Rapid-MLX which natively parses Gemma 4's tool format (no other local backend can do this yet) Two lines to try it: pip install rapid-mlx & rapid-mlx serve gemma-4-26b pip install hermes-agent && hermes @teknaborat @siaborisov #HermesAgent #Gemma4 #LocalLLM
0:21

Hermes Agent Nous Research + Gemma 4 26B Google DeepMind, fully working on local Mac 🤯: one prompt → full CLI app + tests + pytest passing tool calls firing back to back — local Claude Code vibes Gemma 4 MoE is fast AND smart, and tool calling just works — powered by Rapid-MLX which natively parses Gemma 4's tool format (no other local backend can do this yet) Two lines to try it: pip install rapid-mlx & rapid-mlx serve gemma-4-26b pip install hermes-agent && hermes @teknaborat @siaborisov #HermesAgent #Gemma4 #LocalLLM

raullen

24,988 просмотров • 4 месяцев назад

llamacpp vs omlx with Gemma-4-26B-A4B-it 🔥 🥇 llamacpp 🥈 oMLX Notes: - 11 parallel tasks - qat-Q4_0 vs OptiQ-4bit on omlx. - M5 Max 128GB macOS 27 Beta 1, relevant read below. - Fork of Gemma cookbook repo used with oMLX and iTerm2 usage added. Here: Observations: - llamacpp is more fluid in general, oMLX tends to slow down during prefill phase of a new request - I tested some MLX Gemma 4 qat, but they are all large in size, slower and with lower quality 🤷🏻‍♂️ - OptiQ quantization looks stronger than plain 4bit or 5bit MLX - Final result I slightly prefer OptiQ-4bit SVG gallery (on the right) - Results keep changing everytime I start a new instance of llamacpp or omlx, with differences up to 50%. Maybe due to macOS 27 beta1?
0:31

llamacpp vs omlx with Gemma-4-26B-A4B-it 🔥 🥇 llamacpp 🥈 oMLX Notes: - 11 parallel tasks - qat-Q4_0 vs OptiQ-4bit on omlx. - M5 Max 128GB macOS 27 Beta 1, relevant read below. - Fork of Gemma cookbook repo used with oMLX and iTerm2 usage added. Here: Observations: - llamacpp is more fluid in general, oMLX tends to slow down during prefill phase of a new request - I tested some MLX Gemma 4 qat, but they are all large in size, slower and with lower quality 🤷🏻‍♂️ - OptiQ quantization looks stronger than plain 4bit or 5bit MLX - Final result I slightly prefer OptiQ-4bit SVG gallery (on the right) - Results keep changing everytime I start a new instance of llamacpp or omlx, with differences up to 50%. Maybe due to macOS 27 beta1?

Ivan Fioravanti ᯅ

16,509 просмотров • 2 месяцев назад

autoMate Like Manus, Computer Use Agent(CUA) and Omniparser, we are computer-using agents. AI-driven local automation assistant that uses natural language to make computers work by themselves
0:29

autoMate Like Manus, Computer Use Agent(CUA) and Omniparser, we are computer-using agents. AI-driven local automation assistant that uses natural language to make computers work by themselves

AK

14,288 просмотров • 1 год назад

Fable is banned. Long live local AI. Full episode breaking down exactly how to get good at local models. the runtime, the hardware, quantization, connecting it to Hermes agent and local AI startup ideas (25 minutes)
24:55

Fable is banned. Long live local AI. Full episode breaking down exactly how to get good at local models. the runtime, the hardware, quantization, connecting it to Hermes agent and local AI startup ideas (25 minutes)

GREG ISENBERG

156,625 просмотров • 2 месяцев назад

Hermes is the fastest growing AI Agent on GitHub... 100,000 stars And in this 32 min video, i made it way more powerful by connecting it to Browser Use:
32:44

Hermes is the fastest growing AI Agent on GitHub... 100,000 stars And in this 32 min video, i made it way more powerful by connecting it to Browser Use:

David Ondrej

21,886 просмотров • 4 месяцев назад

I gave Nous Research Hermes agent a company brain. I've been LOVING Hermes agent as my personal assistant but haven't been able to use it for work. AI agents are powerful but they are siloed. They don’t have access to the same files, comments, versions, or decisions your team is working from. So I connected Hermes to Box. Now my Hermes agent can work from Slack, use files, comments, and decisions stored on Box as the single source of truth, and get shi* done.
6:33

I gave Nous Research Hermes agent a company brain. I've been LOVING Hermes agent as my personal assistant but haven't been able to use it for work. AI agents are powerful but they are siloed. They don’t have access to the same files, comments, versions, or decisions your team is working from. So I connected Hermes to Box. Now my Hermes agent can work from Slack, use files, comments, and decisions stored on Box as the single source of truth, and get shi* done.

Chris Kim

40,785 просмотров • 2 месяцев назад

a new 8GB VRAM GPU dense Local LLM leader was born yesterday runs on: RTX 4060 / RTX 3070 / RTX 2080. any 8GB card Qwen 3.5 9B (dense) was the go to for 6-8GB VRAM builds. Gemma 4 12B QAT (dense) just changed that. same llama.cpp + cuda 13.2. i7 12700H. 16GB RAM. same -ngl 99 flags. same 48k context. unsloth gemma-4-12b-it-Q4_K_M.gguf → 15 tok/sec @ 48k ctx unsloth gemma-4-12B-it-qat-UD-Q4_K_XL.gguf → 32 tok/sec @ 48k ctx → 26 tok/sec @ 64k ctx 64k context is a big deal. Hermes 3 agent requires 64k minimum to run. you're now getting full hermes compatible context on a budget consumer GPU at 26 tok/sec locally. 2.1x faster on identical hardware. and here's the part that breaks your brain: the QAT-UD-Q4_K_XL is actually SMALLER than the Q4_K_M "XL" why? QAT = Quantization Aware Training Google didn't train the model first and compress it later they trained it to be quantized from day one the weights already know how to survive low precision that's why you get more quality per byte llamacpp flags: -m gemma-4-12B-it-qat-UD-Q4_K_XL.gguf -cnv -ngl 99 -c 48000 -v fits in 8GB VRAM clean. no API. no cloud. no subscription. and this isn't even the MTP variant yet Gemma-4-E2B QAT runs on 3GB RAM, E4B on 5GB, 12B on 7GB, 26-A4B on 15GB and 31B on 18GB. I have benchmarked the 26b and 31b qat as well on a single RTX 4090, checkout the comments for details. If you have a 6GB or 8GB VRAM GPU, post your numbers. more benchmarks and configs coming soon
0:22

a new 8GB VRAM GPU dense Local LLM leader was born yesterday runs on: RTX 4060 / RTX 3070 / RTX 2080. any 8GB card Qwen 3.5 9B (dense) was the go to for 6-8GB VRAM builds. Gemma 4 12B QAT (dense) just changed that. same llama.cpp + cuda 13.2. i7 12700H. 16GB RAM. same -ngl 99 flags. same 48k context. unsloth gemma-4-12b-it-Q4_K_M.gguf → 15 tok/sec @ 48k ctx unsloth gemma-4-12B-it-qat-UD-Q4_K_XL.gguf → 32 tok/sec @ 48k ctx → 26 tok/sec @ 64k ctx 64k context is a big deal. Hermes 3 agent requires 64k minimum to run. you're now getting full hermes compatible context on a budget consumer GPU at 26 tok/sec locally. 2.1x faster on identical hardware. and here's the part that breaks your brain: the QAT-UD-Q4_K_XL is actually SMALLER than the Q4_K_M "XL" why? QAT = Quantization Aware Training Google didn't train the model first and compress it later they trained it to be quantized from day one the weights already know how to survive low precision that's why you get more quality per byte llamacpp flags: -m gemma-4-12B-it-qat-UD-Q4_K_XL.gguf -cnv -ngl 99 -c 48000 -v fits in 8GB VRAM clean. no API. no cloud. no subscription. and this isn't even the MTP variant yet Gemma-4-E2B QAT runs on 3GB RAM, E4B on 5GB, 12B on 7GB, 26-A4B on 15GB and 31B on 18GB. I have benchmarked the 26b and 31b qat as well on a single RTX 4090, checkout the comments for details. If you have a 6GB or 8GB VRAM GPU, post your numbers. more benchmarks and configs coming soon

Alok

259,993 просмотров • 2 месяцев назад

Voice AI without the wait! ⏱️ Thanks to Hugging Face and Cerebras, developers can now use the Gemma 4 31B model as the brain for voice AI at ultra-fast inference speeds. Add it to a fully open-source, cascaded speech-to-speech stack that can be used to power existing voice apps! 🗣️
1:46

Voice AI without the wait! ⏱️ Thanks to Hugging Face and Cerebras, developers can now use the Gemma 4 31B model as the brain for voice AI at ultra-fast inference speeds. Add it to a fully open-source, cascaded speech-to-speech stack that can be used to power existing voice apps! 🗣️

Google Gemma

160,981 просмотров • 1 месяц назад

Hermes is the most powerful AI agent on Earth right now I've used it for over 100+ hours the last few months. NOBODY has used it more In this video I cover EVERY single lesson learned. From which model to use, to best security practices The only Hermes vid you'll ever need:
19:24

Hermes is the most powerful AI agent on Earth right now I've used it for over 100+ hours the last few months. NOBODY has used it more In this video I cover EVERY single lesson learned. From which model to use, to best security practices The only Hermes vid you'll ever need:

Alex Finn

103,768 просмотров • 1 месяц назад

Can a $175 board power an offline robot voice assistant? 🤖 It’s cool to see Gemma 4 E2B powering the Reachy Mini robot entirely locally on a Raspberry Pi 5. Inference powered by LiteRT, it handles low latency voice, vision (YOLO) and robot movement completely offline. With text generation 2x normal human speech (~300 words per minute) on just 1.5GB of memory, the Pi 5 + Gemma 4 + LiteRT combo is a demonstration of how lean edge AI can be!
0:44

Can a $175 board power an offline robot voice assistant? 🤖 It’s cool to see Gemma 4 E2B powering the Reachy Mini robot entirely locally on a Raspberry Pi 5. Inference powered by LiteRT, it handles low latency voice, vision (YOLO) and robot movement completely offline. With text generation 2x normal human speech (~300 words per minute) on just 1.5GB of memory, the Pi 5 + Gemma 4 + LiteRT combo is a demonstration of how lean edge AI can be!

Google Gemma

30,188 просмотров • 15 дней назад

📽️ AI Agent for image-to-video video generation (beta) Combine with Pumpzy AI Agent - Add an image - Add a few words to generate video - Launch Pump Fun token right from AI chat Use-case: Make angry video & launch it on Pump Fun There is a short showcase from the AI chat 🔽
0:42

📽️ AI Agent for image-to-video video generation (beta) Combine with Pumpzy AI Agent - Add an image - Add a few words to generate video - Launch Pump Fun token right from AI chat Use-case: Make angry video & launch it on Pump Fun There is a short showcase from the AI chat 🔽

ZODs

14,731 просмотров • 1 год назад

Hermes Agent “Foundation Release” is a MASSIVE update. In just this release, Nous Research added: - /handoff live session transfers - Native Windows support beta - OpenAI-compatible local proxy - DeepSeek V4 Flash FREE in Nous Portal - Grok + SuperGrok integrations - Native AI video generation - Faster browser automation - Background Computer Use - Cross-session Claude prompt caching - x_search for real-time X/Twitter search - Better multi-agent orchestration - Huge cold-start performance improvements Hermes is rapidly evolving from an AI agent into a true open-source Agentic AI Operating System. Full breakdown/demo:
2:01

Hermes Agent “Foundation Release” is a MASSIVE update. In just this release, Nous Research added: - /handoff live session transfers - Native Windows support beta - OpenAI-compatible local proxy - DeepSeek V4 Flash FREE in Nous Portal - Grok + SuperGrok integrations - Native AI video generation - Faster browser automation - Background Computer Use - Cross-session Claude prompt caching - x_search for real-time X/Twitter search - Better multi-agent orchestration - Huge cold-start performance improvements Hermes is rapidly evolving from an AI agent into a true open-source Agentic AI Operating System. Full breakdown/demo:

WorldofAI

43,815 просмотров • 3 месяцев назад

Gemma 4 26B plus Hermes Agent, fully autonomous on 8GB VRAM. llama.cpp integration took 2 minutes. Writes code, manages GitHub, browses the web, connects to Notion and Obsidian. All offline, all local, 24/7.
0:20

Gemma 4 26B plus Hermes Agent, fully autonomous on 8GB VRAM. llama.cpp integration took 2 minutes. Writes code, manages GitHub, browses the web, connects to Notion and Obsidian. All offline, all local, 24/7.

0xMarioNawfal

153,113 просмотров • 2 месяцев назад

Hermes Agent with ChatGPT 5.5 is literally magic I've thrown some of my hardest tasks at this combo and the agent has been able to handle EVERYTHING In this video I take you through EVERYTHING Hermes from how to set it up to awesome use cases Time to set up your AI employee:
17:16

Hermes Agent with ChatGPT 5.5 is literally magic I've thrown some of my hardest tasks at this combo and the agent has been able to handle EVERYTHING In this video I take you through EVERYTHING Hermes from how to set it up to awesome use cases Time to set up your AI employee:

Alex Finn

118,536 просмотров • 4 месяцев назад

Using my Ferrari super computer, I used AI to analyse the last 3 years of "Stop the Rot, Sack the Lot". Over 35,000 hours of video was scanned and the most relevant data extracted. This is every episode compressed into 4 minutes.
4:28

Using my Ferrari super computer, I used AI to analyse the last 3 years of "Stop the Rot, Sack the Lot". Over 35,000 hours of video was scanned and the most relevant data extracted. This is every episode compressed into 4 minutes.

Cookerwatch

14,777 просмотров • 1 год назад