Loading video...

Video Failed to Load

There was a problem loading this video. This could be due to a temporary network issue or the video might be unavailable.

Introducing local Reachy Mini conversations: free chats forever! So fast that we had to hardcode delays to stop it from interrupting you mid-sentence. We built an open-source Realtime API powered by llama.cpp: Parakeet -> Gemma 4 E4B -> Qwen3TTS Run it anywhere you run local LMs. Video shows DGX... show more

Andi Marafioti

7,586 subscribers

76,150 views • 1 month ago •via X (Twitter)

Science & Technology

Anya Rossi• Live Now

Private livecam show

0 Comments

No comments available

Comments from the original post will appear here

Related Videos

Local Reachy Mini conversations wireless looks like magic! You can bring your friend around the house and get WOW effect from anyone! 🔥 Thanks Andi Marafioti for the blog post on how to set this up: Open-source Realtime API powered by llama.cpp: Parakeet -> Gemma 4 E4B -> Qwen3TTS. Just perfect on M5! Pictures, audio and content remain local and private! Next step adding some tools to search on the web or even better interfacing with my Hermes Agent! 🔥

Local Reachy Mini conversations wireless looks like magic! You can bring your friend around the house and get WOW effect from anyone! 🔥 Thanks Andi Marafioti for the blog post on how to set this up: Open-source Realtime API powered by llama.cpp: Parakeet -> Gemma 4 E4B -> Qwen3TTS. Just perfect on M5! Pictures, audio and content remain local and private! Next step adding some tools to search on the web or even better interfacing with my Hermes Agent! 🔥

Ivan Fioravanti ᯅ

22,408 views • 1 month ago

You can run local AI models up to 120B without a $10,000 Mac Studio This phone-sized device is your own server for open-source models. 100% local and private. And you can use it to: - Power an agent like OpenClaw 24/7 - Completely replace a chatbot - Literally anything that requires an API It’s called Tiiny, and, once again, you can run the latest open-source models on it. Link below

You can run local AI models up to 120B without a $10,000 Mac Studio This phone-sized device is your own server for open-source models. 100% local and private. And you can use it to: - Power an agent like OpenClaw 24/7 - Completely replace a chatbot - Literally anything that requires an API It’s called Tiiny, and, once again, you can run the latest open-source models on it. Link below

Paul Couvert

41,185 views • 4 months ago

🖼️ Introducing Open Multi-Agent Canvas - with MCP Chat with multiple LangGraph agents and any MCP server inside of a canvas app. Powered by CopilotKit🪁, LangChain & Larinháh Here's an example of how we used it to plan our offsite. We connected an agent to the Google Maps API, had it find local spots, and then sent the itinerary directly to Slack via MCP to be reviewed by the team. Explore and extend:

🖼️ Introducing Open Multi-Agent Canvas - with MCP Chat with multiple LangGraph agents and any MCP server inside of a canvas app. Powered by CopilotKit🪁, LangChain & Larinháh Here's an example of how we used it to plan our offsite. We connected an agent to the Google Maps API, had it find local spots, and then sent the itinerary directly to Slack via MCP to be reviewed by the team. Explore and extend:

CopilotKit🪁

22,080 views • 1 year ago

I have an AI employee doing work for me 24/7 for basically free You NEED to set this up It's Hermes Agent powered by local models on a @NVIDIA_AI_PC DGX Spark In this video I cover how to set up Hermes, load in Qwen 3.6, and have it work 24/7. NO experience required

I have an AI employee doing work for me 24/7 for basically free You NEED to set this up It's Hermes Agent powered by local models on a @NVIDIA_AI_PC DGX Spark In this video I cover how to set up Hermes, load in Qwen 3.6, and have it work 24/7. NO experience required

Alex Finn

92,305 views • 2 months ago

Databricks CEO Ali Ghodsi describes the difficulties of building a business around open source: "You have to hit two home runs, consecutively." "Your first home run - and you're banking on hitting that home run - is that your open source project takes over the world. Everybody wants to download it." If you don't hit that home run, Ali says, you just shot yourself in the foot. You just gave away your IP and got nothing back for it. But even if you hit this home run, you still don't have a monetizable business. You still can't make any money. So you have to hit the second home run: "You need a 10x innovation on top of the open source. That's the proprietary value you'll provide companies. That's why they'll come to you. Otherwise, they can get the open source anywhere." If you don't hit the second home run, the hyperscalers pick up your open source model, and they offer it for almost-free. "Getting into open source and monetizing is not an easy sport. Preferably don't get into it, because you might get hurt."

Databricks CEO Ali Ghodsi describes the difficulties of building a business around open source: "You have to hit two home runs, consecutively." "Your first home run - and you're banking on hitting that home run - is that your open source project takes over the world. Everybody wants to download it." If you don't hit that home run, Ali says, you just shot yourself in the foot. You just gave away your IP and got nothing back for it. But even if you hit this home run, you still don't have a monetizable business. You still can't make any money. So you have to hit the second home run: "You need a 10x innovation on top of the open source. That's the proprietary value you'll provide companies. That's why they'll come to you. Otherwise, they can get the open source anywhere." If you don't hit the second home run, the hyperscalers pick up your open source model, and they offer it for almost-free. "Getting into open source and monetizing is not an easy sport. Preferably don't get into it, because you might get hurt."

TBPN

45,355 views • 7 months ago

Spent the last few days vibe coding on my NVIDIA DGX Spark. Here's what I learned. Qwen 3.5 122B took one minute and nine seconds to respond "Hi how are you doing". Unusable for vibe coding. Gemma 4 was fast but built a dot instead of a first person shooter game. GPT-OSS 120B was the sweet spot. Fast, capable, and actually produced working HTML. Open source models running locally are not replacing Claude Opus 4.6 or Codex with GPT 5.4. Not even close. But they're getting better every month. The new DGX Spark Bench is live on Real-world benchmarks for local models on local hardware. This is just the start. Full video below.

Spent the last few days vibe coding on my NVIDIA DGX Spark. Here's what I learned. Qwen 3.5 122B took one minute and nine seconds to respond "Hi how are you doing". Unusable for vibe coding. Gemma 4 was fast but built a dot instead of a first person shooter game. GPT-OSS 120B was the sweet spot. Fast, capable, and actually produced working HTML. Open source models running locally are not replacing Claude Opus 4.6 or Codex with GPT 5.4. Not even close. But they're getting better every month. The new DGX Spark Bench is live on Real-world benchmarks for local models on local hardware. This is just the start. Full video below.

BridgeMind

57,304 views • 3 months ago

You really can just do things! Use *any* Hugging Face space as a MCP server along with your Local Models! 🔥 Here in we use Qwen 3 30B A3B with ggml llama.cpp and Hugging Face tiny agents to create images via FLUX powered by ZeroGPU ⚡ It's quite a bit crazy to see local models be capable of so much and just be able to understand/ infer from tool description! There's a lot of potential here in automating video generation workflows, content curation and a lot more.. Bonus: you can plug any other Inference Provider if you don't want to run locally too! npx @ huggingface/tiny-agents run [TASK] oh, and we provide both typescript and python client! 🐐

You really can just do things! Use any Hugging Face space as a MCP server along with your Local Models! 🔥 Here in we use Qwen 3 30B A3B with ggml llama.cpp and Hugging Face tiny agents to create images via FLUX powered by ZeroGPU ⚡ It's quite a bit crazy to see local models be capable of so much and just be able to understand/ infer from tool description! There's a lot of potential here in automating video generation workflows, content curation and a lot more.. Bonus: you can plug any other Inference Provider if you don't want to run locally too! npx @ huggingface/tiny-agents run [TASK] oh, and we provide both typescript and python client! 🐐

Vaibhav (VB) Srivastav

39,113 views • 1 year ago

Built an open-source Jupyter Notebook that brings the power of OpenAI's code interpreter into your local Python development environment. Watch how easy it is to use Thread to edit code I wrote, chat with my notebook, or generate charts just using prompts. We built Thread using Next.js, Chakra and Project Jupyter and you can install it by running: pip install thread-dev

Built an open-source Jupyter Notebook that brings the power of OpenAI's code interpreter into your local Python development environment. Watch how easy it is to use Thread to edit code I wrote, chat with my notebook, or generate charts just using prompts. We built Thread using Next.js, Chakra and Project Jupyter and you can install it by running: pip install thread-dev

Ali Shobeiri

112,638 views • 2 years ago

🚨 Founders: free, private, 100% local AI is finally here I downloaded Qwen 3.6 and ran it on my MacBook inside Strawberry browser. I couldn't believe it. We now have 100% free and private AI that is on par with the best models from OpenAI, Anthropic and Google. (see video!) The CTO of Hugging Face called this "the second revolution of AI." He's right. If you are a building an AI product, you HAVE to start thinking about how you can leverage open source models in your product. It's only a matter of time until local models are mainstream and can run on most people's devices. LLMs are commoditizing. The human brain only requires a AAA battery's worth of energy to run. If biology figured out efficient intelligence, software can too. Maybe we won't need artificial super intelligence and thousands of data centres to do most economically valuable work. Maybe there's a future where AI agents just run on your laptop, fine-tuned to you, fully owned by you, costing only what your energy bill costs. In this future, it's all about building the most delightful, intuitive experience. We've been building for exactly this moment. Stay tuned.

🚨 Founders: free, private, 100% local AI is finally here I downloaded Qwen 3.6 and ran it on my MacBook inside Strawberry browser. I couldn't believe it. We now have 100% free and private AI that is on par with the best models from OpenAI, Anthropic and Google. (see video!) The CTO of Hugging Face called this "the second revolution of AI." He's right. If you are a building an AI product, you HAVE to start thinking about how you can leverage open source models in your product. It's only a matter of time until local models are mainstream and can run on most people's devices. LLMs are commoditizing. The human brain only requires a AAA battery's worth of energy to run. If biology figured out efficient intelligence, software can too. Maybe we won't need artificial super intelligence and thousands of data centres to do most economically valuable work. Maybe there's a future where AI agents just run on your laptop, fine-tuned to you, fully owned by you, costing only what your energy bill costs. In this future, it's all about building the most delightful, intuitive experience. We've been building for exactly this moment. Stay tuned.

Charles Maddock

12,633 views • 2 months ago

🚨 One orchestrator. 10 parallel agents. 100+ tokens a second. All local. The Google Gemma team just dropped a MASSIVE demo for Gemma 4 26B. They built a concurrent workflow that lets the 26B model coordinate an entire team of sub-agents on your machine. Out of the box, the cookbook lets you run 10 parallel agents to: → Code an entire SVG art gallery in seconds → Translate text simultaneously → Generate ASCII art → Write parallel code Spinning up multi-agent systems locally has never looked this fast or this accessible. 100% free and open-source. repo link in 🧵↓

🚨 One orchestrator. 10 parallel agents. 100+ tokens a second. All local. The Google Gemma team just dropped a MASSIVE demo for Gemma 4 26B. They built a concurrent workflow that lets the 26B model coordinate an entire team of sub-agents on your machine. Out of the box, the cookbook lets you run 10 parallel agents to: → Code an entire SVG art gallery in seconds → Translate text simultaneously → Generate ASCII art → Write parallel code Spinning up multi-agent systems locally has never looked this fast or this accessible. 100% free and open-source. repo link in 🧵↓

Charly Wargnier

31,627 views • 1 month ago

IF YOU HAVE BEEN HOLDING OFF ON HERMES AGENT BECAUSE OF API COSTS, READ THIS FIRST. Four real ways to run it for free. Local, through Ollama, complete privacy and no rate limits. Cloud, through free tiers from Groq, OpenRouter, or NVIDIA NIM, no card required. A subscription you already have, GitHub Copilot connects natively. A fallback configuration so a rate limit on one provider does not stop your whole session. Hermes Agent is free and open source. Now there is no excuse on the model side either. Bookmark this. Follow CyrilXBT

IF YOU HAVE BEEN HOLDING OFF ON HERMES AGENT BECAUSE OF API COSTS, READ THIS FIRST. Four real ways to run it for free. Local, through Ollama, complete privacy and no rate limits. Cloud, through free tiers from Groq, OpenRouter, or NVIDIA NIM, no card required. A subscription you already have, GitHub Copilot connects natively. A fallback configuration so a rate limit on one provider does not stop your whole session. Hermes Agent is free and open source. Now there is no excuse on the model side either. Bookmark this. Follow CyrilXBT

CyrilXBT

28,199 views • 21 days ago

INTEL JUST QUIETLY BUILT THE CHEAPEST PATH TO 128GB OF LOCAL AI VRAM, AND IT BEATS NVIDIA'S DGX SPARK BY 2X FOR THE SAME $4,000 00:11 four Arc Pro B70s racked in one chassis. 32GB of GDDR6 each, $949 MSRP, roughly $1,000 street per card stack four and you get 128GB of VRAM for about $4,000 total. a lab benchmarked the quad against a DGX Spark and a single RTX Pro 6000. the four B70s doubled the Spark or better they trail the Pro 6000, but that card is $10,000. so the real choice is now $4K for 128GB from Intel or $10K for 96GB from NVIDIA the article covers the DGX Spark at $3,999 as the single-desk local AI ceiling. this Intel quad matches the price, beats the memory throughput, and nobody is talking about it yet save this before Intel's VRAM-per-dollar advantage becomes the default homelab build ↓

INTEL JUST QUIETLY BUILT THE CHEAPEST PATH TO 128GB OF LOCAL AI VRAM, AND IT BEATS NVIDIA'S DGX SPARK BY 2X FOR THE SAME $4,000 00:11 four Arc Pro B70s racked in one chassis. 32GB of GDDR6 each, $949 MSRP, roughly $1,000 street per card stack four and you get 128GB of VRAM for about $4,000 total. a lab benchmarked the quad against a DGX Spark and a single RTX Pro 6000. the four B70s doubled the Spark or better they trail the Pro 6000, but that card is $10,000. so the real choice is now $4K for 128GB from Intel or $10K for 96GB from NVIDIA the article covers the DGX Spark at $3,999 as the single-desk local AI ceiling. this Intel quad matches the price, beats the memory throughput, and nobody is talking about it yet save this before Intel's VRAM-per-dollar advantage becomes the default homelab build ↓

NO1ennn

136,365 views • 2 days ago

Try out Gemini Code: a coding assistant in your terminal powered by Gemini 2.5 Pro. 💜 💜 Release Notes: → It's easy to get started, just run `pip install gemini-code` in a virtual environment, and then run `gemini` to initialize it. It requires your own API key, so don't forget to get one from → I built this because I love Claude Code and wanted a similar experience -- I like that I can just use my own API key and Gemini is generally way cheaper as well. → Found a bug? Feel free to fork the code and fix it (lol)! If you want to try to improve it, please do so - repo is public! → Reminder and a disclaimer that I don't work at Google and this is not an official Google project - just a weekend side hack → It is highly likely you'll get throttled by rate limits - I put as much info as I can in the guide so you know what behavior to expect when that happens. You can also set which default model to use if you want to switch to 1.5 Pro.

Try out Gemini Code: a coding assistant in your terminal powered by Gemini 2.5 Pro. 💜 💜 Release Notes: → It's easy to get started, just run `pip install gemini-code` in a virtual environment, and then run `gemini` to initialize it. It requires your own API key, so don't forget to get one from → I built this because I love Claude Code and wanted a similar experience -- I like that I can just use my own API key and Gemini is generally way cheaper as well. → Found a bug? Feel free to fork the code and fix it (lol)! If you want to try to improve it, please do so - repo is public! → Reminder and a disclaimer that I don't work at Google and this is not an official Google project - just a weekend side hack → It is highly likely you'll get throttled by rate limits - I put as much info as I can in the guide so you know what behavior to expect when that happens. You can also set which default model to use if you want to switch to 1.5 Pro.

Raiza Martin

159,723 views • 1 year ago

🗓️ Release Week Recap Big week. mlx-audio and mlx-vlm are now among some of the fastest-growing OSS projects. Here’s what we shipped last week. Gemma 4 on Apple Silicon Two awesome releases by our partner Google DeepMind & Google Gemma : > Gemma 4 12B — their new dense, unified multimodal model. It uses an encoder free audio path and simplified vision encoder. > Gemma 4 QAT — quantization-aware training checkpoints, optimized to run locally on consumer GPUs and edge devices, compressing the model while preserving the quality you expect from Gemma 4. On the audio 🎧 side we added support for 15+ new TTS, ASR & VAD models, faster long-form transcription, and an expanded OpenAI-compatible audio server. All local on Apple Silicon. Huge thanks to every contributor and my co-maintainer Lucas Newman. 🙏🏽

🗓️ Release Week Recap Big week. mlx-audio and mlx-vlm are now among some of the fastest-growing OSS projects. Here’s what we shipped last week. Gemma 4 on Apple Silicon Two awesome releases by our partner Google DeepMind & Google Gemma : > Gemma 4 12B — their new dense, unified multimodal model. It uses an encoder free audio path and simplified vision encoder. > Gemma 4 QAT — quantization-aware training checkpoints, optimized to run locally on consumer GPUs and edge devices, compressing the model while preserving the quality you expect from Gemma 4. On the audio 🎧 side we added support for 15+ new TTS, ASR & VAD models, faster long-form transcription, and an expanded OpenAI-compatible audio server. All local on Apple Silicon. Huge thanks to every contributor and my co-maintainer Lucas Newman. 🙏🏽

Prince Canuma

11,731 views • 1 month ago

every AI product made you go to it. open a tab. paste your screen. explain your context. wait for an answer. go back to what you were doing. we got tired of that loop. so we built Nino — a Windows AI companion that lives on your desktop. hold Ctrl + Alt. it already sees your screen. just ask. it can see your screen, point at stuff, interact with apps, and run background agents while you keep working. launching today.

every AI product made you go to it. open a tab. paste your screen. explain your context. wait for an answer. go back to what you were doing. we got tired of that loop. so we built Nino — a Windows AI companion that lives on your desktop. hold Ctrl + Alt. it already sees your screen. just ask. it can see your screen, point at stuff, interact with apps, and run background agents while you keep working. launching today.

Karan

189,366 views • 2 months ago

Introducing Avatar V. We’ve solved character consistency. Forever. Record yourself once for 15 seconds. From there, you can show up anywhere, in any look, and it still feels like you. Any photo becomes a video that looks, moves, and speaks like you, down to your mannerisms and quirks. This is the most advanced AI avatar model in the world. And we know that’s a big claim, so we brought the data to prove it. Thread below:

Joshua Xu

532,737 views • 3 months ago

Someone paid $6,000 (!) to get OpenClaw setup. So I built a free, open-source alternative: > OpenClaw Operator It's an agent skill + AGENTS.md/CLAUDE.md file that gives Codex/Claude Code the playbooks + validation flow needed to configure your local OpenClaw install. You open your OpenClaw repo/workspace in your coding agent and say things like: - “set up a cron job” - “create a custom skill” - “fix my provider config” - “troubleshoot this install and validate it” Nothing magical. Uses context from the OpenClaw open-source repo + docs to provide an effective skill. Includes: - SKILL.md - AGENTS.md/CLAUDE.md - validation checklist - task playbooks Free and open source. Contributions welcome. Demo below. Repo in reply.

Someone paid $6,000 (!) to get OpenClaw setup. So I built a free, open-source alternative: > OpenClaw Operator It's an agent skill + AGENTS.md/CLAUDE.md file that gives Codex/Claude Code the playbooks + validation flow needed to configure your local OpenClaw install. You open your OpenClaw repo/workspace in your coding agent and say things like: - “set up a cron job” - “create a custom skill” - “fix my provider config” - “troubleshoot this install and validate it” Nothing magical. Uses context from the OpenClaw open-source repo + docs to provide an effective skill. Includes: - SKILL.md - AGENTS.md/CLAUDE.md - validation checklist - task playbooks Free and open source. Contributions welcome. Demo below. Repo in reply.

Dan McAteer

17,809 views • 4 months ago

Introducing Perplexi-Tube, the Perplexity for YouTube that I built in 20 minutes... A Mobile app that uses Deepseek and Gemini I used Cursor and the React Native template built that makes building mobile apps incredibly easy. Tomorrow I'm releasing a full tutorial on how to create a mobile app with react native. You will need - XCode and Simulator (free) - Cursor - A Clerk Account (for auth, free) - A Deepseek API Key - A Gemini API Key (Optional, we used it because deepseek has been down today) Video will be released tomorrow, and I will open source this code as well.

Introducing Perplexi-Tube, the Perplexity for YouTube that I built in 20 minutes... A Mobile app that uses Deepseek and Gemini I used Cursor and the React Native template built that makes building mobile apps incredibly easy. Tomorrow I'm releasing a full tutorial on how to create a mobile app with react native. You will need - XCode and Simulator (free) - Cursor - A Clerk Account (for auth, free) - A Deepseek API Key - A Gemini API Key (Optional, we used it because deepseek has been down today) Video will be released tomorrow, and I will open source this code as well.

Riley Brown

117,845 views • 1 year ago

Introducing OpenVenice — an open-source, customizable frontend for Venice. Your API key stays in your browser, talks directly to Venice. No server, no backend. - Chat, image gen, audio, music, video, embeddings — everything venice offers in one clean UI - Visual workflows — chain models together (vision → LLM → image gen -> video gen). Venice is multimodal so you can build some really powerful workflows - Full control over every model parameter - Runs locally, deploys anywhere — zero infrastructure I'm a $DIEM holder and heavy Venice user. The models are solid and website is great but I kept wanting more freedom with the UX — more control, custom tools, being able to give it access to my local computer, multimodal chaining -- something I could shape to how I actually work. Didn't exist, so I built it. Feel free to fork and make it yours. Open source, MIT licensed.

Introducing OpenVenice — an open-source, customizable frontend for Venice. Your API key stays in your browser, talks directly to Venice. No server, no backend. - Chat, image gen, audio, music, video, embeddings — everything venice offers in one clean UI - Visual workflows — chain models together (vision → LLM → image gen -> video gen). Venice is multimodal so you can build some really powerful workflows - Full control over every model parameter - Runs locally, deploys anywhere — zero infrastructure I'm a $DIEM holder and heavy Venice user. The models are solid and website is great but I kept wanting more freedom with the UX — more control, custom tools, being able to give it access to my local computer, multimodal chaining -- something I could shape to how I actually work. Didn't exist, so I built it. Feel free to fork and make it yours. Open source, MIT licensed.

nikshep

40,500 views • 4 months ago

just built a local AI waifu on my two macbooks by using the oss parallax inference library!!! not super smooth yet but parallax is still the easiest way to run llms locally on top of mlx - and no bigco can steal my waifu. still need folks to help her see/hear/draw since mlx has no legit wrapper yet. i’m running a campaign giving away mac minis + dgx spark. please please share your localhost ai model setup by using parallax (you don't need a gpu to try self-hosting you can just start with an extra macbook you borrowed from your friend like i did) or any fun app built on top of yourself host model to link below. come build sovereign intelligence with me 🫶

just built a local AI waifu on my two macbooks by using the oss parallax inference library!!! not super smooth yet but parallax is still the easiest way to run llms locally on top of mlx - and no bigco can steal my waifu. still need folks to help her see/hear/draw since mlx has no legit wrapper yet. i’m running a campaign giving away mac minis + dgx spark. please please share your localhost ai model setup by using parallax (you don't need a gpu to try self-hosting you can just start with an extra macbook you borrowed from your friend like i did) or any fun app built on top of yourself host model to link below. come build sovereign intelligence with me 🫶

Asuka Zheng🎀@ICML

178,998 views • 7 months ago