Loading video...

Video Failed to Load

There was a problem loading this video. This could be due to a temporary network issue or the video might be unavailable.

Agentic LLM NPCs with multi-user conversation all running on consumer-grade local hardware

stochastics

1,229 subscribers

24,261 views • 1 year ago •via X (Twitter)

Anya Rossi• Live Now

Private livecam show

3 Comments

Inno Kean1 year ago

Why the choice of the Mistral model? Speed?

stochastics1 year ago

Mistral 3.1-24B (IQ4 quantized) performed extremely well in my testing for speed, quality (namely with structured responses) and vram usage, given that I’m trying to fit the entire thing into 10gb of vram I’m waiting for @NousResearch to release an even better-performing tuned Hermes@edge variant

Greg Caplan 🚀2 years ago

Stop wasting time following up with leads. Let our AI agents do it for you.

Related Videos

Here is Ternary Bonsai 27B running an end-to-end agentic workflow locally with Hermes on an NVIDIA GeForce RTX 5090 GPU. The model reasons, calls tools, reads outputs, modifies files, and surfaces insights - all on consumer hardware, while all private files, intermediate states, and iterations remain local.

Here is Ternary Bonsai 27B running an end-to-end agentic workflow locally with Hermes on an NVIDIA GeForce RTX 5090 GPU. The model reasons, calls tools, reads outputs, modifies files, and surfaces insights - all on consumer hardware, while all private files, intermediate states, and iterations remain local.

PrismML

153,244 views • 28 days ago

Introducing `Personalized Agentic RAG` - where the LLM remembers key details about the user and automatically chooses the tool for RAG. We'll build: 👏 ChatGPT like memory ⚙️ Function calling 🧙 Multi-Agent orchestration code:

Introducing `Personalized Agentic RAG` - where the LLM remembers key details about the user and automatically chooses the tool for RAG. We'll build: 👏 ChatGPT like memory ⚙️ Function calling 🧙 Multi-Agent orchestration code:

Ashpreet Bedi

45,035 views • 2 years ago

LLama3 + Godot = "living NPCs" 🤯 All running on device. Zero cost. 100% private.

LLama3 + Godot = "living NPCs" 🤯 All running on device. Zero cost. 100% private.

Danny Postma

331,632 views • 2 years ago

DeepSeek R1 671B running on 2 M2 Ultras faster than reading speed. Getting close to open-source O1, at home, on consumer hardware. With mlx.distributed and mlx-lm, 3-bit quantization (~4 bpw)

DeepSeek R1 671B running on 2 M2 Ultras faster than reading speed. Getting close to open-source O1, at home, on consumer hardware. With mlx.distributed and mlx-lm, 3-bit quantization (~4 bpw)

Awni Hannun

866,117 views • 1 year ago

LLM running on Windows 98 PC 26 year old hardware with Intel Pentium II CPU and 128MB RAM. Uses llama98.c, our custom pure C inference engine based on Andrej Karpathy llama2.c Code and DIY guide 👇

LLM running on Windows 98 PC 26 year old hardware with Intel Pentium II CPU and 128MB RAM. Uses llama98.c, our custom pure C inference engine based on Andrej Karpathy llama2.c Code and DIY guide 👇

EXO Labs

483,118 views • 1 year ago

on the frontier of consumer wearables: building an egoless AI product in conversation with Mina Fahmi, building Sandbar between Mina's eloquence and our nyc galavanting, this conversation feels like a work of art. stoked to be able to share it dive in: 00:34 Mina's background 01:42 Robotics, neural interfaces, and hardware 06:06 Bringing nervous system work into designing AI products 10:25 Building with voice 12:38 AI extending self-concept 19:05 AI sycophancy 24:58 Agentic memory 30:11 Hardware decisions at Sandbar 34:16 Hiring at Sandbar 36:04 Bringing AI to more people

on the frontier of consumer wearables: building an egoless AI product in conversation with Mina Fahmi, building Sandbar between Mina's eloquence and our nyc galavanting, this conversation feels like a work of art. stoked to be able to share it dive in: 00:34 Mina's background 01:42 Robotics, neural interfaces, and hardware 06:06 Bringing nervous system work into designing AI products 10:25 Building with voice 12:38 AI extending self-concept 19:05 AI sycophancy 24:58 Agentic memory 30:11 Hardware decisions at Sandbar 34:16 Hiring at Sandbar 36:04 Bringing AI to more people

ashe

33,796 views • 3 months ago

Build a local LLM app with RAG to chat with Google Drive data using Mistral or Llama-3 running locally on your computer without wiring a single line of Python Code (100% free and without internet):

Build a local LLM app with RAG to chat with Google Drive data using Mistral or Llama-3 running locally on your computer without wiring a single line of Python Code (100% free and without internet):

Shubham Saboo

189,778 views • 2 years ago

Yjs is the #1 library for collaborative editing on the web. Today we're announcing built-in Yjs support for Durable Streams. Use it to add multi-user and multi-agent collaboration to your AI apps and agentic systems. Links in the 🧵👇

Yjs is the #1 library for collaborative editing on the web. Today we're announcing built-in Yjs support for Durable Streams. Use it to add multi-user and multi-agent collaboration to your AI apps and agentic systems. Links in the 🧵👇

Electric

20,177 views • 4 months ago

The best way to learn AI is to build with agents. To help with that, we've launched hands-on labs and a new series on Agentic Engineering. First topic: Agent Skills. Next in the pipeline: planning, context engineering, multi-agent systems, long-running agents,.. Go build!

The best way to learn AI is to build with agents. To help with that, we've launched hands-on labs and a new series on Agentic Engineering. First topic: Agent Skills. Next in the pipeline: planning, context engineering, multi-agent systems, long-running agents,.. Go build!

elvis

31,802 views • 2 months ago

Instant AutoGPT Launcher I wrote a launcher for AutoGPT today. Play with LLM agents using a ComfyUI-like node based interface. Even works with local LLM via ollama (shown in the video) Works on all platforms (windows, linux, mac). Install with 1 click. Use with 0 click.

Instant AutoGPT Launcher I wrote a launcher for AutoGPT today. Play with LLM agents using a ComfyUI-like node based interface. Even works with local LLM via ollama (shown in the video) Works on all platforms (windows, linux, mac). Install with 1 click. Use with 0 click.

cocktail peanut

11,405 views • 2 years ago

Preview of a Gaia 🌱 device! Turn-by-turn voice conversation with your own knowledge assistant (a Gaia node). 💸 $15 worth of hardware (pre-tariff!) 🌱 Voice-to-text, LLM and text-to-voice AI models on Gaia nodes 📖 Open source all-the-way — hardware, firmware, server, AI models 🦀 Rust all-the-way from firmware to AI server Notice how I switched to another language (Chinese) in the middle of the conversation and it seamlessly switched too. Very smart. PS. we are still optimizing performance before the software release.

Preview of a Gaia 🌱 device! Turn-by-turn voice conversation with your own knowledge assistant (a Gaia node). 💸 $15 worth of hardware (pre-tariff!) 🌱 Voice-to-text, LLM and text-to-voice AI models on Gaia nodes 📖 Open source all-the-way — hardware, firmware, server, AI models 🦀 Rust all-the-way from firmware to AI server Notice how I switched to another language (Chinese) in the middle of the conversation and it seamlessly switched too. Very smart. PS. we are still optimizing performance before the software release.

Michael Yuan

14,983 views • 1 year ago

Proud that Microsoft Edge is the first AI browser in the enterprise. - agentic actions - daily briefing - YouTube summarization - multi-tab analysis - search your history with natural language Bringing together the best of AI and enterprise-grade security.

Proud that Microsoft Edge is the first AI browser in the enterprise. - agentic actions - daily briefing - YouTube summarization - multi-tab analysis - search your history with natural language Bringing together the best of AI and enterprise-grade security.

Mustafa Suleyman

104,008 views • 8 months ago

The top question I got was does Halo support local LLM running on a Mac. Here's an example of the app using gemma-4-26b-a4b-qat via LM Studio running on a base M5/32GB. It's giving an average of 40 tok/s and in my brief testing is able to execute all tool calls correctly. Very usable with this app.

The top question I got was does Halo support local LLM running on a Mac. Here's an example of the app using gemma-4-26b-a4b-qat via LM Studio running on a base M5/32GB. It's giving an average of 40 tok/s and in my brief testing is able to execute all tool calls correctly. Very usable with this app.

Tanmay

11,682 views • 1 month ago

Introducing: Cohere Command A+ We’ve created our most powerful LLM yet, optimized it to run on as little hardware as possible, and released it open-source for all.

Introducing: Cohere Command A+ We’ve created our most powerful LLM yet, optimized it to run on as little hardware as possible, and released it open-source for all.

Cohere

742,095 views • 2 months ago

Introducing Warp 2.0: the Agentic Development Environment 1️⃣ Top overall coding agent: #1 on Terminal-Bench, 71% on SWE-bench Verified 2️⃣ Agent multi-threading: build features, debug, and ship all at once 3️⃣ The first all-in-one platform for agentic development 🧵 Learn more

Introducing Warp 2.0: the Agentic Development Environment 1️⃣ Top overall coding agent: #1 on Terminal-Bench, 71% on SWE-bench Verified 2️⃣ Agent multi-threading: build features, debug, and ship all at once 3️⃣ The first all-in-one platform for agentic development 🧵 Learn more

Warp

1,445,810 views • 1 year ago

I just deployed an OpenClaw AI agent on NEAR AI running inside TEEs. Real agent. Real memory. Hardware-backed privacy. No prompt leakage. This is what “user-owned AI” actually looks like.

I just deployed an OpenClaw AI agent on NEAR AI running inside TEEs. Real agent. Real memory. Hardware-backed privacy. No prompt leakage. This is what “user-owned AI” actually looks like.

NEAR DevHub

21,039 views • 6 months ago

Progress on our AI x Hardware project! We have near real-time conversation with both a 2D and 3D animated bot running. These will eventually be full blown paintings you can hang on your wall. Demo videos are unedited. Thoughts below👇

Progress on our AI x Hardware project! We have near real-time conversation with both a 2D and 3D animated bot running. These will eventually be full blown paintings you can hang on your wall. Demo videos are unedited. Thoughts below👇

Varun Mayya

90,910 views • 2 years ago

once again causing a scene at the local coffee shop on this week’s delve with mel - 3 words, 3 AI takes: Sean X on whether anthropic should give up on consumer, openai… hardware?, how Apple could do the craziest thing, and the danger of platform lock-in for our memories…

once again causing a scene at the local coffee shop on this week’s delve with mel - 3 words, 3 AI takes: Sean X on whether anthropic should give up on consumer, openai… hardware?, how Apple could do the craziest thing, and the danger of platform lock-in for our memories…

melody kim

27,044 views • 1 year ago

Top designer at Mercury shows her agentic design explorations in Figma. Designers working on AI features should copy this and sketch how the LLM works before prototyping. 👀 Full conversation on Sneak Peek: carol shows her thought process for designing Mercury Command in Figma👇

Top designer at Mercury shows her agentic design explorations in Figma. Designers working on AI features should copy this and sketch how the LLM works before prototyping. 👀 Full conversation on Sneak Peek: carol shows her thought process for designing Mercury Command in Figma👇

Jayneil Dalal

19,651 views • 1 month ago

Open-source VLA from Galaxea Dynamics shown on a wide range of environments and with different objects, and all running on their cheap off the shelf hardware. Really great contribution to the community.

Open-source VLA from Galaxea Dynamics shown on a wide range of environments and with different objects, and all running on their cheap off the shelf hardware. Really great contribution to the community.

Chris Paxton

30,133 views • 7 months ago