正在加载视频...

视频加载失败

加载此视频时出现问题。这可能是由于临时网络问题，或视频可能不可用。

Agentic LLM NPCs with multi-user conversation all running on consumer-grade local hardware

stochastics

1,229 subscribers

24,261 次观看 • 1 年前 •via X (Twitter)

Anya Rossi• Live Now

Private livecam show

3 条评论

Inno Kean 的头像

Inno Kean1 年前

Why the choice of the Mistral model? Speed?

stochastics 的头像

stochastics1 年前

Mistral 3.1-24B (IQ4 quantized) performed extremely well in my testing for speed, quality (namely with structured responses) and vram usage, given that I’m trying to fit the entire thing into 10gb of vram I’m waiting for @NousResearch to release an even better-performing tuned Hermes@edge variant

Greg Caplan 🚀 的头像

Greg Caplan 🚀2 年前

Stop wasting time following up with leads. Let our AI agents do it for you.

相关视频

Here is Ternary Bonsai 27B running an end-to-end agentic workflow locally with Hermes on an NVIDIA GeForce RTX 5090 GPU. The model reasons, calls tools, reads outputs, modifies files, and surfaces insights - all on consumer hardware, while all private files, intermediate states, and iterations remain local.

Here is Ternary Bonsai 27B running an end-to-end agentic workflow locally with Hermes on an NVIDIA GeForce RTX 5090 GPU. The model reasons, calls tools, reads outputs, modifies files, and surfaces insights - all on consumer hardware, while all private files, intermediate states, and iterations remain local.

PrismML

153,244 次观看 • 28 天前

Introducing `Personalized Agentic RAG` - where the LLM remembers key details about the user and automatically chooses the tool for RAG. We'll build: 👏 ChatGPT like memory ⚙️ Function calling 🧙 Multi-Agent orchestration code:

Introducing `Personalized Agentic RAG` - where the LLM remembers key details about the user and automatically chooses the tool for RAG. We'll build: 👏 ChatGPT like memory ⚙️ Function calling 🧙 Multi-Agent orchestration code:

Ashpreet Bedi

45,035 次观看 • 2 年前

LLama3 + Godot = "living NPCs" 🤯 All running on device. Zero cost. 100% private.

LLama3 + Godot = "living NPCs" 🤯 All running on device. Zero cost. 100% private.

Danny Postma

331,632 次观看 • 2 年前

DeepSeek R1 671B running on 2 M2 Ultras faster than reading speed. Getting close to open-source O1, at home, on consumer hardware. With mlx.distributed and mlx-lm, 3-bit quantization (~4 bpw)

DeepSeek R1 671B running on 2 M2 Ultras faster than reading speed. Getting close to open-source O1, at home, on consumer hardware. With mlx.distributed and mlx-lm, 3-bit quantization (~4 bpw)

Awni Hannun

866,117 次观看 • 1 年前

LLM running on Windows 98 PC 26 year old hardware with Intel Pentium II CPU and 128MB RAM. Uses llama98.c, our custom pure C inference engine based on Andrej Karpathy llama2.c Code and DIY guide 👇

LLM running on Windows 98 PC 26 year old hardware with Intel Pentium II CPU and 128MB RAM. Uses llama98.c, our custom pure C inference engine based on Andrej Karpathy llama2.c Code and DIY guide 👇

EXO Labs

483,118 次观看 • 1 年前

on the frontier of consumer wearables: building an egoless AI product in conversation with Mina Fahmi, building Sandbar between Mina's eloquence and our nyc galavanting, this conversation feels like a work of art. stoked to be able to share it dive in: 00:34 Mina's background 01:42 Robotics, neural interfaces, and hardware 06:06 Bringing nervous system work into designing AI products 10:25 Building with voice 12:38 AI extending self-concept 19:05 AI sycophancy 24:58 Agentic memory 30:11 Hardware decisions at Sandbar 34:16 Hiring at Sandbar 36:04 Bringing AI to more people

on the frontier of consumer wearables: building an egoless AI product in conversation with Mina Fahmi, building Sandbar between Mina's eloquence and our nyc galavanting, this conversation feels like a work of art. stoked to be able to share it dive in: 00:34 Mina's background 01:42 Robotics, neural interfaces, and hardware 06:06 Bringing nervous system work into designing AI products 10:25 Building with voice 12:38 AI extending self-concept 19:05 AI sycophancy 24:58 Agentic memory 30:11 Hardware decisions at Sandbar 34:16 Hiring at Sandbar 36:04 Bringing AI to more people

ashe

33,796 次观看 • 3 个月前

Build a local LLM app with RAG to chat with Google Drive data using Mistral or Llama-3 running locally on your computer without wiring a single line of Python Code (100% free and without internet):

Build a local LLM app with RAG to chat with Google Drive data using Mistral or Llama-3 running locally on your computer without wiring a single line of Python Code (100% free and without internet):

Shubham Saboo

189,778 次观看 • 2 年前

Yjs is the #1 library for collaborative editing on the web. Today we're announcing built-in Yjs support for Durable Streams. Use it to add multi-user and multi-agent collaboration to your AI apps and agentic systems. Links in the 🧵👇

Yjs is the #1 library for collaborative editing on the web. Today we're announcing built-in Yjs support for Durable Streams. Use it to add multi-user and multi-agent collaboration to your AI apps and agentic systems. Links in the 🧵👇

Electric

20,177 次观看 • 4 个月前

The best way to learn AI is to build with agents. To help with that, we've launched hands-on labs and a new series on Agentic Engineering. First topic: Agent Skills. Next in the pipeline: planning, context engineering, multi-agent systems, long-running agents,.. Go build!

The best way to learn AI is to build with agents. To help with that, we've launched hands-on labs and a new series on Agentic Engineering. First topic: Agent Skills. Next in the pipeline: planning, context engineering, multi-agent systems, long-running agents,.. Go build!

elvis

31,802 次观看 • 2 个月前

Instant AutoGPT Launcher I wrote a launcher for AutoGPT today. Play with LLM agents using a ComfyUI-like node based interface. Even works with local LLM via ollama (shown in the video) Works on all platforms (windows, linux, mac). Install with 1 click. Use with 0 click.

Instant AutoGPT Launcher I wrote a launcher for AutoGPT today. Play with LLM agents using a ComfyUI-like node based interface. Even works with local LLM via ollama (shown in the video) Works on all platforms (windows, linux, mac). Install with 1 click. Use with 0 click.

cocktail peanut

11,405 次观看 • 2 年前

Preview of a Gaia 🌱 device! Turn-by-turn voice conversation with your own knowledge assistant (a Gaia node). 💸 $15 worth of hardware (pre-tariff!) 🌱 Voice-to-text, LLM and text-to-voice AI models on Gaia nodes 📖 Open source all-the-way — hardware, firmware, server, AI models 🦀 Rust all-the-way from firmware to AI server Notice how I switched to another language (Chinese) in the middle of the conversation and it seamlessly switched too. Very smart. PS. we are still optimizing performance before the software release.

Preview of a Gaia 🌱 device! Turn-by-turn voice conversation with your own knowledge assistant (a Gaia node). 💸 $15 worth of hardware (pre-tariff!) 🌱 Voice-to-text, LLM and text-to-voice AI models on Gaia nodes 📖 Open source all-the-way — hardware, firmware, server, AI models 🦀 Rust all-the-way from firmware to AI server Notice how I switched to another language (Chinese) in the middle of the conversation and it seamlessly switched too. Very smart. PS. we are still optimizing performance before the software release.

Michael Yuan

14,983 次观看 • 1 年前

Proud that Microsoft Edge is the first AI browser in the enterprise. - agentic actions - daily briefing - YouTube summarization - multi-tab analysis - search your history with natural language Bringing together the best of AI and enterprise-grade security.

Proud that Microsoft Edge is the first AI browser in the enterprise. - agentic actions - daily briefing - YouTube summarization - multi-tab analysis - search your history with natural language Bringing together the best of AI and enterprise-grade security.

Mustafa Suleyman

104,008 次观看 • 8 个月前

The top question I got was does Halo support local LLM running on a Mac. Here's an example of the app using gemma-4-26b-a4b-qat via LM Studio running on a base M5/32GB. It's giving an average of 40 tok/s and in my brief testing is able to execute all tool calls correctly. Very usable with this app.

The top question I got was does Halo support local LLM running on a Mac. Here's an example of the app using gemma-4-26b-a4b-qat via LM Studio running on a base M5/32GB. It's giving an average of 40 tok/s and in my brief testing is able to execute all tool calls correctly. Very usable with this app.

Tanmay

11,682 次观看 • 1 个月前

Introducing: Cohere Command A+ We’ve created our most powerful LLM yet, optimized it to run on as little hardware as possible, and released it open-source for all.

Introducing: Cohere Command A+ We’ve created our most powerful LLM yet, optimized it to run on as little hardware as possible, and released it open-source for all.

Cohere

742,095 次观看 • 2 个月前

Introducing Warp 2.0: the Agentic Development Environment 1️⃣ Top overall coding agent: #1 on Terminal-Bench, 71% on SWE-bench Verified 2️⃣ Agent multi-threading: build features, debug, and ship all at once 3️⃣ The first all-in-one platform for agentic development 🧵 Learn more

Introducing Warp 2.0: the Agentic Development Environment 1️⃣ Top overall coding agent: #1 on Terminal-Bench, 71% on SWE-bench Verified 2️⃣ Agent multi-threading: build features, debug, and ship all at once 3️⃣ The first all-in-one platform for agentic development 🧵 Learn more

Warp

1,445,810 次观看 • 1 年前

I just deployed an OpenClaw AI agent on NEAR AI running inside TEEs. Real agent. Real memory. Hardware-backed privacy. No prompt leakage. This is what “user-owned AI” actually looks like.

I just deployed an OpenClaw AI agent on NEAR AI running inside TEEs. Real agent. Real memory. Hardware-backed privacy. No prompt leakage. This is what “user-owned AI” actually looks like.

NEAR DevHub

21,039 次观看 • 6 个月前

Progress on our AI x Hardware project! We have near real-time conversation with both a 2D and 3D animated bot running. These will eventually be full blown paintings you can hang on your wall. Demo videos are unedited. Thoughts below👇

Progress on our AI x Hardware project! We have near real-time conversation with both a 2D and 3D animated bot running. These will eventually be full blown paintings you can hang on your wall. Demo videos are unedited. Thoughts below👇

Varun Mayya

90,910 次观看 • 2 年前

once again causing a scene at the local coffee shop on this week’s delve with mel - 3 words, 3 AI takes: Sean X on whether anthropic should give up on consumer, openai… hardware?, how Apple could do the craziest thing, and the danger of platform lock-in for our memories…

once again causing a scene at the local coffee shop on this week’s delve with mel - 3 words, 3 AI takes: Sean X on whether anthropic should give up on consumer, openai… hardware?, how Apple could do the craziest thing, and the danger of platform lock-in for our memories…

melody kim

27,044 次观看 • 1 年前

Top designer at Mercury shows her agentic design explorations in Figma. Designers working on AI features should copy this and sketch how the LLM works before prototyping. 👀 Full conversation on Sneak Peek: carol shows her thought process for designing Mercury Command in Figma👇

Top designer at Mercury shows her agentic design explorations in Figma. Designers working on AI features should copy this and sketch how the LLM works before prototyping. 👀 Full conversation on Sneak Peek: carol shows her thought process for designing Mercury Command in Figma👇

Jayneil Dalal

19,651 次观看 • 1 个月前

Open-source VLA from Galaxea Dynamics shown on a wide range of environments and with different objects, and all running on their cheap off the shelf hardware. Really great contribution to the community.

Open-source VLA from Galaxea Dynamics shown on a wide range of environments and with different objects, and all running on their cheap off the shelf hardware. Really great contribution to the community.

Chris Paxton

30,133 次观看 • 7 个月前