Video wird geladen...

Video konnte nicht geladen werden

Zur Startseite

Agentic LLM NPCs with multi-user conversation all running on consumer-grade local hardware

RandoAnalytics's profile picture

stochastics

1,229 subscribers

24,261 Aufrufe • vor 1 Jahr •via X (Twitter)

LIVE

Anya Rossi• Live Now

Private livecam show

3 Kommentare

Profilbild von Inno Kean
Inno Keanvor 1 Jahr

Why the choice of the Mistral model? Speed?

Profilbild von stochastics
stochasticsvor 1 Jahr

Mistral 3.1-24B (IQ4 quantized) performed extremely well in my testing for speed, quality (namely with structured responses) and vram usage, given that I’m trying to fit the entire thing into 10gb of vram I’m waiting for @NousResearch to release an even better-performing tuned Hermes@edge variant

Profilbild von Greg Caplan 🚀
Greg Caplan 🚀vor 2 Jahren

Stop wasting time following up with leads. Let our AI agents do it for you.

Ähnliche Videos

Introducing `Personalized Agentic RAG` - where the LLM remembers key details about the user and automatically chooses the tool for RAG. We'll build: 👏 ChatGPT like memory ⚙️ Function calling 🧙 Multi-Agent orchestration code:
6:16

Introducing `Personalized Agentic RAG` - where the LLM remembers key details about the user and automatically chooses the tool for RAG. We'll build: 👏 ChatGPT like memory ⚙️ Function calling 🧙 Multi-Agent orchestration code:

Ashpreet Bedi

45,035 Aufrufe • vor 2 Jahren

LLama3 + Godot = "living NPCs" 🤯 All running on device. Zero cost. 100% private.
0:54

LLama3 + Godot = "living NPCs" 🤯 All running on device. Zero cost. 100% private.

Danny Postma

331,632 Aufrufe • vor 2 Jahren

DeepSeek R1 671B running on 2 M2 Ultras faster than reading speed. Getting close to open-source O1, at home, on consumer hardware. With mlx.distributed and mlx-lm, 3-bit quantization (~4 bpw)
0:54

DeepSeek R1 671B running on 2 M2 Ultras faster than reading speed. Getting close to open-source O1, at home, on consumer hardware. With mlx.distributed and mlx-lm, 3-bit quantization (~4 bpw)

Awni Hannun

865,941 Aufrufe • vor 1 Jahr

LLM running on Windows 98 PC 26 year old hardware with Intel Pentium II CPU and 128MB RAM. Uses llama98.c, our custom pure C inference engine based on Andrej Karpathy llama2.c Code and DIY guide 👇
0:48

LLM running on Windows 98 PC 26 year old hardware with Intel Pentium II CPU and 128MB RAM. Uses llama98.c, our custom pure C inference engine based on Andrej Karpathy llama2.c Code and DIY guide 👇

EXO Labs

483,010 Aufrufe • vor 1 Jahr

on the frontier of consumer wearables: building an egoless AI product in conversation with Mina Fahmi, building Sandbar between Mina's eloquence and our nyc galavanting, this conversation feels like a work of art. stoked to be able to share it dive in: 00:34 Mina's background 01:42 Robotics, neural interfaces, and hardware 06:06 Bringing nervous system work into designing AI products 10:25 Building with voice 12:38 AI extending self-concept 19:05 AI sycophancy 24:58 Agentic memory 30:11 Hardware decisions at Sandbar 34:16 Hiring at Sandbar 36:04 Bringing AI to more people
40:55

on the frontier of consumer wearables: building an egoless AI product in conversation with Mina Fahmi, building Sandbar between Mina's eloquence and our nyc galavanting, this conversation feels like a work of art. stoked to be able to share it dive in: 00:34 Mina's background 01:42 Robotics, neural interfaces, and hardware 06:06 Bringing nervous system work into designing AI products 10:25 Building with voice 12:38 AI extending self-concept 19:05 AI sycophancy 24:58 Agentic memory 30:11 Hardware decisions at Sandbar 34:16 Hiring at Sandbar 36:04 Bringing AI to more people

ashe

33,508 Aufrufe • vor 1 Monat

Owls hardware running with modified cat software.
1:03

Owls hardware running with modified cat software.

The Figen

40,811 Aufrufe • vor 9 Monaten

Foxes: cat software running on dog hardware.
0:38

Foxes: cat software running on dog hardware.

Nature is Amazing ☘️

6,538,164 Aufrufe • vor 1 Jahr

Foxes: cat software running on dog hardware.
0:38

Foxes: cat software running on dog hardware.

Nature is Amazing ☘️

983,861 Aufrufe • vor 8 Monaten

Build a local LLM app with RAG to chat with Google Drive data using Mistral or Llama-3 running locally on your computer without wiring a single line of Python Code (100% free and without internet):
0:35

Build a local LLM app with RAG to chat with Google Drive data using Mistral or Llama-3 running locally on your computer without wiring a single line of Python Code (100% free and without internet):

Shubham Saboo

189,592 Aufrufe • vor 1 Jahr

Yjs is the #1 library for collaborative editing on the web. Today we're announcing built-in Yjs support for Durable Streams. Use it to add multi-user and multi-agent collaboration to your AI apps and agentic systems. Links in the 🧵👇
1:10

Yjs is the #1 library for collaborative editing on the web. Today we're announcing built-in Yjs support for Durable Streams. Use it to add multi-user and multi-agent collaboration to your AI apps and agentic systems. Links in the 🧵👇

Electric

20,165 Aufrufe • vor 2 Monaten

Casually running a 180B parameter LLM on M2 Ultra
0:50

Casually running a 180B parameter LLM on M2 Ultra

Georgi Gerganov

683,186 Aufrufe • vor 2 Jahren

The best way to learn AI is to build with agents. To help with that, we've launched hands-on labs and a new series on Agentic Engineering. First topic: Agent Skills. Next in the pipeline: planning, context engineering, multi-agent systems, long-running agents,.. Go build!
9:09

The best way to learn AI is to build with agents. To help with that, we've launched hands-on labs and a new series on Agentic Engineering. First topic: Agent Skills. Next in the pipeline: planning, context engineering, multi-agent systems, long-running agents,.. Go build!

elvis

31,802 Aufrufe • vor 23 Tagen

Instant AutoGPT Launcher I wrote a launcher for AutoGPT today. Play with LLM agents using a ComfyUI-like node based interface. Even works with local LLM via ollama (shown in the video) Works on all platforms (windows, linux, mac). Install with 1 click. Use with 0 click.
0:45

Instant AutoGPT Launcher I wrote a launcher for AutoGPT today. Play with LLM agents using a ComfyUI-like node based interface. Even works with local LLM via ollama (shown in the video) Works on all platforms (windows, linux, mac). Install with 1 click. Use with 0 click.

cocktail peanut

11,405 Aufrufe • vor 1 Jahr

Preview of a Gaia 🌱 device! Turn-by-turn voice conversation with your own knowledge assistant (a Gaia node). 💸 $15 worth of hardware (pre-tariff!) 🌱 Voice-to-text, LLM and text-to-voice AI models on Gaia nodes 📖 Open source all-the-way — hardware, firmware, server, AI models 🦀 Rust all-the-way from firmware to AI server Notice how I switched to another language (Chinese) in the middle of the conversation and it seamlessly switched too. Very smart. PS. we are still optimizing performance before the software release.
1:24

Preview of a Gaia 🌱 device! Turn-by-turn voice conversation with your own knowledge assistant (a Gaia node). 💸 $15 worth of hardware (pre-tariff!) 🌱 Voice-to-text, LLM and text-to-voice AI models on Gaia nodes 📖 Open source all-the-way — hardware, firmware, server, AI models 🦀 Rust all-the-way from firmware to AI server Notice how I switched to another language (Chinese) in the middle of the conversation and it seamlessly switched too. Very smart. PS. we are still optimizing performance before the software release.

Michael Yuan

14,983 Aufrufe • vor 1 Jahr

Proud that Microsoft Edge is the first AI browser in the enterprise. - agentic actions - daily briefing - YouTube summarization - multi-tab analysis - search your history with natural language Bringing together the best of AI and enterprise-grade security.
1:00

Proud that Microsoft Edge is the first AI browser in the enterprise. - agentic actions - daily briefing - YouTube summarization - multi-tab analysis - search your history with natural language Bringing together the best of AI and enterprise-grade security.

Mustafa Suleyman

103,831 Aufrufe • vor 6 Monaten

- Multi agent simulation with LLM controlling game actions - Fully onchain maps, agent histories, worlds Smolworld
1:30

- Multi agent simulation with LLM controlling game actions - Fully onchain maps, agent histories, worlds Smolworld

✨ Smol Dev

51,869 Aufrufe • vor 1 Jahr

Introducing Warp 2.0: the Agentic Development Environment 1️⃣ Top overall coding agent: #1 on Terminal-Bench, 71% on SWE-bench Verified 2️⃣ Agent multi-threading: build features, debug, and ship all at once 3️⃣ The first all-in-one platform for agentic development 🧵 Learn more
2:26

Introducing Warp 2.0: the Agentic Development Environment 1️⃣ Top overall coding agent: #1 on Terminal-Bench, 71% on SWE-bench Verified 2️⃣ Agent multi-threading: build features, debug, and ship all at once 3️⃣ The first all-in-one platform for agentic development 🧵 Learn more

Warp

1,445,551 Aufrufe • vor 11 Monaten

Introducing: Cohere Command A+ We’ve created our most powerful LLM yet, optimized it to run on as little hardware as possible, and released it open-source for all.
1:07

Introducing: Cohere Command A+ We’ve created our most powerful LLM yet, optimized it to run on as little hardware as possible, and released it open-source for all.

Cohere

735,868 Aufrufe • vor 25 Tagen

Introducing 🥁🥁TxGemma! 🧪LLM for multiple therapeutic tasks for drug development 🤏2B, 9B, and 27B 🤗Fine-tunable with transformers 🤖Agentic-Tx for agentic systems Blog: Models:
0:35

Introducing 🥁🥁TxGemma! 🧪LLM for multiple therapeutic tasks for drug development 🤏2B, 9B, and 27B 🤗Fine-tunable with transformers 🤖Agentic-Tx for agentic systems Blog: Models:

Omar Sanseviero

19,482 Aufrufe • vor 1 Jahr

I just deployed an OpenClaw AI agent on NEAR AI running inside TEEs. Real agent. Real memory. Hardware-backed privacy. No prompt leakage. This is what “user-owned AI” actually looks like.
8:49

I just deployed an OpenClaw AI agent on NEAR AI running inside TEEs. Real agent. Real memory. Hardware-backed privacy. No prompt leakage. This is what “user-owned AI” actually looks like.

NEAR DevHub

21,039 Aufrufe • vor 4 Monaten