Video wird geladen...

Video konnte nicht geladen werden

Beim Laden dieses Videos ist ein Problem aufgetreten. Dies könnte an einem vorübergehenden Netzwerkproblem liegen oder das Video ist möglicherweise nicht verfügbar.

SOMEONE OPEN SOURCED A SMALL MODEL TRAINED SPECIFICALLY AS A PERSONAL AGENT ROUTER DECIDES WHAT RUNS LOCAL VS CLOUD AUTOMATICALLY ROUTES TASKS TO THE RIGHT MODEL BASED ON COMPLEXITY SMARTER AGENT ORCHESTRATION WITHOUT THE OVERHEAD

0xMarioNawfal

259,263 subscribers

157,664 Aufrufe • vor 6 Monaten •via X (Twitter)

Bildung Nachrichten & Politik Wissenschaft & Technologie

Anya Rossi• Live Now

Private livecam show

0 Kommentare

Keine Kommentare verfügbar

Kommentare vom Original-Post werden hier angezeigt

Ähnliche Videos

Built a model router with Jev by TypeSafe AI. Jev decides what model fits your request best and the request is sent to that model.

Built a model router with Jev by TypeSafe AI. Jev decides what model fits your request best and the request is sent to that model.

Duncan

116,081 Aufrufe • vor 9 Tagen

ANTHROPIC AND OPENAI BOTH MISSED THIS. Someone just open-sourced one SDK that gives AI agents a mouse, keyboard, and screen across macOS, Linux, and Windows. It's called CUA. Same code drives a local VM or a cloud sandbox regardless of the OS. Your agent sees the screen, clicks, types, and runs shell commands like a real user. > Benchmark against OSWorld and ScreenSpot > Export trajectories for model training > Near-native performance on Apple Silicon No separate SDK per OS. No infrastructure headache. 100% Free. Open Source.

ANTHROPIC AND OPENAI BOTH MISSED THIS. Someone just open-sourced one SDK that gives AI agents a mouse, keyboard, and screen across macOS, Linux, and Windows. It's called CUA. Same code drives a local VM or a cloud sandbox regardless of the OS. Your agent sees the screen, clicks, types, and runs shell commands like a real user. > Benchmark against OSWorld and ScreenSpot > Export trajectories for model training > Near-native performance on Apple Silicon No separate SDK per OS. No infrastructure headache. 100% Free. Open Source.

Simplifying AI

33,386 Aufrufe • vor 2 Monaten

I explored a further possibility with local models: Qwen3.6 35B A3B + NVIDIA LocateAnything-3B as a local Computer Use agent (proof of concept). In the demo, I asked it to switch my Mac to light mode. It did. Then back to dark. Did that too — finding the right toggle in System Settings, clicking it, and verifying the change itself. It's fully screenshot-based, so no Accessibility API needed. If it's on screen, the agent can see it and act on it. This runs entirely on your own hardware — private, local, built from two small open models.

I explored a further possibility with local models: Qwen3.6 35B A3B + NVIDIA LocateAnything-3B as a local Computer Use agent (proof of concept). In the demo, I asked it to switch my Mac to light mode. It did. Then back to dark. Did that too — finding the right toggle in System Settings, clicking it, and verifying the change itself. It's fully screenshot-based, so no Accessibility API needed. If it's on screen, the agent can see it and act on it. This runs entirely on your own hardware — private, local, built from two small open models.

stevibe

44,248 Aufrufe • vor 3 Monaten

Claude Code's new dynamic workflow is the real deal. 🤖 Why it matters: It's not just a chain of prompts — it's an autonomous agent swarm. 1. Set model to Opus 4.8 + reasoning effort /ultracode 2. Claude detects complexity, writes orchestration script on the fly 3. Spawns a parallel fleet of coordinated subagents Operator takeaway: This is the first time I've seen an agent actually decompose and delegate autonomously without a rigid framework. Have you tried it yet? 🚀

Claude Code's new dynamic workflow is the real deal. 🤖 Why it matters: It's not just a chain of prompts — it's an autonomous agent swarm. 1. Set model to Opus 4.8 + reasoning effort /ultracode 2. Claude detects complexity, writes orchestration script on the fly 3. Spawns a parallel fleet of coordinated subagents Operator takeaway: This is the first time I've seen an agent actually decompose and delegate autonomously without a rigid framework. Have you tried it yet? 🚀

EK

197,752 Aufrufe • vor 4 Monaten

Funny how you can do the same thing with a local model without sending all your data to a remote cloud.

Funny how you can do the same thing with a local model without sending all your data to a remote cloud.

Victor M

1,197,140 Aufrufe • vor 8 Monaten

New open-source agent harness just landed! I got early access to TrueForge by TrueFoundry and have been running it locally for the past few days. The harness layer deserves as much attention as the model, and open source matters here because you can inspect the loop, run it on your own infrastructure, and swap to the latest or cheaper models. TrueForge handles the runtime work that makes an agent reliable. It drives the tool-calling loop, manages context, coordinates subagents, and executes code in a sandbox, with any model you choose. Every tool call re-sends the growing context to the model, so in practice the harness controls most of what an agent costs to run. A few things stood out from my testing and their published benchmarks. Vendor-Neutral by design. It runs OpenAI, Anthropic, and Google models alongside open-weight models like Kimi, GLM, and DeepSeek. Model routing is a setting, and you can send each task to the model that fits it. On a 14-task enterprise agent benchmark, it matched the accuracy of Claude Managed Agents running the same Opus 4.8 model at roughly 30% lower cost per run (3.8M tokens vs 10M for the same answers). Routing the same tasks to GLM-5.2 held accuracy and brought cost down by about 75%, around $3 per run instead of $12. Fully self-hosted and Open Source (MIT License). I had it running locally with one command, with sandboxed code execution working out of the box. It's time to own your agent harness. Thanks to TrueFoundry for partnering on this post.

New open-source agent harness just landed! I got early access to TrueForge by TrueFoundry and have been running it locally for the past few days. The harness layer deserves as much attention as the model, and open source matters here because you can inspect the loop, run it on your own infrastructure, and swap to the latest or cheaper models. TrueForge handles the runtime work that makes an agent reliable. It drives the tool-calling loop, manages context, coordinates subagents, and executes code in a sandbox, with any model you choose. Every tool call re-sends the growing context to the model, so in practice the harness controls most of what an agent costs to run. A few things stood out from my testing and their published benchmarks. Vendor-Neutral by design. It runs OpenAI, Anthropic, and Google models alongside open-weight models like Kimi, GLM, and DeepSeek. Model routing is a setting, and you can send each task to the model that fits it. On a 14-task enterprise agent benchmark, it matched the accuracy of Claude Managed Agents running the same Opus 4.8 model at roughly 30% lower cost per run (3.8M tokens vs 10M for the same answers). Routing the same tasks to GLM-5.2 held accuracy and brought cost down by about 75%, around $3 per run instead of $12. Fully self-hosted and Open Source (MIT License). I had it running locally with one command, with sandboxed code execution working out of the box. It's time to own your agent harness. Thanks to TrueFoundry for partnering on this post.

elvis

11,303 Aufrufe • vor 1 Monat

What if your model handled its own tuning? ⚙️ With NVIDIA TAO 7, just prompt your coding agent what you want in plain language and let it do the rest. • Agent skills plug into your coding agent and improve accuracy. • AutoML removes the guesswork from hyperparameters. LLM-guided tuning finds strong configs up to 2x faster. • Fine-tune any Hugging Face CV or VLM model on local NVIDIA GPUs. • Data enhanced fine-tuning helps your agent identify why the model fails, then fix it. Try TAO skills ➡️

What if your model handled its own tuning? ⚙️ With NVIDIA TAO 7, just prompt your coding agent what you want in plain language and let it do the rest. • Agent skills plug into your coding agent and improve accuracy. • AutoML removes the guesswork from hyperparameters. LLM-guided tuning finds strong configs up to 2x faster. • Fine-tune any Hugging Face CV or VLM model on local NVIDIA GPUs. • Data enhanced fine-tuning helps your agent identify why the model fails, then fix it. Try TAO skills ➡️

NVIDIA AI

42,294 Aufrufe • vor 2 Monaten

Turn your Cursor agent window into a deck builder. Composer 2.5 + open-slide is a great combo - the model handles design and generation cleanly, and the browser integration lets you watch the deck come together live as the agent works. $ 𝚗𝚙𝚡 @𝚘𝚙𝚎𝚗-𝚜𝚕𝚒𝚍𝚎/𝚌𝚕𝚒 𝚒𝚗𝚒𝚝

Turn your Cursor agent window into a deck builder. Composer 2.5 + open-slide is a great combo - the model handles design and generation cleanly, and the browser integration lets you watch the deck come together live as the agent works. $ 𝚗𝚙𝚡 @𝚘𝚙𝚎𝚗-𝚜𝚕𝚒𝚍𝚎/𝚌𝚕𝚒 𝚒𝚗𝚒𝚝

Yiwei Ho

16,541 Aufrufe • vor 4 Monaten

Let me explain the agent loop, simple It's the core of every agentic system, and the part most people overcomplicate It's just this: 1. Send messages to the model 2. Model responds, maybe calls a tool 3. You run the tool 4. Append the result back to messages 5. Repeat until stop_reason is end_turn Step 4 is the whole thing, the write-back is what makes it an agent The model has to see what actually happened before it decides the next move That's the entire loop... understand this cold before you reach for a framework

Let me explain the agent loop, simple It's the core of every agentic system, and the part most people overcomplicate It's just this: 1. Send messages to the model 2. Model responds, maybe calls a tool 3. You run the tool 4. Append the result back to messages 5. Repeat until stop_reason is end_turn Step 4 is the whole thing, the write-back is what makes it an agent The model has to see what actually happened before it decides the next move That's the entire loop... understand this cold before you reach for a framework

Daniel San

12,514 Aufrufe • vor 3 Monaten

I love this opensource project! Someone just put a 28.9M parameter AI model on an ESP32-S3. A chip that costs only a few dollars. No cloud. No API. No internet. It runs locally at ~9.5 tokens/s and can generate stories on a tiny screen. This changes the way we think about AI hardware. The next generation of AI toys, robots, and IoT devices may not need the cloud at all. Small chips are getting smarter. 🤖

I love this opensource project! Someone just put a 28.9M parameter AI model on an ESP32-S3. A chip that costs only a few dollars. No cloud. No API. No internet. It runs locally at ~9.5 tokens/s and can generate stories on a tiny screen. This changes the way we think about AI hardware. The next generation of AI toys, robots, and IoT devices may not need the cloud at all. Small chips are getting smarter. 🤖

Steven Cheng

105,332 Aufrufe • vor 1 Monat

let me save you 3 hours of head scratching. if you're running local models like Qwen3.5-35B-A3B through Claude Code via llama.cpp's Anthropic endpoint, the chain will break every 3 to 5 minutes. tool call fails. flow stops. you reprompt. it recovers. 2 minutes later it stops again. the model is fine. the harness chokes on local inference latency. switch to OpenCode. same localhost endpoint. same model. same GPU. the chain doesn't break. the tradeoff: OpenCode sometimes loops. the model forgets what it already read and repeats the same tool call. but a loop you can interrupt. a broken chain kills your momentum and you start over. watch both side by side. proprietary agent vs open source agent. same 3B model. different failure modes. pick your poison.

let me save you 3 hours of head scratching. if you're running local models like Qwen3.5-35B-A3B through Claude Code via llama.cpp's Anthropic endpoint, the chain will break every 3 to 5 minutes. tool call fails. flow stops. you reprompt. it recovers. 2 minutes later it stops again. the model is fine. the harness chokes on local inference latency. switch to OpenCode. same localhost endpoint. same model. same GPU. the chain doesn't break. the tradeoff: OpenCode sometimes loops. the model forgets what it already read and repeats the same tool call. but a loop you can interrupt. a broken chain kills your momentum and you start over. watch both side by side. proprietary agent vs open source agent. same 3B model. different failure modes. pick your poison.

Sudo su

72,554 Aufrufe • vor 6 Monaten

Google has open-sourced GNM Head, its parametric model for generating 3D human heads The model, based on real-world scan data, provides 250 controls for head shape, and 380+ for facial expressions A free add-on integrates it into Blender #B3D

Google has open-sourced GNM Head, its parametric model for generating 3D human heads The model, based on real-world scan data, provides 250 controls for head shape, and 380+ for facial expressions A free add-on integrates it into Blender #B3D

CG Channel

46,823 Aufrufe • vor 2 Monaten

𝗧𝗵𝗲 𝟰 𝗟𝗮𝘆𝗲𝗿𝘀 𝗼𝗳 𝗮𝗻 𝗔𝗴𝗲𝗻𝘁 𝗦𝘆𝘀𝘁𝗲𝗺 An agent can burn tokens, declare success, and still fail the tests. That’s often an architecture problem, not a prompting problem. 𝟭. 𝗟𝗼𝗼𝗽 → Decides whether to continue Acts → verifies → retries until there’s evidence of success. 𝟮. 𝗚𝗿𝗮𝗽𝗵 → Decides what runs next Handles branches, retries, handoffs, fallbacks, and shared state. 𝟯. 𝗛𝗮𝗿𝗻𝗲𝘀𝘀 → Gives the model its capabilities Tools, APIs, files, memory, permissions, context, and execution environment. 𝟰. 𝗠𝗲𝘁𝗮-𝗛𝗮𝗿𝗻𝗲𝘀𝘀 → Governs multiple agent environments Coordinates different agents, tools, policies, permissions, and workflows. 𝗧𝗵𝗲 𝗺𝗲𝗻𝘁𝗮𝗹 𝗺𝗼𝗱𝗲𝗹: Loop = verification Graph = workflow Harness = capability Meta-harness = governance A better model can improve reasoning. But reliable agents depend on the architecture built around the model.

𝗧𝗵𝗲 𝟰 𝗟𝗮𝘆𝗲𝗿𝘀 𝗼𝗳 𝗮𝗻 𝗔𝗴𝗲𝗻𝘁 𝗦𝘆𝘀𝘁𝗲𝗺 An agent can burn tokens, declare success, and still fail the tests. That’s often an architecture problem, not a prompting problem. 𝟭. 𝗟𝗼𝗼𝗽 → Decides whether to continue Acts → verifies → retries until there’s evidence of success. 𝟮. 𝗚𝗿𝗮𝗽𝗵 → Decides what runs next Handles branches, retries, handoffs, fallbacks, and shared state. 𝟯. 𝗛𝗮𝗿𝗻𝗲𝘀𝘀 → Gives the model its capabilities Tools, APIs, files, memory, permissions, context, and execution environment. 𝟰. 𝗠𝗲𝘁𝗮-𝗛𝗮𝗿𝗻𝗲𝘀𝘀 → Governs multiple agent environments Coordinates different agents, tools, policies, permissions, and workflows. 𝗧𝗵𝗲 𝗺𝗲𝗻𝘁𝗮𝗹 𝗺𝗼𝗱𝗲𝗹: Loop = verification Graph = workflow Harness = capability Meta-harness = governance A better model can improve reasoning. But reliable agents depend on the architecture built around the model.

Dhairya Karekar

18,724 Aufrufe • vor 21 Tagen

We're excited to power LemonSlice's new video agent product. Turn your real-time voice agent into a video agent using a single photo. The underlying model—which autoscales on Modal 😉—streams infinite-length talking video at 20fps using a single GPU.

We're excited to power LemonSlice's new video agent product. Turn your real-time voice agent into a video agent using a single photo. The underlying model—which autoscales on Modal 😉—streams infinite-length talking video at 20fps using a single GPU.

Modal

17,225 Aufrufe • vor 9 Monaten

i found a way to make UNCENSORED AI AGENT on a RTX 4090 GPU (!!!) with LOCAL 30B model weights this is GLM-4.7-Flash with abliteration, need 24GB VRAM, safety alignment surgically removed from the weights, the model has native tool calling, it actually executes bash, edits files, runs git (1) use ollama to pull weights of GLM > ollama pull huihui_ai/glm-4.7-flash-abliterated:q4_K (2) proxy it to any coding agent via ollama > ollama launch claude --model huihui_ai/glm-4.7-flash-abliterated:q4_K > ollama launch codex --model huihui_ai/glm-4.7-flash-abliterated:q4_K > ollama launch opencode --model huihui_ai/glm-4.7-flash-abliterated:q4_K (3) have fun

i found a way to make UNCENSORED AI AGENT on a RTX 4090 GPU (!!!) with LOCAL 30B model weights this is GLM-4.7-Flash with abliteration, need 24GB VRAM, safety alignment surgically removed from the weights, the model has native tool calling, it actually executes bash, edits files, runs git (1) use ollama to pull weights of GLM > ollama pull huihui_ai/glm-4.7-flash-abliterated:q4_K (2) proxy it to any coding agent via ollama > ollama launch claude --model huihui_ai/glm-4.7-flash-abliterated:q4_K > ollama launch codex --model huihui_ai/glm-4.7-flash-abliterated:q4_K > ollama launch opencode --model huihui_ai/glm-4.7-flash-abliterated:q4_K (3) have fun

chiefofautism

342,264 Aufrufe • vor 7 Monaten

Meet Husky: a Model-Specific Inference (MSI) engine up to 4.5× faster than Apple's MLX Woof, Underdog's Pareto frontier model, now runs up to 730 tokens/sec on a MacBook Finally local models are as fast & capable. Try it now in - your personal private AI

Meet Husky: a Model-Specific Inference (MSI) engine up to 4.5× faster than Apple's MLX Woof, Underdog's Pareto frontier model, now runs up to 730 tokens/sec on a MacBook Finally local models are as fast & capable. Try it now in - your personal private AI

Sigil Wen

424,598 Aufrufe • vor 4 Tagen

Open weight models are now available in Kiro. Three open weight models are available in the IDE and CLI, so you don’t have to default to the largest model for every task. Choose the right model based on speed, cost, or long-running agentic workflows. What model would you like to see supported next? #Kiro #BuildwithKiro #AICoding

Open weight models are now available in Kiro. Three open weight models are available in the IDE and CLI, so you don’t have to default to the largest model for every task. Choose the right model based on speed, cost, or long-running agentic workflows. What model would you like to see supported next? #Kiro #BuildwithKiro #AICoding

Kiro

22,214 Aufrufe • vor 7 Monaten