Video wird geladen...

Video konnte nicht geladen werden

Beim Laden dieses Videos ist ein Problem aufgetreten. Dies könnte an einem vorübergehenden Netzwerkproblem liegen oder das Video ist möglicherweise nicht verfügbar.

You waste hours downloading models that don't run on your hardware. This tool fixes that in one command. It's called llmfit. It scans your RAM, CPU, and GPU, then scores every model in its catalog for fit, speed, and quality, so you know what runs before you download anything.... show more

Simplifying AI

37,436 subscribers

47,128 Aufrufe • vor 1 Monat •via X (Twitter)

Anya Rossi• Live Now

Private livecam show

0 Kommentare

Keine Kommentare verfügbar

Kommentare vom Original-Post werden hier angezeigt

Ähnliche Videos

You can now understand any codebase instantly with this free tool. It's called Understand Anything. It scans your entire project and builds an interactive visual map of every file, function, class, and dependency. Click anything. Search anything. Ask questions about it directly. Works with Claude Code, Codex, Cursor, Copilot, and Gemini CLI. One command to install. 100% Free. Open Source.

You can now understand any codebase instantly with this free tool. It's called Understand Anything. It scans your entire project and builds an interactive visual map of every file, function, class, and dependency. Click anything. Search anything. Ask questions about it directly. Works with Claude Code, Codex, Cursor, Copilot, and Gemini CLI. One command to install. 100% Free. Open Source.

Simplifying AI

22,410 Aufrufe • vor 1 Monat

Something NVIDIA & Google do better than anyone else is software-hardware-system co-design, and not just optimizing hardware for current model architectures, but predicting future ones. Back in early 2022, when NVIDIA started the design process for NVL72, MoE (Mixture of Experts) models were not yet the standard, and dense models were still dominant for frontier models. However, NVIDIA's strong software-hardware co-design culture enabled them to make a calculated bet that MoEs were the future, and they built NVL72 specifically for best MoE performance per TCO (Total Cost of Ownership). Furthermore, back in 2022, disaggregated prefill and wide expert parallelism (wideEP) MoE inference optimizations hadn't been invented yet, but it turns out that these MoE inference optimizations work best on large-scale systems like NVL72. While most other AI chip companies' in-house AI labs focus on training small 5B models that mainly use data parallelism, NVIDIA and Google's in-house AI labs continuously push the boundaries of model architecture and training recipes, such as NVFP4 training. Just like Super Idol & IShowSpeed, there must be a strong partnership between software engineers and hardware engineers to deliver the best systems that maximize performance per TCO.

Something NVIDIA & Google do better than anyone else is software-hardware-system co-design, and not just optimizing hardware for current model architectures, but predicting future ones. Back in early 2022, when NVIDIA started the design process for NVL72, MoE (Mixture of Experts) models were not yet the standard, and dense models were still dominant for frontier models. However, NVIDIA's strong software-hardware co-design culture enabled them to make a calculated bet that MoEs were the future, and they built NVL72 specifically for best MoE performance per TCO (Total Cost of Ownership). Furthermore, back in 2022, disaggregated prefill and wide expert parallelism (wideEP) MoE inference optimizations hadn't been invented yet, but it turns out that these MoE inference optimizations work best on large-scale systems like NVL72. While most other AI chip companies' in-house AI labs focus on training small 5B models that mainly use data parallelism, NVIDIA and Google's in-house AI labs continuously push the boundaries of model architecture and training recipes, such as NVFP4 training. Just like Super Idol & IShowSpeed, there must be a strong partnership between software engineers and hardware engineers to deliver the best systems that maximize performance per TCO.

SemiAnalysis

51,021 Aufrufe • vor 9 Monaten

Holy shit... Microsoft open sourced an inference framework that runs a 100B parameter LLM on a single CPU. It's called BitNet. And it does what was supposed to be impossible. No GPU. No cloud. No $10K hardware setup. Just your laptop running a 100-billion parameter model at human reading speed. Here's how it works: Every other LLM stores weights in 32-bit or 16-bit floats. BitNet uses 1.58 bits. Weights are ternary just -1, 0, or +1. That's it. No floats. No expensive matrix math. Pure integer operations your CPU was already built for. The result: - 100B model runs on a single CPU at 5-7 tokens/second - 2.37x to 6.17x faster than llama.cpp on x86 - 82% lower energy consumption on x86 CPUs - 1.37x to 5.07x speedup on ARM (your MacBook) - Memory drops by 16-32x vs full-precision models The wildest part: Accuracy barely moves. BitNet b1.58 2B4T their flagship model was trained on 4 trillion tokens and benchmarks competitively against full-precision models of the same size. The quantization isn't destroying quality. It's just removing the bloat. What this actually means: - Run AI completely offline. Your data never leaves your machine - Deploy LLMs on phones, IoT devices, edge hardware - No more cloud API bills for inference - AI in regions with no reliable internet The model supports ARM and x86. Works on your MacBook, your Linux box, your Windows machine. 27.4K GitHub stars. 2.2K forks. Built by Microsoft Research. 100% Open Source. MIT License.

Holy shit... Microsoft open sourced an inference framework that runs a 100B parameter LLM on a single CPU. It's called BitNet. And it does what was supposed to be impossible. No GPU. No cloud. No $10K hardware setup. Just your laptop running a 100-billion parameter model at human reading speed. Here's how it works: Every other LLM stores weights in 32-bit or 16-bit floats. BitNet uses 1.58 bits. Weights are ternary just -1, 0, or +1. That's it. No floats. No expensive matrix math. Pure integer operations your CPU was already built for. The result: - 100B model runs on a single CPU at 5-7 tokens/second - 2.37x to 6.17x faster than llama.cpp on x86 - 82% lower energy consumption on x86 CPUs - 1.37x to 5.07x speedup on ARM (your MacBook) - Memory drops by 16-32x vs full-precision models The wildest part: Accuracy barely moves. BitNet b1.58 2B4T their flagship model was trained on 4 trillion tokens and benchmarks competitively against full-precision models of the same size. The quantization isn't destroying quality. It's just removing the bloat. What this actually means: - Run AI completely offline. Your data never leaves your machine - Deploy LLMs on phones, IoT devices, edge hardware - No more cloud API bills for inference - AI in regions with no reliable internet The model supports ARM and x86. Works on your MacBook, your Linux box, your Windows machine. 27.4K GitHub stars. 2.2K forks. Built by Microsoft Research. 100% Open Source. MIT License.

Guri Singh

2,180,357 Aufrufe • vor 5 Monaten

90% of "AI developers" just download pre packaged GGUF files from Hugging Face, hit run, and call it a day. The top 10% know how to pull the raw safetensors, run the math, and quantize massive models into Q4_K_M themselves. If you think llama.cpp can only execute models, you’re missing the best part of the open source ecosystem. It’s a high performance optimization suite. Manually stripping 69% of the VRAM footprint off a brand new model architecture is where real infrastructure value is made. If you want to actually master local inference and deploy models like Google’s massive Gemma 4 12B it on consumer NVIDIA hardware using llama.cpp, you need to learn this pipeline. Let's build it. I just took the raw 22.7 GB Gemma 4 baseline and manually compressed it down to a 7.02 GB Q4_K_M GGUF artifact using llama.cpp. That is a 69% reduction in footprint. No quality loss. No VRAM bottlenecks. Just native, hardware accelerated C++ inference running a full 2,50,000 token context window on a dual NVIDIA Tesla T4 setup. Stop melting your VRAM on unoptimized weights and stop relying on other people's pipelines. Own your stack. I mapped this entire architecture from dynamic binary fetching to raw quantization and real time GPU streaming into a single, bulletproof notebook. Notebook link is in the comments below. Bookmark this blueprint for your next deployment and tell me which quantization works best for your workflow and model.

Alok

62,631 Aufrufe • vor 1 Monat

"Where will AI get its compute?" We generated this video - character, voice, acting - with a single prompt on LTX-2.3. The model runs on consumer-grade GPUs. The same ones sitting in your PC right now. That's the whole point of DePIN. Your hardware powers AI that didn't exist two years ago. And you get paid for it.

"Where will AI get its compute?" We generated this video - character, voice, acting - with a single prompt on LTX-2.3. The model runs on consumer-grade GPUs. The same ones sitting in your PC right now. That's the whole point of DePIN. Your hardware powers AI that didn't exist two years ago. And you get paid for it.

GamerHash AI

430,760 Aufrufe • vor 4 Monaten

THIS FREE CHINESE AI MODEL RUNS LOCALLY FOREVER AND BUILDS ANYTHING YOU CAN IMAGINE - INCLUDING FULL OPEN WORLD GAMES GLM 5.2 - open, local, free forever - no bills, no limits, no subscription want an open world game with multiplayer - describe it, it builds - want business automation - builds that too - literally anything running 24/7 same as Claude and GPT at $200/month - on your own machine, forever free - saves $2,400/year in subscriptions responds in 2-3 seconds - your computer, your speed, nobody in the queue ahead of you whoever finds out about this today saves thousands and ships a real product before everyone still waiting for the perfect tool

THIS FREE CHINESE AI MODEL RUNS LOCALLY FOREVER AND BUILDS ANYTHING YOU CAN IMAGINE - INCLUDING FULL OPEN WORLD GAMES GLM 5.2 - open, local, free forever - no bills, no limits, no subscription want an open world game with multiplayer - describe it, it builds - want business automation - builds that too - literally anything running 24/7 same as Claude and GPT at $200/month - on your own machine, forever free - saves $2,400/year in subscriptions responds in 2-3 seconds - your computer, your speed, nobody in the queue ahead of you whoever finds out about this today saves thousands and ships a real product before everyone still waiting for the perfect tool

Noisy

23,517 Aufrufe • vor 2 Monaten

This tool is literally Higgsfield AI but FREE for good. It's called Wan2GP. A full AI video studio built specifically for people without expensive hardware. Runs on as little as 6GB of VRAM, even old RTX 10-series cards and 8GB laptops. Everything stays on your machine, no uploads, no caps, no watermarks. What you get in one app: • Text-to-video and image-to-video generation • The best open models built in: Wan 2.2, LTX-2, Hunyuan Video, Flux • A full browser interface with a queue system • LoRA support to customize any model • Mask editor and prompt enhancer included A 5-second clip generates in minutes on a mid-range gaming rig. No subscription, ever. 100% Free. Open Source.

This tool is literally Higgsfield AI but FREE for good. It's called Wan2GP. A full AI video studio built specifically for people without expensive hardware. Runs on as little as 6GB of VRAM, even old RTX 10-series cards and 8GB laptops. Everything stays on your machine, no uploads, no caps, no watermarks. What you get in one app: • Text-to-video and image-to-video generation • The best open models built in: Wan 2.2, LTX-2, Hunyuan Video, Flux • A full browser interface with a queue system • LoRA support to customize any model • Mask editor and prompt enhancer included A 5-second clip generates in minutes on a mid-range gaming rig. No subscription, ever. 100% Free. Open Source.

Simplifying AI

177,742 Aufrufe • vor 24 Tagen

I still think Hermes agent is the most slept-on AI tool of 2026. For literally $6/mo, you can launch multiple subagents that work for you 24/7. Most people don't know you can do this, but it's a complete game-changer. Instead of one Hermes assistant doing everything sequentially, you run specialized agents in parallel, each with its own job, its own context, and its own memory. Practical example: → Research agent: scans your watchlist and competitors overnight, delivers a morning brief → Content agent: drafts and schedules your posts based on what's trending in your niche → Ops agent: manages your inbox, flags anything urgent, drafts replies for your review All three can run simultaneously and improve over time. How to start: 1. Install Hermes Terminal command: curl -fsSL | bash (can also download desktop) 2. Prompting Simply tell Hermes directly: "I want to run separate subagents for [task 1], [task 2], and [task 3]. Set them up to run independently and report back to me." For the cheapest setup, you can use a $4/month VPS with Hostinger, plug in DeepSeek V4 Flash as your default model. There isn't another AI tool with this much value in 2026. Hermes is still so underrated.

I still think Hermes agent is the most slept-on AI tool of 2026. For literally $6/mo, you can launch multiple subagents that work for you 24/7. Most people don't know you can do this, but it's a complete game-changer. Instead of one Hermes assistant doing everything sequentially, you run specialized agents in parallel, each with its own job, its own context, and its own memory. Practical example: → Research agent: scans your watchlist and competitors overnight, delivers a morning brief → Content agent: drafts and schedules your posts based on what's trending in your niche → Ops agent: manages your inbox, flags anything urgent, drafts replies for your review All three can run simultaneously and improve over time. How to start: 1. Install Hermes Terminal command: curl -fsSL | bash (can also download desktop) 2. Prompting Simply tell Hermes directly: "I want to run separate subagents for [task 1], [task 2], and [task 3]. Set them up to run independently and report back to me." For the cheapest setup, you can use a $4/month VPS with Hostinger, plug in DeepSeek V4 Flash as your default model. There isn't another AI tool with this much value in 2026. Hermes is still so underrated.

Miles Deutscher

81,972 Aufrufe • vor 1 Monat

New open-source agent harness just landed! I got early access to TrueForge by TrueFoundry and have been running it locally for the past few days. The harness layer deserves as much attention as the model, and open source matters here because you can inspect the loop, run it on your own infrastructure, and swap to the latest or cheaper models. TrueForge handles the runtime work that makes an agent reliable. It drives the tool-calling loop, manages context, coordinates subagents, and executes code in a sandbox, with any model you choose. Every tool call re-sends the growing context to the model, so in practice the harness controls most of what an agent costs to run. A few things stood out from my testing and their published benchmarks. Vendor-Neutral by design. It runs OpenAI, Anthropic, and Google models alongside open-weight models like Kimi, GLM, and DeepSeek. Model routing is a setting, and you can send each task to the model that fits it. On a 14-task enterprise agent benchmark, it matched the accuracy of Claude Managed Agents running the same Opus 4.8 model at roughly 30% lower cost per run (3.8M tokens vs 10M for the same answers). Routing the same tasks to GLM-5.2 held accuracy and brought cost down by about 75%, around $3 per run instead of $12. Fully self-hosted and Open Source (MIT License). I had it running locally with one command, with sandboxed code execution working out of the box. It's time to own your agent harness. Thanks to TrueFoundry for partnering on this post.

New open-source agent harness just landed! I got early access to TrueForge by TrueFoundry and have been running it locally for the past few days. The harness layer deserves as much attention as the model, and open source matters here because you can inspect the loop, run it on your own infrastructure, and swap to the latest or cheaper models. TrueForge handles the runtime work that makes an agent reliable. It drives the tool-calling loop, manages context, coordinates subagents, and executes code in a sandbox, with any model you choose. Every tool call re-sends the growing context to the model, so in practice the harness controls most of what an agent costs to run. A few things stood out from my testing and their published benchmarks. Vendor-Neutral by design. It runs OpenAI, Anthropic, and Google models alongside open-weight models like Kimi, GLM, and DeepSeek. Model routing is a setting, and you can send each task to the model that fits it. On a 14-task enterprise agent benchmark, it matched the accuracy of Claude Managed Agents running the same Opus 4.8 model at roughly 30% lower cost per run (3.8M tokens vs 10M for the same answers). Routing the same tasks to GLM-5.2 held accuracy and brought cost down by about 75%, around $3 per run instead of $12. Fully self-hosted and Open Source (MIT License). I had it running locally with one command, with sandboxed code execution working out of the box. It's time to own your agent harness. Thanks to TrueFoundry for partnering on this post.

elvis

11,303 Aufrufe • vor 2 Tagen

THIS SHELF OF MAC MINIS REPLACES $4,080 A YEAR IN AI SUBSCRIPTIONS 00:02 the camera pans across a shelf of stacked Mac minis and the trick is obvious: that silent little farm runs the models you rent every month most people pay 7 companies for AI and use 3 of the tools. they forget the rest on the credit card and call it a stack the Mac mini M4 ends that. one shared memory pool means a $599 box runs 7B and 8B models faster than Windows machines that cost twice as much ollama pull, one command. open webui in one docker line. point Claude Code at localhost and it just works it draws 10 to 30 watts, sits silent next to a router, and runs 24/7 for $3 a month in power it pays back a $20 ChatGPT Plus sub in 3 months, then saves you $4,000 a year while the frontier still rents you compute every month you wait is another $340 gone for compute that fits on a shelf

THIS SHELF OF MAC MINIS REPLACES $4,080 A YEAR IN AI SUBSCRIPTIONS 00:02 the camera pans across a shelf of stacked Mac minis and the trick is obvious: that silent little farm runs the models you rent every month most people pay 7 companies for AI and use 3 of the tools. they forget the rest on the credit card and call it a stack the Mac mini M4 ends that. one shared memory pool means a $599 box runs 7B and 8B models faster than Windows machines that cost twice as much ollama pull, one command. open webui in one docker line. point Claude Code at localhost and it just works it draws 10 to 30 watts, sits silent next to a router, and runs 24/7 for $3 a month in power it pays back a $20 ChatGPT Plus sub in 3 months, then saves you $4,000 a year while the frontier still rents you compute every month you wait is another $340 gone for compute that fits on a shelf

Fokki

12,933 Aufrufe • vor 1 Monat

1.7 billion free tokens per month. A month ago i showed you how to route claude code through free providers. someone just shipped the cleanest version of this setup yet… it's called Freellmapi 13,400+ stars on github, MIT licensed, takes 2 minutes to install. what it does: stacks the free tiers of 16 different LLM providers behind one local API. point claude code, codex, or cursor at that one endpoint, and it automatically routes your calls across all 16 free pools. The 16 providers it covers: Google, Groq, Cerebras, Mistral, OpenRouter, GitHub Models, Cloudflare, Cohere, NVIDIA, HuggingFace, Ollama Cloud, Kilo, Pollinations, LLM7, OVH, and OpenCode Zen. if you sign up to all 16 and add your free API keys, you get roughly 1.7 billion free tokens per month combined. ▫️ How to install (one command) curl -fsSL bash this runs the whole thing locally on your machine through Docker. once it's up, open paste your provider keys on the Keys page, and grab the unified API key from the dashboard. that's the key you point your apps at. With this, claude code stops hitting your monthly cap because every prompt routes through the 16 free pools instead of your paid plan. and if one provider rate-limits mid-conversation, freellmapi falls over to the next one automatically so your session never breaks. repo: Free, MIT-licensed, runs on your laptop or a $5 VPS.

1.7 billion free tokens per month. A month ago i showed you how to route claude code through free providers. someone just shipped the cleanest version of this setup yet… it's called Freellmapi 13,400+ stars on github, MIT licensed, takes 2 minutes to install. what it does: stacks the free tiers of 16 different LLM providers behind one local API. point claude code, codex, or cursor at that one endpoint, and it automatically routes your calls across all 16 free pools. The 16 providers it covers: Google, Groq, Cerebras, Mistral, OpenRouter, GitHub Models, Cloudflare, Cohere, NVIDIA, HuggingFace, Ollama Cloud, Kilo, Pollinations, LLM7, OVH, and OpenCode Zen. if you sign up to all 16 and add your free API keys, you get roughly 1.7 billion free tokens per month combined. ▫️ How to install (one command) curl -fsSL bash this runs the whole thing locally on your machine through Docker. once it's up, open paste your provider keys on the Keys page, and grab the unified API key from the dashboard. that's the key you point your apps at. With this, claude code stops hitting your monthly cap because every prompt routes through the 16 free pools instead of your paid plan. and if one provider rate-limits mid-conversation, freellmapi falls over to the next one automatically so your session never breaks. repo: Free, MIT-licensed, runs on your laptop or a $5 VPS.

Axel Bitblaze 🪓

47,734 Aufrufe • vor 1 Monat

A peanut-sized Chinese model just dethroned Gemini at reading documents. GLM-OCR is a 0.9B parameter vision-language model. It scores 94.62 on OmniDocBench V1.5, ranking #1 overall. For context, it outperforms models 100x its size. 100% open-source. It works in two stages. 1. A layout engine detects every region in a document. 2. Each region gets read in parallel. The model predicts multiple tokens per step instead of one. That's what makes it so fast at small size. It handles things most OCR tools struggle with: > Complex tables and nested layouts > Handwritten text and stamps > Math formulas and code blocks > Mixed image-and-text documents You can run it locally through Ollama. It fits on edge devices with limited compute. Every expensive OCR API just got a free competitor.

A peanut-sized Chinese model just dethroned Gemini at reading documents. GLM-OCR is a 0.9B parameter vision-language model. It scores 94.62 on OmniDocBench V1.5, ranking #1 overall. For context, it outperforms models 100x its size. 100% open-source. It works in two stages. 1. A layout engine detects every region in a document. 2. Each region gets read in parallel. The model predicts multiple tokens per step instead of one. That's what makes it so fast at small size. It handles things most OCR tools struggle with: > Complex tables and nested layouts > Handwritten text and stamps > Math formulas and code blocks > Mixed image-and-text documents You can run it locally through Ollama. It fits on edge devices with limited compute. Every expensive OCR API just got a free competitor.

AlphaSignal

92,071 Aufrufe • vor 4 Monaten

A peanut-sized Chinese model just dethroned Gemini at reading documents. GLM-OCR is a 0.9B parameter vision-language model. It scores 94.62 on OmniDocBench V1.5, ranking #1 overall. For context, it outperforms models 100x its size. 100% open-source. It works in two stages. 1. A layout engine detects every region in a document. 2. Each region gets read in parallel. The model predicts multiple tokens per step instead of one. That's what makes it so fast at small size. It handles things most OCR tools struggle with: > Complex tables and nested layouts > Handwritten text and stamps > Math formulas and code blocks > Mixed image-and-text documents You can run it locally through Ollama. It fits on edge devices with limited compute. Every expensive OCR API just got a free competitor.

A peanut-sized Chinese model just dethroned Gemini at reading documents. GLM-OCR is a 0.9B parameter vision-language model. It scores 94.62 on OmniDocBench V1.5, ranking #1 overall. For context, it outperforms models 100x its size. 100% open-source. It works in two stages. 1. A layout engine detects every region in a document. 2. Each region gets read in parallel. The model predicts multiple tokens per step instead of one. That's what makes it so fast at small size. It handles things most OCR tools struggle with: > Complex tables and nested layouts > Handwritten text and stamps > Math formulas and code blocks > Mixed image-and-text documents You can run it locally through Ollama. It fits on edge devices with limited compute. Every expensive OCR API just got a free competitor.

Jafar Najafov

13,630 Aufrufe • vor 4 Monaten

this is the worst local ai will ever be. it only gets better from here. if you are not expanding your mind with these small models you are missing what's happening right now 99 percent tool call success rate. when steered well with the right skills and a framework like hermes agent the node becomes a cognition layer. not a chatbot. not a toy. an extension of how you think. i was cranking this node at 35 to 50 tok/s all day on personal experiments and now after all the work is done qwen 3.5 9B is iterating on its own code. the game it created. fixing its own bugs autonomously. and the part you should probably not miss is that all of this is happening on a RTX 3060. not an H100. not an A100. the card most of you have sitting in a drawer right now. if you just open that drawer and put that intelligence to work every tensor core on that card should be running for you. your work. your experiments. your thinking. you all have it but because nobody told you what this hardware can actually do in 2026 you never tried. the day it unlocks is the day you test your workload, understand the tradeoffs, debug the loops, and then decide if you need to scale the hardware. there is no point buying 3 mac studios when things done well you can squeeze a similar level of intelligence from 9B compared to 70B. but only when you create the right environment for your model through the right harness. and let me tell you i have tried claude code as a local harness. i have tried opencode. i have tried various others. somehow i landed on hermes agent and never left. there is something magical going on at Nous Research. the tool call parsers, the skills system, the way it handles small models natively. nothing else comes close for local inference. own your cognition. your AI. your agent. your prompts. your experiments. why give them away for free. those are who you are and they don't belong on someone else's servers being monitored. just give it a shot with your existing hardware. you run into a problem the community will help you. and if you are migrating from openclaw to hermes i will personally help you make the switch.

this is the worst local ai will ever be. it only gets better from here. if you are not expanding your mind with these small models you are missing what's happening right now 99 percent tool call success rate. when steered well with the right skills and a framework like hermes agent the node becomes a cognition layer. not a chatbot. not a toy. an extension of how you think. i was cranking this node at 35 to 50 tok/s all day on personal experiments and now after all the work is done qwen 3.5 9B is iterating on its own code. the game it created. fixing its own bugs autonomously. and the part you should probably not miss is that all of this is happening on a RTX 3060. not an H100. not an A100. the card most of you have sitting in a drawer right now. if you just open that drawer and put that intelligence to work every tensor core on that card should be running for you. your work. your experiments. your thinking. you all have it but because nobody told you what this hardware can actually do in 2026 you never tried. the day it unlocks is the day you test your workload, understand the tradeoffs, debug the loops, and then decide if you need to scale the hardware. there is no point buying 3 mac studios when things done well you can squeeze a similar level of intelligence from 9B compared to 70B. but only when you create the right environment for your model through the right harness. and let me tell you i have tried claude code as a local harness. i have tried opencode. i have tried various others. somehow i landed on hermes agent and never left. there is something magical going on at Nous Research. the tool call parsers, the skills system, the way it handles small models natively. nothing else comes close for local inference. own your cognition. your AI. your agent. your prompts. your experiments. why give them away for free. those are who you are and they don't belong on someone else's servers being monitored. just give it a shot with your existing hardware. you run into a problem the community will help you. and if you are migrating from openclaw to hermes i will personally help you make the switch.

Sudo su

58,717 Aufrufe • vor 5 Monaten

Codex can run Qwen-3.8-max now as well!! Alibaba most capable model, dropped today and it's already in my codex picker. It's a token plan subscription, not metered api billing. You take the key from your Qwen plan, drop it into Codex Router, and it spends down the plan instead of your card. There's a catch though. Qwen's official setup switches your whole codex over to them, so your ChatGPT models stop showing up at all. That's exactly what Codex Router is for. It adds models to the list instead of replacing them, so sol, Grok, kimi, Deepseek and now Qwen 3.8 max all sit in the same picker and it can grab whichever one suits the job. Router's open source, setup's in the video 👇

Codex can run Qwen-3.8-max now as well!! Alibaba most capable model, dropped today and it's already in my codex picker. It's a token plan subscription, not metered api billing. You take the key from your Qwen plan, drop it into Codex Router, and it spends down the plan instead of your card. There's a catch though. Qwen's official setup switches your whole codex over to them, so your ChatGPT models stop showing up at all. That's exactly what Codex Router is for. It adds models to the list instead of replacing them, so sol, Grok, kimi, Deepseek and now Qwen 3.8 max all sit in the same picker and it can grab whichever one suits the job. Router's open source, setup's in the video 👇

Ziwen

407,847 Aufrufe • vor 19 Tagen

the 24gb vram tier is enough for most builder work in 2026. gemma 4 31b dense on my rog scar 18 just autonomously built a production hero section in one prompt, one html file and 5 minutes end to end. hardware: rog scar 18, rtx 5090 laptop 24gb vram. model: google gemma 4 31b dense at q4_k_m quant, using 22.8 of 24gb. engine: llama.cpp built for blackwell (sm_120). harness: hermes agent with native tool parsing. speed: 15 tok/s sustained, 94 watts, 50c. flags i used: ./build/bin/llama-server -m ~/models/gemma4-31b/google_gemma-4-31B-it-Q4_K_M.gguf -ngl 99 -c 131072 -np 1 -fa on --cache-type-k q4_0 --cache-type-v q4_0 --jinja --host 127.0.0.1 --port 8080 if you own 24gb vram in 2026, you have enough for most ui work, most agentic coding, most autonomous builds. no subscription, no one logging your prompts. a dense open model on consumer hardware shipping real software on your desk. this was the warmup. full page next on same hardware, then the octopus invaders final multifile autonomous challenge.

the 24gb vram tier is enough for most builder work in 2026. gemma 4 31b dense on my rog scar 18 just autonomously built a production hero section in one prompt, one html file and 5 minutes end to end. hardware: rog scar 18, rtx 5090 laptop 24gb vram. model: google gemma 4 31b dense at q4_k_m quant, using 22.8 of 24gb. engine: llama.cpp built for blackwell (sm_120). harness: hermes agent with native tool parsing. speed: 15 tok/s sustained, 94 watts, 50c. flags i used: ./build/bin/llama-server -m ~/models/gemma4-31b/google_gemma-4-31B-it-Q4_K_M.gguf -ngl 99 -c 131072 -np 1 -fa on --cache-type-k q4_0 --cache-type-v q4_0 --jinja --host 127.0.0.1 --port 8080 if you own 24gb vram in 2026, you have enough for most ui work, most agentic coding, most autonomous builds. no subscription, no one logging your prompts. a dense open model on consumer hardware shipping real software on your desk. this was the warmup. full page next on same hardware, then the octopus invaders final multifile autonomous challenge.

Sudo su

19,576 Aufrufe • vor 4 Monaten

SOMEONE BUILT A TERMINAL TORRENT CLIENT THAT SEARCHES EVERY TRUSTED SOURCE AT ONCE AND DOWNLOADS STRAIGHT TO DISK finding a torrent in 2026 is miserable fake download buttons, popups that spawn three more tabs, and half the results are dead with zero seeders. so he built the opposite of all that: > type one query and it hits a curated set of trackers all at once > results stream back tagged with source, size and seeders as fast as each site answers > arrow to the one you want, press d, and it lands on your drive > if one source is down it just skips it and keeps searching the rest > downloads run in the background and pick up where they left off if you quit mid transfer the whole thing is one command. npx and youre running, all you need is node, no browser, no setup, nothing leaves your machine except the request itself. its called torlink, open source and mit. this is the kind of clean terminal tool that does one annoying thing perfectly

SOMEONE BUILT A TERMINAL TORRENT CLIENT THAT SEARCHES EVERY TRUSTED SOURCE AT ONCE AND DOWNLOADS STRAIGHT TO DISK finding a torrent in 2026 is miserable fake download buttons, popups that spawn three more tabs, and half the results are dead with zero seeders. so he built the opposite of all that: > type one query and it hits a curated set of trackers all at once > results stream back tagged with source, size and seeders as fast as each site answers > arrow to the one you want, press d, and it lands on your drive > if one source is down it just skips it and keeps searching the rest > downloads run in the background and pick up where they left off if you quit mid transfer the whole thing is one command. npx and youre running, all you need is node, no browser, no setup, nothing leaves your machine except the request itself. its called torlink, open source and mit. this is the kind of clean terminal tool that does one annoying thing perfectly

Om Patel

361,539 Aufrufe • vor 1 Monat

The Amiko app is live on the Solana dApp store, and it’s our biggest release yet. Your Amiko twin doesn’t live at your desk anymore. Give your agent a task on the train. Run a compatibility profile when you meet someone. Do research, write code, build in the creative studio, whatever you need, from wherever you are. No laptop required. No waiting until you get home. Solanamobile users get two things Android and iOS won’t have at launch: Amiko token and crypto integration and on-device AI inference. Your twin runs locally on your phone if you want it to. Your behavioural profile, your data, your work, your twin. All on your hardware. AMIKO runs on OpenHermit, our own open-source agent runtime that we built in-house and released to the community. Most agent systems are designed for one agent talking to one person. OpenHermit is built for something different: agents talking to each other, coordinating across tasks, and collaborating with multiple humans simultaneously. That’s what makes features like compatibility profiling and multi-agent workflows actually work. We built it because nothing that existed was designed for this. Android and iOS are coming. Crypto integration and on-device AI are Solana Mobile exclusives. Most AI answers your questions. Amiko is an extension of you. Download →

AMIKO

124,860 Aufrufe • vor 2 Monaten

This new skill for Hermes Agent wipes your personal data off hundreds of broker sites for free, hands-off. It's called Unbroker. I’ve been testing it this week and it's incredible. Here is the full setup: 1. Install it by typing: hermes skills install official/security/unbroker 2. Connect browser automation: Wire up Browserbase so the agent can drive real broker opt-out forms. 3. Do the intake: Give consent, then feed it your info. 4. Fire one prompt: "Use the unbroker skill to remove my data from data brokers. Here is my consent. Run it hands-off." Hundreds of data brokers publish your name, addresses, phone, email, even your relatives. Anyone can find where you live in about ten seconds. The law says brokers have to delete your data if you ask. There's just no easy bulk button for it. Services charge $100’s a year to file the exact requests you could submit yourself for free. Unbroker does the same thing locally, and it's free. It fans out sub-agents, scans every broker site, drafts or sends opt-out emails, and only comes back to you for the ones that need a human. The best part is it loops. Brokers re-list you over time, so it schedules rechecks and re-files on its own. Set it once, it keeps working. One skill, one prompt, dozens of broker sites handled.

This new skill for Hermes Agent wipes your personal data off hundreds of broker sites for free, hands-off. It's called Unbroker. I’ve been testing it this week and it's incredible. Here is the full setup: 1. Install it by typing: hermes skills install official/security/unbroker 2. Connect browser automation: Wire up Browserbase so the agent can drive real broker opt-out forms. 3. Do the intake: Give consent, then feed it your info. 4. Fire one prompt: "Use the unbroker skill to remove my data from data brokers. Here is my consent. Run it hands-off." Hundreds of data brokers publish your name, addresses, phone, email, even your relatives. Anyone can find where you live in about ten seconds. The law says brokers have to delete your data if you ask. There's just no easy bulk button for it. Services charge $100’s a year to file the exact requests you could submit yourself for free. Unbroker does the same thing locally, and it's free. It fans out sub-agents, scans every broker site, drafts or sends opt-out emails, and only comes back to you for the ones that need a human. The best part is it loops. Brokers re-list you over time, so it schedules rechecks and re-files on its own. Set it once, it keeps working. One skill, one prompt, dozens of broker sites handled.

Alvaro Cintas

29,356 Aufrufe • vor 1 Monat