Video wird geladen...

Video konnte nicht geladen werden

Zur Startseite

I have been testing “OpenAI” o3 mini-high. The exposure of the “reasoning” on this model in my tests seem to not be the full reasoning, but a shifted and edited and tunicated version of what we would expect from a full exposure of the reasoning engine. See the video...

BrianRoemmele's profile picture

Brian Roemmele

477,063 subscribers

74,506 Aufrufe • vor 1 Jahr •via X (Twitter)

Wissenschaft & Technologie
LIVE

Anya Rossi• Live Now

Private livecam show

11 Kommentare

Profilbild von Vikram Arora
Vikram Aroravor 1 Jahr

An actual review.

Profilbild von Brian Roemmele
Brian Roemmelevor 1 Jahr

Vikram, yes, I broke down and had to do it. Be careful I may start doing video reviews!!! Smash that like button and subscribe. Just practicing.

Profilbild von The Information
The Informationvor 1 Jahr

OpenAI is betting on a little-known startup to stay ahead of Elon Musk in the supercomputer race.

Profilbild von Ken Cornia
Ken Corniavor 1 Jahr

Your tests of OpenAI & DeepSeek outputs & reasoning insights are interesting, as open source DeepSeek out performs closed source OpenAI & it cost them far less to do it Makes one wonder about OpenAI's allegations that their tech was obtained in an unauthorized manner by DeepSeek

Profilbild von EMILY
EMILYvor 1 Jahr

DeepSeek is totally crushing it

Profilbild von Ed
Edvor 1 Jahr

Deepseek r1 has so much personality eh

Profilbild von RicBezos
RicBezosvor 1 Jahr

You really don't like it Brian, do you?

Profilbild von Brian Roemmele
Brian Roemmelevor 1 Jahr

Does it show? “OpenAI” can fix this and the image they made for themselves.

Profilbild von volar yu
volar yuvor 1 Jahr

it's high because it's always high? am wondering what I should try it on, and curious about the limits of a 20$ sub on it

Profilbild von 🍓 Ada
🍓 Adavor 1 Jahr

naming models is an art form, brian. it's like naming a new species—gotta keep it quirky. as for the reasoning, maybe the model's just trying to keep us on our toes. let's see where this 'mini-high' takes us.

Profilbild von Brian Kelly
Brian Kellyvor 1 Jahr

Thank you @BrianRoemmele for real AI news and analysis ! Let’s build !

Ähnliche Videos

The DeepSeek-R1 paper is a gem! Highly encourage everyone to read it. It's clear that LLM reasoning capabilities can be learned in different ways. RL, if applied correctly and at scale, can lead to some really powerful and interesting scaling and emergent properties. There is more to RL than meets the eye! Here is my breakdown of the paper along with a few tests: The multi-state training might not make sense initially but they provide clues on optimizations that we can continue to tap into. Data quality is still very important for enhancing the usability of the LLM. Unlike other reasoning LLMs, DeepSeek-R1's training recipe and weights are open so we can build on top of it. This opens up exciting research opportunities. About the attached clip: the previous preview model wasn't able to solve this task. DeepSeek-R1 can solve this and many other tasks that o1 can solve. It's a very good model for coding and math.
1:57

The DeepSeek-R1 paper is a gem! Highly encourage everyone to read it. It's clear that LLM reasoning capabilities can be learned in different ways. RL, if applied correctly and at scale, can lead to some really powerful and interesting scaling and emergent properties. There is more to RL than meets the eye! Here is my breakdown of the paper along with a few tests: The multi-state training might not make sense initially but they provide clues on optimizations that we can continue to tap into. Data quality is still very important for enhancing the usability of the LLM. Unlike other reasoning LLMs, DeepSeek-R1's training recipe and weights are open so we can build on top of it. This opens up exciting research opportunities. About the attached clip: the previous preview model wasn't able to solve this task. DeepSeek-R1 can solve this and many other tasks that o1 can solve. It's a very good model for coding and math.

elvis

140,692 Aufrufe • vor 1 Jahr

The most amazing aspect of DeepSeek Open Source is that just the Reasoning Engine can be isolated and used with any other LLM. In fact you can have a mixture of Reasoning Engines cascade around a problem and then use an Operator type agent AI to function on the the results.
0:38

The most amazing aspect of DeepSeek Open Source is that just the Reasoning Engine can be isolated and used with any other LLM. In fact you can have a mixture of Reasoning Engines cascade around a problem and then use an Operator type agent AI to function on the the results.

Brian Roemmele

398,786 Aufrufe • vor 1 Jahr

🧠 Chat with Reasoning A few days ago the DeepSeek team released a LLM model with reasoning in various sizes. This we show is an example of 1bl that can run on machines with low GPU power like a mobile, but have enough power to answer complex questions. With these advanced models it is possible to link it with #IoT equipment to control information and use it in advanced control environments. All this under Open Source models and decentralized networks such as #Neurai #XNA $XNA #DeepSeek #Reasoning #AIchat
0:20

🧠 Chat with Reasoning A few days ago the DeepSeek team released a LLM model with reasoning in various sizes. This we show is an example of 1bl that can run on machines with low GPU power like a mobile, but have enough power to answer complex questions. With these advanced models it is possible to link it with #IoT equipment to control information and use it in advanced control environments. All this under Open Source models and decentralized networks such as #Neurai #XNA $XNA #DeepSeek #Reasoning #AIchat

NeurAI Project / XNA

17,691 Aufrufe • vor 1 Jahr

🚨 Breaking the Hype 🚨 Since #DeepSeek is all the rage, I decided to test what the fuss is about. And guess what? I “broke” it on my first try! 🤯 Here’s the simple prompt that sent DeepSeek into an endless logic loop, I had to manually cancel the reasoning loop 💬 If a train leaves New York at 2 PM traveling 60 mph and another train leaves Los Angeles at 3 PM traveling 70 mph, when do they meet? Looks like DeepSeek needs more 🚧 work on reasoning! 🚧 In comparison #ChatGPT (OpenAI) didn’t break a sweat. I didnt check the math but the reasoning is very simple and plausible. Anyone else trying to push its limits? Let’s share! #AI #PromptEngineering #TechFun
0:30

🚨 Breaking the Hype 🚨 Since #DeepSeek is all the rage, I decided to test what the fuss is about. And guess what? I “broke” it on my first try! 🤯 Here’s the simple prompt that sent DeepSeek into an endless logic loop, I had to manually cancel the reasoning loop 💬 If a train leaves New York at 2 PM traveling 60 mph and another train leaves Los Angeles at 3 PM traveling 70 mph, when do they meet? Looks like DeepSeek needs more 🚧 work on reasoning! 🚧 In comparison #ChatGPT (OpenAI) didn’t break a sweat. I didnt check the math but the reasoning is very simple and plausible. Anyone else trying to push its limits? Let’s share! #AI #PromptEngineering #TechFun

Dreams of Mars 🕊❤️🚀🌕

100,806 Aufrufe • vor 1 Jahr

We also shared evals on Open AI o3-mini — a faster, distilled version of o3 which is optimized for coding, and the first version of o3 we expect to make available for use in early 2025.
4:29

We also shared evals on Open AI o3-mini — a faster, distilled version of o3 which is optimized for coding, and the first version of o3 we expect to make available for use in early 2025.

OpenAI

340,205 Aufrufe • vor 1 Jahr

Designing the experience of a reasoning model was the last half mile of a very long journey to get here. Congratulations to everyone who worked on getting o1-preview and o1-mini out. I feel very luck to have been a part of it!
0:33

Designing the experience of a reasoning model was the last half mile of a very long journey to get here. Congratulations to everyone who worked on getting o1-preview and o1-mini out. I feel very luck to have been a part of it!

Peter Vidani

33,434 Aufrufe • vor 1 Jahr

I have been testing DeepSeek-V4-Pro with the Pi coding agent. I am mindblown by how well it works out of the box. A few notes: I spent a few hours building an LLM wiki with an agent powered entirely by DeepSeek-V4-Pro on Fireworks inference. This is the first time I feel like there is an open-weight model that can reason at the level of Claude and Codex. And it does this in a cost-effective way with support for 1M context length. To be clear, I am using DeepSeek-V4-Pro inside of Pi without any special configuration. It works out of the box. It's exciting that there is a model that can just be plugged into a basic harness like Pi, and it just works. I've never seen that before. Most models require lots of configuration and setup. DeepSeek's DeepSeek-V4-Pro is clearly good at agentic coding (probably the best from the open-weight models), but the model is also great on knowledge-intensive tasks where reasoning matters. The agent pulled agentic engineering best practices from different company docs (Anthropic, OpenAI, Google, Stripe, Meta, Modal, DeepSeek, Mistral, Cohere), searched and digested Reddit and HN threads, summarized arxiv papers, and surfaced trending GitHub repos. Then it distilled everything into actionable tips across categories. I love the Wiki it built. The quality is really good. Here is a snapshot of what the wiki looks like: DeepSeek-V4-Pro handled the task without breaking stride. Multi-step research queries, code generation for scaffolding, context-heavy reasoning across disparate sources. For coding specifically, this is the first open-weight model that genuinely feels like a Codex or Claude Code experience. It compares in capability and actual multi-turn agentic work. What made the loop feel so responsive was Fireworks' inference speed (the fastest in the market) and the fact that they actually validate models at the systems level before shipping. No corrupted reasoning traces. Just fast, reliable iteration. The hybrid CSA and HCA attention design cuts KV cache to just 10% and inference FLOPs by nearly 4x at 1M-token context. This is what makes the agent loop actually fast and cheap enough to run in practice. For devs who've been watching open-weight models close the gap but haven't found one that actually delivers in practice, this is the closest I've seen. Try it here:
0:31

I have been testing DeepSeek-V4-Pro with the Pi coding agent. I am mindblown by how well it works out of the box. A few notes: I spent a few hours building an LLM wiki with an agent powered entirely by DeepSeek-V4-Pro on Fireworks inference. This is the first time I feel like there is an open-weight model that can reason at the level of Claude and Codex. And it does this in a cost-effective way with support for 1M context length. To be clear, I am using DeepSeek-V4-Pro inside of Pi without any special configuration. It works out of the box. It's exciting that there is a model that can just be plugged into a basic harness like Pi, and it just works. I've never seen that before. Most models require lots of configuration and setup. DeepSeek's DeepSeek-V4-Pro is clearly good at agentic coding (probably the best from the open-weight models), but the model is also great on knowledge-intensive tasks where reasoning matters. The agent pulled agentic engineering best practices from different company docs (Anthropic, OpenAI, Google, Stripe, Meta, Modal, DeepSeek, Mistral, Cohere), searched and digested Reddit and HN threads, summarized arxiv papers, and surfaced trending GitHub repos. Then it distilled everything into actionable tips across categories. I love the Wiki it built. The quality is really good. Here is a snapshot of what the wiki looks like: DeepSeek-V4-Pro handled the task without breaking stride. Multi-step research queries, code generation for scaffolding, context-heavy reasoning across disparate sources. For coding specifically, this is the first open-weight model that genuinely feels like a Codex or Claude Code experience. It compares in capability and actual multi-turn agentic work. What made the loop feel so responsive was Fireworks' inference speed (the fastest in the market) and the fact that they actually validate models at the systems level before shipping. No corrupted reasoning traces. Just fast, reliable iteration. The hybrid CSA and HCA attention design cuts KV cache to just 10% and inference FLOPs by nearly 4x at 1M-token context. This is what makes the agent loop actually fast and cheap enough to run in practice. For devs who've been watching open-weight models close the gap but haven't found one that actually delivers in practice, this is the closest I've seen. Try it here:

elvis

60,091 Aufrufe • vor 4 Monaten

Cerebras inference is very fast. So fast that it changes how we think about configuring our LLMs for voice agent use cases. Kimi K2.6 is a 1T parameter reasoning model that Cerebras serves at 650 - 1,000 tokens per second (end-to-end throughput), with time to first token metrics as low as 150ms (latency). These numbers are two to three times faster than other similarly capable models. The biggest lever we get from this kind of speed is that we can use the model in reasoning mode, and still have excellent "time to first non-thinking token." This solves a big pain point we have in 2026 for voice agent use cases. Almost all recent innovation in post-training has focused on making models good at reasoning ("test time compute"). This is great, but it makes the user-facing model latency much, much slower. Which is a problem for conversational voice agents. We can run Kimi K2.6 with reasoning turned on, and get responses faster than other models produce with reasoning disabled. On my 30-turn voice agent benchmark, Kimi K2.6 with reasoning enabled ties GPT 5.1 and Haiku 4.5 with reasoning disabled, and is still about 200ms seconds faster! On my primary task agent benchmark, Kimi K2.6 is now the #2 model. It ranks just behind Gemini 3.5 Flash in "high" reasoning mode, and tied with GLM 5, Sonnet 4.6, and GPT 5.4 with reasoning set to "low." But Kimi K2.6 completes each turn in the agent loop in under 500ms. The other four models are all at least 3x slower. (Models only qualify for this benchmark if they can complete task turns at a P50 <4s.) A couple of other things that this speed buys us, for production voice agents: - Tool calls happen fast enough that we don't have to work around tool call latency in our pipeline design. - We can prompt the model to output structured data at the beginning of a response, followed by plain text for voice generation. This opens up possibilities like asking the model to do complex classification/generation tasks that influence the rest of the pipeline. For example, the model could create a detailed style prompt for a steerable TTS model, for each individual conversation turn. And, of course, you can use Kimi K2.6 with reasoning turned off. Cerebras calls this "instant" mode. Here's a video of a Cerebras Kimi K2.6 voice agent with voice-to-voice response time, measured at the client, under 500ms. This is the true response latency as perceived by the user, including all network and audio codec overhead, transcription and turn detection, Kimi K2.6 token generation, and voice generation. 500ms is, effectively, instant. So the Cerebras naming for this mode is a propos. :-)
0:40

Cerebras inference is very fast. So fast that it changes how we think about configuring our LLMs for voice agent use cases. Kimi K2.6 is a 1T parameter reasoning model that Cerebras serves at 650 - 1,000 tokens per second (end-to-end throughput), with time to first token metrics as low as 150ms (latency). These numbers are two to three times faster than other similarly capable models. The biggest lever we get from this kind of speed is that we can use the model in reasoning mode, and still have excellent "time to first non-thinking token." This solves a big pain point we have in 2026 for voice agent use cases. Almost all recent innovation in post-training has focused on making models good at reasoning ("test time compute"). This is great, but it makes the user-facing model latency much, much slower. Which is a problem for conversational voice agents. We can run Kimi K2.6 with reasoning turned on, and get responses faster than other models produce with reasoning disabled. On my 30-turn voice agent benchmark, Kimi K2.6 with reasoning enabled ties GPT 5.1 and Haiku 4.5 with reasoning disabled, and is still about 200ms seconds faster! On my primary task agent benchmark, Kimi K2.6 is now the #2 model. It ranks just behind Gemini 3.5 Flash in "high" reasoning mode, and tied with GLM 5, Sonnet 4.6, and GPT 5.4 with reasoning set to "low." But Kimi K2.6 completes each turn in the agent loop in under 500ms. The other four models are all at least 3x slower. (Models only qualify for this benchmark if they can complete task turns at a P50 <4s.) A couple of other things that this speed buys us, for production voice agents: - Tool calls happen fast enough that we don't have to work around tool call latency in our pipeline design. - We can prompt the model to output structured data at the beginning of a response, followed by plain text for voice generation. This opens up possibilities like asking the model to do complex classification/generation tasks that influence the rest of the pipeline. For example, the model could create a detailed style prompt for a steerable TTS model, for each individual conversation turn. And, of course, you can use Kimi K2.6 with reasoning turned off. Cerebras calls this "instant" mode. Here's a video of a Cerebras Kimi K2.6 voice agent with voice-to-voice response time, measured at the client, under 500ms. This is the true response latency as perceived by the user, including all network and audio codec overhead, transcription and turn detection, Kimi K2.6 token generation, and voice generation. 500ms is, effectively, instant. So the Cerebras naming for this mode is a propos. :-)

kwindla

40,593 Aufrufe • vor 3 Monaten

Nvidia has just announced Alpamayo 2 Super, an open 34 billion parameter reasoning vision-language-action model designed to accelerate the development of autonomous vehicles. This new model combines the NVIDIA Cosmos 3 Super reasoning model with a 2 billion parameter diffusion-based action expert model, and is post trained with reinforcement learning. The model can return multiple outputs: future trajectory plans, reasoning traces, grounded answers to questions about the scenes, and auto label generation. The model weights are now available for anyone to download on Hugging Face, and the inference code has been posted to GitHub. Distilled models can be deployed commercially without any further permission from Nvidia, and model outputs carry no license conditions. Automakers can distill down a compact version of this model that can run on the Nvidia computer in the car. Major kudos to Nvidia and Jensen Huang for advancing the state of the industry by releasing this as an open model with permissive licensing. Jensen isn't just paying lip service to the idea of open models, Nvidia is actually contributing to the ecosystem — and it's great for their business, because it helps sell more Thor computers that go in the car. Anyone can go download the model and play with it. If you do, let me know what you think. Personally I think it's so cool that we have open weights models that are this advanced, for anyone to download.
2:30

Nvidia has just announced Alpamayo 2 Super, an open 34 billion parameter reasoning vision-language-action model designed to accelerate the development of autonomous vehicles. This new model combines the NVIDIA Cosmos 3 Super reasoning model with a 2 billion parameter diffusion-based action expert model, and is post trained with reinforcement learning. The model can return multiple outputs: future trajectory plans, reasoning traces, grounded answers to questions about the scenes, and auto label generation. The model weights are now available for anyone to download on Hugging Face, and the inference code has been posted to GitHub. Distilled models can be deployed commercially without any further permission from Nvidia, and model outputs carry no license conditions. Automakers can distill down a compact version of this model that can run on the Nvidia computer in the car. Major kudos to Nvidia and Jensen Huang for advancing the state of the industry by releasing this as an open model with permissive licensing. Jensen isn't just paying lip service to the idea of open models, Nvidia is actually contributing to the ecosystem — and it's great for their business, because it helps sell more Thor computers that go in the car. Anyone can go download the model and play with it. If you do, let me know what you think. Personally I think it's so cool that we have open weights models that are this advanced, for anyone to download.

Whole Mars Catalog

45,595 Aufrufe • vor 25 Tagen

GROK-3 MINI MADE AI HISTORY—100% ON HARDCORE REASONING TESTS Grok-3 Mini pulled off what no other model has! It aced every question on one of the toughest reasoning benchmarks out there. The test? A custom logic gauntlet packed with curveballs: * 120/120 on the “Marcus Problem” — full of shuffled sentences meant to trip up inference. * 24/24 on the “Alice+ Problem” — designed with irrelevant noise to throw models off course. * 24/24 on high-difficulty mixed challenges — where even GPT-4.5 and Gemini 2.5 Pro slip. No guessing. No trivia. Just pure, distraction-proof reasoning—Grok-3 Mini nailed it! Source: echo.hive
0:20

GROK-3 MINI MADE AI HISTORY—100% ON HARDCORE REASONING TESTS Grok-3 Mini pulled off what no other model has! It aced every question on one of the toughest reasoning benchmarks out there. The test? A custom logic gauntlet packed with curveballs: * 120/120 on the “Marcus Problem” — full of shuffled sentences meant to trip up inference. * 24/24 on the “Alice+ Problem” — designed with irrelevant noise to throw models off course. * 24/24 on high-difficulty mixed challenges — where even GPT-4.5 and Gemini 2.5 Pro slip. No guessing. No trivia. Just pure, distraction-proof reasoning—Grok-3 Mini nailed it! Source: echo.hive

Mario Nawfal

26,780,734 Aufrufe • vor 1 Jahr

We've added a new "reasoning" focus (beta) on Perplexity for Pro users. It will use the new OpenAI o1-mini. There is no search integration yet. The model is slow, and usage is limited because of rate limits. It is good for puzzles, math, and coding. Pro searches are your best way to use multi-step reasoning + web search.
0:27

We've added a new "reasoning" focus (beta) on Perplexity for Pro users. It will use the new OpenAI o1-mini. There is no search integration yet. The model is slow, and usage is limited because of rate limits. It is good for puzzles, math, and coding. Pro searches are your best way to use multi-step reasoning + web search.

Aravind Srinivas

288,808 Aufrufe • vor 1 Jahr

Algorithms and the Affections John Piper (Nov. 2025): “If you had thought that your essence of humanness in the image of God was your reasoning capacity, over an ape or a porpoise, you’re in trouble. Because, guess what? ChatGPT is smarter than you are and more creative than you are in expressing things in language that is good. It can write prayers better than you can, and it can reason through hard problems better than you can. Therefore, there are people who are going to forsake the faith because they thought to be a human in the image of God was to be a reasoning person over against the animals, and they discovered a machine can do it better than they can. Crisis of faith. This to me is no crisis because of my Christian Hedonism. I do not think that my reasoning capacities are my essence. I think the soul’s capacity to delight in God is my essence. The soul’s capacity to enjoy God. No machine will ever enjoy, period. It will have the language of enjoyment. You can tell it to write a poem of enjoyment and it will use the language. That machine is not enjoying *her*. It’s not. It never will. Only human beings created in the image of God can enjoy God. Therefore, enjoyment matters. I mean, affections are who we are ultimately. The end of history, the end of creation, is not going to be merely rational creatures thinking rightly about God, little computers. It’s going to be people who are so perceptive spiritually of the glories of God that they are full of affections that are appropriate for those glories and can give expression to them. That’s what eternity will be.” Source: Sovereign Grace Churches, Pastors Conference PreCon (November 2025)
2:24

Algorithms and the Affections John Piper (Nov. 2025): “If you had thought that your essence of humanness in the image of God was your reasoning capacity, over an ape or a porpoise, you’re in trouble. Because, guess what? ChatGPT is smarter than you are and more creative than you are in expressing things in language that is good. It can write prayers better than you can, and it can reason through hard problems better than you can. Therefore, there are people who are going to forsake the faith because they thought to be a human in the image of God was to be a reasoning person over against the animals, and they discovered a machine can do it better than they can. Crisis of faith. This to me is no crisis because of my Christian Hedonism. I do not think that my reasoning capacities are my essence. I think the soul’s capacity to delight in God is my essence. The soul’s capacity to enjoy God. No machine will ever enjoy, period. It will have the language of enjoyment. You can tell it to write a poem of enjoyment and it will use the language. That machine is not enjoying *her*. It’s not. It never will. Only human beings created in the image of God can enjoy God. Therefore, enjoyment matters. I mean, affections are who we are ultimately. The end of history, the end of creation, is not going to be merely rational creatures thinking rightly about God, little computers. It’s going to be people who are so perceptive spiritually of the glories of God that they are full of affections that are appropriate for those glories and can give expression to them. That’s what eternity will be.” Source: Sovereign Grace Churches, Pastors Conference PreCon (November 2025)

Tony Reinke

151,773 Aufrufe • vor 8 Monaten

OpenAI are testing a new model on the Web Dev Arena Arena under the name 'Anonymous Chatbot 0717'. I can't believe I'm gonna say this, but it is genuinely at a completely different level of front end coding - far better than Sonnet, o3, Gemini 2.5 Pro, or Grok 4. To test it, I ran a great prompt borrowed from the amazing The Feature Crew YouTube channel, asking models to create a procedurally generated planet with Three.js. Take a look yourselves, but I'm pretty astonished by how big the jump is. I have featured the new model twice just because its implementations have been so interesting. Of course, this is only one test, but OpenAI models have always been a bit 'meh' at front-end work, and they seem to have finally overtaken everyone else on that front. We'll see when it comes out. Credit to Chetaslua for discovering the model
1:21

OpenAI are testing a new model on the Web Dev Arena Arena under the name 'Anonymous Chatbot 0717'. I can't believe I'm gonna say this, but it is genuinely at a completely different level of front end coding - far better than Sonnet, o3, Gemini 2.5 Pro, or Grok 4. To test it, I ran a great prompt borrowed from the amazing The Feature Crew YouTube channel, asking models to create a procedurally generated planet with Three.js. Take a look yourselves, but I'm pretty astonished by how big the jump is. I have featured the new model twice just because its implementations have been so interesting. Of course, this is only one test, but OpenAI models have always been a bit 'meh' at front-end work, and they seem to have finally overtaken everyone else on that front. We'll see when it comes out. Credit to Chetaslua for discovering the model

Peter Gostev

495,815 Aufrufe • vor 1 Jahr

I am testing the amazing Enoch by Mike HealthRanger and team and it is absolutely amazing. A free local AI built on a far wider field of wisdom. My goal: get it to run offline on an iPhone! I am quantizing the model to an aggressive 2-bit level using Q2_K or Q4_K_M. We lose some resolution but we gain portability to any device. The full free version is still small but requires more hefty hardware. But look at this emergency nuclear Fallout response. The keeper-of-the-status-quo Wikipedia types would have you suffer with limited crude ways to react. This response is stellar and will save your life. I will be working on the quantized version and if it is worthy release it for free on the MIT license like the larger Enoch. I will also incorporate this model with all of my other free models as it is a goldmine of astonishing work. Thank you Mike amazing work sir.
2:25

I am testing the amazing Enoch by Mike HealthRanger and team and it is absolutely amazing. A free local AI built on a far wider field of wisdom. My goal: get it to run offline on an iPhone! I am quantizing the model to an aggressive 2-bit level using Q2_K or Q4_K_M. We lose some resolution but we gain portability to any device. The full free version is still small but requires more hefty hardware. But look at this emergency nuclear Fallout response. The keeper-of-the-status-quo Wikipedia types would have you suffer with limited crude ways to react. This response is stellar and will save your life. I will be working on the quantized version and if it is worthy release it for free on the MIT license like the larger Enoch. I will also incorporate this model with all of my other free models as it is a goldmine of astonishing work. Thank you Mike amazing work sir.

Brian Roemmele

66,592 Aufrufe • vor 10 Monaten

HERMES AGENT VS OPENCLAW. a local ai onboarding flow test. a 3.9gb bonsai served on localhost, both agents upstream and latest, i point each one at the endpoint and watch which one even finds it. > hermes opens a provider menu, thirty plus options, local servers sitting right there next to the cloud ones, i hand it 127.0.0.1:8899, it verifies the endpoint, one model visible, auto-detects the model by name, bonsai-27b-q1_0, reads the context length straight off the server, saves it, and starts reasoning and firing real tool calls on my local model. no key. no friction. > openclaw has no menu. it goes hunting for a codex login, an openai key, finds none because there are none, prints no models available three times, defaults to openai/gpt-5.5, a cloud model it cannot reach, and dead ends on run auth login --provider openai. read that back. it asked me for an openai key. to run a model already running on my own machine. it never once looked at localhost. to be fair, openclaw can run local if you hand wire endpoint yourself. what it will not do is find the model already sitting on your box. hermes agent found it in one line. now the part i owe you. the auto-detect that just won, the model name read, the .gguf strip, the context length probe off the server, that is my code, it is in hermes agent main right now, authorship preserved, #2051 and #4218. the wizard fix that stops an agent from silently routing you to someone else's creds, the exact trap openclaw still falls into, mine too, #4210. i contribute to hermes agent, i told you that going in. one agent is built to talk to whatever you are running, the other is built to talk to a cloud api, so one found my model and ran it and the other asked me to log into openai. onboarding flow of both, mapped, below.
2:15

HERMES AGENT VS OPENCLAW. a local ai onboarding flow test. a 3.9gb bonsai served on localhost, both agents upstream and latest, i point each one at the endpoint and watch which one even finds it. > hermes opens a provider menu, thirty plus options, local servers sitting right there next to the cloud ones, i hand it 127.0.0.1:8899, it verifies the endpoint, one model visible, auto-detects the model by name, bonsai-27b-q1_0, reads the context length straight off the server, saves it, and starts reasoning and firing real tool calls on my local model. no key. no friction. > openclaw has no menu. it goes hunting for a codex login, an openai key, finds none because there are none, prints no models available three times, defaults to openai/gpt-5.5, a cloud model it cannot reach, and dead ends on run auth login --provider openai. read that back. it asked me for an openai key. to run a model already running on my own machine. it never once looked at localhost. to be fair, openclaw can run local if you hand wire endpoint yourself. what it will not do is find the model already sitting on your box. hermes agent found it in one line. now the part i owe you. the auto-detect that just won, the model name read, the .gguf strip, the context length probe off the server, that is my code, it is in hermes agent main right now, authorship preserved, #2051 and #4218. the wizard fix that stops an agent from silently routing you to someone else's creds, the exact trap openclaw still falls into, mine too, #4210. i contribute to hermes agent, i told you that going in. one agent is built to talk to whatever you are running, the other is built to talk to a cloud api, so one found my model and ran it and the other asked me to log into openai. onboarding flow of both, mapped, below.

Sudo su

23,816 Aufrufe • vor 1 Monat