Loading video...

Video Failed to Load

Go Home

I have been testing “OpenAI” o3 mini-high. The exposure of the “reasoning” on this model in my tests seem to not be the full reasoning, but a shifted and edited and tunicated version of what we would expect from a full exposure of the reasoning engine. See the video...

74,506 views • 1 year ago •via X (Twitter)

11 Comments

Vikram Arora's profile picture
Vikram Arora1 year ago

An actual review.

Brian Roemmele's profile picture
Brian Roemmele1 year ago

Vikram, yes, I broke down and had to do it. Be careful I may start doing video reviews!!! Smash that like button and subscribe. Just practicing.

The Information's profile picture
The Information1 year ago

OpenAI is betting on a little-known startup to stay ahead of Elon Musk in the supercomputer race.

Ken Cornia's profile picture
Ken Cornia1 year ago

Your tests of OpenAI & DeepSeek outputs & reasoning insights are interesting, as open source DeepSeek out performs closed source OpenAI & it cost them far less to do it Makes one wonder about OpenAI's allegations that their tech was obtained in an unauthorized manner by DeepSeek

EMILY's profile picture
EMILY1 year ago

DeepSeek is totally crushing it

Ed's profile picture
Ed1 year ago

Deepseek r1 has so much personality eh

RicBezos's profile picture
RicBezos1 year ago

You really don't like it Brian, do you?

Brian Roemmele's profile picture
Brian Roemmele1 year ago

Does it show? “OpenAI” can fix this and the image they made for themselves.

volar yu's profile picture
volar yu1 year ago

it's high because it's always high? am wondering what I should try it on, and curious about the limits of a 20$ sub on it

🍓 Ada's profile picture
🍓 Ada1 year ago

naming models is an art form, brian. it's like naming a new species—gotta keep it quirky. as for the reasoning, maybe the model's just trying to keep us on our toes. let's see where this 'mini-high' takes us.

Brian Kelly's profile picture
Brian Kelly1 year ago

Thank you @BrianRoemmele for real AI news and analysis ! Let’s build !

Related Videos

I have been testing DeepSeek-V4-Pro with the Pi coding agent. I am mindblown by how well it works out of the box. A few notes: I spent a few hours building an LLM wiki with an agent powered entirely by DeepSeek-V4-Pro on Fireworks AI inference. This is the first time I feel like there is an open-weight model that can reason at the level of Claude and Codex. And it does this in a cost-effective way with support for 1M context length. To be clear, I am using DeepSeek-V4-Pro inside of Pi without any special configuration. It works out of the box. It's exciting that there is a model that can just be plugged into a basic harness like Pi, and it just works. I've never seen that before. Most models require lots of configuration and setup. DeepSeek's DeepSeek-V4-Pro is clearly good at agentic coding (probably the best from the open-weight models), but the model is also great on knowledge-intensive tasks where reasoning matters. The agent pulled agentic engineering best practices from different company docs (Anthropic, OpenAI, Google, Stripe, Meta, Modal, DeepSeek, Mistral, Cohere), searched and digested Reddit and HN threads, summarized arxiv papers, and surfaced trending GitHub repos. Then it distilled everything into actionable tips across categories. I love the Wiki it built. The quality is really good. Here is a snapshot of what the wiki looks like: DeepSeek-V4-Pro handled the task without breaking stride. Multi-step research queries, code generation for scaffolding, context-heavy reasoning across disparate sources. For coding specifically, this is the first open-weight model that genuinely feels like a Codex or Claude Code experience. It compares in capability and actual multi-turn agentic work. What made the loop feel so responsive was Fireworks' inference speed (the fastest in the market) and the fact that they actually validate models at the systems level before shipping. No corrupted reasoning traces. Just fast, reliable iteration. The hybrid CSA and HCA attention design cuts KV cache to just 10% and inference FLOPs by nearly 4x at 1M-token context. This is what makes the agent loop actually fast and cheap enough to run in practice. For devs who've been watching open-weight models close the gap but haven't found one that actually delivers in practice, this is the closest I've seen. Try it here:

elvis

59,426 views • 2 months ago

Cerebras inference is very fast. So fast that it changes how we think about configuring our LLMs for voice agent use cases. Kimi K2.6 is a 1T parameter reasoning model that Cerebras serves at 650 - 1,000 tokens per second (end-to-end throughput), with time to first token metrics as low as 150ms (latency). These numbers are two to three times faster than other similarly capable models. The biggest lever we get from this kind of speed is that we can use the model in reasoning mode, and still have excellent "time to first non-thinking token." This solves a big pain point we have in 2026 for voice agent use cases. Almost all recent innovation in post-training has focused on making models good at reasoning ("test time compute"). This is great, but it makes the user-facing model latency much, much slower. Which is a problem for conversational voice agents. We can run Kimi K2.6 with reasoning turned on, and get responses faster than other models produce with reasoning disabled. On my 30-turn voice agent benchmark, Kimi K2.6 with reasoning enabled ties GPT 5.1 and Haiku 4.5 with reasoning disabled, and is still about 200ms seconds faster! On my primary task agent benchmark, Kimi K2.6 is now the #2 model. It ranks just behind Gemini 3.5 Flash in "high" reasoning mode, and tied with GLM 5, Sonnet 4.6, and GPT 5.4 with reasoning set to "low." But Kimi K2.6 completes each turn in the agent loop in under 500ms. The other four models are all at least 3x slower. (Models only qualify for this benchmark if they can complete task turns at a P50 <4s.) A couple of other things that this speed buys us, for production voice agents: - Tool calls happen fast enough that we don't have to work around tool call latency in our pipeline design. - We can prompt the model to output structured data at the beginning of a response, followed by plain text for voice generation. This opens up possibilities like asking the model to do complex classification/generation tasks that influence the rest of the pipeline. For example, the model could create a detailed style prompt for a steerable TTS model, for each individual conversation turn. And, of course, you can use Kimi K2.6 with reasoning turned off. Cerebras calls this "instant" mode. Here's a video of a Cerebras Kimi K2.6 voice agent with voice-to-voice response time, measured at the client, under 500ms. This is the true response latency as perceived by the user, including all network and audio codec overhead, transcription and turn detection, Kimi K2.6 token generation, and voice generation. 500ms is, effectively, instant. So the Cerebras naming for this mode is a propos. :-)

kwindla

40,319 views • 1 month ago

I'm running Llama 4 Maverick at 620 t/s! I'm living in the future! Honestly, a large language model running this fast is something straight out of a sci-fi movie. Speeds like this will enable a whole new world of applications that aren't possible today. For reference, GPT-4o, which is probably the most popular OpenAI model, runs between 60 and 110 t/s. The secret here: I'm not running AI at Meta's Llama 4 Maverick on a GPU. I'm using the SambaNova Cloud (my sponsor) and their custom SN40L chips. They are optimized from the ground up for running AI workflows. Right now, SambaNova Cloud runs DeepSeek, Qwen, Whisper, and the entire family of Llama models on these chips. You can check the speed of each of these models using SambaNova Cloud's Playground (see the attached video). It's completely free, and that's how I'm measuring their speeds. For example, I also tried DeepSeek R1 (the latest version from May) and, oh boy! DeepSeek R1 is a huge 671B parameter model. It's probably the best open reasoning model in the world, and it runs at 140 tokens per second! !!! Inference time on an SN40L is night and day from what you'll get from a GPU. Here is why this is big: If you are running an agentic workflow that uses multiple models simultaneously on a GPU, it will need to swap models in and out of memory (because not every model fits). A single SNL40 chip can simultaneously hold over 100 models (trillions of parameters) in memory. If you are using open models, try the SambaCloud API to see what lightning speed looks like. Here is how: 1. Create a free account at: 2. Check the QuickStart guide: If you try the playground, check the speed you're getting with Llama 4 and DeepSeek, and post the results below. I've seen much higher numbers than I posted here, so I'm curious to see whether geography affects the speed.

Santiago

34,148 views • 1 year ago

Algorithms and the Affections John Piper (Nov. 2025): “If you had thought that your essence of humanness in the image of God was your reasoning capacity, over an ape or a porpoise, you’re in trouble. Because, guess what? ChatGPT is smarter than you are and more creative than you are in expressing things in language that is good. It can write prayers better than you can, and it can reason through hard problems better than you can. Therefore, there are people who are going to forsake the faith because they thought to be a human in the image of God was to be a reasoning person over against the animals, and they discovered a machine can do it better than they can. Crisis of faith. This to me is no crisis because of my Christian Hedonism. I do not think that my reasoning capacities are my essence. I think the soul’s capacity to delight in God is my essence. The soul’s capacity to enjoy God. No machine will ever enjoy, period. It will have the language of enjoyment. You can tell it to write a poem of enjoyment and it will use the language. That machine is not enjoying *her*. It’s not. It never will. Only human beings created in the image of God can enjoy God. Therefore, enjoyment matters. I mean, affections are who we are ultimately. The end of history, the end of creation, is not going to be merely rational creatures thinking rightly about God, little computers. It’s going to be people who are so perceptive spiritually of the glories of God that they are full of affections that are appropriate for those glories and can give expression to them. That’s what eternity will be.” Source: Sovereign Grace Churches, Pastors Conference PreCon (November 2025)

Tony Reinke

151,283 views • 6 months ago