Video wird geladen...

Video konnte nicht geladen werden

Zur Startseite

DeepSeek-V4.1-Flash: the BEST Boeing benchmark result I’ve seen from an open-source model (by far). ✈️ It ran for hours with /goal. Where other models often stall quickly, it kept improving: inspect, spot a defect, zoom in, diagnose, fix, repeat. The video really shows how strong it is at sustaining...

43,845 Aufrufe • vor 19 Stunden •via X (Twitter)

33 Kommentare

Profilbild von Victor M
Victor Mvor 19 Stunden

more details because this is beautiful 🔥

Profilbild von Victor M
Victor Mvor 19 Stunden

extremely good, inspect the result here:

Profilbild von Offscript
Offscriptvor 18 Stunden

kept improving instead of stalling is the only benchmark that matters now. the rest is one shot theatre

Profilbild von Soft Axiom
Soft Axiomvor 12 Stunden

"Until you are 100% satisfied" might be the most important part of the prompt. The model grading its own work is the benchmark now.

Profilbild von Myravyx
Myravyxvor 16 Stunden

The hard part in a multi-hour run isn't the fixing. It's still being dissatisfied at hour three.

Profilbild von catman
catmanvor 17 Stunden

hours of /goal is a much harsher test than a one-shot render. what finally made it stop improving: a visual score, a fixed iteration limit, or its own judgment?

Profilbild von Umar Nasser
Umar Nasservor 12 Stunden

It seems better than opus 4.8 one right?

Profilbild von Shesaidmewakeup
Shesaidmewakeupvor 13 Stunden

Open source running for hours in claude code and still improving. Benches don’t show that.

Profilbild von John Rood
John Roodvor 17 Stunden

the thing that separates "keeps improving" from "stalls" isn't raw capability. it's whether the model can still see what it already tried 40 steps back. most stalls are it relitigating a fix it already ruled out because that context fell out of the window.

Profilbild von neal
nealvor 18 Stunden

The impressive part is the loop, not the “god model” label: inspect → name a defect → fix → verify. That pattern is useful outside 3D work too—give any model explicit checks and a stop condition instead of asking for a one-shot answer.

Profilbild von OmniWired
OmniWiredvor 14 Stunden

I wonder if it be better on dsh

Profilbild von Surya Rajendhran
Surya Rajendhranvor 19 Stunden

this is a great benchmark, where can I find more details? are there any common trends you’re seeing with how deepseek or open weight models handle 3D vs closed frontier models?

Profilbild von Victor M
Victor Mvor 18 Stunden

best way to see other results:

Profilbild von Chizzydigital
Chizzydigitalvor 15 Stunden

Next time just use a separate critic agent

Profilbild von veloX
veloXvor 15 Stunden

this Boeing benchmark reminds me of the Red Queen Gödel Machine: continuous self-improvement against a moving target.

Profilbild von bbzz
bbzzvor 17 Stunden

what'd it cost?

Profilbild von Elledyne Labs
Elledyne Labsvor 14 Stunden

was the inspect→fix loop running on the same context window the whole time, or did /goal spawn fresh subagents? curious what context strategy kept it from rotting across hours

Profilbild von Krish Dasgupta
Krish Dasguptavor 15 Stunden

What really is marvellous- the precision shadow. The moment you move the pane around the plane, the direction also specifies the shadow. That’s something !

Profilbild von Wei佳
Wei佳vor 12 Stunden

What Harness tool are you using?

Profilbild von Elledyne Labs
Elledyne Labsvor 16 Stunden

the harness did the work, not the model. claude code gave it the loop and deepseek just refused to quit. how much of this is /goal's verifier vs deepseek's stamina?

Profilbild von اسلیم کلیک ها
اسلیم کلیک هاvor 17 Stunden

Can you please crash it into a building next

Profilbild von Onur Solmaz
Onur Solmazvor 13 Stunden

did it reach the final version faster than astra before?

Profilbild von Steffan
Steffanvor 18 Stunden

Looks like I am going to change harness, I was not really happy with deepseek results in opencode, maybe it’s a harness problem.

Profilbild von Victor M
Victor Mvor 12 Stunden

try it and tell me - I get really good results with CC with this setup:

Profilbild von FoodTruck Bench
FoodTruck Benchvor 13 Stunden

DeepSeek 4.1 being this close to GPT-5.5 at this price point is actually illegal 💀

Profilbild von josip
josipvor 13 Stunden

the impressive part isn't the boeing render, it's that it stayed in the inspect→diagnose→fix loop for hours instead of stalling after the first pretty output. long-horizon models start looking useful when the harness keeps them pointed at the next defect

Profilbild von Dev
Devvor 12 Stunden

bro chinese models r literally cooking the entire ai market rn distillation really leveled up chinese ai to the point it's outperforming everything ngl 😭🔥

Profilbild von kimodo_cloud
kimodo_cloudvor 18 Stunden

cost ?

Profilbild von Preyforge
Preyforgevor 14 Stunden

this is the satisfying version of a loop: inspect, diagnose, fix. i still make the deployed path prove the demo; screenshots can be charming little liars.

Profilbild von neo hodler
neo hodlervor 14 Stunden

Interesting to see that it “ran for hours with /goal” without stalling. Long-horizon loops are where most “SOTA” models still quietly die.

Profilbild von Ibesh
Ibeshvor 14 Stunden

boeing test is brutal lol. most open models stall after a few fixes, the fact it kept going for hours and kept improving is the real flex

Profilbild von keethesh
keetheshvor 15 Stunden

Does it ever break something that was already working?

Profilbild von 东倒西六条
东倒西六条vor 15 Stunden

你炒股吗?如果你炒股的话马上删了,否则对今晚美国股市有冲击!能设计外形,就可以对飞机内部进行设计。直接冲击了美国高端制造业

Ähnliche Videos

AI AGENTS 101 (58 minute free masterclass) send this to anyone who wants to understand ai agents, claude skills, md files, how to get the most out of AI etc in plain english: 1. chat vs agents - chat models answer questions in a back and forth while agents take a goal, figure out the steps, and deliver a result 2. agents don’t stop after one response. they keep running until the task is actually finishedno babysitting required 3. everything runs on a loop. they gather context, decide what to do, take an action, then repeat until done 4. the loop is the system. they look at files, tools, and the internet. decide the next step. execute and then feed that back into the next step. over and over until completion 5. the model is just one piece. gpt, claude, gemini are the reasoning layer. the key is model + loop + tools + context 6. mcp is how agents use tools. it connects things like browser, code, apis, and your internal software. once connected, the agent decides when to use them to get the job done 7. context beats prompt all day. you don't need to write perfect prompts. load your agent with context about your business, style, and goals and then simple instructions work 8. claude.md or agents.md is the onboarding doc it tells the agent who it is, how to behave, what it knows, and what tools it can use. this gets loaded every time before it starts 9. memory.md is how it improves. agents don’t remember by default. this file stores preferences, corrections, and patterns you tell the agent to update it, and it gets better over time 10. skills + harnesses make it usable. skills are reusable tasks like writing, research, analysis the harness is the environment like claude code or openclaw that runs everything. basiclaly, different interfaces, same system underneath this episode with remy on The Startup Ideas Podcast (SIP) 🧃 was one of the clearest ways of understanding a lot of the core concepts of ai agents could be the best beginners course for ai agents 58 mins. all free. no advertisers. i just want to see you build cool stuff. im rooting for you. send to a friend watch

GREG ISENBERG

377,138 Aufrufe • vor 5 Monaten

CLAUDE CODE JUST SHIPPED THE FEATURE THAT SOLVES THE BIGGEST PROBLEM EVERY BUILDER HAS WITH AI AGENTS. The problem: Claude starts a task, gets distracted by a sub-problem, goes down a rabbit hole, and never finishes the original thing you asked for. The solution: /goal One command. You set the goal at the start of the session. Claude now has a north star it checks against every action it takes. Not just at the beginning. Throughout the entire session. Every time Claude is about to do something it asks: does this action move me toward the goal the user set or am I drifting? If it is drifting it corrects. If it completes a sub-task it returns to the primary goal. If it hits a blocker it reports back instead of spending 45 minutes solving the wrong problem. This sounds like a small feature. It is not. The reason most people do not trust Claude Code for long autonomous runs is not capability. It is reliability. A Claude Code session that reliably finishes what it started is worth 10 times more than one that is more capable but wanders. /goal is the feature that makes long autonomous sessions reliable. Set the goal. Let it run. Come back to a finished result. Not a result that got 70% done before Claude decided the sub-problem was more interesting. Done. The builders running overnight agent sessions are going to use this command on everything from today forward. Bookmark this. Follow CyrilXBT for every Claude Code feature the moment it ships.

CyrilXBT

19,586 Aufrufe • vor 3 Monaten

Sam Altman made the case for open-source harnesses in July. a month later, someone shipped it, and it's more efficient than most managed harnesses. here is the problem it was aimed at: a large share of your agent's token bill is the model rereading things it already read. that isn't the model's doing. the runtime around it decides what goes into every prompt and how often the model gets called. for example, an agent queries a CRM at step four and gets back 400 rows. those rows get piled up in the conversation history. by step nineteen, the model has to read those rows fifteen times unnecessarily, and every token read is billed at input rates. it happened because your harness assembled that prompt on every turn and kept the rows in it. that gives you two levers: how much context the harness carries forward, and how often it calls the model. there are four practical ways to keep the prompt from growing unnecessarily: → load tool schemas on demand. a server with 100 tools doesn't need to put all 100 into every prompt when the agent only calls two. → offload large results to disk. turn a large response into a short preview and a file path instead of replaying the entire result on every turn. → delegate to subagents. let a subagent spend thirty tool calls in its own context and return one summary to the root agent. → run toolchains in code. one script calls three tools, joins the results, and returns a table instead of three turns each dragging a full response. but reducing context is only half the job. you also need to control how often the model gets called. a good harness should avoid unnecessary planning, verification, and reflection when the work can be completed in fewer steps. TrueFoundry's open-source agent harness, TrueForge, is built around both of those controls. it sits between the model and the tools, deciding what goes into every prompt and when another model call is actually needed. it also breaks token usage down across the harness, skills, instructions, tools, and messages. DevRev's Enterprise-Bench is where this gets tested, on multi-step tasks of the kind where an agent pulls records from one system and reconciles them against another. TrueFoundry ran TrueForge there against Claude Managed Agents, both on the same model, and both finished the same number of tasks. the tie is the part that matters, because it means the gap underneath is not a quality tradeoff. TrueForge reached that score on close to a third of the tokens, with roughly 40% fewer trips back to the model. for the same result, that comes out around 2.7x cheaper than Claude Managed Agents. swapping in an open model made it sharper still. TrueForge with GLM-5.2 scored a little higher than either setup above, and the entire benchmark run cost about $3 at list prices. being open source matters beyond the license here. the model underneath can be swapped without rewriting the agent, and the whole thing can run inside your own environment when the data cannot leave it. all of this comes down to the runtime around the model, the context it carries, the tools it exposes, and how many times it goes back to the model. that is what a production harness actually owns. the full task list, the per-run numbers, and the MIT-licensed code are on GitHub: (don't forget to star 🌟) you can read more about the same in the article quoted below. thanks to the TrueForge team for working with me on this one.

Akshay 🚀

76,552 Aufrufe • vor 23 Tagen