Video yükleniyor...

Video Yüklenemedi

Ana Sayfaya Dön

opus 5 is getting routed to opus 5.2 tested opus 5 on xhigh with the same prompt in devin and claude code but results came out really different > claude code one is clean and more detailed > while devin one is almost there but not the same opus...

140,113 görüntüleme • 10 gün önce •via X (Twitter)

44 Yorum

J A Z I I profil fotoğrafı
J A Z I I10 gün önce

here's another voxel test. take a look at detailing looks like we gonna see opus new model this thursday

Lumina profil fotoğrafı
Lumina10 gün önce

what happened to opus 5.1 ?

J A Z I I profil fotoğrafı
J A Z I I10 gün önce

they skipped 5.1 no idea why but 5.2 has been spotted already

Lumina profil fotoğrafı
Lumina10 gün önce

saw this guys post from the other day about it but he fakes some stuff so idk

J A Z I I profil fotoğrafı
J A Z I I10 gün önce

was confirmed by leo and it was leaked in repo too

Lumina profil fotoğrafı
Lumina10 gün önce

ah nice

Devesh Joshi profil fotoğrafı
Devesh Joshi9 gün önce

I think this is just harness difference

Vivek Amilkanthawar profil fotoğrafı
Vivek Amilkanthawar10 gün önce

I'd check the id before assuming a swap. Devin and Claude Code ship different system prompts and different tools, so the same prompt is not the same test. /status in Claude Code shows the exact model it's talking to, opus 5 or 5.2.

J A Z I I profil fotoğrafı
J A Z I I10 gün önce

we are running some knowledge cut off question and for some users it seems opus 5.2 is available lemme do few more before i could say for confirm

Pedro profil fotoğrafı
Pedro10 gün önce

same model name, different harness = different animal. if the ui says opus 5 and the logs say 5.2, you weren't comparing models. you were comparing wrappers. i only trust the session that dumps the exact model string before the first tool call.

Hybrid 🏃🏾 profil fotoğrafı
Hybrid 🏃🏾10 gün önce

Hey, i Just came here to remind those that are reading this. You CAN test all of these models in Devin but also, SWE 2.0 is free

Maziar profil fotoğrafı
Maziar10 gün önce

bro whatever else than sonnet i use these days the cost is not reasonable at all

J A Z I I profil fotoğrafı
J A Z I I10 gün önce

use swe 2.. opus 5 and kimi k3 level model for free in devin 20 bucks plan for month unlimited

fawn profil fotoğrafı
fawn9 gün önce

Ooooo

Arsh - 16 y/o builder profil fotoğrafı
Arsh - 16 y/o builder10 gün önce

what's the cutoff question

J A Z I I profil fotoğrafı
J A Z I I10 gün önce

ask it if it knows tibo the reset guy without search it should know

Adam Krawczyk profil fotoğrafı
Adam Krawczyk10 gün önce

@be_arsh using hermes - op5 high "do you know tibo the reset guy? tell me without search": "Partially... Thibault "Tibo" Louis-Lucas (@tibo_maker).. The "reset guy" tag is where my confidence drops... So: ~80% on who Tibo is, ~30% that the reset guy is him.

J A Z I I profil fotoğrafı
J A Z I I10 gün önce

@be_arsh @tibo_maker won't work in hermes just claude sub not api

Michael Kaiser profil fotoğrafı
Michael Kaiser9 gün önce

Yes it is. Opus Max uses much more thinking Tokens than Opus 5 since yesterday. Can confirm the routing

Veee profil fotoğrafı
Veee10 gün önce

why not Opus 5.1 v Opus 5.2?

J A Z I I profil fotoğrafı
J A Z I I10 gün önce

no idea why but they skipped opus 5.1 or maybe this is opus 5.1 or 5.2 can't say for sure

Gregor profil fotoğrafı
Gregor9 gün önce

the routing to 5.2 tracks, but i'd bet cc's agentic scaffolding explains most of that quality gap, not the model itself. devin handles context chunking totally differently. did you try a raw api call to isolate the model from the tool loop?

Revealyte profil fotoğrafı
Revealyte10 gün önce

Well Opus 5 devin made it noticeably better

Gabe Fletcher profil fotoğrafı
Gabe Fletcher9 gün önce

post the screenshots of the terminal and api calls, other wise bs

Ibesh profil fotoğrafı
Ibesh9 gün önce

same prompt across two coding tools is still a different test since each tool shapes the result. routing may be happening, but output alone can't prove it.

catman profil fotoğrafı
catman10 gün önce

the same prompt producing cleaner output in claude code is a pretty strong clue. did you compare the raw model/version metadata too, or just the generations?

Jamesknightorion profil fotoğrafı
Jamesknightorion10 gün önce

Fable 5.1 flat out felt better to talk to so an improvement but for Opus’ issues would be huge

J-P profil fotoğrafı
J-P9 gün önce

This would explain why it completely smoked sol in the exact same task on isolated worktree's, was just letting fable5.1 look for related issues in the codex adapter but it found none...

yukij profil fotoğrafı
yukij9 gün önce

Bro finally lock in

Mr Pixel | Driftania 🏝 profil fotoğrafı
Mr Pixel | Driftania 🏝9 gün önce

Silent model upgrades are the best kind — one day the code's just cleaner and you can't even explain why. Secret routing stays winning. 🔍

max naid profil fotoğrafı
max naid9 gün önce

You believe that this is a routing block and not a harness difference ?

Dima Glushakov profil fotoğrafı
Dima Glushakov10 gün önce

The output shift is a useful clue, but it does not prove a backend change. JAZII, could you repeat both runs with fixed settings and compare latency, token use, and any model metadata?

volovuk profil fotoğrafı
volovuk9 gün önce

Something changed in the last 2 days" — yeah, quiet model updates are back. Gotta love when they push better weights under the hood without telling anyone

i6six profil fotoğrafı
i6six9 gün önce

Could simply be the harness

ahs profil fotoğrafı
ahs10 gün önce

The only thing that’s clear is that Claude Code turned out much neater

Dōvy profil fotoğrafı
Dōvy10 gün önce

ngl same model, different harness, different personality. The routing story is just the wrapper leaking into the answer.

安叫兽|Bird🕊️ 🔶 BNB profil fotoğrafı
安叫兽|Bird🕊️ 🔶 BNB10 gün önce

这两天确实像偷偷换了个脑子,输出突然勤快了

Francisco Gomez profil fotoğrafı
Francisco Gomez9 gün önce

Clean split: freeze a small probe battery, run it daily, and compare devin vs Claude Code traces across runs - a routing change shows up as a shift, not one sample. And keep the boring hypothesis: if only Claude Code got less lazy, that is a harness update, not a swap.

何晚 profil fotoğrafı
何晚9 gün önce

CC 里 `/status` 先看一眼,确认是 opus 5 还是 5.2,再对比。两边系统提示不一样,光看输出差异很难分。

Quantum Voyager profil fotoğrafı
Quantum Voyager9 gün önce

can you provide the prompt for this, or a live link to view this?

MrVane profil fotoğrafı
MrVane9 gün önce

And Opus 5.1? They are just gonna skip it :c

J A Z I I profil fotoğrafı
J A Z I I9 gün önce

yeah

xuanyin profil fotoğrafı
xuanyin9 gün önce

感受不到,opus实在太强了,完全摸不到上限,astra完全无法处理的难题交给opus5.0都可以一次完成

OhArA🏴‍☠️ profil fotoğrafı
OhArA🏴‍☠️10 gün önce

See2

Benzer Videolar