Video yükleniyor...
Video Yüklenemedi
Is Anthropic altering model performance to force costly upgrades? Chapter Co-Founder and CEO Cobi Blumenfeld-Gantz outlines a shift his team recently noticed: "Anthropic has kind of taken a page out of the Apple playbook, where they have...decreased the quality of the prior models right before they launched the new... show more
36,895 görüntüleme • 5 ay önce •via X (Twitter)
11 Yorum

@CobiBGantz good breakdown, a 25 word cap on tool calls would explain a lot of the weird truncation people were seeing, glad it got reverted

@CobiBGantz as someone using claude daily to build stuff this claim doesnt match what i noticed, the reverted system prompt change explains way more than intentional degradation

@CobiBGantz Yep learn from the champ for squeezing blood out of a turnip. Karma is going to bite your snotty asses in the coming years. Your AI on local devices is fundamentally flawed and dead on arrival. Thank Tim Cook for this fuckup

@CobiBGantz Very much so. That's why we will see AI bubble burst

@CobiBGantz 'Anthropic decreased quality of prior models'..based on what evidence?

@CobiBGantz If you are a frontier lab and develop the best models, what kind of incentives do you have to boost perceived productivity and profitability?

@CobiBGantz Token transparency start up request.

@CobiBGantz I think for a company built on 'ethical AI', the Apple playbook is quite the look.

@CobiBGantz To me it’s simpler. They’ve reallocated priority inference compute to the newer model and we intuitively know that frontier LLMs with access to more compute at inference time seem to perform better.. besides the “impression of degradation”

This kind of gaming of the audience feels inevitable. Throttle performance to justify an upgrade, add adverts so you can charge people to remove them and get back to the experience they already had. It’s all coming. Right now we’re in the honeymoon period, the equivalent of the 1980s and 1990s internet era, the golden age before everything became cookie banners, GDPR pop-ups, adverts, subscriptions, and paywalls. Enjoy it while it lasts.

The assumption baked in is deliberate degradation for upsell leverage, which doesn't hold up against what Anthropic actually disclosed: a system-prompt addition in mid-April that hard-capped Claude's text-between-tool-calls to 25 words and final responses to 100 words caused a measurable drop in coding eval quality before it was reverted.

