Video yükleniyor...

Video Yüklenemedi

Ana Sayfaya Dön

Fable 5 on Hyperagent is producing the most creative, ambitious work we've ever seen from our agents. They're self-improving for hours towards open-ended goals. Visual reasoning has spiked noticeably. Outputs are consistently higher quality than Opus, occasionally at lower cost. 5 of our test cases below vs. Opus 4.8...

1,230,689 görüntüleme • 2 ay önce •via X (Twitter)

0 Yorum

Yorum bulunmuyor

Orijinal gönderinin yorumları burada görünecek

Benzer Videolar

We’re open sourcing the first document OCR benchmark for the agentic era, ParseBench. Document parsing is the foundation of every AI agent that works with real-world files. ParseBench is a benchmark that measures parsing quality specifically for agent knowledge work: ✅ It optimizes for semantic correctness (instead of exact similarity) ✅ It has the most comprehensive distribution of real-world enterprise documents It contains ~2,000 human-verified enterprise document pages with 167,000+ test rules across five dimensions that matter most: tables, charts, content faithfulness, semantic formatting, and visual grounding. We benchmarked 14 known document parsers on ParseBench, from frontier/OSS VLMs to specialized parsers to LlamaParse. Here are some of our findings: 💡 Increasing compute budget yields diminishing returns - Gemini/gpt-5-mini/haiku gain 3-5 points from minimal to high thinking, at 4x the cost. 💡 Charts are the most polarizing dimension for evaluation. Most specialized parsers score below 6%, while some VLM-based parsers do a bit better. 💡 VLMs are great at visual understanding but terrible at layout extraction. GPT-5-mini/haiku score below 10% on our visual grounding task, all specialized parsers do much better. 💡 No method crushes all 5 dimensions at once, but LlamaParse achieves the highest overall score at 84.9%, and is the leader in 4 out of the 5 dimensions. This is by far the deepest technical work that we’ve published as a company. I would encourage you to start with our blog and explore our links to Hugging Face to GitHub. All the details are in our full 35-page (!!) ArXiv whitepaper. 🌐: Blog: 📄 Paper: 💻 Code: 📊 Dataset: 🎥 YouTube:

Jerry Liu

108,093 görüntüleme • 4 ay önce

hy3 vs fable 5 vs opus 4.8 vs sonnet 5 Tencent Hy just dropped hy3 – their new open-weight model under apache 2.0. following the april preview they scaled up post-training, and it now rivals flagship open models with 2-5x the params. api pricing: ~$0.15 in / ~$0.59 out per 1m tokens. built for coding, office work, frontend, agentic tasks so we ran a test: hy3 vs fable 5 vs opus 4.8 vs sonnet 5 three prompts, one-shot each: • ocean wave crumbling a sand castle (canvas) • looping factory assembly line (html/css/js) • interactive 3d city with three.js + orbitcontrols self-contained files, no libraries beyond the cdn where asked totals across all three prompts: 1. hy3 – 1231 loc / 14m34s 2. sonnet 5 – 1373 loc / 18m55s 3. fable 5 – 1546 loc / 18m32s 4. opus 4.8 – 1904 loc / 27m21s hy3 is the fastest and the leanest by a wide margin we had opus 4.8 analyze hy3's code. the read: - sand castle: checklist-complete but the crumble is parametric, not physical. it shrinks and slumps the towers and fades alpha instead of dissolving into grains. the cheap-but-plausible interpretation. the tell of a smaller model - factory line: the arm-to-part sync is actually causal, not faked. it triggers each robot early by exactly the arm's descent time, so the tap lands right as the part arrives. it also pre-seeds the belt so it never cold-starts empty. clean state machine. one latent bug – a part gets marked processed before checking if the robot is free, so at a faster spawn rate a "laptop" could ship missing a part. never fires at current timing, but the invariant isn't enforced - 3d city: genuinely frontier-adjacent. correct modern setup (pcfsoft shadows, srgb, aces tone mapping, damped orbit + auto-rotate pause). clones the window texture per building and scales the uv repeat to each building's dimensions so windows don't stretch. downside: no instancing – ~800 texture clones across 200 buildings. runs fine, not optimized. roads are implicit gaps, not explicit planes our observations: • hy3 is quite fast • its animations are simple but you can see it trying – it adds detail, and the 3d render sits at the same level as the frontier models • sonnet 5 is weak here. hy3 beats it on the sand castle and the 3d render, level on the conveyor • opus 4.8 is anthropic's best model after the fable 5 nerf – it beats fable on the conveyor and the 3d render net: hy3 runs clean and well-formed across all three with zero syntax errors, even version-matching the three.js core and examples build. it's economical rather than ambitious – it does the minimum viable version of each hard requirement well, and only reaches for the expensive interpretation on the 3d task a very coherent profile for a cost-optimized open-weight model follow thehype. for 24/7 ai news, analysis and breakdowns

thehype.

34,961 görüntüleme • 1 ay önce

BREAKING: Anthropic just dropped Fable 5.1—and CLAUDE IS SO BACK. We’ve spent the last week testing it at Every 🪨 across coding, writing, and knowledge work. Our verdict: It's finally Fable for everyone. It’s the strongest coding model we’ve used, but now it's fast, token-efficient, and CRUCIALLY actually speaks like a normal person. Here’s our vibe check: - A monster at coding. Kieran Klaassen rebuilt a working version of Proof, our document editor, from one prompt. It added useful details he hadn’t requested, and it handles enormous coding jobs that run for days at a time. It built a computer use Mac app for me called Hands in one-shot that other models failed at. - A Claude our writers want to use again. It has clearer prose, fewer AI tells, and it takes an edit without arguing. It's a significant upgrade over Opus 5. And won Katie Parrott's heart back. - About half the tokens as Opus 5, and much faster. In our Slack-agent tests, it delivered comparable results to Opus 5 using about half as many tokens, in about 60% of the time. - Knowledge work you can delegate. It can produce great knowledge work—like slide decks—end to end without making slop. And flew threw hammer's tests with flying colors. - It now supports zero-data-retention agreements. Now businesses can actually use it! A big barrier to Fable adoption is gone. Net Result: It's obviously an Opus 5 killer. If that was your daily driver you should switch today. If you're using GPT-5.6 in ChatGPT for Work, it's spinning the wheels on for big delegated tasks. I still use ChatGPT for Work more day to day, but I use way more tokens in Fable 5.1. I send it off at the beginning of the day to do big programming projects, like end to end MVP builds, and check in every once in a while. State of Play: The big knock on Anthropic was they built a supergenius in a datacenter that was almost unusable. It was too slow, argued back, and talked in technical gibberish. They've managed to solve those problems and more with Fable 5.1!

Dan Shipper

198,224 görüntüleme • 2 gün önce

GPT-5.6 vs GPT-5.5 on my custom spaceship prompt. I gave both models the exact same custom prompt. This is also the same prompt I previously gave to Fable 5. For context, GPT-5.6 Pro worked for 87 minutes, while GPT-5.5 Extra High worked for 34 minutes and 42 seconds. As I’ve said before, based on great authority GPT-5.6 will be an incremental/soldi improvement over GPT-5.5, not a “Fable killer.” My rough expectation has been that it would trade blows with Fable 5 on some benchmarks, maybe win around half depending on the category, but not clearly surpass it overall. And again fable five will have bigger model smell, but this was expected. After testing this coding output, that view feels pretty accurate. GPT-5.6 is clearly better than GPT-5.5 in several visual areas. The lighting, shading, chairs, object details, and exterior of the spaceship looked noticeably stronger. The scene was also easier to test. I do want to give GPT-5.5 credit though. It built out the rooms much much better and the planets looked better than GPT-5.6’s. It was also interesting that both GPT-5.5 and GPT-5.6 produced better-looking planets than Fable 5 in this specific test. The downside with GPT-5.5 was stability. The game was much glitchier and harder to test compared to GPT-5.6. But when it comes to the core of the demo, which is the spaceship itself, Fable 5 still beat both models pretty comfortably. GPT-5.6 is impressive, but from this test, it looks exactly like what I expected which was a meaningful incremental improvement over GPT-5.5, at least for indie game demos, but not something that replaces Fable 5. In collaboration with Chetaslua

Chris

250,919 görüntüleme • 2 ay önce