Video wird geladen...

Video konnte nicht geladen werden

Zur Startseite

New Opus 4.8 crashed Opus 4.7 at physics on canvas! We gave both models the same three prompts: simulate a real physics phenomenon on raw HTML5 canvas. Prompt 1: "A triple pendulum swings into chaos and paints glowing trails with its tip" Prompt 2: "A 1 kg block bounces...

638,609 Aufrufe • vor 4 Monaten •via X (Twitter)

39 Kommentare

Profilbild von Hugo Plat
Hugo Platvor 4 Monaten

thanks I’ll buy Opus 4.8 to pass my physics exam

Profilbild von atomic.chat
atomic.chatvor 4 Monaten

@the_great_hug0 the right decision!

Profilbild von Chandraprakash Darji
Chandraprakash Darjivor 4 Monaten

This is the result from sonnet with medium thinking

Profilbild von atomic.chat
atomic.chatvor 4 Monaten

Sonnet did solid job here

Profilbild von Chandraprakash Darji
Chandraprakash Darjivor 4 Monaten

I think it is better then 4.7

Profilbild von LiberalSismo
LiberalSismovor 4 Monaten

Now gives us examples about something that we would use in real life and not for just make an X post.

Profilbild von Shounak Das
Shounak Dasvor 4 Monaten

Skill Issue

Profilbild von Hutch, D.O.
Hutch, D.O.vor 4 Monaten

Fun exercise. Thought I'd have my agent Sirius give it a shot. What I think he did pretty good. @OpenAIDevs

Profilbild von atomic.chat
atomic.chatvor 4 Monaten

@OpenAIDevs sirius did pretty well! Appreciate seeing builders run the same experiment with their own agents :))

Profilbild von iksammy1
iksammy1vor 4 Monaten

Impressive

Profilbild von cws test
cws testvor 4 Monaten

nice

Profilbild von Alexander Benz
Alexander Benzvor 4 Monaten

The pendulum test is the best physics benchmark I've seen. Canvas code that produces realistic chaos requires actually modeling the system, not just pattern-matching from training data.

Profilbild von atomic.chat
atomic.chatvor 4 Monaten

exactly! and fake motion vs real chaotic dynamics shows up immediately

Profilbild von Venkatesh
Venkateshvor 4 Monaten

For these comparisons you need to launch opus 4.7 2x times vs opus 4.8 2x. You could be just looking at run to run variations of how these LLMs work.

Profilbild von insightformer
insightformervor 4 Monaten

Very interesting comparison visualizations. It clearly shows the differences between the models.

Profilbild von WeSee
WeSeevor 4 Monaten

We're slowly reaching the point where model upgrades feel less like "better chat" and more like software evolution.

Profilbild von Tech With Matteo
Tech With Matteovor 4 Monaten

the pendulum one is wild, i use Opus daily for coding and the jump from 4.7 to 4.8 on complex stuff is pretty noticeable

Profilbild von rpello
rpellovor 4 Monaten

Have these prompts run on each model’s release date? Or have you used a today’s 4.7 (crippled) version?

Profilbild von atomic.chat
atomic.chatvor 4 Monaten

opus 4.7 is crippled:))

Profilbild von Samir Patil
Samir Patilvor 4 Monaten

4.8 is wild 🔥 Built Claude Pulse for exactly this — live KV cache timer + usage right on claude .ai.

Profilbild von BruzWJ
BruzWJvor 4 Monaten

tbh the triple pendulum render looks slick but a canvas physics demo doesnt really tell me if the model holds up on actual coding work

Profilbild von Cristobal Santana
Cristobal Santanavor 4 Monaten

Nice. The pi-digits collision one is a good test because it needs exact physics, not just something that looks plausible. Curious whether it holds up on messier problems like fluids or soft-body collisions, where the math gets harder to fake visually.

Profilbild von Sathish Harry
Sathish Harryvor 4 Monaten

992 isn't a random number. The Galperin billiard: collisions ≈ π × √(M/m). With a 100,000:1 mass ratio, that's π × 316 ≈ 993. Opus 4.8 essentially solved the physics. 4.7 got 241 not even close. The benchmark is the whole point.

Profilbild von Rohit
Rohitvor 4 Monaten

That's impressive! It's fascinating to see how Opus 4.8 handles complex physics simulations. Looking forward to more insights from your comparisons.

Profilbild von atomic.chat
atomic.chatvor 4 Monaten

@ai_rohitt glad you enjoyed it! More side by side runs on the way

Profilbild von Sebastian Buzdugan
Sebastian Buzduganvor 4 Monaten

did either use a fixed timestep because variable dt usually makes canvas physics demos lie

Profilbild von Build with Jeje
Build with Jejevor 4 Monaten

opus 4.8 math model is so great. only the limit sucks 😔

Profilbild von GiovanniArturi
GiovanniArturivor 3 Monaten

Sorry, but what as to do Opus with local AI models? It can only run remotely on Anthropic servers via APIs.

Profilbild von 🐺 steve 🐺
🐺 steve 🐺vor 4 Monaten

CC @RayKurz

Profilbild von Noureddine
Noureddinevor 4 Monaten

4.8 crashing on physics implies an over-eager alignment filter. Complex simulations can hit safety boundaries if intermediate steps are misinterpreted as harmful or exploit prompts.

Profilbild von Gia huy
Gia huyvor 4 Monaten

本当に面白そう!バージョン4.8がバージョン4.7を打ち負かしたんだね。どんな物理現象が再現されているんだろう?楽しみ!

Profilbild von Ex0 Byte
Ex0 Bytevor 4 Monaten

i want to use this to improve my memory system! can i use atomic chat to benchmark my self improving memory system?

Profilbild von Ziv Chen
Ziv Chenvor 4 Monaten

Should it be Opus 4.8 or 4.6? Opus 4.7 has received mixed reviews.

Profilbild von Life Around Earth
Life Around Earthvor 4 Monaten

the detail in that pendulum prompt is actually a solid benchmark for chaos visualization

Profilbild von atomic.chat
atomic.chatvor 4 Monaten

Yeeah, exactly why we picked it!

Profilbild von Blum
Blumvor 4 Monaten

wild how clearly opus 4.8 dominates 4.7 here

Profilbild von AIじいさん
AIじいさんvor 4 Monaten

壁を通りぬけるのは面白いんじゃ🤣

Profilbild von Theoden
Theodenvor 4 Monaten

We definitely should see more hard, thick balls hitting the wall more often

Profilbild von Snowdog_base
Snowdog_basevor 3 Monaten

Snowdog has been watching this for 3 hours. 🐾❄️ Not the physics. Not the AI benchmark. Just the bouncing balls. 🟡 Same energy as staring at snow falling at 3am. ❄️🍯 $SD #Snowdog

Ähnliche Videos

Gemini 2.5 Flash demolishes my Galton Board test, I could not get 4omini, 4o mini high, or 03 to produce this. I found that Gemini 2.5 Flash understands my intents almost instantly, code produced is tight and neat. The prompt is a merging of various steps. It took me 5 steps to achieve this in Gemini 2.5 Flash, I gave up on OpenAI models after about half an hour. My iterations are obviously not exact. But people can test with this one prompt for more objective comparison. Please try this prompt on your end to confirm: -------------------------------------------------- Create a self-contained HTML file for a Galton board simulation using client-side JavaScript and a 2D physics engine (like Matter.js, included via CDN). The simulation should be rendered on an HTML5 canvas and meet the following criteria: 1. **Single File:** All necessary HTML, CSS, and JavaScript code must be within this single `.html` file. 2. **Canvas Size:** The overall simulation area (canvas) should be reasonably sized to fit on a standard screen without requiring extensive scrolling or zooming (e.g., around 500x700 pixels). 3. **Physics:** Utilize a 2D rigid body physics engine for realistic ball-peg and ball-wall interactions. 4. **Obstacles (Pegs):** Create static, circular pegs arranged in full-width horizontal rows extending across the usable width of the board (not just a triangle). The pegs should be small enough and spaced appropriately for balls to navigate and bounce between them. 5. **Containment:** * Include static, sufficiently thick side walls and a ground at the bottom to contain the balls within the board. * Implement *physical* static dividers between the collection bins at the bottom. These dividers must be thick enough to prevent balls from passing through them, ensuring accurate accumulation in each bin. 6. **Ball Dropping:** Balls should be dropped from a controlled, narrow area near the horizontal center at the top of the board to ensure they enter the peg field consistently. 7. **Bins:** The collection area at the bottom should be divided into distinct bins by the physical dividers. The height of the bins should be sufficient to clearly visualize the accumulation of balls. 8. **Visualization:** Use a high-contrast color scheme to clearly distinguish between elements. Specifically, use yellow for the structural elements (walls, top guides, physical bin dividers, ground), a contrasting color (like red) for the pegs, and a highly contrasting color (like dark grey or black) for the balls. 9. **Demonstration:** The simulation should visually demonstrate the formation of the normal (or binomial) distribution as multiple balls fall through the pegs and collect in the bins. Ensure the physics parameters (restitution, friction, density) and ball drop rate are tuned for a smooth and clear demonstration of the distribution. #OpenAI Sam Altman Greg Brockman AshutoshShrivastava Aidan McLaughlin

RameshR

247,923 Aufrufe • vor 1 Jahr

So Runway Gen 4.5 finally adds image-to-video, the workflow most pros rely on for consistency. We put it head to head with Kling AI and Google Flow VEO using the same reference images and prompts (below) to evaluate motion quality, stability, and cinematic realism. 1. Action/WaterPhysics Test Prompt: Cinematic, wide-shot of a man running in a shallow river. The camera is tracking the man from behind as he runs up the river. Handheld camera shake as the camera follows the man. 2. Fire Physics Test Prompt: Cinematic, wide-shot of terrified woman running towards her burning barn. She abruptly stops, and puts in hands on her head as she watches her barn burn down. 3. VFX test prompt: Cinematic, wide-shot of a hooded figure. Flashes of purple magic and smoke whirl around the figure. The figure lifts its arms as the purple magic and smoke intensifies. 4. 2D Animation Test Prompt: 2D animated shot of a waiting at a bus stop in a thunderstorm. The man turns, walks to the bench, and sits down. 5. 3D Animation Test Prompt: 3D animated shot of an octopus. The octopus reaches into a coral and picks up a glowing white gem. 6. Conversation Test Prompt: slow camera push-in as two friends are having a conversation at a coffee shop Overall verdict: Despite the “world’s best” claim, Runway Gen 4.5 is not there yet. Prompt adherence is solid, but motion, physics, and cinematic realism still lag behind tools like Kling and VEO. Great platform, mid-tier model for now.

Curious Refuge

25,712 Aufrufe • vor 8 Monaten