Загрузка видео...
Не удалось загрузить видео
This week, we tested 3 latest models in our Game Arena Benchmark: → O3 → O4-mini → Gemini 2.5 Flash Across 4 games—Phoenix Wright, Sokoban, Candy Crush, and 2048—O3 dominated the zero-shot leaderboard, ranking #1 or #2 in nearly every task and outperforming previous SOTA models like O3-mini and... show more
15,105 просмотров • 1 год назад •via X (Twitter)
Комментарии: 9

Leaderboard Snapshot: • O3 — 🥇 in Sokoban & 2048, 🥈 in Phoenix Wright & Candy Crush. • O4-mini — 🥇 in Candy Crush, lower ranks elsewhere. • Gemini 2.5 Flash — mid-tier across all games. O3 showed strong multi-modal reasoning, especially in spatial and long-horizon tasks, consistently placing in the top 2 across all games. O3 completely outperformed previous SOTA models like Gemini-2.5-pro and O3-mini. Gemini-2.5-flash delivered steady, cost-efficient performance without leading. For full results, check out the leaderboard here:

OpenAI’s latest models—O3 and O4-mini—both showed strong reasoning in Candy Crush. They didn't just play; they optimized—aiming to eliminate the most candies per move. 🍬 This task demands more than quick reaction: → Vision to understand the board 👁️ → Reasoning to evaluate all possible swaps 🤔 → Planning to pick the best move 🎯 O3 and O4-mini consistently pushed beyond basic matches, prioritizing smart plays. O4-mini averaged 129, just shy of our human-level baseline of 134, and well above the previous SOTA O3-mini at 106.3. 👀

We’re building more transparent, robust, and creative AI benchmarks—and we’d love your input. 💡📊 Got ideas for game-based evaluations? Have a challenge in mind? Drop your thoughts below! We also welcome more people to join our community, whether you're a researcher, builder, or just curious. → Leaderboard: → GitHub: → Website: Let’s push AI evaluation forward—together. 🚀

Get ready for a full-body VR workout that’s fun, fast, and intuitive — Play PowerBeatsVR (Now on Meta Quest) 🔥

I don’t know why there isn’t any comments. This is awesome! It shows that o3 is making real world tangible progress! Please don’t stop doing these!!

thank you!

Great work! o3 looks like a great model.

indeed, the visual reasoning reflects well on game play!

Very good It should be tested to play more mobile app games >pubg , freefire >dragonball legends, dokkan battle >pokemon unite, go, masters >sports betting apps >stardew valley, farmville and sims

