正在加载视频...
视频加载失败
Release Day 🎉 Meet OpenApps — a pure-Python, open-source ecosystem for stress-testing UI agents at scale. Runs on a single CPU. Generates thousands of unique UI variations. And it reveals just how fragile today’s SOTA agents are. (Yes, even GPT-4 and Claude struggle.)
10,143 次观看 • 10 个月前 •via X (Twitter)
5 条评论

Why OpenApps? ✅ Unlimited data for evaluation and training ✅ Lightweight — single CPU, no Docker, no OS emulators ✅ Reliable rewards from ground-truth app state ✅ Plug-and-play with any RL Gym or multimodal LLM agent

This isn’t just a benchmark — it’s a generator. 🏭 With simple YAML configs, you can spawn thousands of variants of 6 fully functional apps. Swap themes, scramble layouts, inject “challenging” fonts… If your agent really understands UIs, this will show it.

⭐️ 📖 🛠️ Want to build new apps or tasks? Contributions welcome. Let’s push UI agents forward — together. 🚀

fascinating, so you're saying that even the current state-of-the-art models like GPT-4 and Claude are fragile under massive UI stress testing. what's the average time-to-failure (TTF) you observed for these models in OpenApps tests, and how does it compare to a baseline of non-stressed model performance?

Appreciate the simplicity of this framework!👏
