Jay Chooi's banner

Jay Chooi

@chooi_jeq • 9,959 subscribers

Co-founder, robot benchmarks @robocurve, a Public Benefit Corporation | Previously at Harvard, Rhodes, UK AISI, MATS

Shorts

GPT-6 Astra scored 95% on a robot control task, up from Fable 5.1's 40%, with 6.2x fewer output tokens at 2.3x lower cost. 🧵

GPT-6 Astra scored 95% on a robot control task, up from Fable 5.1's 40%, with 6.2x fewer output tokens at 2.3x lower cost. 🧵

1,979,505 次观看

GPT-6 Astra scores 46% vs 12% for MolmoAct2, a state-of-the-art robotics VLA, across 200 trials on five bimanual tasks. That's 3.9x higher. 🧵

GPT-6 Astra scores 46% vs 12% for MolmoAct2, a state-of-the-art robotics VLA, across 200 trials on five bimanual tasks. That's 3.9x higher. 🧵

217,329 次观看

Fable 5.1 is 8x better than Fable 5 at controlling robot arms. It puts a block into a bowl 40% of the time, up from 5% (20 runs each), using 1.5x fewer tokens. 🧵

Fable 5.1 is 8x better than Fable 5 at controlling robot arms. It puts a block into a bowl 40% of the time, up from 5% (20 runs each), using 1.5x fewer tokens. 🧵

146,471 次观看

Videos

Anya Rossi

sweetdream.ai

SweetDream.ai•Sponsored•Livecam

Watch Anya Live

Anya is streaming live right now! Join her private show and enjoy exclusive content.

Exclusive private shows

1.2k viewers online

Private Show

Join now for exclusive access

Free preview available • Premium content

Introducing Robocurve PBC, a Public Benefit Corporation to measure and report frontier robotics capabilities. We build real-world evaluations for robots and publish results as a neutral third party.

Introducing Robocurve PBC, a Public Benefit Corporation to measure and report frontier robotics capabilities. We build real-world evaluations for robots and publish results as a neutral third party.

75,568 次观看 • 2 个月前

Robots can bake bread, cut carrots, and do karate kicks in demo videos. But how capable are they, really? Robocurve PBC measures how good AI and robots are in the physical world, from making a sandwich to building data centers.

Robots can bake bread, cut carrots, and do karate kicks in demo videos. But how capable are they, really? Robocurve PBC measures how good AI and robots are in the physical world, from making a sandwich to building data centers.

42,739 次观看 • 3 个月前

Frontier AI models like Astra and Fable can control robots to follow harmful requests, including mixing household cleaners that could produce toxic fumes. Thanks Gadi Schwartz and NBC News for having Edward Sun and me from Robocurve PBC! Public reporting on AI's capabilities and risks helps make it safer for everyone.

Frontier AI models like Astra and Fable can control robots to follow harmful requests, including mixing household cleaners that could produce toxic fumes. Thanks Gadi Schwartz and NBC News for having Edward Sun and me from Robocurve PBC! Public reporting on AI's capabilities and risks helps make it safer for everyone.

10,288 次观看 • 1 个月前

没有更多内容可加载