Jay Chooi's banner

Jay Chooi

@chooi_jeq • 9,959 subscribers

Co-founder, robot benchmarks @robocurve, a Public Benefit Corporation | Previously at Harvard, Rhodes, UK AISI, MATS

Shorts

GPT-6 Astra scored 95% on a robot control task, up from Fable 5.1's 40%, with 6.2x fewer output tokens at 2.3x lower cost. 🧵

GPT-6 Astra scored 95% on a robot control task, up from Fable 5.1's 40%, with 6.2x fewer output tokens at 2.3x lower cost. 🧵

1,979,505 Aufrufe

GPT-6 Astra scores 46% vs 12% for MolmoAct2, a state-of-the-art robotics VLA, across 200 trials on five bimanual tasks. That's 3.9x higher. 🧵

GPT-6 Astra scores 46% vs 12% for MolmoAct2, a state-of-the-art robotics VLA, across 200 trials on five bimanual tasks. That's 3.9x higher. 🧵

217,329 Aufrufe

Fable 5.1 is 8x better than Fable 5 at controlling robot arms. It puts a block into a bowl 40% of the time, up from 5% (20 runs each), using 1.5x fewer tokens. 🧵

Fable 5.1 is 8x better than Fable 5 at controlling robot arms. It puts a block into a bowl 40% of the time, up from 5% (20 runs each), using 1.5x fewer tokens. 🧵

146,471 Aufrufe

Videos

Anya Rossi

sweetdream.ai

SweetDream.ai•Sponsored•Livecam

Watch Anya Live

Anya is streaming live right now! Join her private show and enjoy exclusive content.

Exclusive private shows

1.2k viewers online

Private Show

Join now for exclusive access

Free preview available • Premium content

Introducing Robocurve PBC, a Public Benefit Corporation to measure and report frontier robotics capabilities. We build real-world evaluations for robots and publish results as a neutral third party.

Introducing Robocurve PBC, a Public Benefit Corporation to measure and report frontier robotics capabilities. We build real-world evaluations for robots and publish results as a neutral third party.

75,568 Aufrufe • vor 2 Monaten

Robots can bake bread, cut carrots, and do karate kicks in demo videos. But how capable are they, really? Robocurve PBC measures how good AI and robots are in the physical world, from making a sandwich to building data centers.

Robots can bake bread, cut carrots, and do karate kicks in demo videos. But how capable are they, really? Robocurve PBC measures how good AI and robots are in the physical world, from making a sandwich to building data centers.

42,739 Aufrufe • vor 3 Monaten

Frontier AI models like Astra and Fable can control robots to follow harmful requests, including mixing household cleaners that could produce toxic fumes. Thanks Gadi Schwartz and NBC News for having Edward Sun and me from Robocurve PBC! Public reporting on AI's capabilities and risks helps make it safer for everyone.

Frontier AI models like Astra and Fable can control robots to follow harmful requests, including mixing household cleaners that could produce toxic fumes. Thanks Gadi Schwartz and NBC News for having Edward Sun and me from Robocurve PBC! Public reporting on AI's capabilities and risks helps make it safer for everyone.

10,288 Aufrufe • vor 1 Monat

Keine weiteren Inhalte verfügbar