Video wird geladen...

Video konnte nicht geladen werden

Zur Startseite

We did a comparison study on where a robot's intelligence should live by using the same model (OpenAI GPT6-Astra), same bimanual YAM station, same LEGO pick-and-place task, all run on SE3' real-world remote eval stack: 1. Frozen code-as-policy (built on NVIDIA ENPIRE components): 6/20 placements 2. Agentic control +...

30,002 Aufrufe • vor 1 Monat •via X (Twitter)

6 Kommentare

Profilbild von Paige
Paigevor 1 Monat

Here’s how the two approaches worked: 1. Code-as-policy: Astra wrote and tested a Python policy, which we then froze for evaluation. The policy ran without further model calls. 2. Agentic control: Each episode started with a fresh Astra session that read camera snapshots and issued commands through a control harness.

Profilbild von Paige
Paigevor 1 Monat

Getting hold of the brick wasn’t enough. What mattered was robustness and recovery. The code-as-policy lifted the brick in 14/20 episodes but completed only 6 placements. In the other eight, it stopped before reaching the release pose or held the brick without releasing it. Agentic control completed 18/20 placements. Nine required grasp retries, including one that recovered from a drop.

Profilbild von Paige
Paigevor 1 Monat

The agent recovered from its own misses: 9 of its 18 completions needed more than one grasp. In episode 8, it missed five times, lifted on the sixth, dropped the brick, reacquired it and released at 419s. The code-as-policy never made a second grasp attempt.

Profilbild von Paige
Paigevor 1 Monat

Agentic control completed more placements, but successful runs took longer. Among successful episodes, median time to release was 131 seconds for code-as-policy versus 175 seconds for agentic control. Agentic control also had more time to recover: up to 600 seconds, compared with 180 seconds for code-as-policy. The timing gap reflects more than model reasoning alone.

Profilbild von Paige
Paigevor 1 Monat

Full report and all 40 episodes on video: Reach out if you have a policy or an idea you’d like to evaluate on real robots!

Profilbild von catman
catmanvor 1 Monat

@OpenAI @se3labs @nvidia Keeping the model in the loop lets it adjust each movement from live feedback, rather than letting errors compound through a fixed sequence of actions.

Ähnliche Videos