Loading video...
Video Failed to Load
Astra’s spatial understanding is mindblowing to watch. three uncalibrated cameras. no intrinsics, no extrinsics. it nudged the robot arm, learned how each camera sees motion, worked out the brush tip’s 3d offset, and verified it at new angles -- all from one prompt and a tiny follow up. final... show more
19,123 views • 5 days ago •via X (Twitter)
12 Comments

the three cameras watching all of this -- a 4k camera, a two 1080p cameras! earlier while using Sol & Fable -- i'd tried a lot of fancy stuff with ChArUco boards, microswitches, Raspbery pico + touchscreen, and was still struggling. Astra was like, "bro, just give me 3 cameras."

very cool to watch. the goal was to maintain the tip at a fixed point in space right ?

yes, exactly! to find the 3d position of the brush tip relative to the robot arm.

did u also do the drawing demo on reddit?

yes! that one was with 5.6 Sol. With Astra it's been a whole diff experience!

This looks like Astra closed the gap so much with humans.

impressive

the polished demo is the invitation; i still want the awkward click where the handoff can wobble. watched demos are not deployed-path proof, especially when the robot is learning the room. curious what broke first in the live path?

Three uncalibrated cameras and one prompt… that’s pretty wild.

That's wild. Most vision systems still choke on calibration drift, but resolving 3d offsets on the fly is a huge jump in real world reliability.

Estimating TCP offsets under 0.2 mm across uncalibrated views is impressive for spatial geometry. The next step is dynamic contact. The moment the brush touches the surface, stiffness and force compliance take over where vision leaves off.

That kind of self calibration changes everything
