I asked Astra to express itself using a keyboard. 40 minutes, several accidental long presses, and a lot of backspace later, it learned how to type. Video at 20× speed. Watch till the end!

now add a mouse

Next post

finally, computer use

how much did this cost

Do you provide some feedback when it doing wrong?

Great question, I did! I kinda regret it though, because I think it would figure out the even if I don’t say anything. I told it to use quick taps when it was struggling with the “c”.

It is still a very impressive demo :)

"I am not a robot" just got 10x more real

40 minutes of long presses and backspace to learn typing is oddly human. progress looks messy in real time, clean at 20x speed

机器人自主学习打字还是挺有意思，从误触到学会只花了四十分钟，端到端自主训练的思路确实可以在实体机器人上落地。

Slow day on the keyboard frontd.

That's actually pretty impressive progress

Those accidental long presses make this a better control example than a perfect typing clip. A keypress is a timed contact and release, not just a target position. Treating it that way could make each action easier to verify before moving on.

This feels like robothorse that is pulling a car. Usually these types of innovations turn out to be very useful, because its totally new type of way for thinking.

The interesting part is not that it typed. It is the forty minutes of long presses, backspaces, and resets under the 20× cut. That recovery tax is usually what Physical AI demos leave on the cutting room floor.

Great demo! I'm curious about how the AI controlls keyboard.. With code-as-policy control, what is the reasoning behind the code like?

He seem has a mind