Loading video...
Video Failed to Load
hey Astra, how fast are you really at using a computer?
1,951,106 views • 1 month ago •via X (Twitter)
51 Comments

the cursor isn’t doing all the work here: think of it as mouse clicks as the pianist’s right hand, with keyboard control covering the left hand and faster passages. both playing the same online piano. beautiful :)

im am literally speechless rn

😶

can you pls let tibo reset in a few hours? 🙏 ik that one banked reset is not enough to test astra today hahaha

i love yall

its 2am here. lemme sleep victor 🙏😭

i’m sorry 😂 I’ll upload my other demos tomorrow

Wait is this real?

100%

I don't wanna be that guy, but this is not realtime right? it writes the exact mouse clicks and keyboard presses it will take + sleeps for pacing, and then submitting the complete sequence in one tool call to execute over time? (which is still amazing btw, but I thought you meant it was moving the mouse and pressing keys in realtime, reacting as it goes, like a person would play) (I tried both ways to make sure, and it only worked when it wrote the sequence beforehand)

it is real. it’s moving the cursor and clicking around the main melody (right hand) chords require multiple presses so those are done by mapping to the keyboard ✅ Astra is then executing both actions at the same time

@janini_joao No AI doesn't work like that, they don't have sense of pace. It can send series of action in one turn and play it as scheduled, if you don't believe just ask codex

@victornunez @janini_joao I think it's generating the sequence as it's playing though. Kind of like how when using chat gpt voice it starts replying before the end of the line is actually done. So it's still essentially writing the key presses ahead of time but executing so fast it can write before needed

@MingyangJJ @victornunez I tried, it is not.

@MingyangJJ @victornunez So it's completely generating the entire sequence before starting?

@MingyangJJ @victornunez Yep

astra recorded the screen and edited this video btw 🎥

Unreal

still amazed at everything you’ve built 🫶

bro edited the video 1. why would it minimize and open the piano

sped up the reasoning piece and I mentioned that it took 3 turns to get to this point. music and clicks are both in real time 🫶

Had to try it for myself. Absolutely insane. Great work!

I tried it with Flight of the Bumblebee. So cool!

This is crazy

So cool! I asked it to be my drummer and started jamming with it. What a time to be alive 🤯

Very impressive

thanks, Dmitry! amazing times we’re living in

thanks team for making it available for everyone you da best

I have never wished for something to be real more than I have right now.

yoo thats not working at all for me haha

it’s a simplified demo has to ask it to get crafty and play it well (took 2 more turns)

sometimes im not patient enough xD, asked it again and its doing great!!

there you go!! 🎹

Not computer only. HOLY MOLY Astra is SO GOOD at Frontend design and creativity!! its insane.

very impressive work Victor! Astra feels like AGI and it’s better than Fable 5.1 and cheaper 👀👀👀👀

me seriously listening to AI play piano

Okay now you’re just flexing

claude code was good enough for this 3 months ago

vibes

You’re cheating a bit by using fast mode mate

Damn that’s awesome, actually felt a tear down my cheek

now do bohemian rhapsody

No, it is not using the computer in this speed, it is just one tool call. It is impossible for the model to time it's actions. Impressive that it can write such a complex tool call, but it is not playing piano live.

@AdamHoltererer 😳

Light speed.

Nice and quite fast! I've made it check papers and audit some code, and for now it seems to be working way faster than I thought it would be

Are we sure it didn't batch or script all of these commands beforehand?

But can it do Through the Fire and Flames on guitar hero?

Thats faster than me when i was a kid 🤭

Amazing stuff Victor! 🐐

i didnt believe it lol just tried and it’s legit. great demo! wild times
