Computer use has arrived in GitHub Copilot! Automate expenses, book travel, or speed up E2E testing. Available in preview today:

U couldn’t have found a better use case to demo computer use on 😁🎉🙌 Worth every token

If you've ever used any internal expense tool, you know that is the ultimate test for any CUA agent :D

Definitely have and they r all awful And when u say it like that I can already see agentTravelExpenseBench becoming a thing 😝

How do you know we don't already have it in our evals??? 👀

@fkadev At last!!!!!! It’s been so long, so cool!

Ah, I can finally get to doing all the SAP Concur stuff now Pretty cool stuff btw, excited to try this :)

Thank you!

coming to vs code github copilot too?

Yes, definitely! Very soon.

thx love it

desktop app automation means agents can control real tools, not just chat.

Expense forms are a good test of recovery. After a timeout, the agent needs to check whether the submission already went through before clicking again. A saved confirmation number or draft ID would make that much easier to verify.

Surely that costs a lot of credits

Congrats mate. What build is this supported in? It says i'm up to date (1.1.26), i don't see Computer Use in settings...

Can't wait to try it on myexpense!

If it can renew my Indian passport online, I am all in!!!

It is wild that it can now automate tasks in apps that don't even have APIs:

wait what. how th it's been controlling my computer all this time. you guys have different github copilot app than mine. jokes aside, I been loving the "Session Bridge" feature in the app for a month or two, until it started to kill my cpu and after debugging I found no such a feature from you. it was me who built it unknowingly and was thinking it's new feature!

Is there a plan to make a remote experience that works seamlessly with the Local harness in vs code? Like codex where I can go to a remote tab on my phone app and the session is there. Why only the agent host and copilot (cli) harness?

Best use case ever!

Receipt OCR is solved; surviving 5 nested dropdowns and expired SSO cookies in Concur is the true boss fight.

Just need these now

Did you guys will ever fix elephant in the room? Monthly reset is ridiculous

desktop interaction makes copilot far more useful for end-to-end testing

Does it use Cua under the hood for computer use, or is it a custom tool developed by GitHub internally?

home, cowork, autopilot, code, ghcp computer use...incredibly confusing user experience. I do think GHCP is better overall than the whole MS Copilot experience...I figure I'll just use this primarily tbh. I dont understand why MSFT just trashes the copilot app and invest everything into the GHCP experience....