Loading video...

Video Failed to Load

Go Home

Google just unveiled a new project that shows how AI Agents are coming for full browser and computer use. This opens up AI to any of the laborious knowledge tasks that we do today. Most importantly, it lets us automate work that we never had even contemplated before.

145,442 views • 1 year ago •via X (Twitter)

10 Comments

Maddy's profile picture
Maddy1 year ago

This is a half step. Building AIs to interact with computer browsers like humans shouldn’t be the end goal. Building AIs and infrastructure needed for AIs to use computers via APIs and other faster non human interfaces should be the end goal. Imagine filling out a spreadsheet with 1000 rows with this format. It would take days.

Suchintan Singh's profile picture
Suchintan Singh1 year ago

This paints a very rosy future for sure. I can't wait to see where we end up in a few months when we don't have to do any pointless work anymore PS: we're building the open source version of this at

Russell's profile picture
Russell1 year ago

Google has a challenge that most of the other AI vendors do not. As the defacto search engine for the world, they need to ease their users into a new way of using their search products.

Jagan's profile picture
Jagan1 year ago

Things will get really wild pretty soon. Future is to deloy these powerful models locally so we decrease the latency significantly. If it has to be done through a cloud platform, I would not want to see it do the work. Do that behind the screen and show me only the results.

.X .Com's profile picture
.X .Com1 year ago

Lead magnet

Jordan Thibodeau's profile picture
Jordan Thibodeau1 year ago

Thank god. Keep pushing this forward @JeffDean and @demishassabis, you guys are doing the lord's work. There's so much corporate drone work that needs to go away so folks can focus on work that they enjoy doing.

JR McKee's profile picture
JR McKee1 year ago

OK. I'm sold, how do I get to play with it?

insecurity matters's profile picture
insecurity matters1 year ago

Waiting for someone to ask it to trawl all sites for login pages and attempt a bruteforce attack!

ml's profile picture
ml1 year ago

but.. not your OS, not your agent?

Ali Partovi's profile picture
Ali Partovi1 year ago

Super impressive!

Related Videos

Today, Box is announcing major new AI agent capabilities to let customers tap into the full value of their unstructured data. First, we’re announcing all new updates to the Box AI Studio to make it even easier to build AI agents that tap into your enterprise content for any job function, business process, or industry specific use case. We are also expanding our set of foundational agents that customers will be able to use to work with their enterprise content, including new features like search and research on unstructured data. Next, we’re announcing Box Extract to enable customers to use AI agents seamlessly for complex data extraction from any type of document or content. This makes it easier than ever to pull out data from contracts, invoices, research data, marketing assets, medical charts, and more. Finally, we’re introducing Box Automate, a new workflow automation solution within Box that lets you deploy AI agents across enterprise content-centric workflows. With Box Automate, you can design your business process in a simple drag and drop builder and then drop in AI agents at any step in the process. This ensures agents execute tasks at the right steps in a workflow every time. Best of all, our AI agents and workflow tools are designed to work across any system our customers work within, whether it’s leveraging pre-built integrations, Box APIs, or the new Box MCP Server. Ultimately, all of these capabilities come together to transform how companies can work with their enterprise content. Software has historically only been good at automating work that deals with structured data, which is why ERP, CRM, and HR systems have been mainstays of enterprise software for so long. The data in these systems fits neatly into a database, and the workflows are very ripe for automation. But it turns out most of the work in the world deals with unstructured data. It’s ideating through research documents, working with a client on contracts, reviewing details for a new product launch, looking at a patient’s healthcare record to make a diagnosis, working through due diligence documents for an M&A deal, and so on. For the first time ever, we can begin to bring all new insights and automation to this work with AI agents. At Box, we’re incredibly excited to be on this journey to help customers transform how they work with their most important data.

Aaron Levie

91,863 views • 1 year ago