Loading video...

Video Failed to Load

There was a problem loading this video. This could be due to a temporary network issue or the video might be unavailable.

Finally, a browser automation framework for Agents that actually works in production (open-source)! Typical browser automation tools like Selenium or Playwright require you to hard-code automation. These are brittle since one change in the website can disrupt the full workflow. On the other hand, high-level Agents like OpenAI Operator... can be unpredictable in production. Stagehand is an open-source framework that bridges the gap between: - brittle traditional automation like Playwright, Selenium, etc. and - unpredictable full-agent solutions like OpenAI Operator. Key features: - Use AI when you want to navigate unfamiliar pages. - Use code (Playwright) when you know exactly what to do. - Preview AI actions before running them. - Cache repeatable actions to save tokens. - Compatible with SOTA computer use models with just one line of code. - Available in both Python and TypeScript SDK. Stagehand also has an open-source MCP server. Find a link to the repo in the comments! 👉 Over to you: Would you use this instead of Selenium?show more

Avi Chawla

71,795 subscribers

101,419 views • 1 year ago •via X (Twitter)

Science & Technology Education

Anya Rossi• Live Now

Private livecam show

10 Comments

Avi Chawla1 year ago

GitHub repo →

Avi Chawla1 year ago

If you found it insightful, reshare it with your network. Find me → @_avichawla Every day, I share tutorials and insights on DS, ML, LLMs, and RAGs.

Akshay 🚀1 year ago

Browser automation framework for Agents that actually works! 🔥

Bui Dinh Ngoc1 year ago

I'm curious how it handles authentication flows and CAPTCHAs compared to traditional automation. Those edge cases are where most tools fall apart.

John the Freelancer1 year ago

This could finally make browser automation less painful.

Tyson Thomas1 year ago

What if I told you just need a single download of @BrowserOperator browser to get the same functionality with @AnthropicAI models!! 😉 #OpenSourceAI #AIBrowser

Julian Harris1 year ago

Have you used this? Do you have examples of this in production? Highly sceptical myself. I have a fundamental problem with approach, which is extremely expensive to run and very slow. I found a better technique that still takes advantage of language model flexibility but is at least 10x times faster. And cheaper.

Senthazal Ravi1 year ago

Finally !

Himanshu Kumar1 year ago

Automating agents reliably needs more than just avoiding hard-coded workflows; true resilience requires adaptability.

PromptNextAI – eu/acc1 year ago

can work headless mode?

Related Videos

Open AI released Operator, an agent that can use the browser to perform and automate tasks for you! I have built an Open Source version of Operator using Browser Use, running locally on your computer. 100% Open Source

Open AI released Operator, an agent that can use the browser to perform and automate tasks for you! I have built an Open Source version of Operator using Browser Use, running locally on your computer. 100% Open Source

Sumanth

62,485 views • 1 year ago

Don't waste your time building an Agentic Browser We built an chrome extension that does everything gpt atlas does and more - Can take actions and do things for you right in your own browser - Use 500+ tools like Gmail, Slack, Notion and more - Can be easily accessed in your sidebar Built with Composio Tool Router, Google AI Developers Gemini 2.5 Computer Use and AI SDK Completely free and open source link to the code:

Don't waste your time building an Agentic Browser We built an chrome extension that does everything gpt atlas does and more - Can take actions and do things for you right in your own browser - Use 500+ tools like Gmail, Slack, Notion and more - Can be easily accessed in your sidebar Built with Composio Tool Router, Google AI Developers Gemini 2.5 Computer Use and AI SDK Completely free and open source link to the code:

Karan Vaidya

73,887 views • 10 months ago

You can easily rewrite most automations I've seen using Claude Code and Codex by replacing them with a script. Why would you spend tokens running deterministic workflows? In this video, I'll show you: • An automation using Zapier's SDK • When to use the SDK and when the MCP

You can easily rewrite most automations I've seen using Claude Code and Codex by replacing them with a script. Why would you spend tokens running deterministic workflows? In this video, I'll show you: • An automation using Zapier's SDK • When to use the SDK and when the MCP

Santiago

29,103 views • 3 months ago

OpenAI Operator looks great here is a open source version of it you can use now see an agent that uses your browser to perform tasks for you developers get started in a few lines of code pip install 'ai-gradio[browser]' import gradio as gr import ai_gradio gr.load( name='browser:gpt-4o', src=ai_gradio.registry, title='AI Browser Agent', description='Agent that helps with web tasks' ).launch()

OpenAI Operator looks great here is a open source version of it you can use now see an agent that uses your browser to perform tasks for you developers get started in a few lines of code pip install 'ai-gradio[browser]' import gradio as gr import ai_gradio gr.load( name='browser:gpt-4o', src=ai_gradio.registry, title='AI Browser Agent', description='Agent that helps with web tasks' ).launch()

AK

98,797 views • 1 year ago

You should really stop using Zapier or Make. Deploying Python scripts on Replit takes less than 5 min and is cheaper. Just describe what you want to automate and AI takes care of writing the code. For example, I created an automation that merges all the PDFs in a folder on Drive into a single file. All that's left to do is: - Copy/paste the API key - Click on "Run" And you're done! In this case I used Aider Chat (free and open source), but you can also use Replit Agent.

You should really stop using Zapier or Make. Deploying Python scripts on Replit takes less than 5 min and is cheaper. Just describe what you want to automate and AI takes care of writing the code. For example, I created an automation that merges all the PDFs in a folder on Drive into a single file. All that's left to do is: - Copy/paste the API key - Click on "Run" And you're done! In this case I used Aider Chat (free and open source), but you can also use Replit Agent.

Paul Couvert

163,002 views • 2 years ago

We just open-sourced Simulang, a JavaScript library that gives you and your coding agents the ability to fully control computers. Simulang is our scripting framework for desktop automation. It allows you to write deterministic computer use code that can be replayed dozens if not hundreds of times. Much faster and cheaper, compared to LLM agents. It ships with a skill out of the box. That means you can turn natural language prompts into Simulang code directly, and your agent can now see the screen, click, type, and navigate. It gives your AI agents eyes and hands to control the computer like humans do. Try these things with Simulang: - upload your pile of invoices to the expense platform - find 50 people with specific criteria on LinkedIn - open your calculator app and do some math - find all buttons on your favorite app using accessibility tree - or draw a bunny with MS paint 🐰 In this demo, we show how Simulang took over when the coding agent couldn’t open and click on the target LinkedIn profile page. Give it a try:

Simular

14,468 views • 3 months ago

SITUATION EXPLAINED: What happens to open source when the US restricts access to frontier AI models? We asked Adrian Dittmann: "China is releasing these models [open source] to gain international dominance, people will work on these things and say, 'Hey, maybe I can contribute to this if it's open source.' This is the thing that actually gets them talent." "If you're not allowed into the next GPT release or you're not allowed to use Fable, then what are you gonna do? You're stuck with the existing stuff, or you will have to use an open source model that might have subtly better capabilities." "The United States will catch up to open source in some form as well. They seem to just be maximizing product creation." "The problem with open source models is you have to be kind of a nerd in order to use them properly. Consumer facing, the effects will be minimal because the average person doesn't care about open source models. They only care whether or not they can do a quick search with Gemini or ChatGPT."

SITUATION EXPLAINED: What happens to open source when the US restricts access to frontier AI models? We asked Adrian Dittmann: "China is releasing these models [open source] to gain international dominance, people will work on these things and say, 'Hey, maybe I can contribute to this if it's open source.' This is the thing that actually gets them talent." "If you're not allowed into the next GPT release or you're not allowed to use Fable, then what are you gonna do? You're stuck with the existing stuff, or you will have to use an open source model that might have subtly better capabilities." "The United States will catch up to open source in some form as well. They seem to just be maximizing product creation." "The problem with open source models is you have to be kind of a nerd in order to use them properly. Consumer facing, the effects will be minimal because the average person doesn't care about open source models. They only care whether or not they can do a quick search with Gemini or ChatGPT."

MTS

14,406 views • 2 months ago

Peak AI: Never play Minecraft alone again Steve is an open-source Minecraft mod that brings LLM-powered AI agents (Groq, OpenAI, Gemini) directly into the game. Instead of helping you write code, these agents play alongside you - mining, building, exploring, and fighting through natural language commands. You type things like “mine some iron” or “build a house”, and the agent understands the context, plans a sequence of actions, and executes them autonomously. Source: YuvDwi Github (link in comments)

Peak AI: Never play Minecraft alone again Steve is an open-source Minecraft mod that brings LLM-powered AI agents (Groq, OpenAI, Gemini) directly into the game. Instead of helping you write code, these agents play alongside you - mining, building, exploring, and fighting through natural language commands. You type things like “mine some iron” or “build a house”, and the agent understands the context, plans a sequence of actions, and executes them autonomously. Source: YuvDwi Github (link in comments)

Chubby♨️

484,251 views • 10 months ago

The most amazing aspect of DeepSeek Open Source is that just the Reasoning Engine can be isolated and used with any other LLM. In fact you can have a mixture of Reasoning Engines cascade around a problem and then use an Operator type agent AI to function on the the results.

The most amazing aspect of DeepSeek Open Source is that just the Reasoning Engine can be isolated and used with any other LLM. In fact you can have a mixture of Reasoning Engines cascade around a problem and then use an Operator type agent AI to function on the the results.

Brian Roemmele

398,807 views • 1 year ago

wtf is MCP? Paul Klein IV, CEO of explains "Model Context Protocol" (MCP) in plain terms: "There's this new way that people are exposing tools to AI & the 'Model Context Protocol' is one of those ways that you can standardize & give your AI a set of tools to call. BrowserBase has a way to expose the browser to your agent via MCP or MCP server. More & more developers are trying to find ways to integrate more functionalities to their AI agents & BrowserBase's browsers are one of those primitive functionalities, & the MCP is just one way to integrate it into your software." Paul Klein IV From 🅱️'s GitHub: Model Context Protocol (MCP) is an open protocol that enables seamless integration between LLM applications and external data sources and tools. Whether you’re building an AI-powered IDE, enhancing a chat interface, or creating custom AI workflows, MCP provides a standardized way to connect LLMs with the context they need. This server provides cloud browser automation capabilities using Browserbase and Stagehand. This server enables LLMs to interact with web pages, take screenshots, and execute JavaScript in a cloud browser environment.

wtf is MCP? Paul Klein IV, CEO of explains "Model Context Protocol" (MCP) in plain terms: "There's this new way that people are exposing tools to AI & the 'Model Context Protocol' is one of those ways that you can standardize & give your AI a set of tools to call. BrowserBase has a way to expose the browser to your agent via MCP or MCP server. More & more developers are trying to find ways to integrate more functionalities to their AI agents & BrowserBase's browsers are one of those primitive functionalities, & the MCP is just one way to integrate it into your software." Paul Klein IV From 🅱️'s GitHub: Model Context Protocol (MCP) is an open protocol that enables seamless integration between LLM applications and external data sources and tools. Whether you’re building an AI-powered IDE, enhancing a chat interface, or creating custom AI workflows, MCP provides a standardized way to connect LLMs with the context they need. This server provides cloud browser automation capabilities using Browserbase and Stagehand. This server enables LLMs to interact with web pages, take screenshots, and execute JavaScript in a cloud browser environment.

Molly O’Shea

20,408 views • 1 year ago

NVIDIA just released a new open source transcription model, Nemotron Speech ASR, designed from the ground up for low-latency use cases like voice agents. Here's a voice agent built with this new model. 24ms transcription finalization and total voice-to-voice inference time under 500ms. This agent actually uses *three* NVIDIA open source models: - Nemotron Speech ASR - Nemotron 3 Nano 30GB in a 4-bit quant (released in December) - A preview checkpoint of the upcoming Magpie text-to-speech model These models are all truly open source: weights, training data, training code, and inference code. This is a big deal! Jensen said in the CES keynote yesterday that he expects open source models to catch up to proprietary models this year in a number of categories. NVIDIA is putting their weight behind making this happen. (As Alan Kay said, the best way to predict the future is to invent it.) The code for this agent is open source too, of course. You can deploy it to production with Modal and Pipecat AI cloud, or run locally on an NVIDIA DGX Spark or RTX 5090.

NVIDIA just released a new open source transcription model, Nemotron Speech ASR, designed from the ground up for low-latency use cases like voice agents. Here's a voice agent built with this new model. 24ms transcription finalization and total voice-to-voice inference time under 500ms. This agent actually uses three NVIDIA open source models: - Nemotron Speech ASR - Nemotron 3 Nano 30GB in a 4-bit quant (released in December) - A preview checkpoint of the upcoming Magpie text-to-speech model These models are all truly open source: weights, training data, training code, and inference code. This is a big deal! Jensen said in the CES keynote yesterday that he expects open source models to catch up to proprietary models this year in a number of categories. NVIDIA is putting their weight behind making this happen. (As Alan Kay said, the best way to predict the future is to invent it.) The code for this agent is open source too, of course. You can deploy it to production with Modal and Pipecat AI cloud, or run locally on an NVIDIA DGX Spark or RTX 5090.

kwindla

274,801 views • 8 months ago

Web scraping is a critical skill, and yet nobody talks about it. How do you think companies are training their Large Language Models? Where do you think the data comes from? But web scraping goes beyond all of that. Imagine giving an AI agent access to any public online data in real time! I like to call this "web-scrapping on demand", and I'm pretty sure it's going to unlock unlimited power for AI applications. I recorded a quick video to show you how you can do this using Apify. I've talked about them before, and they are collaborating with me on this post. They have one of the best open-source web scraping and browser automation libraries out there: But it gets much better than this! You can use MCP to connect your AI Agents and applications to the Apify platform and use any specialized actor on demand to scrape and process online data. In the video, I used Cursor to scrape LinkedIn posts with the words "Machine Learning" in real time. Worked like a charm with no code needed! Here is a link to the platform: Think about this: You can now feed your AI applications with any public data on demand! We aren't ready for what's coming.

Web scraping is a critical skill, and yet nobody talks about it. How do you think companies are training their Large Language Models? Where do you think the data comes from? But web scraping goes beyond all of that. Imagine giving an AI agent access to any public online data in real time! I like to call this "web-scrapping on demand", and I'm pretty sure it's going to unlock unlimited power for AI applications. I recorded a quick video to show you how you can do this using Apify. I've talked about them before, and they are collaborating with me on this post. They have one of the best open-source web scraping and browser automation libraries out there: But it gets much better than this! You can use MCP to connect your AI Agents and applications to the Apify platform and use any specialized actor on demand to scrape and process online data. In the video, I used Cursor to scrape LinkedIn posts with the words "Machine Learning" in real time. Worked like a charm with no code needed! Here is a link to the platform: Think about this: You can now feed your AI applications with any public data on demand! We aren't ready for what's coming.

Santiago

101,473 views • 1 year ago

Thrilled to see Amazon Web Services making a major contribution to the open source AI community with the launch of the Strands Agents, an open source AI agents SDK! The core of Strands is the simple agentic loop that connects the model and tools together, like the two strands of DNA. This model-driven approach to agent building eliminates the need for complex agent orchestration by embracing the capabilities of state-of-the-art models to plan, chain thoughts, call tools, and reflect. Providing open source tools and interoperability with open source protocols is an important part of our strategy to enable an agentic future. Can't wait to see what you build with Strands!

Thrilled to see Amazon Web Services making a major contribution to the open source AI community with the launch of the Strands Agents, an open source AI agents SDK! The core of Strands is the simple agentic loop that connects the model and tools together, like the two strands of DNA. This model-driven approach to agent building eliminates the need for complex agent orchestration by embracing the capabilities of state-of-the-art models to plan, chain thoughts, call tools, and reflect. Providing open source tools and interoperability with open source protocols is an important part of our strategy to enable an agentic future. Can't wait to see what you build with Strands!

Swami Sivasubramanian

32,185 views • 1 year ago

this is f**king insane. Jack Dorsey just open sourced a free tool for running a one-person business. the GitHub repo already has 14.4K stars. It lets you: → run your own server → keep chat, search, Git, and automation in one place → add AI agents that work like teammates → decide exactly what each agent can do no monthly subscriptions. just you, your AI agents, and full control. this is where one-person businesses are headed. save this for later.

this is f**king insane. Jack Dorsey just open sourced a free tool for running a one-person business. the GitHub repo already has 14.4K stars. It lets you: → run your own server → keep chat, search, Git, and automation in one place → add AI agents that work like teammates → decide exactly what each agent can do no monthly subscriptions. just you, your AI agents, and full control. this is where one-person businesses are headed. save this for later.

MIKE

708,451 views • 1 month ago

🚨 Secure OpenClaw - Message Your Custom AI Agent From Telegram We are excited for our first release of personal agents. You can now use Abacus AI's DeepAgent to vibe code a personal agent on Telegram Create and simply message the agent! - do tasks like respond to emails - schedule meetings - use the browser to book tickets - connect to your internal systems The agent runs on a secure environment with constraints and you can pretty much customize it exactly like you want it when you are building it This is just v1 - we are going to be launching something WAY more exciting soon

🚨 Secure OpenClaw - Message Your Custom AI Agent From Telegram We are excited for our first release of personal agents. You can now use Abacus AI's DeepAgent to vibe code a personal agent on Telegram Create and simply message the agent! - do tasks like respond to emails - schedule meetings - use the browser to book tickets - connect to your internal systems The agent runs on a secure environment with constraints and you can pretty much customize it exactly like you want it when you are building it This is just v1 - we are going to be launching something WAY more exciting soon

Bindu Reddy

10,702 views • 6 months ago