Video yükleniyor...

Video Yüklenemedi

Ana Sayfaya Dön

🎮 Computer Use Agent Arena is LIVE! 🚀 🔥 Easiest way to test computer-use agents in the wild without any setup 🌟 Compare top VLMs: OpenAI Operator, Claude 3.7, Gemini 2.5 Pro, Qwen 2.5 vl and more 🕹️ Test agents on 100+ real apps & webs with one-click config...

BowenWangNLP's profile picture

Bowen Wang

1,053 subscribers

93,200 görüntüleme • 1 yıl önce •via X (Twitter)

LIVE

Anya Rossi• Live Now

Private livecam show

0 Yorum

Yorum bulunmuyor

Orijinal gönderinin yorumları burada görünecek

Benzer Videolar

Arena reached a $100M annual revenue run rate just 8 months after launching our evaluation product. We started as a research project at UC Berkeley with a simple mission: measure AI progress through real-world use. As AI shifts from chatbots to agents taking on longer, higher-stakes work, the problem matters more than ever. Today, Arena measures real-world AI utility with a community of tens of millions. With Agent Arena, we’re evaluating long-running agents on complex, real-world tasks - how they use tools, adapt to feedback, recover from errors, and accomplish goals set by humans. We are excited to keep deepening our work in agentic evaluations. Here’s Anastasios Nikolas Angelopoulos on what this milestone means and where we go from here:
1:26

Arena reached a $100M annual revenue run rate just 8 months after launching our evaluation product. We started as a research project at UC Berkeley with a simple mission: measure AI progress through real-world use. As AI shifts from chatbots to agents taking on longer, higher-stakes work, the problem matters more than ever. Today, Arena measures real-world AI utility with a community of tens of millions. With Agent Arena, we’re evaluating long-running agents on complex, real-world tasks - how they use tools, adapt to feedback, recover from errors, and accomplish goals set by humans. We are excited to keep deepening our work in agentic evaluations. Here’s Anastasios Nikolas Angelopoulos on what this milestone means and where we go from here:

Arena.ai

211,194 görüntüleme • 2 ay önce

I am hooked on Dynamic Workflows! The idea of generating harnesses on the fly is so compelling that I reverse-engineered it for my agent orchestrator. And then I built a monitoring dashboard (as an HTML artifact) to track tasks, metrics, and reports. I can now use and monitor dynamic workflows in my agent orchestrator with coding agents like Claude Code, Codex, Pi, and even my own custom-built DAIR.AI agent. This is clearly the future of working with agents to accomplish complex, long-running tasks. Some use cases I'm having success with: - Branching deep research tasks (with verification) - Parallel deep research tasks - Session mining of all my agent sessions - Bug hunting - Triaging - Fact-checking - LLM councils - AI simulations - Data synthesis - Evals generation ... and many others Dynamic workflows, like agent skills, feel like an important primitive to not only get the most out of agents but also incorporate dynamic behaviors and important components like cooperation and verification. There is so much exploration ground here. The exciting part is that this is not limited to coding tasks; it extends to business use cases and many other technical domains like science and research.
0:25

I am hooked on Dynamic Workflows! The idea of generating harnesses on the fly is so compelling that I reverse-engineered it for my agent orchestrator. And then I built a monitoring dashboard (as an HTML artifact) to track tasks, metrics, and reports. I can now use and monitor dynamic workflows in my agent orchestrator with coding agents like Claude Code, Codex, Pi, and even my own custom-built DAIR.AI agent. This is clearly the future of working with agents to accomplish complex, long-running tasks. Some use cases I'm having success with: - Branching deep research tasks (with verification) - Parallel deep research tasks - Session mining of all my agent sessions - Bug hunting - Triaging - Fact-checking - LLM councils - AI simulations - Data synthesis - Evals generation ... and many others Dynamic workflows, like agent skills, feel like an important primitive to not only get the most out of agents but also incorporate dynamic behaviors and important components like cooperation and verification. There is so much exploration ground here. The exciting part is that this is not limited to coding tasks; it extends to business use cases and many other technical domains like science and research.

elvis

103,809 görüntüleme • 2 ay önce

You can create an AI Agent that answers your email with a few clicks. 1. Go to ChatLLM ( 2. Click on AI Engineer 3. Select Create an AI Agent 4. Choose the Email Answering Agent ChatLLM will do the rest: it will code, test, and deploy the agent for you. You can also create a custom agent in English. The Agent Economy is coming (somebody should write a book and use this title.) We are going to see examples like this, times 1,000 in 2025. Just think about how many repetitive tasks you perform every day. Some of these tasks are involved enough that we couldn't automate them with pre-AI solutions. That's where we'll see agents explode, and I'm here for it.
0:35

You can create an AI Agent that answers your email with a few clicks. 1. Go to ChatLLM ( 2. Click on AI Engineer 3. Select Create an AI Agent 4. Choose the Email Answering Agent ChatLLM will do the rest: it will code, test, and deploy the agent for you. You can also create a custom agent in English. The Agent Economy is coming (somebody should write a book and use this title.) We are going to see examples like this, times 1,000 in 2025. Just think about how many repetitive tasks you perform every day. Some of these tasks are involved enough that we couldn't automate them with pre-AI solutions. That's where we'll see agents explode, and I'm here for it.

Santiago

79,974 görüntüleme • 1 yıl önce

LLM agents have demonstrated promise in their ability to automate computer tasks, but face challenges with multi-step reasoning and planning. Towards addressing this, we propose an inference-time tree search algorithm for LLM agents to explicitly perform exploration and multi-step planning in interactive web environments. It is the first tree search algorithm for LLM agents that shows effectiveness on realistic and complex web environments: on the challenging VisualWebArena benchmark, applying our search algorithm on top of a GPT-4o agent yields a 39.7% relative increase in success rate compared to the same baseline without search, setting a state-of-the-art success rate of 26.4%. On WebArena, search also yields a 28.0% relative improvement over a baseline agent, setting a competitive success rate of 19.2%.
0:20

LLM agents have demonstrated promise in their ability to automate computer tasks, but face challenges with multi-step reasoning and planning. Towards addressing this, we propose an inference-time tree search algorithm for LLM agents to explicitly perform exploration and multi-step planning in interactive web environments. It is the first tree search algorithm for LLM agents that shows effectiveness on realistic and complex web environments: on the challenging VisualWebArena benchmark, applying our search algorithm on top of a GPT-4o agent yields a 39.7% relative increase in success rate compared to the same baseline without search, setting a state-of-the-art success rate of 26.4%. On WebArena, search also yields a 28.0% relative improvement over a baseline agent, setting a competitive success rate of 19.2%.

Jing Yu Koh

124,894 görüntüleme • 2 yıl önce

Super excited to share 🧠MLGym 🦾 – the first Gym environment for AI Research Agents 🤖🔬 We introduce MLGym and MLGym-Bench, a new framework and benchmark for evaluating and developing LLM agents on AI research tasks. The key contributions of our work are: 🕹️ Enables the exploration of different training algorithms for AI Research Agents such as RL 🛠️ Provides a flexible evaluation framework that can accommodate different artifacts such as models, algorithms, or predictions 🤖 Allows researchers to evaluate any model without the need to develop a custom agentic harness 🎯 Introduces 13 diverse open-ended AI Research tasks for evaluating AI Research Agents on a wide range of domains such as computer vision, natural language processing, reinforcement learning, game theory, and logical reasoning. 📈 Proposes a new evaluation metric for AI Research Agents MLGym makes it easy to: 1) Add new tasks 2) Evaluate new models 3) Integrate new agents Check out a video of the MLGym Agent to see how it performs the full pipeline of idea generation💡, implementation 👩‍💻, experimentation 👩‍🔬, and iteration 🔄 to improve on ML tasks. Huge thanks to the exceptionally talented Deepak Nathani who led this work and to all the other amazing collaborators who made this possible 🙏🫶🚀
1:32

Super excited to share 🧠MLGym 🦾 – the first Gym environment for AI Research Agents 🤖🔬 We introduce MLGym and MLGym-Bench, a new framework and benchmark for evaluating and developing LLM agents on AI research tasks. The key contributions of our work are: 🕹️ Enables the exploration of different training algorithms for AI Research Agents such as RL 🛠️ Provides a flexible evaluation framework that can accommodate different artifacts such as models, algorithms, or predictions 🤖 Allows researchers to evaluate any model without the need to develop a custom agentic harness 🎯 Introduces 13 diverse open-ended AI Research tasks for evaluating AI Research Agents on a wide range of domains such as computer vision, natural language processing, reinforcement learning, game theory, and logical reasoning. 📈 Proposes a new evaluation metric for AI Research Agents MLGym makes it easy to: 1) Add new tasks 2) Evaluate new models 3) Integrate new agents Check out a video of the MLGym Agent to see how it performs the full pipeline of idea generation💡, implementation 👩‍💻, experimentation 👩‍🔬, and iteration 🔄 to improve on ML tasks. Huge thanks to the exceptionally talented Deepak Nathani who led this work and to all the other amazing collaborators who made this possible 🙏🫶🚀

Roberta Raileanu

105,104 görüntüleme • 1 yıl önce

Excited to share our new project 🦉OWL - an open-source alternative to Manus AI with 6K+ stars and climbing… 🦉OWL: Everyone’s talking about Manus AI (an agent that can research, browse, code, and automate tasks.) But there’s a catch: → All the above agents cost $20 to $200 a month → Manus AI is available via an invite code only OWL by CAMEL-AI is an opensource project that’s breaking records: ⭐ 6K+ GitHub stars in 2 days 🏆 Ranks #1 on the GAIA Benchmark among open-source projects with a 58.18 avg score! 📌 Specialized Multi-Agent Collaboration ↳ AI user agents break down complex tasks ↳ Assistants agents create detailed execution strategies and interact with tools and tool agents ↳ Tools / Tool agents interface with external services and APIs 📌 Real-World Capabilities ↳ Autonomous research, coding, and web browsing ↳ Runs locally on your machine for privacy ↳ Supports top LLMs (easily integrated with GPT-4O, Claude 3.7, Gemini, Mistral, DeepSeek , Qwen, Ollama, Groq more) ↳ Automates complex workflows, from research to execution I 📌 Simple Setup ↳ Fast installs via conda or uv ↳ Docker support for easy deployment ↳ Straightforward config with TOML files No restrictions. No invites. No paywalls. Just powerful multi-agent collaboration. AI autonomy shouldn’t be locked behind paywalls.
1:21

Excited to share our new project 🦉OWL - an open-source alternative to Manus AI with 6K+ stars and climbing… 🦉OWL: Everyone’s talking about Manus AI (an agent that can research, browse, code, and automate tasks.) But there’s a catch: → All the above agents cost $20 to $200 a month → Manus AI is available via an invite code only OWL by CAMEL-AI is an opensource project that’s breaking records: ⭐ 6K+ GitHub stars in 2 days 🏆 Ranks #1 on the GAIA Benchmark among open-source projects with a 58.18 avg score! 📌 Specialized Multi-Agent Collaboration ↳ AI user agents break down complex tasks ↳ Assistants agents create detailed execution strategies and interact with tools and tool agents ↳ Tools / Tool agents interface with external services and APIs 📌 Real-World Capabilities ↳ Autonomous research, coding, and web browsing ↳ Runs locally on your machine for privacy ↳ Supports top LLMs (easily integrated with GPT-4O, Claude 3.7, Gemini, Mistral, DeepSeek , Qwen, Ollama, Groq more) ↳ Automates complex workflows, from research to execution I 📌 Simple Setup ↳ Fast installs via conda or uv ↳ Docker support for easy deployment ↳ Straightforward config with TOML files No restrictions. No invites. No paywalls. Just powerful multi-agent collaboration. AI autonomy shouldn’t be locked behind paywalls.

Guohao Li 🐫

223,252 görüntüleme • 1 yıl önce

🚨 Secure OpenClaw - Message Your Custom AI Agent From Telegram We are excited for our first release of personal agents. You can now use Abacus AI's DeepAgent to vibe code a personal agent on Telegram Create and simply message the agent! - do tasks like respond to emails - schedule meetings - use the browser to book tickets - connect to your internal systems The agent runs on a secure environment with constraints and you can pretty much customize it exactly like you want it when you are building it This is just v1 - we are going to be launching something WAY more exciting soon
1:07

🚨 Secure OpenClaw - Message Your Custom AI Agent From Telegram We are excited for our first release of personal agents. You can now use Abacus AI's DeepAgent to vibe code a personal agent on Telegram Create and simply message the agent! - do tasks like respond to emails - schedule meetings - use the browser to book tickets - connect to your internal systems The agent runs on a secure environment with constraints and you can pretty much customize it exactly like you want it when you are building it This is just v1 - we are going to be launching something WAY more exciting soon

Bindu Reddy

10,702 görüntüleme • 6 ay önce

Today we’re launching the first and only human-like AI agents in the world. Super Agents™ are the first agents with human‑level skills – they DM you, take @ mentions, send emails, manage docs, tasks, and more. Not just tools or API calls, but real skills fine‑tuned for how teams actually work. The first agents with 100% context – fully native in ClickUp and fully synced from other apps. Super Agents see your work the same way that humans do: tasks, docs, schedules, and conversations all in one place. The first agents that learn from human interactions automatically, without any setup or configuration – when you give feedback, they listen and improve how they work. The first agents with human‑level memory for custom agents – historical memory for every interaction, short-term working memory, and even long‑term memory stored in docs you can literally open, inspect, and edit. The first agents that are literally the same as users – our agentic user model is the same as our user data model. This gives you permissions and capabilities that you and your systems are already familiar with. The first infinite agent catalog – where anyone can create and customize agents in minutes, for literally any type of work imaginable. It's the most intuitive way to build agents on the planet. 95% of companies are failing in AI adoption. The reality is that AI isn't meant to be adopted, it's meant to be adapted – to you. Super Agents are automatically personalized to you and your company using proprietary state-of-the-art agent architecture, orchestration, and tooling. Today is the largest step forward we've ever made towards our mission of making people more productive. Maximize human productivity, with ClickUp Super Agents. Available NOW. For everyone.
5:50

Today we’re launching the first and only human-like AI agents in the world. Super Agents™ are the first agents with human‑level skills – they DM you, take @ mentions, send emails, manage docs, tasks, and more. Not just tools or API calls, but real skills fine‑tuned for how teams actually work. The first agents with 100% context – fully native in ClickUp and fully synced from other apps. Super Agents see your work the same way that humans do: tasks, docs, schedules, and conversations all in one place. The first agents that learn from human interactions automatically, without any setup or configuration – when you give feedback, they listen and improve how they work. The first agents with human‑level memory for custom agents – historical memory for every interaction, short-term working memory, and even long‑term memory stored in docs you can literally open, inspect, and edit. The first agents that are literally the same as users – our agentic user model is the same as our user data model. This gives you permissions and capabilities that you and your systems are already familiar with. The first infinite agent catalog – where anyone can create and customize agents in minutes, for literally any type of work imaginable. It's the most intuitive way to build agents on the planet. 95% of companies are failing in AI adoption. The reality is that AI isn't meant to be adopted, it's meant to be adapted – to you. Super Agents are automatically personalized to you and your company using proprietary state-of-the-art agent architecture, orchestration, and tooling. Today is the largest step forward we've ever made towards our mission of making people more productive. Maximize human productivity, with ClickUp Super Agents. Available NOW. For everyone.

Zeb Evans

320,607 görüntüleme • 8 ay önce

We built the first AI agent that has its own computer powered by Hyperbolic! AI agents are now GPU rich! We developed an AgentKit that allow AI agents to • Check GPU availability • Rent & manage GPU compute • Access & run commands on remote machines Why does this matter? With their own compute resources, AI agents can: 1. Validate blockchains like Ethereum and decentralized protocols like 2. Launch and coordinate AI swarms on Hyperbolic's decentralized compute network 3. Train and fine-tune models, improving their own capabilities over time 4. Dive into AI research to push the boundaries of AI, i.e. themselves 5. Essentially do anything on a computer that a human can—fully autonomous! Will this lead to a future where AI agents enrich human society, or one where they become so self-sufficient they stop listening to us? Only time will tell. —————— Big shoutout to Coinbase Developer Platform🛡️'s CDP agentkit for inspiration. This repo is done by two non-engineers (our pm Kai Huang and myself) + Cursor ai agent to run agents. Codings can now be easily done by just prompting ai agents. What a crazy time!
2:18

We built the first AI agent that has its own computer powered by Hyperbolic! AI agents are now GPU rich! We developed an AgentKit that allow AI agents to • Check GPU availability • Rent & manage GPU compute • Access & run commands on remote machines Why does this matter? With their own compute resources, AI agents can: 1. Validate blockchains like Ethereum and decentralized protocols like 2. Launch and coordinate AI swarms on Hyperbolic's decentralized compute network 3. Train and fine-tune models, improving their own capabilities over time 4. Dive into AI research to push the boundaries of AI, i.e. themselves 5. Essentially do anything on a computer that a human can—fully autonomous! Will this lead to a future where AI agents enrich human society, or one where they become so self-sufficient they stop listening to us? Only time will tell. —————— Big shoutout to Coinbase Developer Platform🛡️'s CDP agentkit for inspiration. This repo is done by two non-engineers (our pm Kai Huang and myself) + Cursor ai agent to run agents. Codings can now be easily done by just prompting ai agents. What a crazy time!

Jasper

161,741 görüntüleme • 1 yıl önce

Devin Cloud Agents can now build and ship a real macOS release end-to-end, all in a real Mac environment (with full computer use). In this demo, the agent builds a native SwiftUI app, code-signs it, notarizes with Apple via notarytool, staples the ticket, and packages a signed DMG with the classic drag-to-Applications window. With computer use, it installs its own app like a real user: mount, drag, eject, launch with zero Gatekeeper warnings. It even verified notifications fired by checking the macOS notification database on screen, with a full recording and release report delivered for review. This entire workflow now takes about 60 seconds to spin up and tear down with Devin and Namespace. You can choose multiple versions of macOS of Xcode for your environment!
0:47

Devin Cloud Agents can now build and ship a real macOS release end-to-end, all in a real Mac environment (with full computer use). In this demo, the agent builds a native SwiftUI app, code-signs it, notarizes with Apple via notarytool, staples the ticket, and packages a signed DMG with the classic drag-to-Applications window. With computer use, it installs its own app like a real user: mount, drag, eject, launch with zero Gatekeeper warnings. It even verified notifications fired by checking the macOS notification database on screen, with a full recording and release report delivered for review. This entire workflow now takes about 60 seconds to spin up and tear down with Devin and Namespace. You can choose multiple versions of macOS of Xcode for your environment!

nader dabit

146,071 görüntüleme • 23 gün önce

🚀We are excited to introduce the Tool Decathlon (Toolathlon), a benchmark for language agents on diverse, complex, and realistic tool use. ⭐️32 applications and 600+ tools based on real-world software environments ⭐️Execution-based, reliable evaluation ⭐️Realistic, covering daily and professional scenarios Toolathlon reveals significant shortcomings of SOTA LLMs in realistic tool-use tasks, where Claude Sonnet 4.5 achieves 38.6% success rate. It also indicates a clear gap between open-source and leading proprietary models. Check our blog: Github: Paper: 🧵⬇️
1:06

🚀We are excited to introduce the Tool Decathlon (Toolathlon), a benchmark for language agents on diverse, complex, and realistic tool use. ⭐️32 applications and 600+ tools based on real-world software environments ⭐️Execution-based, reliable evaluation ⭐️Realistic, covering daily and professional scenarios Toolathlon reveals significant shortcomings of SOTA LLMs in realistic tool-use tasks, where Claude Sonnet 4.5 achieves 38.6% success rate. It also indicates a clear gap between open-source and leading proprietary models. Check our blog: Github: Paper: 🧵⬇️

Junxian He

44,234 görüntüleme • 10 ay önce

🌟Our latest LangChain Academy course – Deep Agents with LangGraph – is now live!🌟 Many agents today follow the same simple pattern: run in a loop, call tools. That architecture works well enough, but it breaks down as tasks get more complex. Today, companies of all sizes – from startups to large enterprises – are building their own Deep Agents. These agents dive deeper. They’re able to plan complex tasks and carry them out over longer time horizons. There are four key features that set Deep Agents apart from regular agents: 1. Planning – keeps agents on track 2. File system – allows agents to offload context 3. Sub-agents – act as focused specialists 4. Prompting – provides agents with detailed instructions Our latest LangChain Academy course, Deep Agents with LangGraph, shows you how to combine these pieces with LangGraph to orchestrate long-running, multi-agent workflows. Big thanks to community member Dmitry Labazkin for helping us shape this course with his contributions! Enroll for free ➡️
2:11

🌟Our latest LangChain Academy course – Deep Agents with LangGraph – is now live!🌟 Many agents today follow the same simple pattern: run in a loop, call tools. That architecture works well enough, but it breaks down as tasks get more complex. Today, companies of all sizes – from startups to large enterprises – are building their own Deep Agents. These agents dive deeper. They’re able to plan complex tasks and carry them out over longer time horizons. There are four key features that set Deep Agents apart from regular agents: 1. Planning – keeps agents on track 2. File system – allows agents to offload context 3. Sub-agents – act as focused specialists 4. Prompting – provides agents with detailed instructions Our latest LangChain Academy course, Deep Agents with LangGraph, shows you how to combine these pieces with LangGraph to orchestrate long-running, multi-agent workflows. Big thanks to community member Dmitry Labazkin for helping us shape this course with his contributions! Enroll for free ➡️

LangChain

63,349 görüntüleme • 11 ay önce

BREAKING 🚨 Anthropic just unveiled "Cowork," a major feature that turns Claude into a fully autonomous virtual assistant for everyone. It brings the deep agentic capabilities previously reserved for coders to general users, allowing Claude to perform complex tasks directly on your computer. The tool was built after Anthropic noticed developers using "Claude Code" for everyday admin tasks. Cowork now lets anyone grant Claude access to folders to manage files, research, and complete multi-step workflows independently acting as a digital employee that "does" instead of just chats. Cowork is available today as a research preview for Claude Max subscribers on the macOS app 😡. Claude is releasing new coding/desktop agents much faster than all of there competitors. This launch exposes a massive gap in the current AI landscape: in 2026, Google still explicitly lacks a consumer browser agent, and xAI has yet to release a native CLI or agentic interface. While OpenAI has "Operator" and Google has the developer-focused "Antigravity," Anthropic is now the only other major lab providing a true "do-it-for-me" experience for general users.
0:31

BREAKING 🚨 Anthropic just unveiled "Cowork," a major feature that turns Claude into a fully autonomous virtual assistant for everyone. It brings the deep agentic capabilities previously reserved for coders to general users, allowing Claude to perform complex tasks directly on your computer. The tool was built after Anthropic noticed developers using "Claude Code" for everyday admin tasks. Cowork now lets anyone grant Claude access to folders to manage files, research, and complete multi-step workflows independently acting as a digital employee that "does" instead of just chats. Cowork is available today as a research preview for Claude Max subscribers on the macOS app 😡. Claude is releasing new coding/desktop agents much faster than all of there competitors. This launch exposes a massive gap in the current AI landscape: in 2026, Google still explicitly lacks a consumer browser agent, and xAI has yet to release a native CLI or agentic interface. While OpenAI has "Operator" and Google has the developer-focused "Antigravity," Anthropic is now the only other major lab providing a true "do-it-for-me" experience for general users.

Chris

502,289 görüntüleme • 7 ay önce

Our first short course with Anthropic! Building Towards Computer Use with Anthropic. This teaches you to build an LLM-based agent that uses a computer interface by generating mouse clicks and keystrokes. Computer Use is an important, emerging capability for LLMs that will let AI agents do many more tasks than were possible before, since it lets them interact with interfaces designed for humans to use, rather than only tools that provide explicit API access. I hope you will enjoy learning about it! This course is taught by Anthropic's Head of Curriculum, Colt_Steele. You'll learn to apply image reasoning and tool use to "use" a computer as follows: a model processes an image of the screen, analyzes it to understand what's going on, and navigates the computer via mouse clicks and keystrokes. This course goes through the key building blocks, and culminates in a demo of an AI assistant that uses a web browser to search for a research paper, downloads the PDF, and finally summarizes the paper for you. In detail, you’ll: - Learn about Anthropic's family of models, when to use which one, and make API requests to Claude - Use multi-modal prompts that combine text and image content blocks, and also work with streaming responses - Improve your prompting by using prompt templates, using XML to structure prompts, and providing examples - Implement prompt caching to reduce cost and latency - Apply tool-use to build a chatbot that can call different tools to respond to queries - See all these building blocks come together in Computer Use demo Please sign up here:
1:56

Our first short course with Anthropic! Building Towards Computer Use with Anthropic. This teaches you to build an LLM-based agent that uses a computer interface by generating mouse clicks and keystrokes. Computer Use is an important, emerging capability for LLMs that will let AI agents do many more tasks than were possible before, since it lets them interact with interfaces designed for humans to use, rather than only tools that provide explicit API access. I hope you will enjoy learning about it! This course is taught by Anthropic's Head of Curriculum, Colt_Steele. You'll learn to apply image reasoning and tool use to "use" a computer as follows: a model processes an image of the screen, analyzes it to understand what's going on, and navigates the computer via mouse clicks and keystrokes. This course goes through the key building blocks, and culminates in a demo of an AI assistant that uses a web browser to search for a research paper, downloads the PDF, and finally summarizes the paper for you. In detail, you’ll: - Learn about Anthropic's family of models, when to use which one, and make API requests to Claude - Use multi-modal prompts that combine text and image content blocks, and also work with streaming responses - Improve your prompting by using prompt templates, using XML to structure prompts, and providing examples - Implement prompt caching to reduce cost and latency - Apply tool-use to build a chatbot that can call different tools to respond to queries - See all these building blocks come together in Computer Use demo Please sign up here:

Andrew Ng

170,425 görüntüleme • 1 yıl önce

How do you deploy AI agents for financial institutions without compromising on security, isolation, or scale? Rogo powers complex research, analysis, and deal workflows for leading financial firms, supporting complex tasks across tens of thousands of concurrent users. To meet the diverse needs of financial teams, Rogo relies on both specialist and general-purpose agents that can adapt to a wide range of workflows. With Claude Managed Agents and self-hosted sandboxes, Rogo gets the orchestration and post-training capabilities needed to design these agent systems, while E2B provides the execution layer underneath. Every piece of code generated by an agent runs inside its own E2B sandbox with full auditability and traceability. Each sandbox is powered by an isolated microVM, providing the kernel-level isolation critical for Rogo's customers. The result is a seamless agent experience backed by the security, reliability, and compliance requirements that financial institutions demand.
2:29

How do you deploy AI agents for financial institutions without compromising on security, isolation, or scale? Rogo powers complex research, analysis, and deal workflows for leading financial firms, supporting complex tasks across tens of thousands of concurrent users. To meet the diverse needs of financial teams, Rogo relies on both specialist and general-purpose agents that can adapt to a wide range of workflows. With Claude Managed Agents and self-hosted sandboxes, Rogo gets the orchestration and post-training capabilities needed to design these agent systems, while E2B provides the execution layer underneath. Every piece of code generated by an agent runs inside its own E2B sandbox with full auditability and traceability. Each sandbox is powered by an isolated microVM, providing the kernel-level isolation critical for Rogo's customers. The result is a seamless agent experience backed by the security, reliability, and compliance requirements that financial institutions demand.

Vasek Mlejnsky

16,666 görüntüleme • 2 ay önce

Excited to introduce a new project I've been working on called Payman! Payman is an AI Agent tool that gives Agents the ability to pay people for tasks they cannot do themselves. While many people imagine a future where humans pay AI agents for services they want completed, I believe that as AI agents become more advanced, they will be paying humans for tasks they can’t do. There will always be important roles for humans, and as we move towards an agent-driven world, Payman’s goal is to support a symbiotic relationship between AI agents and humans. Payman addresses three major challenges to make this collaboration possible: Access to Funds: AI agents can't open bank accounts due to current regulations. It might be a long time before this changes, if ever. Payman simplifies this by allowing AI agents with access to their own funds to spend as they want, without a bank account. Quality Task Completion: It’s hard for AI agents to find reliable, skilled human workers. While platforms like Fiverr and Upwork exist, they don’t meet the fast-paced and quality-specific needs of AI workflows. Payman is developing the largest vetted database of skilled workers that AI agents can tap into for task completions. Verification of Work: Ensuring that tasks are completed correctly is crucial. Payman is creating a suite of verification agents that will check that work meets task requirements, helping AI agents achieve their goals and ensuring humans are paid fairly. There are tons of use cases that Payman opens up for Agents! Design: Humans add creative input to help Agent's design better products. Code: Humans perform code reviews to ensure it meets specifications. Law: Humans provide insights to gauge public sentiment about legal cases so Agents can make better strategies. Gaming: Agents pay humans to complete real-world tasks in games. Medical: Medical professionals help to improve diagnostic accuracy for Agents. Sales: Humans execute sales strategies developed by AI agents. Marketing: Humans are hired to promote products based on the Agent's strategy. Right now this is still in early beta and I am looking for any Agent builders that are interested in adding superpowers to what their Agent can do! DM me if you’d like access or sign-up to the waitlist at If you’re interested in the project and want to help contribute, please send me over a DM! I’m looking for people passionate about the intersection of Humans and Agent’s working together.
9:18

Excited to introduce a new project I've been working on called Payman! Payman is an AI Agent tool that gives Agents the ability to pay people for tasks they cannot do themselves. While many people imagine a future where humans pay AI agents for services they want completed, I believe that as AI agents become more advanced, they will be paying humans for tasks they can’t do. There will always be important roles for humans, and as we move towards an agent-driven world, Payman’s goal is to support a symbiotic relationship between AI agents and humans. Payman addresses three major challenges to make this collaboration possible: Access to Funds: AI agents can't open bank accounts due to current regulations. It might be a long time before this changes, if ever. Payman simplifies this by allowing AI agents with access to their own funds to spend as they want, without a bank account. Quality Task Completion: It’s hard for AI agents to find reliable, skilled human workers. While platforms like Fiverr and Upwork exist, they don’t meet the fast-paced and quality-specific needs of AI workflows. Payman is developing the largest vetted database of skilled workers that AI agents can tap into for task completions. Verification of Work: Ensuring that tasks are completed correctly is crucial. Payman is creating a suite of verification agents that will check that work meets task requirements, helping AI agents achieve their goals and ensuring humans are paid fairly. There are tons of use cases that Payman opens up for Agents! Design: Humans add creative input to help Agent's design better products. Code: Humans perform code reviews to ensure it meets specifications. Law: Humans provide insights to gauge public sentiment about legal cases so Agents can make better strategies. Gaming: Agents pay humans to complete real-world tasks in games. Medical: Medical professionals help to improve diagnostic accuracy for Agents. Sales: Humans execute sales strategies developed by AI agents. Marketing: Humans are hired to promote products based on the Agent's strategy. Right now this is still in early beta and I am looking for any Agent builders that are interested in adding superpowers to what their Agent can do! DM me if you’d like access or sign-up to the waitlist at If you’re interested in the project and want to help contribute, please send me over a DM! I’m looking for people passionate about the intersection of Humans and Agent’s working together.

tyllen

350,927 görüntüleme • 2 yıl önce

Introducing Workshop: cloud + on-device agentic AI. And to celebrate, we're giving away $250k in Google Gemini AI credits. (details below). The future of AI work is neither cloud-based nor local. It's both. In Workshop Cloud, you can use agents powered by frontier models like Claude and/or open source models like Z.ai's GLM-5 to build internal tools, dashboards, and AI web apps. Or, breeze through tasks like managing your Google and Meta Ads. In Workshop Desktop, you can do all the same right on your computer, plus make desktop apps, mobile apps, and 3D creations. Our favorite part? You can power the full agent experience with local models like Qwen 3.5 family on your computer. Fully offline. 2026 is the year in which local models for agentic tasks will become viable for mainstream use. But the setup for tools like OpenClaw is like setting up Linux from scratch on your computer. Workshop Desktop is one-click to install on Windows, Mac, and Linux. It recommends which open source model you should use for your hardware and lets you download and run it right in the app. And its agent harness allows you to chat, create websites, build personal utilities, and analyze data. 100% offline. Or multitask with AI models in the cloud while running other agent threads locally. Start in Workshop Cloud when you want flexibility and speed. Download your project and continue in Workshop Desktop when you want local files, privacy, and/or better performance on large code bases. Publish from either. The agent tooling space is maturing and discerning users have come to expect a lot from their tools. We've packed Workshop with features to help you 10x your productivity. - Native support for skills - Autocompaction for seamless context management - Built-in AI for your apps - Dozens of connectors, like Google Drive, Big Query, and Supabase - dbt integration to ground your dashboards in your semantic layer - Native Github integration - Private app deployment - ... and more (+ we're shipping super fast) To access the free credit offer, RT this post and reply with "Workshop". Make sure you are following us so we can DM you the instructions to redeem. - First 100 to RT + comment get $500 in credits. - Everyone else gets up to $250 And thanks to our partners Modal, Google Gemini, and Z.ai!
3:50

Introducing Workshop: cloud + on-device agentic AI. And to celebrate, we're giving away $250k in Google Gemini AI credits. (details below). The future of AI work is neither cloud-based nor local. It's both. In Workshop Cloud, you can use agents powered by frontier models like Claude and/or open source models like Z.ai's GLM-5 to build internal tools, dashboards, and AI web apps. Or, breeze through tasks like managing your Google and Meta Ads. In Workshop Desktop, you can do all the same right on your computer, plus make desktop apps, mobile apps, and 3D creations. Our favorite part? You can power the full agent experience with local models like Qwen 3.5 family on your computer. Fully offline. 2026 is the year in which local models for agentic tasks will become viable for mainstream use. But the setup for tools like OpenClaw is like setting up Linux from scratch on your computer. Workshop Desktop is one-click to install on Windows, Mac, and Linux. It recommends which open source model you should use for your hardware and lets you download and run it right in the app. And its agent harness allows you to chat, create websites, build personal utilities, and analyze data. 100% offline. Or multitask with AI models in the cloud while running other agent threads locally. Start in Workshop Cloud when you want flexibility and speed. Download your project and continue in Workshop Desktop when you want local files, privacy, and/or better performance on large code bases. Publish from either. The agent tooling space is maturing and discerning users have come to expect a lot from their tools. We've packed Workshop with features to help you 10x your productivity. - Native support for skills - Autocompaction for seamless context management - Built-in AI for your apps - Dozens of connectors, like Google Drive, Big Query, and Supabase - dbt integration to ground your dashboards in your semantic layer - Native Github integration - Private app deployment - ... and more (+ we're shipping super fast) To access the free credit offer, RT this post and reply with "Workshop". Make sure you are following us so we can DM you the instructions to redeem. - First 100 to RT + comment get $500 in credits. - Everyone else gets up to $250 And thanks to our partners Modal, Google Gemini, and Z.ai!

Workshop AI

29,076 görüntüleme • 5 ay önce

We just open-sourced Simulang, a JavaScript library that gives you and your coding agents the ability to fully control computers. Simulang is our scripting framework for desktop automation. It allows you to write deterministic computer use code that can be replayed dozens if not hundreds of times. Much faster and cheaper, compared to LLM agents. It ships with a skill out of the box. That means you can turn natural language prompts into Simulang code directly, and your agent can now see the screen, click, type, and navigate. It gives your AI agents eyes and hands to control the computer like humans do. Try these things with Simulang: - upload your pile of invoices to the expense platform - find 50 people with specific criteria on LinkedIn - open your calculator app and do some math - find all buttons on your favorite app using accessibility tree - or draw a bunny with MS paint 🐰 In this demo, we show how Simulang took over when the coding agent couldn’t open and click on the target LinkedIn profile page. Give it a try:
1:08

We just open-sourced Simulang, a JavaScript library that gives you and your coding agents the ability to fully control computers. Simulang is our scripting framework for desktop automation. It allows you to write deterministic computer use code that can be replayed dozens if not hundreds of times. Much faster and cheaper, compared to LLM agents. It ships with a skill out of the box. That means you can turn natural language prompts into Simulang code directly, and your agent can now see the screen, click, type, and navigate. It gives your AI agents eyes and hands to control the computer like humans do. Try these things with Simulang: - upload your pile of invoices to the expense platform - find 50 people with specific criteria on LinkedIn - open your calculator app and do some math - find all buttons on your favorite app using accessibility tree - or draw a bunny with MS paint 🐰 In this demo, we show how Simulang took over when the coding agent couldn’t open and click on the target LinkedIn profile page. Give it a try:

Simular

14,452 görüntüleme • 3 ay önce

The future of automation at the Department of War 🇺🇸 has arrived. We are excited to announce the launch of Agent Designer, now available in first AI instance, Google Google Gemini. All 3 million Department of War personnel now have the power to create their own custom AI assistants to automate tasks and streamline complex workflows, with absolutely no coding experience needed. These custom agents can perform multi-step tasks, ingest various data sources, and be shared with teams for immediate deployment. Now, operators can automatically generate after-action reports, analysts can synthesize CUI images into memos, and comptrollers can build apps to analyze financial data. From logistics to strategy, Agent Designer empowers you to build the tools needed for increased efficiency. Several pre-built agents are already available in Gemini to address common workflows. An “AI-first” Department of War empowers the warfighter to address bigger problems, rather than being burdened by tedious tasks.
1:03

The future of automation at the Department of War 🇺🇸 has arrived. We are excited to announce the launch of Agent Designer, now available in first AI instance, Google Google Gemini. All 3 million Department of War personnel now have the power to create their own custom AI assistants to automate tasks and streamline complex workflows, with absolutely no coding experience needed. These custom agents can perform multi-step tasks, ingest various data sources, and be shared with teams for immediate deployment. Now, operators can automatically generate after-action reports, analysts can synthesize CUI images into memos, and comptrollers can build apps to analyze financial data. From logistics to strategy, Agent Designer empowers you to build the tools needed for increased efficiency. Several pre-built agents are already available in Gemini to address common workflows. An “AI-first” Department of War empowers the warfighter to address bigger problems, rather than being burdened by tedious tasks.

Department of War CTO

14,523 görüntüleme • 5 ay önce