正在加载视频...

视频加载失败

Today we're excited to launch Action: a Claude computer use launcher for macOS. Action is a macOS launcher that can take actions (click, type, and more) on your Mac using Claude’s computer use API. The interface is a floating window triggered by a keyboard shortcut, similar to Spotlight. This...

21,622 次观看 • 1 年前 •via X (Twitter)

11 条评论

Lawrence Chen 的头像
Lawrence Chen1 年前

Since Action operates at the operating system level, it has access to your authenticated apps. This means that you don't have to pass your credentials through a third party in order to automate apps like Doordash, Amazon, and Uber. Watch Action order Doordash using my account:

Lawrence Chen 的头像
Lawrence Chen1 年前

Here, Action installs the SwiftAnthropic package by interacting with Xcode:

Lawrence Chen 的头像
Lawrence Chen1 年前

You can also use Action as an LLM that has immediate context of your screen. Unlike the ChatGPT Mac app, taking a screenshot with Action doesn't require extra steps -- it's automatically included when you send a message. Here, I use it to extract a table from a PDF in Preview:

Lawrence Chen 的头像
Lawrence Chen1 年前

Action is written purely in Swift, and the DMG size is quite small at roughly 3 MB. You can download the macOS client today at (requires Anthropic API key).

Page to Pixel Publishing 的头像
Page to Pixel Publishing2 年前

The Art of Flight is a homage to 80s/90s arcade action shmups with a fresh twist on the genre. Pilot multiple ships at the same time to take on oncoming waves of enemies in this fast paced space shooter. Wishlist on Steam today!

Austin Wang 的头像
Austin Wang1 年前

This is a super cool use of computer agents - really drives momentum of AI agents to the new year!

Wesley Tjangnaka 的头像
Wesley Tjangnaka1 年前

Amazing stuff!

Subhash Ramesh 的头像
Subhash Ramesh1 年前

🔥🔥

Adi 的头像
Adi1 年前

@ycombinator This simply doesn’t work. Been trying for the past hour. Asked it to order my usual from doordash and this is where I am

Lawrence Chen 的头像
Lawrence Chen1 年前

@ycombinator Hm, do you think it's a fundamental issue with claude computer use or was it an implementation error? Did it try to open chrome first and forget to press 'return'?

Alex Xi 的头像
Alex Xi1 年前

Cool stuff!

相关视频

Our first short course with Anthropic! Building Towards Computer Use with Anthropic. This teaches you to build an LLM-based agent that uses a computer interface by generating mouse clicks and keystrokes. Computer Use is an important, emerging capability for LLMs that will let AI agents do many more tasks than were possible before, since it lets them interact with interfaces designed for humans to use, rather than only tools that provide explicit API access. I hope you will enjoy learning about it! This course is taught by Anthropic's Head of Curriculum, Colt_Steele. You'll learn to apply image reasoning and tool use to "use" a computer as follows: a model processes an image of the screen, analyzes it to understand what's going on, and navigates the computer via mouse clicks and keystrokes. This course goes through the key building blocks, and culminates in a demo of an AI assistant that uses a web browser to search for a research paper, downloads the PDF, and finally summarizes the paper for you. In detail, you’ll: - Learn about Anthropic's family of models, when to use which one, and make API requests to Claude - Use multi-modal prompts that combine text and image content blocks, and also work with streaming responses - Improve your prompting by using prompt templates, using XML to structure prompts, and providing examples - Implement prompt caching to reduce cost and latency - Apply tool-use to build a chatbot that can call different tools to respond to queries - See all these building blocks come together in Computer Use demo Please sign up here:

Andrew Ng

170,399 次观看 • 1 年前