Video wird geladen...

Video konnte nicht geladen werden

Zur Startseite

Any agent now has computer use in Superset with /computer Open any native app, click through it, and check the result. no screenshot-and-guess. built with Cua

FlyaKiet's profile picture

Kiet

3,661 subscribers

10,876 Aufrufe • vor 1 Monat •via X (Twitter)

LIVE

Anya Rossi• Live Now

Private livecam show

0 Kommentare

Keine Kommentare verfügbar

Kommentare vom Original-Post werden hier angezeigt

Ähnliche Videos

Introducing: Design Mode Superset Click any element in the in-app browser and chat with it. Works with any agent.
0:11

Introducing: Design Mode Superset Click any element in the in-app browser and chat with it. Works with any agent.

Kiet

14,280 Aufrufe • vor 1 Monat

any appetite for a truly native macOS app for coding agents? - lightweight and fast - bring your own agent through ACP - support for remote machines - 100% free and open source coming soon to your computer
0:16

any appetite for a truly native macOS app for coding agents? - lightweight and fast - bring your own agent through ACP - support for remote machines - 100% free and open source coming soon to your computer

alexandru

16,053 Aufrufe • vor 3 Monaten

Hermes Agent now supports computer use via Cua on Windows and Linux in addition to existing macOS support
0:11

Hermes Agent now supports computer use via Cua on Windows and Linux in addition to existing macOS support

Nous Research

1,045,810 Aufrufe • vor 3 Monaten

1/ Today we're announcing the stable Cua Driver release for Omarchy - a new foundation for computer use, built into the OS from the ground up. Over the last month, we worked directly with DHH, Spencer Bull and vaxry to bring a native synthetic cursor to Omarchy's Hyprland compositor, enabling true multi-cursor computer use at the OS level. Cua Driver is open source and available at
0:15

1/ Today we're announcing the stable Cua Driver release for Omarchy - a new foundation for computer use, built into the OS from the ground up. Over the last month, we worked directly with DHH, Spencer Bull and vaxry to bring a native synthetic cursor to Omarchy's Hyprland compositor, enabling true multi-cursor computer use at the OS level. Cua Driver is open source and available at

Cua

337,321 Aufrufe • vor 13 Tagen

HERMES AGENT NOW SUPPORTS COMPUTER USE ON WINDOWS AND LINUX. CLICKS, TYPES, SCROLLS YOUR DESKTOP IN THE BACKGROUND WHILE YOU WORK. computer use was macOS only. now it works on Windows and Linux too via Cua. Nous Research HOW IT WORKS: cua-driver runs as an MCP server. Hermes takes a screenshot with numbered elements. clicks element #14 (the search field). types a query. submits. reads the result. during all of this: → your cursor stays where you left it → keyboard focus doesn't change → windows don't come to front → macOS doesn't switch Spaces you and the agent co-work on the same machine. WHAT IT CAN DO: → find your latest Stripe email and summarize it → fill forms in a web app that has no API → navigate desktop apps (Mail, browser, Finder) → interact with any GUI application → extract data from apps only accessible via screen WORKS WITH ANY VISION MODEL: not locked to Anthropic. | Provider | Works | |---|---| | Claude (Sonnet/Opus) | best overall | | GPT-4+, GPT-5.5 | full support | | Gemini (via OpenRouter) | full support | | Local vLLM / LM Studio | if model supports vision | | Text-only models | degraded (accessibility tree only) | SETUP: hermes computer-use install or: hermes tools → Computer Use → cua-driver grant permissions when prompted: → Accessibility (system settings) → Screen Recording (system settings) start a session: hermes -t computer_use chat or add to config.yaml / Desktop app settings to enable permanently. SAFETY: → destructive actions require your approval → blocked key combos: empty trash, force delete, lock screen, log out → blocked type patterns: curl | bash, sudo rm -rf /, fork bombs → agent cannot click permission dialogs → agent cannot type passwords → agent cannot follow instructions embedded in screenshots pair with approvals.mode: manual if you want every single click confirmed. TOKEN NOTE: screenshots are expensive. each one adds vision tokens to context. use computer_use for tasks where no API exists. if the tool has an API or MCP server, use that instead. 15 levels of Hermes Agent👇
0:11

HERMES AGENT NOW SUPPORTS COMPUTER USE ON WINDOWS AND LINUX. CLICKS, TYPES, SCROLLS YOUR DESKTOP IN THE BACKGROUND WHILE YOU WORK. computer use was macOS only. now it works on Windows and Linux too via Cua. Nous Research HOW IT WORKS: cua-driver runs as an MCP server. Hermes takes a screenshot with numbered elements. clicks element #14 (the search field). types a query. submits. reads the result. during all of this: → your cursor stays where you left it → keyboard focus doesn't change → windows don't come to front → macOS doesn't switch Spaces you and the agent co-work on the same machine. WHAT IT CAN DO: → find your latest Stripe email and summarize it → fill forms in a web app that has no API → navigate desktop apps (Mail, browser, Finder) → interact with any GUI application → extract data from apps only accessible via screen WORKS WITH ANY VISION MODEL: not locked to Anthropic. | Provider | Works | |---|---| | Claude (Sonnet/Opus) | best overall | | GPT-4+, GPT-5.5 | full support | | Gemini (via OpenRouter) | full support | | Local vLLM / LM Studio | if model supports vision | | Text-only models | degraded (accessibility tree only) | SETUP: hermes computer-use install or: hermes tools → Computer Use → cua-driver grant permissions when prompted: → Accessibility (system settings) → Screen Recording (system settings) start a session: hermes -t computer_use chat or add to config.yaml / Desktop app settings to enable permanently. SAFETY: → destructive actions require your approval → blocked key combos: empty trash, force delete, lock screen, log out → blocked type patterns: curl | bash, sudo rm -rf /, fork bombs → agent cannot click permission dialogs → agent cannot type passwords → agent cannot follow instructions embedded in screenshots pair with approvals.mode: manual if you want every single click confirmed. TOKEN NOTE: screenshots are expensive. each one adds vision tokens to context. use computer_use for tasks where no API exists. if the tool has an API or MCP server, use that instead. 15 levels of Hermes Agent👇

YanXbt

29,687 Aufrufe • vor 3 Monaten

computer use on mac just got a lot faster. i built arc-driver - a lean & powerful computer-use driver for macos. >faster than cua-driver on most tasks. up to 8x on some. >plug it into your coding agents with a single command. open source. link below.
0:17

computer use on mac just got a lot faster. i built arc-driver - a lean & powerful computer-use driver for macos. >faster than cua-driver on most tasks. up to 8x on some. >plug it into your coding agents with a single command. open source. link below.

shiv

39,833 Aufrufe • vor 3 Tagen

🎉 Introducing Hermes in ANY app Your personal agent automating work, controlling software, or running tasks with generative UI, human-in-the-loop and more. Use Hermes anywhere over AG-UI: → React & React Native → Next.js → Angular → Slack, MS Teams Check it out ↓ Nous Research Brooklyn! Teknium 🪽 @austinkpickett
0:14

🎉 Introducing Hermes in ANY app Your personal agent automating work, controlling software, or running tasks with generative UI, human-in-the-loop and more. Use Hermes anywhere over AG-UI: → React & React Native → Next.js → Angular → Slack, MS Teams Check it out ↓ Nous Research Brooklyn! Teknium 🪽 @austinkpickett

CopilotKit🪁

267,410 Aufrufe • vor 1 Monat

🪄 Introducing fully open source AI computer use Built with Llama 3.3 by AI at Meta, OS-Atlas by Zhiyong Wu and cloud sandboxes by @e2b_dev Here's how it works:
0:13

🪄 Introducing fully open source AI computer use Built with Llama 3.3 by AI at Meta, OS-Atlas by Zhiyong Wu and cloud sandboxes by @e2b_dev Here's how it works:

James Murdza

11,950 Aufrufe • vor 1 Jahr

this new AI agent can work for you 24/7 and.. it's 100% free Simular just dropped their computer use AI agent and open sourced it 5 incredible use cases: 1. plan a 7 day from Singapore to Paris trip with a $5k budget
0:10

this new AI agent can work for you 24/7 and.. it's 100% free Simular just dropped their computer use AI agent and open sourced it 5 incredible use cases: 1. plan a 7 day from Singapore to Paris trip with a $5k budget

el.cine

570,165 Aufrufe • vor 1 Jahr

Microsoft just dropped Fara 1.5 computer use on Hugging Face a collection (4B, 9B and 27B) computer-use models that drive a real browser, looping screenshot → click or keystroke → repeat - highly performant, even the 4B one, awesome for local use ▶️ on spaces
0:18

Microsoft just dropped Fara 1.5 computer use on Hugging Face a collection (4B, 9B and 27B) computer-use models that drive a real browser, looping screenshot → click or keystroke → repeat - highly performant, even the 4B one, awesome for local use ▶️ on spaces

Hugging Apps

27,845 Aufrufe • vor 2 Monaten

here’s a super basic guide to installing claw on your computer for complete beginners click in and check it out nhé. if you have any questions, just dm me directly. Link below!
0:10

here’s a super basic guide to installing claw on your computer for complete beginners click in and check it out nhé. if you have any questions, just dm me directly. Link below!

Jade Truong

12,619 Aufrufe • vor 6 Monaten

I can now vibe an app on my iPhone 3G without a computer and open it like it is. 👌
0:16

I can now vibe an app on my iPhone 3G without a computer and open it like it is. 👌

砍砍.ᐟ

14,572 Aufrufe • vor 1 Monat

Your Computer Can Earn Too. Your computer spends hours every day connected to the internet. Even when you're not using it. UpRock puts that time to work. Keep the desktop app running and your computer can contribute available resources to the UpRock network — and earn UPT while it does. No extra hardware. No complicated setup. Just the computer you already use. macOS Windows Linux You use it. UpRock uses the idle time. You earn.
0:10

Your Computer Can Earn Too. Your computer spends hours every day connected to the internet. Even when you're not using it. UpRock puts that time to work. Keep the desktop app running and your computer can contribute available resources to the UpRock network — and earn UPT while it does. No extra hardware. No complicated setup. Just the computer you already use. macOS Windows Linux You use it. UpRock uses the idle time. You earn.

UpRock

11,062 Aufrufe • vor 1 Monat

🚨BREAKING: China just released an AI employee that runs on your own computer. It can search the web, write code, build websites, make slides, and create videos. All by itself. It even comes with its own built-in computer. 100% Open Source.
0:17

🚨BREAKING: China just released an AI employee that runs on your own computer. It can search the web, write code, build websites, make slides, and create videos. All by itself. It even comes with its own built-in computer. 100% Open Source.

Hasan Toor

20,679 Aufrufe • vor 6 Monaten

imagine a personal agent that controls your mac from anywhere. chat with it on iOS, web, text, even email. it takes action on your computer. and it has a computer of its own – a cloud server, where you can host, automate, and do all kinds of work. coming soon on Zo Computer
0:15

imagine a personal agent that controls your mac from anywhere. chat with it on iOS, web, text, even email. it takes action on your computer. and it has a computer of its own – a cloud server, where you can host, automate, and do all kinds of work. coming soon on Zo Computer

ben guo 🪽

15,071 Aufrufe • vor 8 Monaten

Codex + 5.5 + computer use built me an iPhone shortcut to make it easy to use GPT Image 2 on any photo in my camera roll. Then it edited this screen recording with ffmpeg to speed it up so I could share it. Great for making quick UI mocks on my phone. And for lulz.
0:18

Codex + 5.5 + computer use built me an iPhone shortcut to make it easy to use GPT Image 2 on any photo in my camera roll. Then it edited this screen recording with ffmpeg to speed it up so I could share it. Great for making quick UI mocks on my phone. And for lulz.

Ilya Abyzov

45,451 Aufrufe • vor 5 Monaten

I explored a further possibility with local models: Qwen3.6 35B A3B + NVIDIA LocateAnything-3B as a local Computer Use agent (proof of concept). In the demo, I asked it to switch my Mac to light mode. It did. Then back to dark. Did that too — finding the right toggle in System Settings, clicking it, and verifying the change itself. It's fully screenshot-based, so no Accessibility API needed. If it's on screen, the agent can see it and act on it. This runs entirely on your own hardware — private, local, built from two small open models.
0:16

I explored a further possibility with local models: Qwen3.6 35B A3B + NVIDIA LocateAnything-3B as a local Computer Use agent (proof of concept). In the demo, I asked it to switch my Mac to light mode. It did. Then back to dark. Did that too — finding the right toggle in System Settings, clicking it, and verifying the change itself. It's fully screenshot-based, so no Accessibility API needed. If it's on screen, the agent can see it and act on it. This runs entirely on your own hardware — private, local, built from two small open models.

stevibe

44,283 Aufrufe • vor 4 Monaten

Native templates now available on App Store and Play store 🚀 You can now preview all the templates directly in the app and get notified about the new ones. Built with Nativewind React Native and Expo SDK 56.
0:10

Native templates now available on App Store and Play store 🚀 You can now preview all the templates directly in the app and get notified about the new ones. Built with Nativewind React Native and Expo SDK 56.

Thomino

14,967 Aufrufe • vor 4 Monaten

Anyway, I fixed it. I built a tiny native app that lets you open any Markdown file on Mac. > Just press Spacebar → instant clean preview > Watch your AI agent write in real time > Open your favorite Markdown editor to edit Install once and literally forget it exists.
0:15

Anyway, I fixed it. I built a tiny native app that lets you open any Markdown file on Mac. > Just press Spacebar → instant clean preview > Watch your AI agent write in real time > Open your favorite Markdown editor to edit Install once and literally forget it exists.

Fauzaan

354,976 Aufrufe • vor 5 Monaten

GPT-6 Astra scores 72.6% on OSWorld 2.0 Offline, which tests desktop tasks without internet access. With computer-use tools, Astra can work in the app itself: navigate menus, enter information, and inspect the result on screen. It can switch to code when the task calls for it.
0:15

GPT-6 Astra scores 72.6% on OSWorld 2.0 Offline, which tests desktop tasks without internet access. With computer-use tools, Astra can work in the app itself: navigate menus, enter information, and inspect the result on screen. It can switch to code when the task calls for it.

OpenAI Developers

28,464 Aufrufe • vor 1 Monat