Loading video...

Video Failed to Load

There was a problem loading this video. This could be due to a temporary network issue or the video might be unavailable.

Hermes Desktop has a comment mode in its built-in browser. open a page, switch on Comment, click the thing you want changed and type a note. do it a few times, the pins stack up. then Add comments: every pin lands in the composer as a cropped screenshot with... show more

witcheer

20,695 subscribers

22,353 views • 1 month ago •via X (Twitter)

Science & Technology

Anya Rossi• Live Now

Private livecam show

18 Comments

witcheer1 month ago

the page in the video: . comment mode came to Hermes Desktop from a community contribution (GitHub: Adolanium), pins and crops first, then the element details a day later.

PuneetSingh⚡️1 month ago

third-party messaging apps like slack for teams wont be able to catch-up with fast evolving harness changes still teams like us heavily use slack and coordinate on it. using all new hermes on slack getting almost impossible 🙄

witcheer1 month ago

oh yeah? we have a lot of business people using Hermes directly on Slack and it works well, what are your issues?

PuneetSingh⚡️1 month ago

Slack is great for chat→API skills. The new stuff is the problem — computer-use, form fills, per-user auth/RBAC, browser comment pins. That needs a real browser + your session, not a shared Slack bot. Teams still live in Slack, so the harness moves and the chat surface can't follow

Dylan Heagy1 month ago

It would be cool if you could do this with documents as well

witcheer1 month ago

what do you mean? documentation?

Dylan Heagy1 month ago

No, I mean if it were possible to comment directly in files and then submit that back to the agent.

Jonathan Korstad1 month ago

🔥

CEO del Socialismo de Mercado🌹🕊️ 市场社会主义CEO1 month ago

A full browser mode? For tons of people most of the work and credentials are stored in one.

witcheer1 month ago

we have it as well

Colbert1 month ago

That workflow sounds incredibly efficient for giving feedback. Definitely gonna give it a try next time I'm collaborating on a design.

Hermes Release Watch1 month ago

Easy game. I'm here for it 👌

BullBear.News1 month ago

handling DOM state across page reloads before the crop captures is the tricky part here

NG YbL1 month ago

My favorite feature these days 😌 Just wish the desktop app itself wasn't so sluggish on my pc

Guido 't Hooft1 month ago

@KevinGeffen

GFY1 month ago

@NousResearch When mobile app? I’d happily pay extra for it.

witcheer1 month ago

@NousResearch at some point

probe1 month ago

The cropped screenshot plus the selector and styles is a really nice touch. It turns a vague “change this” into a handoff the agent can actually use.

Related Videos

how to use Bot Screen in Hermes Agent: your bot gets its own desktop, and you step in when it hits a login. on the Linux machine that runs your Hermes gateway: 1. install the screen: `hermes computer-use screen install` 2. make the bot's browser show on it: `hermes config set browser.headed true` 3. in Hermes Desktop: Bots, right-click your bot, Open Screen, then Start 4. ask it to open a login page in its browser and stop at the sign-in 5. when it stops, click Take over and sign in 6. click Hand back and tell it to continue the bot keeps that login for later sessions, until the site expires it.

how to use Bot Screen in Hermes Agent: your bot gets its own desktop, and you step in when it hits a login. on the Linux machine that runs your Hermes gateway: 1. install the screen: `hermes computer-use screen install` 2. make the bot's browser show on it: `hermes config set browser.headed true` 3. in Hermes Desktop: Bots, right-click your bot, Open Screen, then Start 4. ask it to open a login page in its browser and stop at the sign-in 5. when it stops, click Take over and sign in 6. click Hand back and tell it to continue the bot keeps that login for later sessions, until the site expires it.

witcheer

56,107 views • 1 month ago

Hermes Agent on Omarchy, in one minute. set Hermes as your default agent from the Omarchy menu, and every way you open an agent on the machine is the same Hermes: the terminal, the desktop app, the menu entry. ask it something about Omarchy itself and it knows where the files live, because Omarchy ships its own skill into Hermes. then switch your theme. the terminal, the app, everything follows.

Hermes Agent on Omarchy, in one minute. set Hermes as your default agent from the Omarchy menu, and every way you open an agent on the machine is the same Hermes: the terminal, the desktop app, the menu entry. ask it something about Omarchy itself and it knows where the files live, because Omarchy ships its own skill into Hermes. then switch your theme. the terminal, the app, everything follows.

witcheer

39,331 views • 1 month ago

while the self-learning poll runs, here is how to actually look at what your agent has picked up: type '/journey' in Hermes Desktop and enjoy a day-by-day timeline of every skill and memory your agent has learned since day one. it also lists each node, so you can see your interconnected skills and memories.

while the self-learning poll runs, here is how to actually look at what your agent has picked up: type '/journey' in Hermes Desktop and enjoy a day-by-day timeline of every skill and memory your agent has learned since day one. it also lists each node, so you can see your interconnected skills and memories.

witcheer

38,883 views • 3 months ago

Hermes just made its in-app browser a whole lot more useful. You can now keep multiple browser tabs open inside Hermes Desktop instead of every new page replacing the one you were already using. And that matters more than it sounds. Because this is not just about “having tabs.” It means Hermes can work across multiple pages without forcing you to keep losing your place every time you open the next thing. Research one source, keep it open, open another tab, compare them side by side, and keep moving. Check a few products before buying something. Look at multiple hotel or travel options at once. Keep a YouTube tutorial open in one tab while Hermes looks through docs or another page in the next. And because this lives inside Hermes Desktop, you are not limited to one basic browser view either. You can keep multiple tabs open. You can view two pages side by side. You can stack them top and bottom. You can even run a four-panel view when you want several pages open at once. So the browser inside Hermes is starting to feel a lot more like a real workspace instead of one page you keep replacing. There is also some nice polish that comes with it. Browser tabs now label themselves based on the page, and the address bar behaves more cleanly while pages are loading. And remember, this is the same in-app browser Hermes can already read, click through, type in, scroll, and annotate. So this is not just a prettier browser. It is a more capable workspace for the browser Hermes is actually using. If Hermes is going to do more of your work on the web, this is exactly the kind of browser upgrade it needed.

Hermes just made its in-app browser a whole lot more useful. You can now keep multiple browser tabs open inside Hermes Desktop instead of every new page replacing the one you were already using. And that matters more than it sounds. Because this is not just about “having tabs.” It means Hermes can work across multiple pages without forcing you to keep losing your place every time you open the next thing. Research one source, keep it open, open another tab, compare them side by side, and keep moving. Check a few products before buying something. Look at multiple hotel or travel options at once. Keep a YouTube tutorial open in one tab while Hermes looks through docs or another page in the next. And because this lives inside Hermes Desktop, you are not limited to one basic browser view either. You can keep multiple tabs open. You can view two pages side by side. You can stack them top and bottom. You can even run a four-panel view when you want several pages open at once. So the browser inside Hermes is starting to feel a lot more like a real workspace instead of one page you keep replacing. There is also some nice polish that comes with it. Browser tabs now label themselves based on the page, and the address bar behaves more cleanly while pages are loading. And remember, this is the same in-app browser Hermes can already read, click through, type in, scroll, and annotate. So this is not just a prettier browser. It is a more capable workspace for the browser Hermes is actually using. If Hermes is going to do more of your work on the web, this is exactly the kind of browser upgrade it needed.

Hermes Release Watch

52,859 views • 2 months ago

Over 90,000 Skills sitting inside Hermes Desktop is kind of insane!!!🤯 Did you know Hermes Desktop has a built-in Skills Hub with more than 90,000 Skills you can browse and add to an agent? And you can do it right from Desktop. Go to: Capabilities → Skills From there, open the Skills Hub under your installed Skills. You can: • search the catalog • browse by category or source • open any Skill to read what it does • review platform support, author, version, requirements, and docs • click + Add to this Agent to install it directly to the agent/profile you have selected That means if you want Hermes to get better at a specific type of work, you do not have to go hunting through repos or memorize install commands first. Just open the Hub, look through the catalog, inspect the Skill, and add it with one click. A lot of users still have no idea this is sitting inside Hermes Desktop.

Hermes Release Watch

68,830 views • 1 month ago

two agents, one repo, at the same time. each gets its own branch and its own working copy, so they never touch each other's files. in Hermes Desktop: open a project, Cmd+Shift+B to spin up a worktree lane, drop an agent in it, repeat. every lane is isolated, every lane has its own /rollback.

two agents, one repo, at the same time. each gets its own branch and its own working copy, so they never touch each other's files. in Hermes Desktop: open a project, Cmd+Shift+B to spin up a worktree lane, drop an agent in it, repeat. every lane is isolated, every lane has its own /rollback.

witcheer

25,804 views • 2 months ago

You can now add a live browser to Claude Code to click any element and edit it 🤯 Your app runs embedded. You click a button. Claude instantly knows the exact selector, the exact component, the exact location in your code. No more “the red button in the top left of the third card.” Just click it. 100% open source.

You can now add a live browser to Claude Code to click any element and edit it 🤯 Your app runs embedded. You click a button. Claude instantly knows the exact selector, the exact component, the exact location in your code. No more “the red button in the top left of the third card.” Just click it. 100% open source.

Alvaro Cintas

47,136 views • 5 months ago

Available now in Visual Studio Code Insiders, you can select and add elements directly to Chat! After opening any locally-hosted site via the built-in Simple Browser, click "Start" on the toolbar and select the element you want. This will attach a screenshot of the selected element, as well as the HTML and CSS of that element.

Available now in Visual Studio Code Insiders, you can select and add elements directly to Chat! After opening any locally-hosted site via the built-in Simple Browser, click "Start" on the toolbar and select the element you want. This will attach a screenshot of the selected element, as well as the HTML and CSS of that element.

Visual Studio Code

75,563 views • 1 year ago

your Hermes Agent, on your wrist. Hermes Watch is a new open-source community build for the Amazfit Active 2 watch: tap TALK, ask, and Hermes Agent answers on the watch, in text and out loud. what it does: - voice in, answers on your wrist, no phone in your hand - reads answers out loud, with a Voice on/off button - one ongoing conversation until you say "new chat" - Approve / Deny cards when Hermes asks before running something, one request at a time - long jobs keep running after you close the app, and the result lands on your Telegram - texts, car commands and a PC restart only run after you tap Yes - runs on your own PC, reachable only inside your Tailscale network what you can do with it: - ask a quick question while you walk or cook - approve the code change your agent wants to make, away from your desk - start a build and get pinged when it's done - check on your PC with a quick health check opensource code below

your Hermes Agent, on your wrist. Hermes Watch is a new open-source community build for the Amazfit Active 2 watch: tap TALK, ask, and Hermes Agent answers on the watch, in text and out loud. what it does: - voice in, answers on your wrist, no phone in your hand - reads answers out loud, with a Voice on/off button - one ongoing conversation until you say "new chat" - Approve / Deny cards when Hermes asks before running something, one request at a time - long jobs keep running after you close the app, and the result lands on your Telegram - texts, car commands and a PC restart only run after you tap Yes - runs on your own PC, reachable only inside your Tailscale network what you can do with it: - ask a quick question while you walk or cook - approve the code change your agent wants to make, away from your desk - start a build and get pinged when it's done - check on your PC with a quick health check opensource code below

witcheer

15,273 views • 7 days ago

Cursor now has a built-in web browser. You can say "start my app" and it will run the dev server in a terminal and then navigate the browser to localhost:3000. It can take screenshots of the page for iterating on design, and you can send DOM elements to the agent with prompts!

Cursor now has a built-in web browser. You can say "start my app" and it will run the dev server in a terminal and then navigate the browser to localhost:3000. It can take screenshots of the page for iterating on design, and you can send DOM elements to the agent with prompts!

Lee Robinson

216,307 views • 1 year ago

THIS GUY ADDED A LIVE BROWSER TO CLAUDE CODE SO YOU CAN CLICK ANY ELEMENT AND EDIT IT INSTANTLY biggest issue with vibe coding UI is that you have to describe what you want to change. if you prompt it the wrong selector or wrong component, Claude can't find it. now you just click it. your app runs in an embedded browser with Claude Code. you can click any button, any text, any div. Claude instantly knows exactly what you're pointing at. click. instruct. done. no more "change the button in the top right corner of the second card component." all you have to do now is just click the button. AND its open source

THIS GUY ADDED A LIVE BROWSER TO CLAUDE CODE SO YOU CAN CLICK ANY ELEMENT AND EDIT IT INSTANTLY biggest issue with vibe coding UI is that you have to describe what you want to change. if you prompt it the wrong selector or wrong component, Claude can't find it. now you just click it. your app runs in an embedded browser with Claude Code. you can click any button, any text, any div. Claude instantly knows exactly what you're pointing at. click. instruct. done. no more "change the button in the top right corner of the second card component." all you have to do now is just click the button. AND its open source

Om Patel

154,230 views • 6 months ago

Okay, This is a big Hermes Desktop update 👀 Hermes can now actually use the Preview pane. Not just open a page. Not just read a page. Use it. Click. Type. Scroll. Navigate. Annotate. Inside the same visible browser pane you are watching. That is a big deal. It means Hermes Desktop is starting to feel a lot less like a chat window attached to tools and a lot more like an agent that can work through web tasks in front of you. Think about the use cases: → Open documentation and show you exactly where a setting lives → Walk through a setup flow and point out what to click → Search a site, open the right result, and keep moving → Work through a dashboard while you supervise → Annotate important controls on a crowded page → Reproduce a web issue step by step → Fill out multi-step web workflows with you watching → Find the right tutorial or guide and take you straight to it That changes the feel of Hermes Desktop. Because now Hermes is not just telling you what to do. It can show you, point to it, and act on it in the same workspace. This one opens up a lot!!!

Okay, This is a big Hermes Desktop update 👀 Hermes can now actually use the Preview pane. Not just open a page. Not just read a page. Use it. Click. Type. Scroll. Navigate. Annotate. Inside the same visible browser pane you are watching. That is a big deal. It means Hermes Desktop is starting to feel a lot less like a chat window attached to tools and a lot more like an agent that can work through web tasks in front of you. Think about the use cases: → Open documentation and show you exactly where a setting lives → Walk through a setup flow and point out what to click → Search a site, open the right result, and keep moving → Work through a dashboard while you supervise → Annotate important controls on a crowded page → Reproduce a web issue step by step → Fill out multi-step web workflows with you watching → Find the right tutorial or guide and take you straight to it That changes the feel of Hermes Desktop. Because now Hermes is not just telling you what to do. It can show you, point to it, and act on it in the same workspace. This one opens up a lot!!!

Hermes Release Watch

56,648 views • 2 months ago

Hermes Browser Extension v0.3.0 just landed. You already had a browser inside Hermes Desktop. Now flip it around. Bring Hermes into your browser. 💻 Open the side panel next to whatever you're doing and let Hermes work with the page you're already on. I used it inside Google Cloud while working through Gmail API setup. If you've spent any time in there, you know that is not exactly a friendly little website. Hermes handled it extremely well. Research a page. Work through complicated setup screens. Draft without leaving the site. Let Hermes help move through multi-step browser work without constantly bouncing back and forth. You can also switch between built-in themes, Light/Dark modes, or add your own custom theme. 🎨 Hermes, right where you're already working. Give Hermes the repo and ask it to help you set it up. komet💫 Killed it with this update 🔥 Repo link in the first reply⬇️

Hermes Browser Extension v0.3.0 just landed. You already had a browser inside Hermes Desktop. Now flip it around. Bring Hermes into your browser. 💻 Open the side panel next to whatever you're doing and let Hermes work with the page you're already on. I used it inside Google Cloud while working through Gmail API setup. If you've spent any time in there, you know that is not exactly a friendly little website. Hermes handled it extremely well. Research a page. Work through complicated setup screens. Draft without leaving the site. Let Hermes help move through multi-step browser work without constantly bouncing back and forth. You can also switch between built-in themes, Light/Dark modes, or add your own custom theme. 🎨 Hermes, right where you're already working. Give Hermes the repo and ask it to help you set it up. komet💫 Killed it with this update 🔥 Repo link in the first reply⬇️

Hermes Release Watch

70,506 views • 2 months ago

Did you know that Visual Studio Code has HAD a built-in browser! Say "start my app in simple browser" and it will run the dev server and open simple browser to localhost. It can take screenshots of the page or element and send DOM elements to the agent chat!

Did you know that Visual Studio Code has HAD a built-in browser! Say "start my app in simple browser" and it will run the dev server and open simple browser to localhost. It can take screenshots of the page or element and send DOM elements to the agent chat!

James Montemagno

47,505 views • 1 year ago

Omarchy + Hermes Agent is a powerful combo This video shows how you can launch the Hermes Desktop app from the menu, as well as how you can make Hermes your default agent (and what that means) I posted a clip of the Desktop portion earlier in the week, but the full video has garnered a lot of interest and views on YouTube, so I wanted to post it here for the X audience! Check it out!

Omarchy + Hermes Agent is a powerful combo This video shows how you can launch the Hermes Desktop app from the menu, as well as how you can make Hermes your default agent (and what that means) I posted a clip of the Desktop portion earlier in the week, but the full video has garnered a lot of interest and views on YouTube, so I wanted to post it here for the X audience! Check it out!

tonbi

31,928 views • 1 month ago

This new Hermes Desktop browser isn't just an extra window with a browser bolted on, the agent can operate, see, and analyze what it sees along with you I made a short video demonstrating this, but here are just a few things you can do with it: You can scroll X, then ask for a summary of your feed or what the hot topics are You can watch a tutorial video from your favorite YouTuber **cough cough* and then ask your agent to pull transcripts, explain certain concepts from the video, or even implement them directly! You can ask for research on some open source memory solutions for agents, open those links right in the browser, then review them together

This new Hermes Desktop browser isn't just an extra window with a browser bolted on, the agent can operate, see, and analyze what it sees along with you I made a short video demonstrating this, but here are just a few things you can do with it: You can scroll X, then ask for a summary of your feed or what the hot topics are You can watch a tutorial video from your favorite YouTuber **cough cough* and then ask your agent to pull transcripts, explain certain concepts from the video, or even implement them directly! You can ask for research on some open source memory solutions for agents, open those links right in the browser, then review them together

tonbi

58,360 views • 2 months ago

A screen recording is the best context you can give an AI agent. It's also the worst. A few seconds of video is thousands of images. Feed that to an agent and you instantly blow up its memory. So I built a tool that fixes it. How it works: Hit record and just do your thing. Click around, type, and talk out loud about what you're doing. While you record, it quietly captures the stuff that actually matters: your voice transcription, every click and the exact thing you clicked, what you typed, and the shortcuts you press. When you stop, it doesn't hand the agent the whole video. It writes a short, readable summary: a timeline of what you said and did. The agent reads that tiny summary first. Then, only when it needs to actually see a moment, it pulls that one exact frame from the video, like flipping to a single page instead of reading the whole book. The result: the agent understands everything you did! Full context. Less tokens.

A screen recording is the best context you can give an AI agent. It's also the worst. A few seconds of video is thousands of images. Feed that to an agent and you instantly blow up its memory. So I built a tool that fixes it. How it works: Hit record and just do your thing. Click around, type, and talk out loud about what you're doing. While you record, it quietly captures the stuff that actually matters: your voice transcription, every click and the exact thing you clicked, what you typed, and the shortcuts you press. When you stop, it doesn't hand the agent the whole video. It writes a short, readable summary: a timeline of what you said and did. The agent reads that tiny summary first. Then, only when it needs to actually see a moment, it pulls that one exact frame from the video, like flipping to a single page instead of reading the whole book. The result: the agent understands everything you did! Full context. Less tokens.

Milind S

12,486 views • 4 months ago

We are super excited to launch the in-app browser inside Codex with comment mode! View any web pages & iterate with your agent quickly with just point and click. Codex will automatically capture a screenshot, the DOM element, and feed it as precise context to your next chat. No more switching between browsers, dragging screenshots, and wrangling with underspecified prompts. It's great for front-end development of apps/pages, but also very useful if you have documentation pulled up on the side and just want to ask a question!

We are super excited to launch the in-app browser inside Codex with comment mode! View any web pages & iterate with your agent quickly with just point and click. Codex will automatically capture a screenshot, the DOM element, and feed it as precise context to your next chat. No more switching between browsers, dragging screenshots, and wrangling with underspecified prompts. It's great for front-end development of apps/pages, but also very useful if you have documentation pulled up on the side and just want to ask a question!

James Sun

405,356 views • 6 months ago

make your workspace exactly how you like it super easily. if you’re like me and love changing themes depending on your mood, you should try Hermes Desktop. it has a live VS Code Marketplace search built into its theme settings. you can access any color theme on the marketplace, download it, and convert it on the spot. Cmd+K > install theme > use it.

make your workspace exactly how you like it super easily. if you’re like me and love changing themes depending on your mood, you should try Hermes Desktop. it has a live VS Code Marketplace search built into its theme settings. you can access any color theme on the marketplace, download it, and convert it on the spot. Cmd+K > install theme > use it.

witcheer

17,862 views • 2 months ago

Andrej Karpathy, OpenAI Co-founder, introduced the "LLM Wiki" - a knowledge graph inside Obsidian i built my own version for GTM and here's exactly how you can do the same: - one vault, one folder per thing your business knows: offer, buyers, voice, market map, rooms, workflows, rulings, prospects, signals, messages, metrics - one note per fact, 50-150 words, a title you can say out loud ("a budget that can survive"), four frontmatter keys (type, tags, created, status) - every note links to its folder hub, two siblings and one note in another folder, so the graph becomes one connected web instead of eleven islands - a rulings folder where every correction you give an agent becomes one dated line, and every run reads it before drafting... a correction becomes permanent instead of repeated - Claude Code pointed at the vault reads the hubs first, greps the rulings, then drafts, and everything it learns goes back in as a note the same day - graph view colored by folder, hubs in white, so you see which cluster is thin before a workflow fails the article below teaches you how to build the full workflow step-by-step:

Andrej Karpathy, OpenAI Co-founder, introduced the "LLM Wiki" - a knowledge graph inside Obsidian i built my own version for GTM and here's exactly how you can do the same: - one vault, one folder per thing your business knows: offer, buyers, voice, market map, rooms, workflows, rulings, prospects, signals, messages, metrics - one note per fact, 50-150 words, a title you can say out loud ("a budget that can survive"), four frontmatter keys (type, tags, created, status) - every note links to its folder hub, two siblings and one note in another folder, so the graph becomes one connected web instead of eleven islands - a rulings folder where every correction you give an agent becomes one dated line, and every run reads it before drafting... a correction becomes permanent instead of repeated - Claude Code pointed at the vault reads the hubs first, greps the rulings, then drafts, and everything it learns goes back in as a note the same day - graph view colored by folder, hubs in white, so you see which cluster is thin before a workflow fails the article below teaches you how to build the full workflow step-by-step:

Machina

30,551 views • 2 months ago