正在加载视频...

视频加载失败

This new Hermes Desktop browser isn't just an extra window with a browser bolted on, the agent can operate, see, and analyze what it sees along with you I made a short video demonstrating this, but here are just a few things you can do with it: You can...

58,257 次观看 • 1 个月前 •via X (Twitter)

38 条评论

kkiran 的头像
kkiran1 个月前

Sweet! iOS and Android simulator next? @Teknium is that a possibility?

link 的头像
link1 个月前

how can i use it?it's a plugin?

tonbi 的头像
tonbi1 个月前

I don't believe it is a plugin, just an in-app feature. Just ask your hermes to do it!

Percy Kintu 的头像
Percy Kintu1 个月前

@Teknium Can this be done remotely? Or only by seating at the computer using desktop app. I want my agent to see and read but remotely so I don’t have to be at my desktop

tonbi 的头像
tonbi1 个月前

@Teknium So it does appear that it needs to be with a local gateway

basetta 的头像
basetta1 个月前

guys I know it seems a dumb question but : HOW TO OPEN IT ?!?! I've even asked to hermes but even him seems confused :\

tonbi 的头像
tonbi1 个月前

You need to be updated to the latest version, and be running on a local gateway for it to work apparently. I simply asked hermes to open the in-app browser like you saw in the video

sindikitil 的头像
sindikitil1 个月前

seeing the actual screen beats scraping the DOM every time. half of X context is visual, so an agent that watches along is way more useful.

flep ✪ 的头像
flep ✪1 个月前

Sadly can't use with my remote gateway

tonbi 的头像
tonbi1 个月前

Yes it appears to only work on local gateway for now

Mind of Marc 的头像
Mind of Marc1 个月前

@tonbinstudio this won't work for remote gateway right?

tonbi 的头像
tonbi1 个月前

No it seems like it needs local gateway

Majenta 的头像
Majenta1 个月前

@Teknium So cool hey.

Bobby Ivanov 的头像
Bobby Ivanov1 个月前

Is it possible to have Hermes running on VPS whilst having desktop on your main computer connecting to it? So all work is kept on the VPs and the desktop is simply a window to it? @witcheer

Transurfer 的头像
Transurfer1 个月前

Looks like I won’t need to keep a separate X window open anymore.

Eyes Wide Open 的头像
Eyes Wide Open1 个月前

Hi Tonbi, question. I was following your instructions and I got the browser to work. One thing I noticed was that my desktop was a lot slower than yours. You were getting it to open in several milliseconds. I was on the order of 5 to 10 seconds. I suppose it could be machine speed because I'm running it on a Mac mini base, but I'm wondering if there might be other factors related to load or context. I want to speed up my desktop a little bit. It feels a little slow to me and sluggish at times. While I'm waiting to buy my super machine, I wonder if there are any tips that I can do locally to help. On a separate note, I couldn't get the new voice conversation mode working properly. It was very, very laggy, nothing like my codex, which is a quick back-and-forth conversation. Any tips about that? did you do a video about that also?

tonbi 的头像
tonbi1 个月前

Great! In terms of your desktop speed, it could just be based on the memory usage/speed of your machine. Maybe the model too, I was using a faster model, maybe a slower one just took longer Voice conversation is fairly new and I haven't really tested it all that much, I'm more of a text guy, but I'll take a look

Eyes Wide Open 的头像
Eyes Wide Open1 个月前

Thanks for the quick response. I enjoy the videos. Yeah, I definitely think making that model at high versus fast should be investigated because that might be the trick. Thanks for the idea. Regarding voice, I've recently started using voice more and more, and I really like it. I love it in codex with the conversation.Haven't been able to replicate the codex experience yet, despite using fast models for that. I found one or two bugs in the voice files also that I reported,so I'm holding off a conversational voice in Hermes until I see those are resolved. Wispr Flow is working fine for me.

Eyes Wide Open 的头像
Eyes Wide Open1 个月前

Following up on this I had switched to Fast model and I'm still finding it very laggy, nowhere near my experience on Codex. In fact when I use Codex Fast, it's great. It's like talking to a friend. When I use Fast modes in 5.5 or 5.6 GPT via OAuth in Hermes, it still feels very laggy and it still prints out the call response and then starts talking

Kaden 🏴‍☠️ 的头像
Kaden 🏴‍☠️1 个月前

@Teknium Anybody remember those 2 guys who released the brainrot attachment for cursor so you could watch YouTube or gamble on stake while in cursor all one window. This is like the productive version of that, @NousResearch are making incredible strides in so many directions

strangle_hodl 的头像
strangle_hodl1 个月前

that command doesnt work for me. i dont see this anywhere in the desktop ui, and my agent doesnt seem to be aware of its existence. how do i enable this? im running hermes via gateway if that makes a differnece

tonbi 的头像
tonbi1 个月前

You need to be using the local gateway I believe

Rick A.F. 的头像
Rick A.F.1 个月前

Hermes is shipping crazy features 🚀

Jed Ivie 的头像
Jed Ivie1 个月前

That's cool...but how do you have the tabbed sessions there at the top of Hermes Desktop?

tonbi 的头像
tonbi1 个月前

They shipped tabbed sessions before, it is just a normal pane

Quest for Yield 的头像
Quest for Yield1 个月前

nice

BG 的头像
BG1 个月前

Amazing

Cryptogemguy 的头像
Cryptogemguy1 个月前

life-changing this browser thing is it won't ban me, right? using to access linkedin posts / x timeline etc

tonbi 的头像
tonbi1 个月前

I haven't been banned yet!

Cryptogemguy 的头像
Cryptogemguy1 个月前

tried yesterday - turned my 1 hour work in 10 min.

Raul Morales 的头像
Raul Morales1 个月前

Right?! Seeing the actual screen is legit everything. DOM scraping guesses. Watching along is how you catch the stuff a text summary just... skips.

badmaash 的头像
badmaash1 个月前

Much needed shiii

Casey 的头像
Casey1 个月前

Is this Mac only? I don't have it and I'm updated on PC.

Matt Barber 的头像
Matt Barber1 个月前

Hermes-verse day 62…I have Hermes open watching me watch this, watch yourself, watch Hermes scroll your X feed while I’m sitting here in my Hermes X feed….sendhelp 🫠😂

tonbi 的头像
tonbi1 个月前

This is all too much lol

AI Mastery Guide 的头像
AI Mastery Guide1 个月前

An agent that actually sees and reacts to the page is a real step up

Xochiqu 的头像
Xochiqu1 个月前

is there a way to get an address bar, forwards/back buttons, open the browser without asking the agent to do it for you?

Philip 的头像
Philip1 个月前

Will try this out.

相关视频

Hermes just made its in-app browser a whole lot more useful. You can now keep multiple browser tabs open inside Hermes Desktop instead of every new page replacing the one you were already using. And that matters more than it sounds. Because this is not just about “having tabs.” It means Hermes can work across multiple pages without forcing you to keep losing your place every time you open the next thing. Research one source, keep it open, open another tab, compare them side by side, and keep moving. Check a few products before buying something. Look at multiple hotel or travel options at once. Keep a YouTube tutorial open in one tab while Hermes looks through docs or another page in the next. And because this lives inside Hermes Desktop, you are not limited to one basic browser view either. You can keep multiple tabs open. You can view two pages side by side. You can stack them top and bottom. You can even run a four-panel view when you want several pages open at once. So the browser inside Hermes is starting to feel a lot more like a real workspace instead of one page you keep replacing. There is also some nice polish that comes with it. Browser tabs now label themselves based on the page, and the address bar behaves more cleanly while pages are loading. And remember, this is the same in-app browser Hermes can already read, click through, type in, scroll, and annotate. So this is not just a prettier browser. It is a more capable workspace for the browser Hermes is actually using. If Hermes is going to do more of your work on the web, this is exactly the kind of browser upgrade it needed.

Hermes Release Watch

52,493 次观看 • 27 天前

Introducing the Clips chrome extension - the easiest way to send bug reports to agents with video, transcript, and browser debug info captured automatically. 100% free and open source. If you are like me and get tired of manually typing instructions to agents, attaching screenshots, pasting debug logs, and all of that, this might be your new favorite tool. With the Clips chrome extension, you can just click the Clips icon, hit record, and start talking. Visually demonstrate your issue, go through the flow, point out what’s broken. Clips will capture everything on your screen, plus network requests, browser logs, client errors, and all the details around them. And it redacts sensitive information. Then it gives you a link you can send to humans so they can play it and take a look. Or, more importantly, just give it to your agents by just pasting the URL to them. The link has special metadata for agents so just from the URL, the agent can pull all information from the clip automatically. No plugin or MCP server required. That means it can "see and hear" what’s in the video - read the transcript, grab snapshots at any timestamp, and inspect the logs and network requests that were shared with it. So whether you want to quickly demo an issue and send all that context to an agent, or get better bug reports from teammates, recording and sending Clips makes that super easy. Unlike expensive apps like Loom, this is all 100% free and open source. The framework that powers this, plus a bunch of other free applications, is open source too. You can just sign up and use it, or fork it and customize it to your needs. This, in my opinion, is the future of software. Rather than bloated SaaS that charges you a ton of money and still doesn’t even have the things you need, we get free open source canonical apps that you can fork and customize in any way you want. I'll link to all this stuff in the replies. If you try it, let me know your feedback.

Steve (Builder.io)

60,923 次观看 • 2 个月前