正在加载视频...

视频加载失败

whoa this actually worked! Jev lets me control my browser in real time with my voice now > i talk > transcript sent to Jev > jev returns probabilities in ~300ms > browser clicks costs: $0.0002 per decision i'm stunned how fast this is. when i asked it to...

241,927 次观看 • 1 天前 •via X (Twitter)

37 条评论

Florian S 的头像
Florian S1 天前

Nice experminent. I was also thinking about computer use. Would be great if it had multimodal inputs. Just a matter of time until it has, I guess. Currently experimenting with Jev as a classifier for a LLM autorouter. Also very promising here.

Moritz Kremb 的头像
Moritz Kremb1 天前

nice. so many interesting things to do, not enough time 😄

Florian S 的头像
Florian S1 天前

💯

Florian S 的头像
Florian S1 天前

oh, let me DM you quickly

Moritz Kremb 的头像
Moritz Kremb1 天前

I'll be doing a live Jev build session in my community for founders next week Join here:

bikram 的头像
bikram1 天前

Can you explain the setup? Or gh repo

Milton 的头像
Milton23 小时前

@dhh - We need a Jev + Omarchy implementation, stat! This would be killer for physically disabled people who have trouble using their limbs to control computer input devices.

Wayne Nilsen 的头像
Wayne Nilsen1 天前

This really just makes me excited for when we get ASICs

Tucker King 的头像
Tucker King1 天前

Congrats. It even beat you to go back.

Moritz Kremb 的头像
Moritz Kremb21 小时前

yes 😂

Jimmy Jones 的头像
Jimmy Jones1 天前

so jev is just a super fast classifier of intent? dangit, why haven't I gotten an invite yet!

Alex 的头像
Alex1 天前

Computer use might be solved dudes. So excited for SSI's model...!!

Sahibzada Allahyar 的头像
Sahibzada Allahyar23 小时前

GLiNER does the same thing as Jev while being local, free and open weights

physalisx 的头像
physalisx1 天前

How do you get it to understand you want it to go to " You didn't put that specific URL into its decision tree did you?

OptionHans 的头像
OptionHans1 天前

You can control it with your voice? Amazing, it's the Clapper. AI is nuts :)

W3nzel.eth 的头像
W3nzel.eth22 小时前

How do I see your profile now for the first time. Damn.

Moritz Kremb 的头像
Moritz Kremb21 小时前

🫶

Josh 的头像
Josh1 天前

The weak part of the demo is task difficulty, not the model being used wrong. Browser MCP (existing) already gives us click/navigate/snapshot. Your voice mostly does that and could be implemented with a control prompt. What’s new? You've only swapped the LLM turn for Jev’s 300ms structured choice over the current DOM + partial transcript. Great for Jev. WebMCP is a different bet: where sites expose tools so you don’t click the UI at all. Your clip doesn’t test that, and Wikipedia isn’t speaking WebMCP. I'd like to see both.

Xavi 的头像
Xavi22 小时前

Nice one. Next step pairing it with Neuralink

Aymane 的头像
Aymane22 小时前

This is insane I didn't know Jev is this good. It's gonna be implemented in literally everything.

neexpl 的头像
neexpl1 天前

What kind of STT are you using? Is it local?

Manu_TechAndGames 的头像
Manu_TechAndGames1 天前

Jev has a very limited set of actions in response. How can it handle something like 'go to ? And it's funny you said .com and it understood it was .org !

GD 的头像
GD1 天前

I'm just wondering how you are taking decision rather than Jev taking the decision. You are telling do this to that, what is Jev doing here ? Try video give a high level goal and Jev decides and navigate of it own, true agentic browser use.

OPitA 的头像
OPitA1 天前

will you be sharing this, looks pretty useful.

Moritz Kremb 的头像
Moritz Kremb21 小时前

yes will do

Gerald Reimertz 的头像
Gerald Reimertz1 天前

Impressive demo!

Ben 的头像
Ben1 天前

Jev looks great for computer use! Loving these examples coming out!

Dave 的头像
Dave23 小时前

I got access today and immediately had no idea what was going on.

johnineson 的头像
johnineson1 天前

Latency is impressive, considering it also includes STT – what are you using for that? Local model?

MattacK 的头像
MattacK1 天前

cool use case man! thanks for sharing, getting ideas for how we might use this - any other applications of this?

Dani Debatte 的头像
Dani Debatte1 天前

Instead of using your hand and clicking for free? I mean, okay, I can imagine proper, useful use cases, like helping people with disabilities.

Tom Lynch 的头像
Tom Lynch1 天前

@FarzaTV

draslan.eth 的头像
draslan.eth1 天前

does it work via API?

Mr.Nobi 的头像
Mr.Nobi1 天前

Wait I'm a bit confused, I thought this thing was a big probabilistic if statement. How does it recognize each actions, do you send the hotel page or something?

Brian 的头像
Brian1 天前

incredible

Bryant 的头像
Bryant1 天前

great usage. will it soon be time to put away the mouse and keyboard?

Aestivial (Nayan Panda) 的头像
Aestivial (Nayan Panda)1 天前

Setup? Need to test it with my Jev.

相关视频