Video wird geladen...

Video konnte nicht geladen werden

Zur Startseite

whoa this actually worked! Jev lets me control my browser in real time with my voice now > i talk > transcript sent to Jev > jev returns probabilities in ~300ms > browser clicks costs: $0.0002 per decision i'm stunned how fast this is. when i asked it to...

241,927 Aufrufe • vor 1 Tag •via X (Twitter)

37 Kommentare

Profilbild von Florian S
Florian Svor 1 Tag

Nice experminent. I was also thinking about computer use. Would be great if it had multimodal inputs. Just a matter of time until it has, I guess. Currently experimenting with Jev as a classifier for a LLM autorouter. Also very promising here.

Profilbild von Moritz Kremb
Moritz Krembvor 1 Tag

nice. so many interesting things to do, not enough time 😄

Profilbild von Florian S
Florian Svor 1 Tag

💯

Profilbild von Florian S
Florian Svor 1 Tag

oh, let me DM you quickly

Profilbild von Moritz Kremb
Moritz Krembvor 1 Tag

I'll be doing a live Jev build session in my community for founders next week Join here:

Profilbild von bikram
bikramvor 1 Tag

Can you explain the setup? Or gh repo

Profilbild von Milton
Miltonvor 1 Tag

@dhh - We need a Jev + Omarchy implementation, stat! This would be killer for physically disabled people who have trouble using their limbs to control computer input devices.

Profilbild von Wayne Nilsen
Wayne Nilsenvor 1 Tag

This really just makes me excited for when we get ASICs

Profilbild von Tucker King
Tucker Kingvor 1 Tag

Congrats. It even beat you to go back.

Profilbild von Moritz Kremb
Moritz Krembvor 22 Stunden

yes 😂

Profilbild von Jimmy Jones
Jimmy Jonesvor 1 Tag

so jev is just a super fast classifier of intent? dangit, why haven't I gotten an invite yet!

Profilbild von Alex
Alexvor 1 Tag

Computer use might be solved dudes. So excited for SSI's model...!!

Profilbild von Sahibzada Allahyar
Sahibzada Allahyarvor 1 Tag

GLiNER does the same thing as Jev while being local, free and open weights

Profilbild von physalisx
physalisxvor 1 Tag

How do you get it to understand you want it to go to " You didn't put that specific URL into its decision tree did you?

Profilbild von OptionHans
OptionHansvor 1 Tag

You can control it with your voice? Amazing, it's the Clapper. AI is nuts :)

Profilbild von W3nzel.eth
W3nzel.ethvor 23 Stunden

How do I see your profile now for the first time. Damn.

Profilbild von Moritz Kremb
Moritz Krembvor 22 Stunden

🫶

Profilbild von Josh
Joshvor 1 Tag

The weak part of the demo is task difficulty, not the model being used wrong. Browser MCP (existing) already gives us click/navigate/snapshot. Your voice mostly does that and could be implemented with a control prompt. What’s new? You've only swapped the LLM turn for Jev’s 300ms structured choice over the current DOM + partial transcript. Great for Jev. WebMCP is a different bet: where sites expose tools so you don’t click the UI at all. Your clip doesn’t test that, and Wikipedia isn’t speaking WebMCP. I'd like to see both.

Profilbild von Xavi
Xavivor 23 Stunden

Nice one. Next step pairing it with Neuralink

Profilbild von Aymane
Aymanevor 23 Stunden

This is insane I didn't know Jev is this good. It's gonna be implemented in literally everything.

Profilbild von neexpl
neexplvor 1 Tag

What kind of STT are you using? Is it local?

Profilbild von Manu_TechAndGames
Manu_TechAndGamesvor 1 Tag

Jev has a very limited set of actions in response. How can it handle something like 'go to ? And it's funny you said .com and it understood it was .org !

Profilbild von GD
GDvor 1 Tag

I'm just wondering how you are taking decision rather than Jev taking the decision. You are telling do this to that, what is Jev doing here ? Try video give a high level goal and Jev decides and navigate of it own, true agentic browser use.

Profilbild von OPitA
OPitAvor 1 Tag

will you be sharing this, looks pretty useful.

Profilbild von Moritz Kremb
Moritz Krembvor 22 Stunden

yes will do

Profilbild von Gerald Reimertz
Gerald Reimertzvor 1 Tag

Impressive demo!

Profilbild von Ben
Benvor 1 Tag

Jev looks great for computer use! Loving these examples coming out!

Profilbild von Dave
Davevor 1 Tag

I got access today and immediately had no idea what was going on.

Profilbild von johnineson
johninesonvor 1 Tag

Latency is impressive, considering it also includes STT – what are you using for that? Local model?

Profilbild von MattacK
MattacKvor 1 Tag

cool use case man! thanks for sharing, getting ideas for how we might use this - any other applications of this?

Profilbild von Dani Debatte
Dani Debattevor 1 Tag

Instead of using your hand and clicking for free? I mean, okay, I can imagine proper, useful use cases, like helping people with disabilities.

Profilbild von Tom Lynch
Tom Lynchvor 1 Tag

@FarzaTV

Profilbild von draslan.eth
draslan.ethvor 1 Tag

does it work via API?

Profilbild von Mr.Nobi
Mr.Nobivor 1 Tag

Wait I'm a bit confused, I thought this thing was a big probabilistic if statement. How does it recognize each actions, do you send the hotel page or something?

Profilbild von Brian
Brianvor 1 Tag

incredible

Profilbild von Bryant
Bryantvor 1 Tag

great usage. will it soon be time to put away the mouse and keyboard?

Profilbild von Aestivial (Nayan Panda)
Aestivial (Nayan Panda)vor 1 Tag

Setup? Need to test it with my Jev.

Ähnliche Videos