Loading video...

Video Failed to Load

Go Home

jev has changed computer-use forever. i built a computer use tool with jev that costs basically nothing to use, and has sub-second latency. it can even decide what to type, and doesn't need an LLM. open source. link below. no LLM required.

138,333 views • 1 day ago •via X (Twitter)

34 Comments

shiv's profile picture
shiv1 day ago

repo: also, if you're building computer-use agents that need applications without the overhead of an entire computer, i'd love to talk - @tryisle

Daniel Zambrini's profile picture
Daniel Zambrini20 hours ago

Wait I thought Jev could not generate text, so how does it type?

Asaf Mazuz's profile picture
Asaf Mazuz1 day ago

Nice! Consider adding it to

Asklv's profile picture
Asklv15 hours ago

Great proof that computer use can be reduced to fast, bounded click/type decisions instead of a generative loop. We used that split for social research: Jev picks typed actions, socai runs them in Chrome, and evidence becomes a cited report:

Phanindra Reddy's profile picture
Phanindra Reddy1 day ago

here are some opensource use cases, love if you can submit a pr here as wlel

Ábel Énekes's profile picture
Ábel Énekes1 day ago

Congrats man, but at this point every second person who has access to a coding agent did it

Pranav's profile picture
Pranav1 day ago

add this on

Taper Solanki's profile picture
Taper Solanki1 day ago

The real breakthrough is making computer use an engineered primitive instead of an expensive LLM loop.

Harshit Khemani's profile picture
Harshit Khemani15 hours ago

wait, wdym "doesn't need an llm"? @grok

Scooby's profile picture
Scooby16 hours ago

Hey saw your repo, wanted to talk about the pros/cons of using screenshots/labeling ui elements vs using internal accessibility stuff the apps expose. Would love to talk more

Diplocracy's profile picture
Diplocracy15 hours ago

Could you make it test mobile games/apps somehow? So it tests everything, clicks everywhere, tries to break it and notes all the bugs?

Truegav's profile picture
Truegav17 hours ago

How good is it at tasks though?

Jeremy Bosma's profile picture
Jeremy Bosma13 hours ago

The no-LLM part is the unlock

Brian Hadu's profile picture
Brian Hadu13 hours ago

how does it decide what to type without using an LLM?

The M0d3rn R3tr0 Gam3r's profile picture
The M0d3rn R3tr0 Gam3r23 hours ago

Im gonna install this to help with youtube and opusclip automation and see if it works

GBE's profile picture
GBE23 hours ago

wait so this can actually be your personal assistant like actually

Leo's profile picture
Leo14 hours ago

sub-second: relating to a time interval of less than one second

Harrison's profile picture
Harrison1 day ago

sub-second latency on computer use is the part that matters. nobody talks about it but it's why most of these demos feel broken in practice

Chef Decoder's profile picture
Chef Decoder14 hours ago

nice one 🔥🔥🔥

Vlad Terin's profile picture
Vlad Terin23 hours ago

Nice! How are you building the choices for what to type? My Codex version supplies the text and lets Jev choose the action—curious about your approach.

ZAY TRADE's profile picture
ZAY TRADE21 hours ago

Damn JEV is like the upgrade from cydia repos x 10000

Isma's profile picture
Isma22 hours ago

can't see yet only receives DOM

AI Mastery Guide's profile picture
AI Mastery Guide22 hours ago

Wait, no LLM at all?

Ravi's profile picture
Ravi1 day ago

latency was always the bigger blocker for computer use, more than cost. a screenshot → model → action round trip on every step adds up fast on a 20 step task. drop the model call and most of that goes away. then the hard part is grounding: finding the right element after the UI

Tobi's profile picture
Tobi1 day ago

the important distinction is not whether a model is in the loop. it is whether the system can keep the action narrow and check the result before it becomes consequential.the important distinction is not whether a model is in the loop. it is whether the system can keep the action narrow and check the result before it becomes consequential.

Klasta's profile picture
Klasta21 hours ago

No LLM in the loop. The keys already knew the sentence.

Siddharth Vishwanath's profile picture
Siddharth Vishwanath1 day ago

Can it fill out forms for me? Can it send text through whatsapp?

Valentin Rudloff's profile picture
Valentin Rudloff13 hours ago

The app keeps quitting the app I want to interact with

Jhon Dennis's profile picture
Jhon Dennis13 hours ago

不靠大模型也能把下一步选出来 这才是真正的 agent 基础设施 延迟和成本一起下来 普通人也能随手接进工作流

Milos Zlatanovic's profile picture
Milos Zlatanovic17 hours ago

how yall make all dis things

Matteo M.'s profile picture
Matteo M.13 hours ago

Thats cool and all but wouldnt navigating via dom insta flag you as a bot? Especially since it is so incredibly fast

Proud Indian 🇮🇳 (Modi Ka Pariwar)'s profile picture
Proud Indian 🇮🇳 (Modi Ka Pariwar)17 hours ago

Would you have any extra invite?

Dan's profile picture
Dan13 hours ago

This is so interesting

Itay Abraham Cohen's profile picture
Itay Abraham Cohen14 hours ago

Ew why did you make him do such an abhorrent act to your machine

Related Videos

Our first short course with Anthropic! Building Towards Computer Use with Anthropic. This teaches you to build an LLM-based agent that uses a computer interface by generating mouse clicks and keystrokes. Computer Use is an important, emerging capability for LLMs that will let AI agents do many more tasks than were possible before, since it lets them interact with interfaces designed for humans to use, rather than only tools that provide explicit API access. I hope you will enjoy learning about it! This course is taught by Anthropic's Head of Curriculum, Colt_Steele. You'll learn to apply image reasoning and tool use to "use" a computer as follows: a model processes an image of the screen, analyzes it to understand what's going on, and navigates the computer via mouse clicks and keystrokes. This course goes through the key building blocks, and culminates in a demo of an AI assistant that uses a web browser to search for a research paper, downloads the PDF, and finally summarizes the paper for you. In detail, you’ll: - Learn about Anthropic's family of models, when to use which one, and make API requests to Claude - Use multi-modal prompts that combine text and image content blocks, and also work with streaming responses - Improve your prompting by using prompt templates, using XML to structure prompts, and providing examples - Implement prompt caching to reduce cost and latency - Apply tool-use to build a chatbot that can call different tools to respond to queries - See all these building blocks come together in Computer Use demo Please sign up here:

Andrew Ng

170,541 views • 1 year ago