Video wird geladen...

Video konnte nicht geladen werden

Zur Startseite

jev has changed computer-use forever. i built a computer use tool with jev that costs basically nothing to use, and has sub-second latency. it can even decide what to type, and doesn't need an LLM. open source. link below. no LLM required.

138,333 Aufrufe • vor 1 Tag •via X (Twitter)

34 Kommentare

Profilbild von shiv
shivvor 1 Tag

repo: also, if you're building computer-use agents that need applications without the overhead of an entire computer, i'd love to talk - @tryisle

Profilbild von Daniel Zambrini
Daniel Zambrinivor 21 Stunden

Wait I thought Jev could not generate text, so how does it type?

Profilbild von Asaf Mazuz
Asaf Mazuzvor 1 Tag

Nice! Consider adding it to

Profilbild von Asklv
Asklvvor 16 Stunden

Great proof that computer use can be reduced to fast, bounded click/type decisions instead of a generative loop. We used that split for social research: Jev picks typed actions, socai runs them in Chrome, and evidence becomes a cited report:

Profilbild von Phanindra Reddy
Phanindra Reddyvor 1 Tag

here are some opensource use cases, love if you can submit a pr here as wlel

Profilbild von Ábel Énekes
Ábel Énekesvor 1 Tag

Congrats man, but at this point every second person who has access to a coding agent did it

Profilbild von Pranav
Pranavvor 1 Tag

add this on

Profilbild von Taper Solanki
Taper Solankivor 1 Tag

The real breakthrough is making computer use an engineered primitive instead of an expensive LLM loop.

Profilbild von Harshit Khemani
Harshit Khemanivor 16 Stunden

wait, wdym "doesn't need an llm"? @grok

Profilbild von Scooby
Scoobyvor 17 Stunden

Hey saw your repo, wanted to talk about the pros/cons of using screenshots/labeling ui elements vs using internal accessibility stuff the apps expose. Would love to talk more

Profilbild von Diplocracy
Diplocracyvor 16 Stunden

Could you make it test mobile games/apps somehow? So it tests everything, clicks everywhere, tries to break it and notes all the bugs?

Profilbild von Truegav
Truegavvor 18 Stunden

How good is it at tasks though?

Profilbild von Jeremy Bosma
Jeremy Bosmavor 15 Stunden

The no-LLM part is the unlock

Profilbild von Brian Hadu
Brian Haduvor 15 Stunden

how does it decide what to type without using an LLM?

Profilbild von The M0d3rn R3tr0 Gam3r
The M0d3rn R3tr0 Gam3rvor 1 Tag

Im gonna install this to help with youtube and opusclip automation and see if it works

Profilbild von GBE
GBEvor 1 Tag

wait so this can actually be your personal assistant like actually

Profilbild von Leo
Leovor 15 Stunden

sub-second: relating to a time interval of less than one second

Profilbild von Harrison
Harrisonvor 1 Tag

sub-second latency on computer use is the part that matters. nobody talks about it but it's why most of these demos feel broken in practice

Profilbild von Chef Decoder
Chef Decodervor 15 Stunden

nice one 🔥🔥🔥

Profilbild von Vlad Terin
Vlad Terinvor 1 Tag

Nice! How are you building the choices for what to type? My Codex version supplies the text and lets Jev choose the action—curious about your approach.

Profilbild von ZAY TRADE
ZAY TRADEvor 22 Stunden

Damn JEV is like the upgrade from cydia repos x 10000

Profilbild von Isma
Ismavor 1 Tag

can't see yet only receives DOM

Profilbild von AI Mastery Guide
AI Mastery Guidevor 23 Stunden

Wait, no LLM at all?

Profilbild von Ravi
Ravivor 1 Tag

latency was always the bigger blocker for computer use, more than cost. a screenshot → model → action round trip on every step adds up fast on a 20 step task. drop the model call and most of that goes away. then the hard part is grounding: finding the right element after the UI

Profilbild von Tobi
Tobivor 1 Tag

the important distinction is not whether a model is in the loop. it is whether the system can keep the action narrow and check the result before it becomes consequential.the important distinction is not whether a model is in the loop. it is whether the system can keep the action narrow and check the result before it becomes consequential.

Profilbild von Klasta
Klastavor 22 Stunden

No LLM in the loop. The keys already knew the sentence.

Profilbild von Siddharth Vishwanath
Siddharth Vishwanathvor 1 Tag

Can it fill out forms for me? Can it send text through whatsapp?

Profilbild von Valentin Rudloff
Valentin Rudloffvor 14 Stunden

The app keeps quitting the app I want to interact with

Profilbild von Jhon Dennis
Jhon Dennisvor 14 Stunden

不靠大模型也能把下一步选出来 这才是真正的 agent 基础设施 延迟和成本一起下来 普通人也能随手接进工作流

Profilbild von Milos Zlatanovic
Milos Zlatanovicvor 18 Stunden

how yall make all dis things

Profilbild von Matteo M.
Matteo M.vor 15 Stunden

Thats cool and all but wouldnt navigating via dom insta flag you as a bot? Especially since it is so incredibly fast

Profilbild von Proud Indian 🇮🇳 (Modi Ka Pariwar)
Proud Indian 🇮🇳 (Modi Ka Pariwar)vor 18 Stunden

Would you have any extra invite?

Profilbild von Dan
Danvor 14 Stunden

This is so interesting

Profilbild von Itay Abraham Cohen
Itay Abraham Cohenvor 15 Stunden

Ew why did you make him do such an abhorrent act to your machine

Ähnliche Videos

Our first short course with Anthropic! Building Towards Computer Use with Anthropic. This teaches you to build an LLM-based agent that uses a computer interface by generating mouse clicks and keystrokes. Computer Use is an important, emerging capability for LLMs that will let AI agents do many more tasks than were possible before, since it lets them interact with interfaces designed for humans to use, rather than only tools that provide explicit API access. I hope you will enjoy learning about it! This course is taught by Anthropic's Head of Curriculum, Colt_Steele. You'll learn to apply image reasoning and tool use to "use" a computer as follows: a model processes an image of the screen, analyzes it to understand what's going on, and navigates the computer via mouse clicks and keystrokes. This course goes through the key building blocks, and culminates in a demo of an AI assistant that uses a web browser to search for a research paper, downloads the PDF, and finally summarizes the paper for you. In detail, you’ll: - Learn about Anthropic's family of models, when to use which one, and make API requests to Claude - Use multi-modal prompts that combine text and image content blocks, and also work with streaming responses - Improve your prompting by using prompt templates, using XML to structure prompts, and providing examples - Implement prompt caching to reduce cost and latency - Apply tool-use to build a chatbot that can call different tools to respond to queries - See all these building blocks come together in Computer Use demo Please sign up here:

Andrew Ng

170,541 Aufrufe • vor 1 Jahr