正在加载视频...

视频加载失败

jev has changed computer-use forever. i built a computer use tool with jev that costs basically nothing to use, and has sub-second latency. it can even decide what to type, and doesn't need an LLM. open source. link below. no LLM required.

138,333 次观看 • 1 天前 •via X (Twitter)

34 条评论

shiv 的头像
shiv1 天前

repo: also, if you're building computer-use agents that need applications without the overhead of an entire computer, i'd love to talk - @tryisle

Daniel Zambrini 的头像
Daniel Zambrini21 小时前

Wait I thought Jev could not generate text, so how does it type?

Asaf Mazuz 的头像
Asaf Mazuz1 天前

Nice! Consider adding it to

Asklv 的头像
Asklv16 小时前

Great proof that computer use can be reduced to fast, bounded click/type decisions instead of a generative loop. We used that split for social research: Jev picks typed actions, socai runs them in Chrome, and evidence becomes a cited report:

Phanindra Reddy 的头像
Phanindra Reddy1 天前

here are some opensource use cases, love if you can submit a pr here as wlel

Ábel Énekes 的头像
Ábel Énekes1 天前

Congrats man, but at this point every second person who has access to a coding agent did it

Pranav 的头像
Pranav1 天前

add this on

Taper Solanki 的头像
Taper Solanki1 天前

The real breakthrough is making computer use an engineered primitive instead of an expensive LLM loop.

Harshit Khemani 的头像
Harshit Khemani16 小时前

wait, wdym "doesn't need an llm"? @grok

Scooby 的头像
Scooby17 小时前

Hey saw your repo, wanted to talk about the pros/cons of using screenshots/labeling ui elements vs using internal accessibility stuff the apps expose. Would love to talk more

Diplocracy 的头像
Diplocracy16 小时前

Could you make it test mobile games/apps somehow? So it tests everything, clicks everywhere, tries to break it and notes all the bugs?

Truegav 的头像
Truegav18 小时前

How good is it at tasks though?

Jeremy Bosma 的头像
Jeremy Bosma15 小时前

The no-LLM part is the unlock

Brian Hadu 的头像
Brian Hadu15 小时前

how does it decide what to type without using an LLM?

The M0d3rn R3tr0 Gam3r 的头像
The M0d3rn R3tr0 Gam3r1 天前

Im gonna install this to help with youtube and opusclip automation and see if it works

GBE 的头像
GBE1 天前

wait so this can actually be your personal assistant like actually

Leo 的头像
Leo15 小时前

sub-second: relating to a time interval of less than one second

Harrison 的头像
Harrison1 天前

sub-second latency on computer use is the part that matters. nobody talks about it but it's why most of these demos feel broken in practice

Chef Decoder 的头像
Chef Decoder15 小时前

nice one 🔥🔥🔥

Vlad Terin 的头像
Vlad Terin1 天前

Nice! How are you building the choices for what to type? My Codex version supplies the text and lets Jev choose the action—curious about your approach.

ZAY TRADE 的头像
ZAY TRADE22 小时前

Damn JEV is like the upgrade from cydia repos x 10000

Isma 的头像
Isma1 天前

can't see yet only receives DOM

AI Mastery Guide 的头像
AI Mastery Guide23 小时前

Wait, no LLM at all?

Ravi 的头像
Ravi1 天前

latency was always the bigger blocker for computer use, more than cost. a screenshot → model → action round trip on every step adds up fast on a 20 step task. drop the model call and most of that goes away. then the hard part is grounding: finding the right element after the UI

Tobi 的头像
Tobi1 天前

the important distinction is not whether a model is in the loop. it is whether the system can keep the action narrow and check the result before it becomes consequential.the important distinction is not whether a model is in the loop. it is whether the system can keep the action narrow and check the result before it becomes consequential.

Klasta 的头像
Klasta22 小时前

No LLM in the loop. The keys already knew the sentence.

Siddharth Vishwanath 的头像
Siddharth Vishwanath1 天前

Can it fill out forms for me? Can it send text through whatsapp?

Valentin Rudloff 的头像
Valentin Rudloff14 小时前

The app keeps quitting the app I want to interact with

Jhon Dennis 的头像
Jhon Dennis14 小时前

不靠大模型也能把下一步选出来 这才是真正的 agent 基础设施 延迟和成本一起下来 普通人也能随手接进工作流

Milos Zlatanovic 的头像
Milos Zlatanovic18 小时前

how yall make all dis things

Matteo M. 的头像
Matteo M.15 小时前

Thats cool and all but wouldnt navigating via dom insta flag you as a bot? Especially since it is so incredibly fast

Proud Indian 🇮🇳 (Modi Ka Pariwar) 的头像
Proud Indian 🇮🇳 (Modi Ka Pariwar)18 小时前

Would you have any extra invite?

Dan 的头像
Dan14 小时前

This is so interesting

Itay Abraham Cohen 的头像
Itay Abraham Cohen15 小时前

Ew why did you make him do such an abhorrent act to your machine

相关视频

Our first short course with Anthropic! Building Towards Computer Use with Anthropic. This teaches you to build an LLM-based agent that uses a computer interface by generating mouse clicks and keystrokes. Computer Use is an important, emerging capability for LLMs that will let AI agents do many more tasks than were possible before, since it lets them interact with interfaces designed for humans to use, rather than only tools that provide explicit API access. I hope you will enjoy learning about it! This course is taught by Anthropic's Head of Curriculum, Colt_Steele. You'll learn to apply image reasoning and tool use to "use" a computer as follows: a model processes an image of the screen, analyzes it to understand what's going on, and navigates the computer via mouse clicks and keystrokes. This course goes through the key building blocks, and culminates in a demo of an AI assistant that uses a web browser to search for a research paper, downloads the PDF, and finally summarizes the paper for you. In detail, you’ll: - Learn about Anthropic's family of models, when to use which one, and make API requests to Claude - Use multi-modal prompts that combine text and image content blocks, and also work with streaming responses - Improve your prompting by using prompt templates, using XML to structure prompts, and providing examples - Implement prompt caching to reduce cost and latency - Apply tool-use to build a chatbot that can call different tools to respond to queries - See all these building blocks come together in Computer Use demo Please sign up here:

Andrew Ng

170,541 次观看 • 1 年前