Загрузка видео...

Не удалось загрузить видео

На главную

jev has changed computer-use forever. i built a computer use tool with jev that costs basically nothing to use, and has sub-second latency. it can even decide what to type, and doesn't need an LLM. open source. link below. no LLM required.

138,333 просмотров • 1 день назад •via X (Twitter)

Комментарии: 34

Фото профиля shiv
shiv1 день назад

repo: also, if you're building computer-use agents that need applications without the overhead of an entire computer, i'd love to talk - @tryisle

Фото профиля Daniel Zambrini
Daniel Zambrini21 часов назад

Wait I thought Jev could not generate text, so how does it type?

Фото профиля Asaf Mazuz
Asaf Mazuz1 день назад

Nice! Consider adding it to

Фото профиля Asklv
Asklv16 часов назад

Great proof that computer use can be reduced to fast, bounded click/type decisions instead of a generative loop. We used that split for social research: Jev picks typed actions, socai runs them in Chrome, and evidence becomes a cited report:

Фото профиля Phanindra Reddy
Phanindra Reddy1 день назад

here are some opensource use cases, love if you can submit a pr here as wlel

Фото профиля Ábel Énekes
Ábel Énekes1 день назад

Congrats man, but at this point every second person who has access to a coding agent did it

Фото профиля Pranav
Pranav1 день назад

add this on

Фото профиля Taper Solanki
Taper Solanki1 день назад

The real breakthrough is making computer use an engineered primitive instead of an expensive LLM loop.

Фото профиля Harshit Khemani
Harshit Khemani16 часов назад

wait, wdym "doesn't need an llm"? @grok

Фото профиля Scooby
Scooby17 часов назад

Hey saw your repo, wanted to talk about the pros/cons of using screenshots/labeling ui elements vs using internal accessibility stuff the apps expose. Would love to talk more

Фото профиля Diplocracy
Diplocracy16 часов назад

Could you make it test mobile games/apps somehow? So it tests everything, clicks everywhere, tries to break it and notes all the bugs?

Фото профиля Truegav
Truegav18 часов назад

How good is it at tasks though?

Фото профиля Jeremy Bosma
Jeremy Bosma15 часов назад

The no-LLM part is the unlock

Фото профиля Brian Hadu
Brian Hadu15 часов назад

how does it decide what to type without using an LLM?

Фото профиля The M0d3rn R3tr0 Gam3r
The M0d3rn R3tr0 Gam3r1 день назад

Im gonna install this to help with youtube and opusclip automation and see if it works

Фото профиля GBE
GBE1 день назад

wait so this can actually be your personal assistant like actually

Фото профиля Leo
Leo15 часов назад

sub-second: relating to a time interval of less than one second

Фото профиля Harrison
Harrison1 день назад

sub-second latency on computer use is the part that matters. nobody talks about it but it's why most of these demos feel broken in practice

Фото профиля Chef Decoder
Chef Decoder15 часов назад

nice one 🔥🔥🔥

Фото профиля Vlad Terin
Vlad Terin1 день назад

Nice! How are you building the choices for what to type? My Codex version supplies the text and lets Jev choose the action—curious about your approach.

Фото профиля ZAY TRADE
ZAY TRADE22 часов назад

Damn JEV is like the upgrade from cydia repos x 10000

Фото профиля Isma
Isma1 день назад

can't see yet only receives DOM

Фото профиля AI Mastery Guide
AI Mastery Guide23 часов назад

Wait, no LLM at all?

Фото профиля Ravi
Ravi1 день назад

latency was always the bigger blocker for computer use, more than cost. a screenshot → model → action round trip on every step adds up fast on a 20 step task. drop the model call and most of that goes away. then the hard part is grounding: finding the right element after the UI

Фото профиля Tobi
Tobi1 день назад

the important distinction is not whether a model is in the loop. it is whether the system can keep the action narrow and check the result before it becomes consequential.the important distinction is not whether a model is in the loop. it is whether the system can keep the action narrow and check the result before it becomes consequential.

Фото профиля Klasta
Klasta22 часов назад

No LLM in the loop. The keys already knew the sentence.

Фото профиля Siddharth Vishwanath
Siddharth Vishwanath1 день назад

Can it fill out forms for me? Can it send text through whatsapp?

Фото профиля Valentin Rudloff
Valentin Rudloff14 часов назад

The app keeps quitting the app I want to interact with

Фото профиля Jhon Dennis
Jhon Dennis14 часов назад

不靠大模型也能把下一步选出来 这才是真正的 agent 基础设施 延迟和成本一起下来 普通人也能随手接进工作流

Фото профиля Milos Zlatanovic
Milos Zlatanovic18 часов назад

how yall make all dis things

Фото профиля Matteo M.
Matteo M.15 часов назад

Thats cool and all but wouldnt navigating via dom insta flag you as a bot? Especially since it is so incredibly fast

Фото профиля Proud Indian 🇮🇳 (Modi Ka Pariwar)
Proud Indian 🇮🇳 (Modi Ka Pariwar)18 часов назад

Would you have any extra invite?

Фото профиля Dan
Dan14 часов назад

This is so interesting

Фото профиля Itay Abraham Cohen
Itay Abraham Cohen15 часов назад

Ew why did you make him do such an abhorrent act to your machine

Похожие видео

Our first short course with Anthropic! Building Towards Computer Use with Anthropic. This teaches you to build an LLM-based agent that uses a computer interface by generating mouse clicks and keystrokes. Computer Use is an important, emerging capability for LLMs that will let AI agents do many more tasks than were possible before, since it lets them interact with interfaces designed for humans to use, rather than only tools that provide explicit API access. I hope you will enjoy learning about it! This course is taught by Anthropic's Head of Curriculum, Colt_Steele. You'll learn to apply image reasoning and tool use to "use" a computer as follows: a model processes an image of the screen, analyzes it to understand what's going on, and navigates the computer via mouse clicks and keystrokes. This course goes through the key building blocks, and culminates in a demo of an AI assistant that uses a web browser to search for a research paper, downloads the PDF, and finally summarizes the paper for you. In detail, you’ll: - Learn about Anthropic's family of models, when to use which one, and make API requests to Claude - Use multi-modal prompts that combine text and image content blocks, and also work with streaming responses - Improve your prompting by using prompt templates, using XML to structure prompts, and providing examples - Implement prompt caching to reduce cost and latency - Apply tool-use to build a chatbot that can call different tools to respond to queries - See all these building blocks come together in Computer Use demo Please sign up here:

Andrew Ng

170,541 просмотров • 1 год назад