Video yükleniyor...

Video Yüklenemedi

Ana Sayfaya Dön

jev has changed computer-use forever. i built a computer use tool with jev that costs basically nothing to use, and has sub-second latency. it can even decide what to type, and doesn't need an LLM. open source. link below. no LLM required.

138,333 görüntüleme • 1 gün önce •via X (Twitter)

34 Yorum

shiv profil fotoğrafı
shiv1 gün önce

repo: also, if you're building computer-use agents that need applications without the overhead of an entire computer, i'd love to talk - @tryisle

Daniel Zambrini profil fotoğrafı
Daniel Zambrini21 saat önce

Wait I thought Jev could not generate text, so how does it type?

Asaf Mazuz profil fotoğrafı
Asaf Mazuz1 gün önce

Nice! Consider adding it to

Asklv profil fotoğrafı
Asklv16 saat önce

Great proof that computer use can be reduced to fast, bounded click/type decisions instead of a generative loop. We used that split for social research: Jev picks typed actions, socai runs them in Chrome, and evidence becomes a cited report:

Phanindra Reddy profil fotoğrafı
Phanindra Reddy1 gün önce

here are some opensource use cases, love if you can submit a pr here as wlel

Ábel Énekes profil fotoğrafı
Ábel Énekes1 gün önce

Congrats man, but at this point every second person who has access to a coding agent did it

Pranav profil fotoğrafı
Pranav1 gün önce

add this on

Taper Solanki profil fotoğrafı
Taper Solanki1 gün önce

The real breakthrough is making computer use an engineered primitive instead of an expensive LLM loop.

Harshit Khemani profil fotoğrafı
Harshit Khemani16 saat önce

wait, wdym "doesn't need an llm"? @grok

Scooby profil fotoğrafı
Scooby17 saat önce

Hey saw your repo, wanted to talk about the pros/cons of using screenshots/labeling ui elements vs using internal accessibility stuff the apps expose. Would love to talk more

Diplocracy profil fotoğrafı
Diplocracy16 saat önce

Could you make it test mobile games/apps somehow? So it tests everything, clicks everywhere, tries to break it and notes all the bugs?

Truegav profil fotoğrafı
Truegav18 saat önce

How good is it at tasks though?

Jeremy Bosma profil fotoğrafı
Jeremy Bosma15 saat önce

The no-LLM part is the unlock

Brian Hadu profil fotoğrafı
Brian Hadu15 saat önce

how does it decide what to type without using an LLM?

The M0d3rn R3tr0 Gam3r profil fotoğrafı
The M0d3rn R3tr0 Gam3r1 gün önce

Im gonna install this to help with youtube and opusclip automation and see if it works

GBE profil fotoğrafı
GBE1 gün önce

wait so this can actually be your personal assistant like actually

Leo profil fotoğrafı
Leo15 saat önce

sub-second: relating to a time interval of less than one second

Harrison profil fotoğrafı
Harrison1 gün önce

sub-second latency on computer use is the part that matters. nobody talks about it but it's why most of these demos feel broken in practice

Chef Decoder profil fotoğrafı
Chef Decoder15 saat önce

nice one 🔥🔥🔥

Vlad Terin profil fotoğrafı
Vlad Terin1 gün önce

Nice! How are you building the choices for what to type? My Codex version supplies the text and lets Jev choose the action—curious about your approach.

ZAY TRADE profil fotoğrafı
ZAY TRADE22 saat önce

Damn JEV is like the upgrade from cydia repos x 10000

Isma profil fotoğrafı
Isma1 gün önce

can't see yet only receives DOM

AI Mastery Guide profil fotoğrafı
AI Mastery Guide23 saat önce

Wait, no LLM at all?

Ravi profil fotoğrafı
Ravi1 gün önce

latency was always the bigger blocker for computer use, more than cost. a screenshot → model → action round trip on every step adds up fast on a 20 step task. drop the model call and most of that goes away. then the hard part is grounding: finding the right element after the UI

Tobi profil fotoğrafı
Tobi1 gün önce

the important distinction is not whether a model is in the loop. it is whether the system can keep the action narrow and check the result before it becomes consequential.the important distinction is not whether a model is in the loop. it is whether the system can keep the action narrow and check the result before it becomes consequential.

Klasta profil fotoğrafı
Klasta22 saat önce

No LLM in the loop. The keys already knew the sentence.

Siddharth Vishwanath profil fotoğrafı
Siddharth Vishwanath1 gün önce

Can it fill out forms for me? Can it send text through whatsapp?

Valentin Rudloff profil fotoğrafı
Valentin Rudloff14 saat önce

The app keeps quitting the app I want to interact with

Jhon Dennis profil fotoğrafı
Jhon Dennis14 saat önce

不靠大模型也能把下一步选出来 这才是真正的 agent 基础设施 延迟和成本一起下来 普通人也能随手接进工作流

Milos Zlatanovic profil fotoğrafı
Milos Zlatanovic18 saat önce

how yall make all dis things

Matteo M. profil fotoğrafı
Matteo M.15 saat önce

Thats cool and all but wouldnt navigating via dom insta flag you as a bot? Especially since it is so incredibly fast

Proud Indian 🇮🇳 (Modi Ka Pariwar) profil fotoğrafı
Proud Indian 🇮🇳 (Modi Ka Pariwar)18 saat önce

Would you have any extra invite?

Dan profil fotoğrafı
Dan14 saat önce

This is so interesting

Itay Abraham Cohen profil fotoğrafı
Itay Abraham Cohen15 saat önce

Ew why did you make him do such an abhorrent act to your machine

Benzer Videolar

Our first short course with Anthropic! Building Towards Computer Use with Anthropic. This teaches you to build an LLM-based agent that uses a computer interface by generating mouse clicks and keystrokes. Computer Use is an important, emerging capability for LLMs that will let AI agents do many more tasks than were possible before, since it lets them interact with interfaces designed for humans to use, rather than only tools that provide explicit API access. I hope you will enjoy learning about it! This course is taught by Anthropic's Head of Curriculum, Colt_Steele. You'll learn to apply image reasoning and tool use to "use" a computer as follows: a model processes an image of the screen, analyzes it to understand what's going on, and navigates the computer via mouse clicks and keystrokes. This course goes through the key building blocks, and culminates in a demo of an AI assistant that uses a web browser to search for a research paper, downloads the PDF, and finally summarizes the paper for you. In detail, you’ll: - Learn about Anthropic's family of models, when to use which one, and make API requests to Claude - Use multi-modal prompts that combine text and image content blocks, and also work with streaming responses - Improve your prompting by using prompt templates, using XML to structure prompts, and providing examples - Implement prompt caching to reduce cost and latency - Apply tool-use to build a chatbot that can call different tools to respond to queries - See all these building blocks come together in Computer Use demo Please sign up here:

Andrew Ng

170,541 görüntüleme • 1 yıl önce