Loading video...
Video Failed to Load
I built a voice controlled computer-use for my mac using TypeSafe AI's Jev and it's INSANE how fast it is! I can dictate "open the notes app and create..." and the app opens before I even finish my sentence.
506,757 views • 1 day ago •via X (Twitter)
35 Comments

@typesafeai Repo or it didn’t happen

@typesafeai My Jev app just classified this post as complete bullshit.

@typesafeai are you just feeding it a giant list of input choices…?

explain everything that’s happening in this video and put it in the form of a prompt that I can give my Claude to see if you can incorporate Jeff into my workflow to make my workflow faster, but I don’t want to destroy the deep thinking LLMs for tasks and pieces of tasks that require it. But for the things where it doesn’t matter and speed is King that’s when I want to try to incorporate Jeff if possible.

@typesafeai Why is everyone doing things you could have done two weeks ago and having their brains explode?

@DiamondEyesFox @typesafeai 🔥🔥🔥

@typesafeai Open Source? 👀🙏

@typesafeai Cool stuff, did similar on mobile

Hey Andy just wondering if you could send over the jev voice feature you made to control the computer. My dad has recently been diagnosed with carpal tunnel which makes it very hard for him to use his computer, so I was wondering if you could tell me the way it works and what is used or send it over I would pay for it. I’m asking because I’m trying to find the cheapest alternative to the expensive ones we can’t afford, let me know if this is a possibility. Thanks so much for your time.

@typesafeai share it :)

@typesafeai Gotta open source it

@typesafeai This is insane 🤯 Is Jev that good at computer use tho?

@typesafeai are you open sourcing it? will be featuring your post in ;)

@typesafeai What harness are u using for the computer use ? Are you using astra ? Like how was it able to type inside the notes app? I don’t think it can do that from the CLI can it ?

cool demo. what exactly is Jev's role here? must be small (critical nevertheless). my guess is there's a lot of plumbing for stuff like writing Jev's criteria dynamically with a list of apps, then what actions can be performed on those apps, or in general. are you using a vision model to spell that out? i suppose one could get a list of all running processes too..

@typesafeai this is insanely fast

@typesafeai shouldve asked it to stop recording too

@typesafeai a m a z i n g!!!

@typesafeai i need this can you open source it??

@typesafeai No code = FAKE MODE

@typesafeai wait how did you get jev output actual input for tool call?

@typesafeai is this on github? so cool

@typesafeai No repo - no trust

@typesafeai Hey Andy — this voice-controlled Mac demo is exactly the kind of Jev experiment we’d love to feature at Jev Demo Day. Would you be up for presenting it online Sunday, September 27 at 3 PM EDT?

@typesafeai Jarvis has been officially created

@typesafeai yeah this is insane

@typesafeai can somebody create an open source version of this?

@typesafeai So amazing

@typesafeai Is that all Jev or a LLM working beside?

@typesafeai Jarvis is officially here

@typesafeai that fast? yeah that would feel pretty crazy the first time

@typesafeai share it on r/typesafe_ai

@typesafeai that means that everyhing om your screen gows to typesafe servers correct ?

@typesafeai you can't drop this and not tell how you did it

@typesafeai Hey, Does it uses image understanding? cuz if not then we can even use newly released cactus-needle-3 model right? which is just of 243mb something.
