Video wird geladen...

Video konnte nicht geladen werden

Zur Startseite

this guy built an app that lets him control multiple claude code instances WITH JUST HIS EYES AND VOICE he looks at the terminal he wants and speaks his command. that's it no keyboard. no mouse. just gaze tracking + voice on a macbook pro absolutely unreal. I guess...

94,583 Aufrufe • vor 7 Monaten •via X (Twitter)

34 Kommentare

Profilbild von Slopware Engineer
Slopware Engineervor 7 Monaten

A lot of people don't know this but you can achieve half of this with just stock macOS using "head pointer" setting that uses the web cam and your head to move the mouse anywhere on the screen. I use it in combination with normal keyboard bindings for micro adjustments and caps lock for mouse click.

Profilbild von Tech With Matteo
Tech With Matteovor 7 Monaten

that's wild, never thought about using eye tracking for this kind of workflow. do you think it actually speeds things up compared to just typing?

Profilbild von northStar0x7
northStar0x7vor 7 Monaten

Huge respect to @therituallab for building eyeTerm and making the built-in Mac camera actually useful for something beyond selfies Accessibility win, productivity cheat code, and honestly a glimpse of how agentic coding will probably feel in 2–3 years for everyone.Question for anyone who's tried similar: does the gaze latency stay low enough during long sessions, or do you still end up making subtle head adjustments?Either way, keyboard is officially on life support.

Profilbild von ashen
ashenvor 7 Monaten

What's this guy's handle and how can I get this app?

Profilbild von Om Patel
Om Patelvor 7 Monaten

@therituallab

Profilbild von robertus
robertusvor 7 Monaten

gaze tracking + voice as a dev interface removes the biggest bottleneck in coding which isn't thinking, it's context switching. the day your editor just knows where you're looking is genuinely closer than people think

Profilbild von Steven Smith
Steven Smithvor 7 Monaten

I speak to my PM agent. She organizes the backlog. My developer agent takes on anything he can. My reviewer agent reviews and merges low risk. Calls my attention to things that need it. Agent monitors system interactions to proactively report problems or suggest enhancements. None of it requires my laptop open.

Profilbild von MVP
MVPvor 7 Monaten

No cto for pippn's friend...will you take up

Profilbild von Craig Doriot
Craig Doriotvor 7 Monaten

This very thing was warned of in a detailed vision about 15 years ago

Profilbild von Object Orienter
Object Orientervor 7 Monaten

Naaah, at least for me, it won't happen like this. The reason why I like typing is that I can organize my ideas mentally without speaking the line of thought straight away, because it's just noise most of the time. Typing gives me to control when I consider it ready.

Profilbild von Rob Builds
Rob Buildsvor 7 Monaten

Run multiple Claude Code instances daily. The bottleneck isn't typing — it's switching context between them. Gaze tracking solves the right problem. This is an accessibility tool that accidentally became a productivity tool.

Profilbild von Gocha
Gochavor 7 Monaten

this is where it gets interesting. the bottleneck was never typing speed. it was context switching between terminals. eyes solve that instantly. you look at what you want and talk to it. that's how humans naturally work. keyboards were the workaround, not the solution

Profilbild von orkward ☄︎
orkward ☄︎vor 7 Monaten

this is another level of madness, wow.

Profilbild von Sharon Daniel ©️🎭
Sharon Daniel ©️🎭vor 7 Monaten

winke wink . its gonna be hard not to wink lol you can't use this in real Real production

Profilbild von Sylvain Dechamps (Sido)🧙‍♂️
Sylvain Dechamps (Sido)🧙‍♂️vor 7 Monaten

Futur Software Engineers 👇

Profilbild von K Fluffy
K Fluffyvor 7 Monaten

Idk if its actually doing proper tracking versus using the placement of his eyes within the grids. I'd like to see it done without face movement.

Profilbild von Priyanka Pudi
Priyanka Pudivor 7 Monaten

Looks like next openclaw VR

Profilbild von Democracy Manifest
Democracy Manifestvor 7 Monaten

prob not that hard to do with something like Tobii Eye Tracker

Profilbild von sir rabbit
sir rabbitvor 7 Monaten

him, next year

Profilbild von Matei Gherceanu
Matei Gherceanuvor 7 Monaten

So what the hell you do with it? Eat, fart, fuck and code or work same time? Why not just replace himself, ohh better go full digital and become a desktop pc. :)) then will be the OP agent usage. No body just a pc

Profilbild von Ros Marino
Ros Marinovor 7 Monaten

I mean… nah.

Profilbild von Codie Mullins | AI + Sports
Codie Mullins | AI + Sportsvor 7 Monaten

I can’t even wink with both eyes. This guy is such a show off.

Profilbild von Shreya Gupta
Shreya Guptavor 7 Monaten

But this seems too slow Would rather use mouse

Profilbild von Atul thakur
Atul thakurvor 7 Monaten

the multi-instance approach is where things get interesting. we run 2-3 agents in parallel at Crove too. one for planning one for execution. but controlling them with eyes is next level

Profilbild von Stay Ready 🎺
Stay Ready 🎺vor 7 Monaten

instead of winking he should just snap his fingers. winking all the time is annoying

Profilbild von Dhru
Dhruvor 7 Monaten

The eyes and voice actually help give more input since the model has context what the person is seeing and gets clear execution intent from the voice, more human input better performance

Profilbild von troneras
tronerasvor 7 Monaten

Very cool! I wish I had enough tasks to need this setup haha

Profilbild von Boz NZ
Boz NZvor 7 Monaten

.. and totally logical with hindsight (or if you read sci-fi)

Profilbild von A M
A Mvor 7 Monaten

Now make it so you can just do a thumbsup to get him to continue 👍

Profilbild von DavidJBerman
DavidJBermanvor 7 Monaten

Claude filed 47 sexual harassment claims against him

Profilbild von Matt
Mattvor 7 Monaten

this is exactly the direction we went with - voice as the primary input for controlling your whole mac. gaze tracking is a cool addition though, we use macos accessibility apis to know which app has focus. the keyboard/mouse era for AI interaction feels so wrong

Profilbild von Voy Zeglin
Voy Zeglinvor 7 Monaten

I can already see sooo many applications!

Profilbild von Andrey
Andreyvor 7 Monaten

using your voice is the future, so ppl need to use @VoiceOSApp

Profilbild von ᑯƌǨ
ᑯƌǨvor 7 Monaten

Have you seen the Claude Code / Openclaw butt plug? dude you can control it...

Ähnliche Videos