Loading video...

Video Failed to Load

Go Home

this guy built an app that lets him control multiple claude code instances WITH JUST HIS EYES AND VOICE he looks at the terminal he wants and speaks his command. that's it no keyboard. no mouse. just gaze tracking + voice on a macbook pro absolutely unreal. I guess...

94,583 views • 7 months ago •via X (Twitter)

34 Comments

Slopware Engineer's profile picture
Slopware Engineer7 months ago

A lot of people don't know this but you can achieve half of this with just stock macOS using "head pointer" setting that uses the web cam and your head to move the mouse anywhere on the screen. I use it in combination with normal keyboard bindings for micro adjustments and caps lock for mouse click.

Tech With Matteo's profile picture
Tech With Matteo7 months ago

that's wild, never thought about using eye tracking for this kind of workflow. do you think it actually speeds things up compared to just typing?

northStar0x7's profile picture
northStar0x77 months ago

Huge respect to @therituallab for building eyeTerm and making the built-in Mac camera actually useful for something beyond selfies Accessibility win, productivity cheat code, and honestly a glimpse of how agentic coding will probably feel in 2–3 years for everyone.Question for anyone who's tried similar: does the gaze latency stay low enough during long sessions, or do you still end up making subtle head adjustments?Either way, keyboard is officially on life support.

ashen's profile picture
ashen7 months ago

What's this guy's handle and how can I get this app?

Om Patel's profile picture
Om Patel7 months ago

@therituallab

robertus's profile picture
robertus7 months ago

gaze tracking + voice as a dev interface removes the biggest bottleneck in coding which isn't thinking, it's context switching. the day your editor just knows where you're looking is genuinely closer than people think

Steven Smith's profile picture
Steven Smith7 months ago

I speak to my PM agent. She organizes the backlog. My developer agent takes on anything he can. My reviewer agent reviews and merges low risk. Calls my attention to things that need it. Agent monitors system interactions to proactively report problems or suggest enhancements. None of it requires my laptop open.

MVP's profile picture
MVP7 months ago

No cto for pippn's friend...will you take up

Craig Doriot's profile picture
Craig Doriot7 months ago

This very thing was warned of in a detailed vision about 15 years ago

Object Orienter's profile picture
Object Orienter7 months ago

Naaah, at least for me, it won't happen like this. The reason why I like typing is that I can organize my ideas mentally without speaking the line of thought straight away, because it's just noise most of the time. Typing gives me to control when I consider it ready.

Rob Builds's profile picture
Rob Builds7 months ago

Run multiple Claude Code instances daily. The bottleneck isn't typing — it's switching context between them. Gaze tracking solves the right problem. This is an accessibility tool that accidentally became a productivity tool.

Gocha's profile picture
Gocha7 months ago

this is where it gets interesting. the bottleneck was never typing speed. it was context switching between terminals. eyes solve that instantly. you look at what you want and talk to it. that's how humans naturally work. keyboards were the workaround, not the solution

orkward ☄︎'s profile picture
orkward ☄︎7 months ago

this is another level of madness, wow.

Sharon Daniel ©️🎭's profile picture
Sharon Daniel ©️🎭7 months ago

winke wink . its gonna be hard not to wink lol you can't use this in real Real production

Sylvain Dechamps (Sido)🧙‍♂️'s profile picture
Sylvain Dechamps (Sido)🧙‍♂️7 months ago

Futur Software Engineers 👇

K Fluffy's profile picture
K Fluffy7 months ago

Idk if its actually doing proper tracking versus using the placement of his eyes within the grids. I'd like to see it done without face movement.

Priyanka Pudi's profile picture
Priyanka Pudi7 months ago

Looks like next openclaw VR

Democracy Manifest's profile picture
Democracy Manifest7 months ago

prob not that hard to do with something like Tobii Eye Tracker

sir rabbit's profile picture
sir rabbit7 months ago

him, next year

Matei Gherceanu's profile picture
Matei Gherceanu7 months ago

So what the hell you do with it? Eat, fart, fuck and code or work same time? Why not just replace himself, ohh better go full digital and become a desktop pc. :)) then will be the OP agent usage. No body just a pc

Ros Marino's profile picture
Ros Marino7 months ago

I mean… nah.

Codie Mullins | AI + Sports's profile picture
Codie Mullins | AI + Sports7 months ago

I can’t even wink with both eyes. This guy is such a show off.

Shreya Gupta's profile picture
Shreya Gupta7 months ago

But this seems too slow Would rather use mouse

Atul thakur's profile picture
Atul thakur7 months ago

the multi-instance approach is where things get interesting. we run 2-3 agents in parallel at Crove too. one for planning one for execution. but controlling them with eyes is next level

Stay Ready 🎺's profile picture
Stay Ready 🎺7 months ago

instead of winking he should just snap his fingers. winking all the time is annoying

Dhru's profile picture
Dhru7 months ago

The eyes and voice actually help give more input since the model has context what the person is seeing and gets clear execution intent from the voice, more human input better performance

troneras's profile picture
troneras7 months ago

Very cool! I wish I had enough tasks to need this setup haha

Boz NZ's profile picture
Boz NZ7 months ago

.. and totally logical with hindsight (or if you read sci-fi)

A M's profile picture
A M7 months ago

Now make it so you can just do a thumbsup to get him to continue 👍

DavidJBerman's profile picture
DavidJBerman7 months ago

Claude filed 47 sexual harassment claims against him

Matt's profile picture
Matt7 months ago

this is exactly the direction we went with - voice as the primary input for controlling your whole mac. gaze tracking is a cool addition though, we use macos accessibility apis to know which app has focus. the keyboard/mouse era for AI interaction feels so wrong

Voy Zeglin's profile picture
Voy Zeglin7 months ago

I can already see sooo many applications!

Andrey's profile picture
Andrey7 months ago

using your voice is the future, so ppl need to use @VoiceOSApp

ᑯƌǨ's profile picture
ᑯƌǨ7 months ago

Have you seen the Claude Code / Openclaw butt plug? dude you can control it...

Related Videos