Video yükleniyor...

Video Yüklenemedi

Ana Sayfaya Dön

this guy built an app that lets him control multiple claude code instances WITH JUST HIS EYES AND VOICE he looks at the terminal he wants and speaks his command. that's it no keyboard. no mouse. just gaze tracking + voice on a macbook pro absolutely unreal. I guess...

94,583 görüntüleme • 7 ay önce •via X (Twitter)

34 Yorum

Slopware Engineer profil fotoğrafı
Slopware Engineer7 ay önce

A lot of people don't know this but you can achieve half of this with just stock macOS using "head pointer" setting that uses the web cam and your head to move the mouse anywhere on the screen. I use it in combination with normal keyboard bindings for micro adjustments and caps lock for mouse click.

Tech With Matteo profil fotoğrafı
Tech With Matteo7 ay önce

that's wild, never thought about using eye tracking for this kind of workflow. do you think it actually speeds things up compared to just typing?

northStar0x7 profil fotoğrafı
northStar0x77 ay önce

Huge respect to @therituallab for building eyeTerm and making the built-in Mac camera actually useful for something beyond selfies Accessibility win, productivity cheat code, and honestly a glimpse of how agentic coding will probably feel in 2–3 years for everyone.Question for anyone who's tried similar: does the gaze latency stay low enough during long sessions, or do you still end up making subtle head adjustments?Either way, keyboard is officially on life support.

ashen profil fotoğrafı
ashen7 ay önce

What's this guy's handle and how can I get this app?

Om Patel profil fotoğrafı
Om Patel7 ay önce

@therituallab

robertus profil fotoğrafı
robertus7 ay önce

gaze tracking + voice as a dev interface removes the biggest bottleneck in coding which isn't thinking, it's context switching. the day your editor just knows where you're looking is genuinely closer than people think

Steven Smith profil fotoğrafı
Steven Smith7 ay önce

I speak to my PM agent. She organizes the backlog. My developer agent takes on anything he can. My reviewer agent reviews and merges low risk. Calls my attention to things that need it. Agent monitors system interactions to proactively report problems or suggest enhancements. None of it requires my laptop open.

MVP profil fotoğrafı
MVP7 ay önce

No cto for pippn's friend...will you take up

Craig Doriot profil fotoğrafı
Craig Doriot7 ay önce

This very thing was warned of in a detailed vision about 15 years ago

Object Orienter profil fotoğrafı
Object Orienter7 ay önce

Naaah, at least for me, it won't happen like this. The reason why I like typing is that I can organize my ideas mentally without speaking the line of thought straight away, because it's just noise most of the time. Typing gives me to control when I consider it ready.

Rob Builds profil fotoğrafı
Rob Builds7 ay önce

Run multiple Claude Code instances daily. The bottleneck isn't typing — it's switching context between them. Gaze tracking solves the right problem. This is an accessibility tool that accidentally became a productivity tool.

Gocha profil fotoğrafı
Gocha7 ay önce

this is where it gets interesting. the bottleneck was never typing speed. it was context switching between terminals. eyes solve that instantly. you look at what you want and talk to it. that's how humans naturally work. keyboards were the workaround, not the solution

orkward ☄︎ profil fotoğrafı
orkward ☄︎7 ay önce

this is another level of madness, wow.

Sharon Daniel ©️🎭 profil fotoğrafı
Sharon Daniel ©️🎭7 ay önce

winke wink . its gonna be hard not to wink lol you can't use this in real Real production

Sylvain Dechamps (Sido)🧙‍♂️ profil fotoğrafı
Sylvain Dechamps (Sido)🧙‍♂️7 ay önce

Futur Software Engineers 👇

K Fluffy profil fotoğrafı
K Fluffy7 ay önce

Idk if its actually doing proper tracking versus using the placement of his eyes within the grids. I'd like to see it done without face movement.

Priyanka Pudi profil fotoğrafı
Priyanka Pudi7 ay önce

Looks like next openclaw VR

Democracy Manifest profil fotoğrafı
Democracy Manifest7 ay önce

prob not that hard to do with something like Tobii Eye Tracker

sir rabbit profil fotoğrafı
sir rabbit7 ay önce

him, next year

Matei Gherceanu profil fotoğrafı
Matei Gherceanu7 ay önce

So what the hell you do with it? Eat, fart, fuck and code or work same time? Why not just replace himself, ohh better go full digital and become a desktop pc. :)) then will be the OP agent usage. No body just a pc

Ros Marino profil fotoğrafı
Ros Marino7 ay önce

I mean… nah.

Codie Mullins | AI + Sports profil fotoğrafı
Codie Mullins | AI + Sports7 ay önce

I can’t even wink with both eyes. This guy is such a show off.

Shreya Gupta profil fotoğrafı
Shreya Gupta7 ay önce

But this seems too slow Would rather use mouse

Atul thakur profil fotoğrafı
Atul thakur7 ay önce

the multi-instance approach is where things get interesting. we run 2-3 agents in parallel at Crove too. one for planning one for execution. but controlling them with eyes is next level

Stay Ready 🎺 profil fotoğrafı
Stay Ready 🎺7 ay önce

instead of winking he should just snap his fingers. winking all the time is annoying

Dhru profil fotoğrafı
Dhru7 ay önce

The eyes and voice actually help give more input since the model has context what the person is seeing and gets clear execution intent from the voice, more human input better performance

troneras profil fotoğrafı
troneras7 ay önce

Very cool! I wish I had enough tasks to need this setup haha

Boz NZ profil fotoğrafı
Boz NZ7 ay önce

.. and totally logical with hindsight (or if you read sci-fi)

A M profil fotoğrafı
A M7 ay önce

Now make it so you can just do a thumbsup to get him to continue 👍

DavidJBerman profil fotoğrafı
DavidJBerman7 ay önce

Claude filed 47 sexual harassment claims against him

Matt profil fotoğrafı
Matt7 ay önce

this is exactly the direction we went with - voice as the primary input for controlling your whole mac. gaze tracking is a cool addition though, we use macos accessibility apis to know which app has focus. the keyboard/mouse era for AI interaction feels so wrong

Voy Zeglin profil fotoğrafı
Voy Zeglin7 ay önce

I can already see sooo many applications!

Andrey profil fotoğrafı
Andrey7 ay önce

using your voice is the future, so ppl need to use @VoiceOSApp

ᑯƌǨ profil fotoğrafı
ᑯƌǨ7 ay önce

Have you seen the Claude Code / Openclaw butt plug? dude you can control it...

Benzer Videolar