Загрузка видео...

Не удалось загрузить видео

На главную

this guy built an app that lets him control multiple claude code instances WITH JUST HIS EYES AND VOICE he looks at the terminal he wants and speaks his command. that's it no keyboard. no mouse. just gaze tracking + voice on a macbook pro absolutely unreal. I guess...

94,583 просмотров • 7 месяцев назад •via X (Twitter)

Комментарии: 34

Фото профиля Slopware Engineer
Slopware Engineer7 месяцев назад

A lot of people don't know this but you can achieve half of this with just stock macOS using "head pointer" setting that uses the web cam and your head to move the mouse anywhere on the screen. I use it in combination with normal keyboard bindings for micro adjustments and caps lock for mouse click.

Фото профиля Tech With Matteo
Tech With Matteo7 месяцев назад

that's wild, never thought about using eye tracking for this kind of workflow. do you think it actually speeds things up compared to just typing?

Фото профиля northStar0x7
northStar0x77 месяцев назад

Huge respect to @therituallab for building eyeTerm and making the built-in Mac camera actually useful for something beyond selfies Accessibility win, productivity cheat code, and honestly a glimpse of how agentic coding will probably feel in 2–3 years for everyone.Question for anyone who's tried similar: does the gaze latency stay low enough during long sessions, or do you still end up making subtle head adjustments?Either way, keyboard is officially on life support.

Фото профиля ashen
ashen7 месяцев назад

What's this guy's handle and how can I get this app?

Фото профиля Om Patel
Om Patel7 месяцев назад

@therituallab

Фото профиля robertus
robertus7 месяцев назад

gaze tracking + voice as a dev interface removes the biggest bottleneck in coding which isn't thinking, it's context switching. the day your editor just knows where you're looking is genuinely closer than people think

Фото профиля Steven Smith
Steven Smith7 месяцев назад

I speak to my PM agent. She organizes the backlog. My developer agent takes on anything he can. My reviewer agent reviews and merges low risk. Calls my attention to things that need it. Agent monitors system interactions to proactively report problems or suggest enhancements. None of it requires my laptop open.

Фото профиля MVP
MVP7 месяцев назад

No cto for pippn's friend...will you take up

Фото профиля Craig Doriot
Craig Doriot7 месяцев назад

This very thing was warned of in a detailed vision about 15 years ago

Фото профиля Object Orienter
Object Orienter7 месяцев назад

Naaah, at least for me, it won't happen like this. The reason why I like typing is that I can organize my ideas mentally without speaking the line of thought straight away, because it's just noise most of the time. Typing gives me to control when I consider it ready.

Фото профиля Rob Builds
Rob Builds7 месяцев назад

Run multiple Claude Code instances daily. The bottleneck isn't typing — it's switching context between them. Gaze tracking solves the right problem. This is an accessibility tool that accidentally became a productivity tool.

Фото профиля Gocha
Gocha7 месяцев назад

this is where it gets interesting. the bottleneck was never typing speed. it was context switching between terminals. eyes solve that instantly. you look at what you want and talk to it. that's how humans naturally work. keyboards were the workaround, not the solution

Фото профиля orkward ☄︎
orkward ☄︎7 месяцев назад

this is another level of madness, wow.

Фото профиля Sharon Daniel ©️🎭
Sharon Daniel ©️🎭7 месяцев назад

winke wink . its gonna be hard not to wink lol you can't use this in real Real production

Фото профиля Sylvain Dechamps (Sido)🧙‍♂️
Sylvain Dechamps (Sido)🧙‍♂️7 месяцев назад

Futur Software Engineers 👇

Фото профиля K Fluffy
K Fluffy7 месяцев назад

Idk if its actually doing proper tracking versus using the placement of his eyes within the grids. I'd like to see it done without face movement.

Фото профиля Priyanka Pudi
Priyanka Pudi7 месяцев назад

Looks like next openclaw VR

Фото профиля Democracy Manifest
Democracy Manifest7 месяцев назад

prob not that hard to do with something like Tobii Eye Tracker

Фото профиля sir rabbit
sir rabbit7 месяцев назад

him, next year

Фото профиля Matei Gherceanu
Matei Gherceanu7 месяцев назад

So what the hell you do with it? Eat, fart, fuck and code or work same time? Why not just replace himself, ohh better go full digital and become a desktop pc. :)) then will be the OP agent usage. No body just a pc

Фото профиля Ros Marino
Ros Marino7 месяцев назад

I mean… nah.

Фото профиля Codie Mullins | AI + Sports
Codie Mullins | AI + Sports7 месяцев назад

I can’t even wink with both eyes. This guy is such a show off.

Фото профиля Shreya Gupta
Shreya Gupta7 месяцев назад

But this seems too slow Would rather use mouse

Фото профиля Atul thakur
Atul thakur7 месяцев назад

the multi-instance approach is where things get interesting. we run 2-3 agents in parallel at Crove too. one for planning one for execution. but controlling them with eyes is next level

Фото профиля Stay Ready 🎺
Stay Ready 🎺7 месяцев назад

instead of winking he should just snap his fingers. winking all the time is annoying

Фото профиля Dhru
Dhru7 месяцев назад

The eyes and voice actually help give more input since the model has context what the person is seeing and gets clear execution intent from the voice, more human input better performance

Фото профиля troneras
troneras7 месяцев назад

Very cool! I wish I had enough tasks to need this setup haha

Фото профиля Boz NZ
Boz NZ7 месяцев назад

.. and totally logical with hindsight (or if you read sci-fi)

Фото профиля A M
A M7 месяцев назад

Now make it so you can just do a thumbsup to get him to continue 👍

Фото профиля DavidJBerman
DavidJBerman7 месяцев назад

Claude filed 47 sexual harassment claims against him

Фото профиля Matt
Matt7 месяцев назад

this is exactly the direction we went with - voice as the primary input for controlling your whole mac. gaze tracking is a cool addition though, we use macos accessibility apis to know which app has focus. the keyboard/mouse era for AI interaction feels so wrong

Фото профиля Voy Zeglin
Voy Zeglin7 месяцев назад

I can already see sooo many applications!

Фото профиля Andrey
Andrey7 месяцев назад

using your voice is the future, so ppl need to use @VoiceOSApp

Фото профиля ᑯƌǨ
ᑯƌǨ7 месяцев назад

Have you seen the Claude Code / Openclaw butt plug? dude you can control it...

Похожие видео