Loading video...
Video Failed to Load
imagining a few small gestures to edit/write with ai: word: spin synonyms sentence: shift the tone (cold <-> warm) paragraph: shorten/expand
1,039,673 views • 2 months ago •via X (Twitter)
33 Comments

Inspiration?

It starts out as a few small gestures in POC, but then you scale....😂

Looks cool, but my arm is already tired watching this. mouse + keyboard still more practical.

vim bindings are still faster

Great demo. I wish my text editing experience were this fast. What is the speedup on the video vs. RL?

Contrived. This is a interesting interface from a tech perspective, but fails miserably in it's actual intended use case.

i feel like its more efficient to use keyboard and mouse. putting my hand up and doing all those gesture is alot more physical work. Looks cool and futuristic though.

What is this field of tech called?

love the concept, especially going after text editing specifically. my main worry is arm fatigue without a surface to rest against, gestures get less precise the longer you hold them up.

Gestural editing is such a fresh idea

I'm of the opinion that we don't eant hand gestures for anything because we are lazy. I mean I don't even point the remote at the tv if it's not absolutely necessary

@RayFernando1337 so dang cool

We've come a long way from the early days of being impressed with a sound synthesiser attached to a ZX Spectrum. (Yes, I'm that old). This is awesome Kat. GG! Kudos!

another great concept!

Can I play NBA 2k with this?

That is first step to Stark’s Jarvis

word/sentence/paragraph as three separate edit granularities is the right mental model. Most AI writing tools still treat rewrite as one blunt button instead of giving you a dial per unit of text.

This feels like the right direction for AI interfaces. The best AI tools may not be about giving better prompts, but making the act of editing itself expressive enough that you can manipulate ideas the way you manipulate objects.

funny, been also playing around with the cam, I think there is a whole new word of UIs waiting

Spinonyms

The gesture works as an interface, but the real leap isn’t spinning synonyms, it’s the model already coming out in your style, or the company’s, so you barely have to touch anything.

Very Bill Buxton like…I love it!!

I’d get arm ache Why don’t you just do trackpad gestures

It's no fun without augment or virtual holographic interfaces. It's like cheap knock off. Weird how no one commercialised this. This yo next MAC

That’s so cool!! How you did it?

This feels much better than “rewrite this.” Keep the human in control of the size of the change, and let AI handle the mechanics.

Your hands should never have to reach above your nipple line to use a computer.

great visually, horrendous practically

Maybe not so practical for text editing in terms of active movement required, but sure looks awesome

looks cool but also like a carpal tunnel speed run.

the tone slider is the one i want most. typing 'make this warmer' into a chat box every time breaks my flow completely

So cool. Any idea on what type of product this type of interface can unlock ? Maybe a video game?

这交互有点帅


