got bored and reverse engineered the HID APIs for Apple's unreleased touchscreen MacBooks made an iPhone duo remote client so I can mess with native touch support on macOS lol

this is fun

code:

duo as a touchscreen mac remote is peak hack

I'm planning to make a full client so I can control my mac mini from duo when I need a screen (usually codex just does his thing there)

@ClaudioSonnet I made this 😆

@ClaudioSonnet oh I like this, like half of it it handled by screen sharing service?

"Got bored and reverse engineered unreleased hardware APIs" is the most dev sentence ever. Curious how macOS treats hover vs touch once it's native. Does a tap just become a click, or something new?

mostly, but it can vary, apple has a good video on their proposed rules

you mean claude

codex did the typing, unfortunately it couldn't reverse engineer undocumented HID behaviour without me figuring out what to make it do lol

i’m trolling lol it’s my favorite bait

oh lmao fell for the bait

we need this in yosei

holy mog

That's a cool and fun project. I am wondering if workbench from @Astropad could be used the same way

@Astropad idk if Apple would let them but if so fuck yeah lol I'm running with SIP disabled and amfi_get_out_of_my_way=0x1 on the 27.3 beta to get around the restricted virtual HID entitlement I'm open sourcing my implementation later but I'm sure they could figure it out themselves

@caguilar51 @Astropad We'd love to add it. Do you think it's possible to do without disabling SIP?

@caguilar51 @Astropad My build was self-signed, hence the SIP workaround :p (new apple account, waiting on getting the license) This also would work with SIP on using Apple Development signing + a provisioned virtual HID entitlement

@caguilar51 @Astropad I'd love to check out the open source too when you've got a chance!

@caguilar51 @Astropad btw do you guys do lifetime subs or just yearly?

@caguilar51 @Astropad Awesome! Just yearly because we have ongoing bandwidth costs for relay servers that are a fallback when direct connection can’t be made

@caguilar51 @Astropad makes sense! considered a one time license for direct connections? I'd happily pay more upfront it's better than anything I've built lol I use my own tailnet so if astropad ever shuts down I'd hate to lose access to great software that doesn't need your servers

My boy is boutta put Ethan Lipnik at Cognition out of business slowly

MacOS on iPhone before iPad?

i just realised the reason why they made toucscreen macbook is for this bs that doesn't even work in europe yet

Wdym? I'm in London rn and anyone can install 27.3

oh it released for europe in .3 im careful with updating as there might be jailbreak soon

super cool

Out appleing apple

now THIS is a use for the duo

so good!

remote macbook client v0.1

MacBook Pro mini

did that too

Please open source it, it'd be good to have access to the touch screen HID interface

Throw this on the app store, will pay for it so I can use it on my iPad

Apple wouldn't let me this breaks some rules, but you can sign and build yourself I'm ossing later

Ran out of tokens to try this, could you open source it?

I plan to! Just need to tidy some other stuff I threw in which makes the app bad

You need tiny fingers though looks like

or change display scale and everything sorts itself out (screenshot from Duo)

That’s not a want but a NEED on the duo

can you connect it to an external display with keyboard and mouse to get a full mac experience?

No but that wouldn't be hard to build, code is oss

i bet this slaps on a bigger ipad though

Yeah I might make my duo app a better sidecar app at some point, but I don't carry iPads with me

so cool

vnc?

nah, custom streaming over TLS screencapturekit + videotoolbox for H.264, corehid for native multitouch input

pls add this to sunshine or something

and it will work on iPad Pro 13”?

would need to change a few things but that should be easy

i think iPhone Duo is a cool surface to get the likes on sn rn, but for real production work with your concept, iPad Pros with their large screen estates is where your demo shines.

this is a fun project not super serious haha, feel free to mess around with it. should work on ipad now

just saw the github link!

双人远程触控听着很好玩，但延迟怎么样？两个人同时操作会不会互相打架，真能当日常工具用吗？

great work! waiting for you to opensource so bad

lol bet

seeing stuff like this makes me want to get a duo

you would have a better time with an iphone air and an ipad mini I have to build my own software because everyone else isn't optimizing theirs

nah I like messing around and tinkering with things, I probably won't use it as my primary device though

How does the HID work?

it's pretty simple, the iphone sends touch coordinates to the mac which uses CoreHID to emulate a touchscreen I associate the virtual touchscreen with the display by passing its UUID and setting kIOHIDDisplayIntegratedKey before activation

Wonder if the trackpads work in a similar way

sends touch contacts through a virtual magic trackpad not sure what you had in mind though?

that's seriously impressive work—pushing boundaries with creativity!