In VR, users can experience “magical” interactions, such as moving distant virtual objects with the Go-Go technique. How might we similarly extend people’s abilities in the physical world? 🪄 Excited to share Reality Promises, our #UIST2025 paper, led by the amazing Mohamed Kari ✨

Beyond materializing physical objects (seemingly out of thin air), users can manipulate out-of-reach objects via RealityGoGo — creating the illusion of telekinesis. 🪴

Even virtual agents’ actions can have physical effects, with motion paths that divert attention from the hidden robot. 🐝

In #AR, using real-time on-device 3D Gaussian splatting, we create the illusion that physical changes occur instantaneously, while a hidden robot fulfills the “reality promise” moments later, updating the physical world to match what users already perceive visually. 🤖

“Reality Promises: Virtual-Physical Decoupling Illusions in Mixed Reality via Invisible Mobile Robots” Paper: Full Video: Project Page: @m0k4r1 and I hope to see you in Busan! 🇰🇷 @PrincetonCS @PrincetonHCI

@m0k4r1 doing elements of this in our beta. We allow full collab and use of people's own gear. We have objects to throw around, and people are in the same room where they can use their computers, iPads, etc. would love for you to check it out.

@m0k4r1 Impressive

@m0k4r1