At #CHI2024 we present ⚙️𝑴𝒐𝒊𝒓𝒆́𝑾𝒊𝒅𝒈𝒆𝒕𝒔: High-Precision, Passive Tangible Interfaces via Moiré Effect! Daniel Campos Zamora Alexa Siu Chang Xiao Adobe AdobeResearch MIT CSAIL Makeability Lab ACM CHI Conference ACM SIGCHI #CHI24 #digitalfabrication #mixedreality #inputmethods #hci

🪄 The Moiré effect is a commonly observed phenomenon that occurs when two repetitive patterns are superimposed. 👀 We use this to track three types of primitive movements: 1D translation, 2D translation, and rotation

⚙️⚙️ Our widgets are made of 3D printed mechanical structures & fringes printed on paper. Here's how they're assembled, and how the image processing works:

👇 Here is a breakdown of each MoiréWidget ⚙️⚙️⚙️

Here's a sample application of MoiréWidgets - a tangible audio console 🔊 tracked only using computer vision!

Our paper will be presented by Daniel @Daniel_C_Z in Honolulu on Wed, May 15, during the "Fabrication and Tangible Interaction A" session from 2:00-2:15 pm. 📄 Paper: 🎥 Video:

@Daniel_C_Z @alexafay @changxiao0731 @Adobe @AdobeResearch @MIT_CSAIL @makeabilitylab @acm_chi @sigchi reminds me of a japanese artist who scan barcodes for music

@Daniel_C_Z @alexafay @changxiao0731 @Adobe @AdobeResearch @MIT_CSAIL @makeabilitylab @acm_chi @sigchi What's the artist's name? 😃

@Daniel_C_Z @alexafay @changxiao0731 @Adobe @AdobeResearch @MIT_CSAIL @makeabilitylab @acm_chi @sigchi so cool 🤩

@Daniel_C_Z @alexafay @changxiao0731 @Adobe @AdobeResearch @MIT_CSAIL @makeabilitylab @acm_chi @sigchi Thanks Cathy! 🤩🙏🏻