Prototyped a little app that allows you to take frames from Figma and 'pull them into space'. The frames stay linked to the canvas and update on any changes

It's just a little idea I had while toying around with the visionOS SDK. How it works: it's a Figma plugin that talks to an iOS app via WebSockets. All Figma frames are loaded as AR reference images which makes them detectable by ARKit (works surprisingly well) 1/2

...once detected, a high-res version is loaded, mapped onto a plane and stored as a reference for future updates. It's a lot of hot-glue and cobbled together, but it feels pretty magic to just pull frames from the screen like that :-) 2/2

One little detail is the grid animation while detecting a frame. I wanted to go for something that feels like something is being assembled/constructed. It’s pretty simple and almost entirely driven by a spring delay value (SwiftUI). (Commented gist:

@figma Looking forward to your 30m seed round

@figma 🔥🔥 figma plugin + ios app + web sockets is undefeated

@figma holy shit alex

@figma Insane potential, Geo-locked “Permanent frames” like this should be a game changer for vision products. Like widget panels only visible when you look where you “put them”

@figma I think this is really cool. What’s the use case?

@avstorm @figma Like the idea 💡

@figma Neat. This will be useful with Apples VR.