Dilmer
@Dilmerv • 50,138 subscribers
Building XR + AI in public @Meta 🥽 Dev advocate · weekly build demos · dev tips · Shipped VR/MR games👇 apps & XR tutorials!
Shorts
Videos
Last year I built a full Unity VR/MR demo for our talk and the Meta booth, and it took me around 3–4 weeks to complete. This year, with only a week left before GDC, I was definitely feeling the pressure. Surprisingly, I ended up building a full VR game with AI in just one day. The tech stack 👇
Dilmer1,606,014 Aufrufe • vor 7 Monaten
Over the past 3-4 weeks, I focused on creating a live demo for the Meta Connect Developer Keynote. When the team asked me to do this with AI, my first reaction was, “How am I going to pull this off on stage?” 😅 Then I got to work. I’ve been building so many games and prototypes that I had a pretty good idea of how to approach it. Well, I don’t want to spoil it, but here’s the full live demo showing how I built a Mini Golf game that’s ready for Meta VR Glasses! It uses v207, hand tracking, and gaze interactions, and I relied quite a bit on Meta XR Simulator for rapid iteration. 👇
Dilmer29,504 Aufrufe • vor 19 Tagen
📣 This solo developer who currently works at Pixar as a Technical Director is building a VR rhythm game called Sock Puppet Superstar for Quest as an indie project, and over the last week he has been going viral on TikTok! 🤖Features/Tech: - Using Unity, OpenXR, hand tracking, and a custom voice synthesizer built in FMOD - Raise and lower your puppet to control the pitch - Works with hand tracking or controllers - Customize your sock puppet with colors, fabrics, accessories, and voices 📌 Devs can achieve this using the Meta XR Interaction SDK or Unity XR Toolkit (XR Hands) to add full hand support like what’s shown here. 🚀 Share this to give this solo indie dev more visibility! I’ll continue this bi-weekly with more indie devs who deserve the amplification!
Dilmer151,693 Aufrufe • vor 6 Monaten
So cool to see what devs are building with hand-first experiences using Unity and Meta SDKs! 🙌 Add hand support to your existing Quest title or build something new for Meta VR Glasses, using one codebase across multiple devices. Get started with Unity 6.6 or higher, and check out these great experiences built with these tools!
Dilmer10,510 Aufrufe • vor 23 Tagen
🤯 1.5 days after posting about this MR tabletop game and it’s crazy, I’ve already added 30+ commits to GitHub. 90% of that progress came from agentic workflows, and the remaining 10% came from core Unity, programming, and design knowledge. 👨🏻💻 What did I add? - Power indicators - UI + poke interactions - Court lines that now look closer to a real basketball court - Improved game stats and timer UI - Improved the backend, including some manual refactoring after Claude had done its job - Added multiple rounds to the game loop - Added Game Over UI and a variety of fixes ⏭️ What’s next? - Adding automatic alignment to table surfaces by using MRUK - Adding leaderboards through PSDK - VFX & Particle effects
Dilmer40,622 Aufrufe • vor 5 Monaten
Hello everyone! 👋🕶️ Unity recently released the new Unity CLI and made Unity MCP free. In today’s video, I explore whether MCP is still needed while covering editor and module management, C# execution with eval, automated builds, testing, and Codex integration! 🚀 🎥 Full video: I also built a very cool mini golf game using Codex and Unity CLI. Then I remotely control the game directly from the terminal. You’ll want to see this! ⛳ Let me know if you’ve any questions below. I had so much fun making this one!
Dilmer20,527 Aufrufe • vor 2 Monaten
🔉(sound on) "What if you could just grab sounds from your surroundings?" I am extremely proud of this team, who participated in XRCC in Berlin, a hackathon we supported this year, and made amazing updates to enter the Meta Horizon Start Developer Competition! This team took advantage of new PCA features (SDK v81+, stereo, timestamps) to improve the overall experience.
Dilmer57,579 Aufrufe • vor 10 Monaten
🏀 Arcade Hoops is now available on the official Meta Horizon Store! 🚀 This was such a fun test: taking an idea and shipping it to the Meta Horizon Store in exactly 4 weeks. I built it using: - Meta VR CLI - Agentic Tools Repo, full of skills - Claude Code + VS Code - Unity 6 + Unity MCP - Meta XR Core + Meta ISDK + MRUK - OpenAI Image 2.0 for concept generation - Adobe Photoshop for all the store assets 💡Honestly, this project taught me so much about what modern VR/MR development workflows can look like when you combine Unity with our agentic workflows.
Dilmer26,210 Aufrufe • vor 4 Monaten
💡What if I could fully turn an existing full-scale VR/MR game into a mini tabletop game? Honestly, this just took 6-7 prompts + a few android permission changes to enable hand tracking. The results 🤯 and this used to take me a while because I had to manually resize and adjust everything before I could even make it work. This is exactly why Unity AI and their exposed MCP tools are such a big deal for developers.
Dilmer28,858 Aufrufe • vor 5 Monaten
📣 Today, I’m excited to walk you through Unity’s NEW AI offering, Meta MCP Extensions, and agentic tools to demonstrate how we can 𝗕𝘂𝗶𝗹𝗱 𝗔 𝗙𝘂𝗹𝗹 𝗩𝗥/𝗩𝗥 𝗚𝗮𝗺𝗲 from start to finish using these AI tools in a practical way. 🎥 Full video available at: 📌 Here’s what I’m covering today: - Unity VR project setup (with OpenXR plugins) - Installing the Unity AI Assistant and demos - Configuring Unity MCP + Meta MCP Extensions - Configuring Claude Code & MCPs - Building a VR/MR Basketball Game with the Unity AI Assistant, Claude Agent, and external Claude Code CLI - A lot of iteration with Claude Code + the Meta XR Simulator 💡Also, it’s been a while since I've posted a new video, and I’m genuinely excited to be back, especially with a topic like this that I know many devs have been waiting for.
Dilmer25,153 Aufrufe • vor 5 Monaten
⛳️ Tiny Golf - A Very Cool Meta Horizon Start Developer Competition Submission! Mixed Reality games are challenging because they must adapt to real-world spaces with dynamic content, but they don’t have to be complex. Tiny Golf is a great example, using a minimalistic aesthetic and 🙌 hand-tracking pinch-and-pull gestures to launch the golf ball. I hope MR/VR games like this inspire many of you to build, there is just so much opportunity with XR today and 2026 is the year to start! 😉 📌 To get started, you can use: Meta XR All-In-One SDK, or a leaner option: Meta XR Interaction SDK, which pulls in the Meta XR Core SDK package and includes advanced hand-tracking features and passthrough.
Dilmer31,924 Aufrufe • vor 10 Monaten
🚨 Unity AI is finally opening up, and this is a big one for Unity developers 🚀 You now get access to an in-project agentic assistant, AI Gateway, MCP server support, and deeper editor context so AI tools can understand your scene, assets, packages, hierarchy, settings, and target platforms. This is the kind of workflow I’ve been waiting for, AI that actually understands your Unity project and helps you build faster.
Dilmer17,837 Aufrufe • vor 5 Monaten
🔥We’ve very exciting news for 𝗩𝗥, 𝗔𝗻𝗱𝗿𝗼𝗶𝗱, 𝗮𝗻𝗱 𝗪𝗲𝗯𝗫𝗥 𝗗𝗲𝘃𝘀. We’re thrilled to announce the new “Meta Horizon Start Developer Competition 2025” which offers up to 1.5 Million Dollars in Prizes. 𝗖𝗼𝗺𝗽𝗲𝘁𝗶𝘁𝗶𝗼𝗻 𝗗𝗮𝘁𝗲𝘀: Nov 5 - Dec 9, 2025 𝗙𝗼𝗰𝘂𝘀 𝗔𝗿𝗲𝗮𝘀: Entertainment, Lifestyle, and Gaming experiences ℹ️ Special awards will recognize creative use 𝗛𝗮𝗻𝗱 𝗜𝗻𝘁𝗲𝗿𝗮𝗰𝘁𝗶𝗼𝗻𝘀, 𝗣𝗮𝘀𝘀𝘁𝗵𝗿𝗼𝘂𝗴𝗵 𝗖𝗮𝗺𝗲𝗿𝗮 𝗔𝗰𝗰𝗲𝘀𝘀 𝘄𝗶𝘁𝗵 𝗔𝗜, 𝗦𝗽𝗮𝘁𝗶𝗮𝗹 𝗦𝗗𝗞, 𝗜𝗺𝗺𝗲𝗿𝘀𝗶𝘃𝗲 𝗪𝗲𝗯 𝗦𝗗𝗞, 𝗥𝗲𝗮𝗰𝘁 𝗡𝗮𝘁𝗶𝘃𝗲, 𝗮𝗻𝗱 𝗔𝗻𝗱𝗿𝗼𝗶𝗱.
Dilmer26,853 Aufrufe • vor 11 Monaten
This is pretty cool 👓 Google Announces Geospatial Creator powered by ARCore & Google Maps and it allows you to visualize, design, and publish world-anchored content by using Unity ! Few features available: 📌 Photorealistic 3D Tiles: Visualize the 3D geometry of the world and deploy location-anchored content accurately with high-resolution, photorealistic 3D tiles. 📌 Geospatial anchors: Place and anchor 3D content at any given latitude, longitude, and altitude with sub-meter accuracy in areas covered by Google Street View. 📌 Terrain anchors: Place and anchor 3D content with only latitude and longitude coordinates, using data from Google Maps to determine ground level. 📌 Rooftop anchors: Use rooftops to place and anchor 3D content with respect to the building geometry and terrain in areas covered by Google Street View. 📢 To get started with Unity follow these steps: #AR #Google
Dilmer58,297 Aufrufe • vor 3 Jahren
📣 I talk a lot about Meta SDKs because I spend a lot of time with these tools. But also when someone asks me what VR/MR tools they can use for cross platform support, I recommend 𝗨𝗻𝗶𝘁𝘆’𝘀 𝗫𝗥 𝗧𝗼𝗼𝗹𝗸𝗶𝘁 which provides: - 𝗖𝗿𝗼𝘀𝘀-𝗽𝗹𝗮𝘁𝗳𝗼𝗿𝗺 𝘀𝘂𝗽𝗽𝗼𝗿𝘁: Meta Quest, OpenXR, Windows Mixed Reality, + more - 𝗜𝗻𝘁𝗲𝗿𝗮𝗰𝘁𝗶𝗼𝗻𝘀: Hover, select, grab - 𝗙𝗲𝗲𝗱𝗯𝗮𝗰𝗸: Haptic + visual tint/line for possible & active interactions - 𝗨𝗜: Canvas interaction via XR controllers - 𝗨𝘁𝗶𝗹𝗶𝘁𝗶𝗲𝘀: XR Origin support for stationary & room-scale VR - 𝗫𝗥 𝗛𝗮𝗻𝗱𝘀: this is an extended package to support more advanced hand tracking interactions 👉 Also, it supports 𝗔𝗥 𝗳𝗼𝗿 𝗺𝗼𝗯𝗶𝗹𝗲 𝗳𝗲𝗮𝘁𝘂𝗿𝗲𝘀 𝘁𝗵𝗿𝗼𝘂𝗴𝗵 𝗔𝗥 𝗙𝗼𝘂𝗻𝗱𝗮𝘁𝗶𝗼𝗻, the features are: - 𝗔𝗥 𝗴𝗲𝘀𝘁𝘂𝗿𝗲 𝘀𝘆𝘀𝘁𝗲𝗺: Maps screen touches to Input System gesture events via TouchscreenGestureInputController - 𝗦𝗰𝗿𝗲𝗲𝗻-𝘀𝗽𝗮𝗰𝗲 𝗶𝗻𝗽𝘂𝘁: Feeds touch data into XRRayInteractor for AR interaction - 𝗔𝗥𝗧𝗿𝗮𝗻𝘀𝗳𝗼𝗿𝗺𝗲𝗿: Converts place, select, translate, rotate, scale gestures into object manipulation 👨💻 And to emulate your apps/games without physical devices I recommend the following: - 𝗫𝗥 𝗗𝗲𝘃𝗶𝗰𝗲 𝗦𝗶𝗺𝘂𝗹𝗮𝘁𝗼𝗿 for VR/MR to test your interactions - 𝗔𝗥 𝗙𝗼𝘂𝗻𝗱𝗮𝘁𝗶𝗼𝗻 𝗥𝗲𝗺𝗼𝘁𝗲 𝟮.𝟬 for AR Foundation testing, this allows you to remotely test all the AR features by connecting the Unity editor to your physical device (iOS or Android) 💡 Are you using Unity’s XR Toolkit? ISDK? any other toolkit?
Dilmer13,239 Aufrufe • vor 6 Monaten