Dilmer ๐ AWE
@Dilmerv โข 49,433 subscribers
๐จโ๐ป Developer Advocate at Meta | 10+ Years as a Dev | Unity / C# / C++ / Swift | Helping devs build XR + AI | https://t.co/MIehvrIvEC | Opinions are my own.
Shorts
Videos
Last year I built a full Unity VR/MR demo for our talk and the Meta booth, and it took me around 3โ4 weeks to complete. This year, with only a week left before GDC, I was definitely feeling the pressure. Surprisingly, I ended up building a full VR game with AI in just one day. The tech stack ๐
Dilmer ๐ AWE1,597,669 gรถrรผntรผleme โข 2 ay รถnce
๐ฃ This solo developer who currently works at Pixar as a Technical Director is building a VR rhythm game called Sock Puppet Superstar for Quest as an indie project, and over the last week he has been going viral on TikTok! ๐คFeatures/Tech: - Using Unity, OpenXR, hand tracking, and a custom voice synthesizer built in FMOD - Raise and lower your puppet to control the pitch - Works with hand tracking or controllers - Customize your sock puppet with colors, fabrics, accessories, and voices ๐ Devs can achieve this using the Meta XR Interaction SDK or Unity XR Toolkit (XR Hands) to add full hand support like whatโs shown here. ๐ Share this to give this solo indie dev more visibility! Iโll continue this bi-weekly with more indie devs who deserve the amplification!
Dilmer ๐ AWE149,332 gรถrรผntรผleme โข 1 ay รถnce
๐คฏ 1.5 days after posting about this MR tabletop game and itโs crazy, Iโve already added 30+ commits to GitHub. 90% of that progress came from agentic workflows, and the remaining 10% came from core Unity, programming, and design knowledge. ๐จ๐ปโ๐ป What did I add? - Power indicators - UI + poke interactions - Court lines that now look closer to a real basketball court - Improved game stats and timer UI - Improved the backend, including some manual refactoring after Claude had done its job - Added multiple rounds to the game loop - Added Game Over UI and a variety of fixes โญ๏ธ Whatโs next? - Adding automatic alignment to table surfaces by using MRUK - Adding leaderboards through PSDK - VFX & Particle effects
Dilmer ๐ AWE40,396 gรถrรผntรผleme โข 1 ay รถnce
๐ข BIG NEWS! ๐ถ๏ธ Weโre launching GOAT and 2048 on Meta Ray-Ban Displays, ambient games for the in-between moments. No controllers. No friction. Just intuitive EMG + gestures, layered into your day. This is the future of play: human, lightweight, and present!
Dilmer ๐ AWE94,241 gรถrรผntรผleme โข 3 ay รถnce
๐กWhat if I could fully turn an existing full-scale VR/MR game into a mini tabletop game? Honestly, this just took 6-7 prompts + a few android permission changes to enable hand tracking. The results ๐คฏ and this used to take me a while because I had to manually resize and adjust everything before I could even make it work. This is exactly why Unity AI and their exposed MCP tools are such a big deal for developers.
Dilmer ๐28,554 gรถrรผntรผleme โข 1 ay รถnce
๐ฃ Today, Iโm excited to walk you through Unityโs NEW AI offering, Meta MCP Extensions, and agentic tools to demonstrate how we can ๐๐๐ถ๐น๐ฑ ๐ ๐๐๐น๐น ๐ฉ๐ฅ/๐ฉ๐ฅ ๐๐ฎ๐บ๐ฒ from start to finish using these AI tools in a practical way. ๐ฅ Full video available at: ๐ Hereโs what Iโm covering today: - Unity VR project setup (with OpenXR plugins) - Installing the Unity AI Assistant and demos - Configuring Unity MCP + Meta MCP Extensions - Configuring Claude Code & MCPs - Building a VR/MR Basketball Game with the Unity AI Assistant, Claude Agent, and external Claude Code CLI - A lot of iteration with Claude Code + the Meta XR Simulator ๐กAlso, itโs been a while since I've posted a new video, and Iโm genuinely excited to be back, especially with a topic like this that I know many devs have been waiting for.
Dilmer ๐ AWE24,521 gรถrรผntรผleme โข 1 ay รถnce
๐จ Unity AI is finally opening up, and this is a big one for Unity developers ๐ You now get access to an in-project agentic assistant, AI Gateway, MCP server support, and deeper editor context so AI tools can understand your scene, assets, packages, hierarchy, settings, and target platforms. This is the kind of workflow Iโve been waiting for, AI that actually understands your Unity project and helps you build faster.
Dilmer ๐17,292 gรถrรผntรผleme โข 1 ay รถnce
Evan Spiegel takes the stage to demonstrate how the new Spectacles work, take a look, this is pretty incredible. #SnapPartnerSummit2024
Dilmer ๐ AWE193,019 gรถrรผntรผleme โข 1 yฤฑl รถnce
๐(sound on) "What if you could just grab sounds from your surroundings?" I am extremely proud of this team, who participated in XRCC in Berlin, a hackathon we supported this year, and made amazing updates to enter the Meta Horizon Start Developer Competition! This team took advantage of new PCA features (SDK v81+, stereo, timestamps) to improve the overall experience.
Dilmer ๐57,397 gรถrรผntรผleme โข 5 ay รถnce
๐ฃ I talk a lot about Meta SDKs because I spend a lot of time with these tools. But also when someone asks me what VR/MR tools they can use for cross platform support, I recommend ๐จ๐ป๐ถ๐๐โ๐ ๐ซ๐ฅ ๐ง๐ผ๐ผ๐น๐ธ๐ถ๐ which provides: - ๐๐ฟ๐ผ๐๐-๐ฝ๐น๐ฎ๐๐ณ๐ผ๐ฟ๐บ ๐๐๐ฝ๐ฝ๐ผ๐ฟ๐: Meta Quest, OpenXR, Windows Mixed Reality, + more - ๐๐ป๐๐ฒ๐ฟ๐ฎ๐ฐ๐๐ถ๐ผ๐ป๐: Hover, select, grab - ๐๐ฒ๐ฒ๐ฑ๐ฏ๐ฎ๐ฐ๐ธ: Haptic + visual tint/line for possible & active interactions - ๐จ๐: Canvas interaction via XR controllers - ๐จ๐๐ถ๐น๐ถ๐๐ถ๐ฒ๐: XR Origin support for stationary & room-scale VR - ๐ซ๐ฅ ๐๐ฎ๐ป๐ฑ๐: this is an extended package to support more advanced hand tracking interactions ๐ Also, it supports ๐๐ฅ ๐ณ๐ผ๐ฟ ๐บ๐ผ๐ฏ๐ถ๐น๐ฒ ๐ณ๐ฒ๐ฎ๐๐๐ฟ๐ฒ๐ ๐๐ต๐ฟ๐ผ๐๐ด๐ต ๐๐ฅ ๐๐ผ๐๐ป๐ฑ๐ฎ๐๐ถ๐ผ๐ป, the features are: - ๐๐ฅ ๐ด๐ฒ๐๐๐๐ฟ๐ฒ ๐๐๐๐๐ฒ๐บ: Maps screen touches to Input System gesture events via TouchscreenGestureInputController - ๐ฆ๐ฐ๐ฟ๐ฒ๐ฒ๐ป-๐๐ฝ๐ฎ๐ฐ๐ฒ ๐ถ๐ป๐ฝ๐๐: Feeds touch data into XRRayInteractor for AR interaction - ๐๐ฅ๐ง๐ฟ๐ฎ๐ป๐๐ณ๐ผ๐ฟ๐บ๐ฒ๐ฟ: Converts place, select, translate, rotate, scale gestures into object manipulation ๐จโ๐ป And to emulate your apps/games without physical devices I recommend the following: - ๐ซ๐ฅ ๐๐ฒ๐๐ถ๐ฐ๐ฒ ๐ฆ๐ถ๐บ๐๐น๐ฎ๐๐ผ๐ฟ for VR/MR to test your interactions - ๐๐ฅ ๐๐ผ๐๐ป๐ฑ๐ฎ๐๐ถ๐ผ๐ป ๐ฅ๐ฒ๐บ๐ผ๐๐ฒ ๐ฎ.๐ฌ for AR Foundation testing, this allows you to remotely test all the AR features by connecting the Unity editor to your physical device (iOS or Android) ๐ก Are you using Unityโs XR Toolkit? ISDK? any other toolkit?
Dilmer ๐12,943 gรถrรผntรผleme โข 1 ay รถnce
โณ๏ธ Tiny Golf - A Very Cool Meta Horizon Start Developer Competition Submission! Mixed Reality games are challenging because they must adapt to real-world spaces with dynamic content, but they donโt have to be complex. Tiny Golf is a great example, using a minimalistic aesthetic and ๐ hand-tracking pinch-and-pull gestures to launch the golf ball. I hope MR/VR games like this inspire many of you to build, there is just so much opportunity with XR today and 2026 is the year to start! ๐ ๐ To get started, you can use: Meta XR All-In-One SDK, or a leaner option: Meta XR Interaction SDK, which pulls in the Meta XR Core SDK package and includes advanced hand-tracking features and passthrough.
Dilmer ๐๐ GDC31,749 gรถrรผntรผleme โข 5 ay รถnce
๐ This is something I recently learned about the ๐ ๐ฒ๐๐ฎ ๐๐ป๐๐ฒ๐ฟ๐ฎ๐ฐ๐๐ถ๐ผ๐ป ๐ฆ๐๐, and if you're aiming for ๐ฐ๐ฟ๐ผ๐๐-๐ฝ๐น๐ฎ๐๐ณ๐ผ๐ฟ๐บ, there is a way to do it. Basically, the Interaction SDK Essentials package provides the core implementations of all the interaction models, along with the necessary shaders, materials, and prefabs. The package can optionally integrate with Unity XR if the dependency is available. ๐กUse this package paired with Unity XR Hands if cross-platform development is important to your project.
Dilmer ๐10,166 gรถrรผntรผleme โข 1 ay รถnce
This is Project Orion AR Glasses, and Mark Zuckerberg is showing them live right now on stage during #MetaConnect 2024 ๐๐
Dilmer ๐71,462 gรถrรผntรผleme โข 1 yฤฑl รถnce
๐ฅWeโve very exciting news for ๐ฉ๐ฅ, ๐๐ป๐ฑ๐ฟ๐ผ๐ถ๐ฑ, ๐ฎ๐ป๐ฑ ๐ช๐ฒ๐ฏ๐ซ๐ฅ ๐๐ฒ๐๐. Weโre thrilled to announce the new โMeta Horizon Start Developer Competition 2025โ which offers up to 1.5 Million Dollars in Prizes. ๐๐ผ๐บ๐ฝ๐ฒ๐๐ถ๐๐ถ๐ผ๐ป ๐๐ฎ๐๐ฒ๐: Nov 5 - Dec 9, 2025 ๐๐ผ๐ฐ๐๐ ๐๐ฟ๐ฒ๐ฎ๐: Entertainment, Lifestyle, and Gaming experiences โน๏ธ Special awards will recognize creative use ๐๐ฎ๐ป๐ฑ ๐๐ป๐๐ฒ๐ฟ๐ฎ๐ฐ๐๐ถ๐ผ๐ป๐, ๐ฃ๐ฎ๐๐๐๐ต๐ฟ๐ผ๐๐ด๐ต ๐๐ฎ๐บ๐ฒ๐ฟ๐ฎ ๐๐ฐ๐ฐ๐ฒ๐๐ ๐๐ถ๐๐ต ๐๐, ๐ฆ๐ฝ๐ฎ๐๐ถ๐ฎ๐น ๐ฆ๐๐, ๐๐บ๐บ๐ฒ๐ฟ๐๐ถ๐๐ฒ ๐ช๐ฒ๐ฏ ๐ฆ๐๐, ๐ฅ๐ฒ๐ฎ๐ฐ๐ ๐ก๐ฎ๐๐ถ๐๐ฒ, ๐ฎ๐ป๐ฑ ๐๐ป๐ฑ๐ฟ๐ผ๐ถ๐ฑ.
Dilmer ๐26,774 gรถrรผntรผleme โข 7 ay รถnce
Hello AI enthusiasts!๐ Iโd like to share that weโre introducing the latest 3D foundation AI model AssetGen 2.0, which was designed to create high-quality 3D assets from text and image prompts. ๐กAssetGen 2.0 consist of 2 models: one to generate the 3D Mesh, & a second one to generate textures. โน๏ธ Technological Advancements: - Utilizes a single-stage 3D diffusion model for geometry estimation, leading to improved detail and fidelity compared to its predecessor, AssetGen 1.0. - TextureGen introduces methods for enhanced view consistency, texture in-painting, and higher texture resolution. ๐ Current Use and Future Plans: - Currently employed internally for creating 3D worlds. - Planned rollout to Horizon creators later this year. ๐ More details about this announcement: #Meta #AI #GenAI
Dilmer Valecillos28,153 gรถrรผntรผleme โข 1 yฤฑl รถnce
This is pretty cool ๐ Google Announces Geospatial Creator powered by ARCore & Google Maps and it allows you to visualize, design, and publish world-anchored content by using Unity ! Few features available: ๐ Photorealistic 3D Tiles: Visualize the 3D geometry of the world and deploy location-anchored content accurately with high-resolution, photorealistic 3D tiles. ๐ Geospatial anchors: Place and anchor 3D content at any given latitude, longitude, and altitude with sub-meter accuracy in areas covered by Google Street View. ๐ Terrain anchors: Place and anchor 3D content with only latitude and longitude coordinates, using data from Google Maps to determine ground level. ๐ Rooftop anchors: Use rooftops to place and anchor 3D content with respect to the building geometry and terrain in areas covered by Google Street View. ๐ข To get started with Unity follow these steps: #AR #Google
Dilmer ๐58,241 gรถrรผntรผleme โข 3 yฤฑl รถnce
๐ฅUnity just announced XR Hands Package 1.7.0 that enables devs to create custom gestures even easier! The steps in Unity: 1๏ธโฃ Connect your headset 2๏ธโฃ Record the gesture on your device 3๏ธโฃ Import the recordings into Unity A faster, smoother workflow with fewer configurations, making it easier than ever to create complex gestures.
Dilmer ๐10,324 gรถrรผntรผleme โข 7 ay รถnce
โInstant Placementโ was announced during Connect last year, but I couldnโt find references to it in the Meta SDKs until recently. The actual code name is โEnvironmentRaycastManagerโ, and it is extremely helpful because it allows you to place objects on vertical or horizontal surfaces within your environment without requiring a full scene setup. ๐กHow does this work? This new manager utilizes the Depth API to provide raycasting functionality against the physical environment. ๐กDoes it impact performance? Yes, enabling this component adds an additional performance cost on top of using the Depth API. Therefore, consider enabling it only when you need raycasting functionality. #unity #xr
Dilmer Valecillos15,011 gรถrรผntรผleme โข 1 yฤฑl รถnce
