Загрузка видео...

Не удалось загрузить видео

На главную

📣 This solo developer who currently works at Pixar as a Technical Director is building a VR rhythm game called Sock Puppet Superstar for Quest as an indie project, and over the last week he has been going viral on TikTok! 🤖Features/Tech: - Using Unity, OpenXR, hand tracking, and...

Dilmerv's profile picture

Dilmer

49,471 subscribers

150,197 просмотров • 3 месяцев назад •via X (Twitter)

ИгрыИскусствоНаука и технологии
LIVE

Anya Rossi• Live Now

Private livecam show

Комментарии: 0

Нет доступных комментариев

Здесь появятся комментарии из оригинального поста

Похожие видео

⛳️ Tiny Golf - A Very Cool Meta Horizon Start Developer Competition Submission! Mixed Reality games are challenging because they must adapt to real-world spaces with dynamic content, but they don’t have to be complex. Tiny Golf is a great example, using a minimalistic aesthetic and 🙌 hand-tracking pinch-and-pull gestures to launch the golf ball. I hope MR/VR games like this inspire many of you to build, there is just so much opportunity with XR today and 2026 is the year to start! 😉 📌 To get started, you can use: Meta XR All-In-One SDK, or a leaner option: Meta XR Interaction SDK, which pulls in the Meta XR Core SDK package and includes advanced hand-tracking features and passthrough.
0:43

⛳️ Tiny Golf - A Very Cool Meta Horizon Start Developer Competition Submission! Mixed Reality games are challenging because they must adapt to real-world spaces with dynamic content, but they don’t have to be complex. Tiny Golf is a great example, using a minimalistic aesthetic and 🙌 hand-tracking pinch-and-pull gestures to launch the golf ball. I hope MR/VR games like this inspire many of you to build, there is just so much opportunity with XR today and 2026 is the year to start! 😉 📌 To get started, you can use: Meta XR All-In-One SDK, or a leaner option: Meta XR Interaction SDK, which pulls in the Meta XR Core SDK package and includes advanced hand-tracking features and passthrough.

Dilmer 👓🔜 GDC

31,749 просмотров • 7 месяцев назад

Hello everyone 👋 It is pretty excited to know that Unity released a new VR Multiplayer template 🚀🥳! This template integrates Unity Gaming Services, Netcode for GameObjects, and the XR Interaction Toolkit, enabling you to quickly launch your next social VR game. 📌 Key features include: 👉 XR Hands 1.4.1: Access hand tracking data from devices that support it. 👉 XR Interaction Toolkit v3.0.1: A high-level, component-based system for creating XR experiences, facilitating 3D and UI interactions from Unity input events. 👉 XR Plugin Management 4.4.1: Streamlines XR plug-in lifecycle management and offers a build-time UI through Unity Unified Settings. 👉 Netcode for GameObjects 1.8.1: Provides networking capabilities for GameObject and MonoBehaviour workflows. 👉 OpenXR 1.10.0: An open standard by Khronos that simplifies AR/VR development across various devices. ☁️ Unity Cloud Multiplayer Services: - Authentication 3.3.1: Offers anonymous and platform-specific authentication solutions. - Lobby 1.2.0: Facilitates player discovery and connection for various multiplayer scenarios. - Relay 1.6.0: Ensures secure player connectivity via a join code system, eliminating the need for third-party solutions or dedicated servers. - Vivox 16.0.0: Enhances multiplayer experiences with in-game voice and text chat capabilities. ℹ️ To access the template and additional documentation check out: #unity #multiplayer #xr
0:51

Hello everyone 👋 It is pretty excited to know that Unity released a new VR Multiplayer template 🚀🥳! This template integrates Unity Gaming Services, Netcode for GameObjects, and the XR Interaction Toolkit, enabling you to quickly launch your next social VR game. 📌 Key features include: 👉 XR Hands 1.4.1: Access hand tracking data from devices that support it. 👉 XR Interaction Toolkit v3.0.1: A high-level, component-based system for creating XR experiences, facilitating 3D and UI interactions from Unity input events. 👉 XR Plugin Management 4.4.1: Streamlines XR plug-in lifecycle management and offers a build-time UI through Unity Unified Settings. 👉 Netcode for GameObjects 1.8.1: Provides networking capabilities for GameObject and MonoBehaviour workflows. 👉 OpenXR 1.10.0: An open standard by Khronos that simplifies AR/VR development across various devices. ☁️ Unity Cloud Multiplayer Services: - Authentication 3.3.1: Offers anonymous and platform-specific authentication solutions. - Lobby 1.2.0: Facilitates player discovery and connection for various multiplayer scenarios. - Relay 1.6.0: Ensures secure player connectivity via a join code system, eliminating the need for third-party solutions or dedicated servers. - Vivox 16.0.0: Enhances multiplayer experiences with in-game voice and text chat capabilities. ℹ️ To access the template and additional documentation check out: #unity #multiplayer #xr

Dilmer

12,048 просмотров • 2 лет назад

📣 Today, I’m excited to walk you through Unity’s NEW AI offering, Meta MCP Extensions, and agentic tools to demonstrate how we can 𝗕𝘂𝗶𝗹𝗱 𝗔 𝗙𝘂𝗹𝗹 𝗩𝗥/𝗩𝗥 𝗚𝗮𝗺𝗲 from start to finish using these AI tools in a practical way. 🎥 Full video available at: 📌 Here’s what I’m covering today: - Unity VR project setup (with OpenXR plugins) - Installing the Unity AI Assistant and demos - Configuring Unity MCP + Meta MCP Extensions - Configuring Claude Code & MCPs - Building a VR/MR Basketball Game with the Unity AI Assistant, Claude Agent, and external Claude Code CLI - A lot of iteration with Claude Code + the Meta XR Simulator 💡Also, it’s been a while since I've posted a new video, and I’m genuinely excited to be back, especially with a topic like this that I know many devs have been waiting for.
0:21

📣 Today, I’m excited to walk you through Unity’s NEW AI offering, Meta MCP Extensions, and agentic tools to demonstrate how we can 𝗕𝘂𝗶𝗹𝗱 𝗔 𝗙𝘂𝗹𝗹 𝗩𝗥/𝗩𝗥 𝗚𝗮𝗺𝗲 from start to finish using these AI tools in a practical way. 🎥 Full video available at: 📌 Here’s what I’m covering today: - Unity VR project setup (with OpenXR plugins) - Installing the Unity AI Assistant and demos - Configuring Unity MCP + Meta MCP Extensions - Configuring Claude Code & MCPs - Building a VR/MR Basketball Game with the Unity AI Assistant, Claude Agent, and external Claude Code CLI - A lot of iteration with Claude Code + the Meta XR Simulator 💡Also, it’s been a while since I've posted a new video, and I’m genuinely excited to be back, especially with a topic like this that I know many devs have been waiting for.

Dilmer

24,796 просмотров • 2 месяцев назад

📣 I talk a lot about Meta SDKs because I spend a lot of time with these tools. But also when someone asks me what VR/MR tools they can use for cross platform support, I recommend 𝗨𝗻𝗶𝘁𝘆’𝘀 𝗫𝗥 𝗧𝗼𝗼𝗹𝗸𝗶𝘁 which provides: - 𝗖𝗿𝗼𝘀𝘀-𝗽𝗹𝗮𝘁𝗳𝗼𝗿𝗺 𝘀𝘂𝗽𝗽𝗼𝗿𝘁: Meta Quest, OpenXR, Windows Mixed Reality, + more - 𝗜𝗻𝘁𝗲𝗿𝗮𝗰𝘁𝗶𝗼𝗻𝘀: Hover, select, grab - 𝗙𝗲𝗲𝗱𝗯𝗮𝗰𝗸: Haptic + visual tint/line for possible & active interactions - 𝗨𝗜: Canvas interaction via XR controllers - 𝗨𝘁𝗶𝗹𝗶𝘁𝗶𝗲𝘀: XR Origin support for stationary & room-scale VR - 𝗫𝗥 𝗛𝗮𝗻𝗱𝘀: this is an extended package to support more advanced hand tracking interactions 👉 Also, it supports 𝗔𝗥 𝗳𝗼𝗿 𝗺𝗼𝗯𝗶𝗹𝗲 𝗳𝗲𝗮𝘁𝘂𝗿𝗲𝘀 𝘁𝗵𝗿𝗼𝘂𝗴𝗵 𝗔𝗥 𝗙𝗼𝘂𝗻𝗱𝗮𝘁𝗶𝗼𝗻, the features are: - 𝗔𝗥 𝗴𝗲𝘀𝘁𝘂𝗿𝗲 𝘀𝘆𝘀𝘁𝗲𝗺: Maps screen touches to Input System gesture events via TouchscreenGestureInputController - 𝗦𝗰𝗿𝗲𝗲𝗻-𝘀𝗽𝗮𝗰𝗲 𝗶𝗻𝗽𝘂𝘁: Feeds touch data into XRRayInteractor for AR interaction - 𝗔𝗥𝗧𝗿𝗮𝗻𝘀𝗳𝗼𝗿𝗺𝗲𝗿: Converts place, select, translate, rotate, scale gestures into object manipulation 👨‍💻 And to emulate your apps/games without physical devices I recommend the following: - 𝗫𝗥 𝗗𝗲𝘃𝗶𝗰𝗲 𝗦𝗶𝗺𝘂𝗹𝗮𝘁𝗼𝗿 for VR/MR to test your interactions - 𝗔𝗥 𝗙𝗼𝘂𝗻𝗱𝗮𝘁𝗶𝗼𝗻 𝗥𝗲𝗺𝗼𝘁𝗲 𝟮.𝟬 for AR Foundation testing, this allows you to remotely test all the AR features by connecting the Unity editor to your physical device (iOS or Android) 💡 Are you using Unity’s XR Toolkit? ISDK? any other toolkit?
0:38

📣 I talk a lot about Meta SDKs because I spend a lot of time with these tools. But also when someone asks me what VR/MR tools they can use for cross platform support, I recommend 𝗨𝗻𝗶𝘁𝘆’𝘀 𝗫𝗥 𝗧𝗼𝗼𝗹𝗸𝗶𝘁 which provides: - 𝗖𝗿𝗼𝘀𝘀-𝗽𝗹𝗮𝘁𝗳𝗼𝗿𝗺 𝘀𝘂𝗽𝗽𝗼𝗿𝘁: Meta Quest, OpenXR, Windows Mixed Reality, + more - 𝗜𝗻𝘁𝗲𝗿𝗮𝗰𝘁𝗶𝗼𝗻𝘀: Hover, select, grab - 𝗙𝗲𝗲𝗱𝗯𝗮𝗰𝗸: Haptic + visual tint/line for possible & active interactions - 𝗨𝗜: Canvas interaction via XR controllers - 𝗨𝘁𝗶𝗹𝗶𝘁𝗶𝗲𝘀: XR Origin support for stationary & room-scale VR - 𝗫𝗥 𝗛𝗮𝗻𝗱𝘀: this is an extended package to support more advanced hand tracking interactions 👉 Also, it supports 𝗔𝗥 𝗳𝗼𝗿 𝗺𝗼𝗯𝗶𝗹𝗲 𝗳𝗲𝗮𝘁𝘂𝗿𝗲𝘀 𝘁𝗵𝗿𝗼𝘂𝗴𝗵 𝗔𝗥 𝗙𝗼𝘂𝗻𝗱𝗮𝘁𝗶𝗼𝗻, the features are: - 𝗔𝗥 𝗴𝗲𝘀𝘁𝘂𝗿𝗲 𝘀𝘆𝘀𝘁𝗲𝗺: Maps screen touches to Input System gesture events via TouchscreenGestureInputController - 𝗦𝗰𝗿𝗲𝗲𝗻-𝘀𝗽𝗮𝗰𝗲 𝗶𝗻𝗽𝘂𝘁: Feeds touch data into XRRayInteractor for AR interaction - 𝗔𝗥𝗧𝗿𝗮𝗻𝘀𝗳𝗼𝗿𝗺𝗲𝗿: Converts place, select, translate, rotate, scale gestures into object manipulation 👨‍💻 And to emulate your apps/games without physical devices I recommend the following: - 𝗫𝗥 𝗗𝗲𝘃𝗶𝗰𝗲 𝗦𝗶𝗺𝘂𝗹𝗮𝘁𝗼𝗿 for VR/MR to test your interactions - 𝗔𝗥 𝗙𝗼𝘂𝗻𝗱𝗮𝘁𝗶𝗼𝗻 𝗥𝗲𝗺𝗼𝘁𝗲 𝟮.𝟬 for AR Foundation testing, this allows you to remotely test all the AR features by connecting the Unity editor to your physical device (iOS or Android) 💡 Are you using Unity’s XR Toolkit? ISDK? any other toolkit?

Dilmer 👓

12,943 просмотров • 3 месяцев назад

Hi XR devs! Big day today. v83 of the Meta XR SDK is officially out and it includes something very special to me 🦙. For the past 6 months we’ve been building AI Inference Building Blocks, which you may have seen teased at Meta Connect 2025. Our goal: keep the simplicity of Building Blocks while giving you the freedom to plug in any AI provider or model you want to power you apps with AI. More details and a full step-by-step guide are coming soon. And stay tuned as two more iterations are already locked in for early next year with new capabilities and major performance and inference improvements like you've never seen on Meta Quest. 🚀 For now, learn more on the Meta Horizon OS Developer Center:
0:51

Hi XR devs! Big day today. v83 of the Meta XR SDK is officially out and it includes something very special to me 🦙. For the past 6 months we’ve been building AI Inference Building Blocks, which you may have seen teased at Meta Connect 2025. Our goal: keep the simplicity of Building Blocks while giving you the freedom to plug in any AI provider or model you want to power you apps with AI. More details and a full step-by-step guide are coming soon. And stay tuned as two more iterations are already locked in for early next year with new capabilities and major performance and inference improvements like you've never seen on Meta Quest. 🚀 For now, learn more on the Meta Horizon OS Developer Center:

Robi ᯅ

12,241 просмотров • 7 месяцев назад

🏀 Arcade Hoops is now available on the official Meta Horizon Store! 🚀 This was such a fun test: taking an idea and shipping it to the Meta Horizon Store in exactly 4 weeks. I built it using: - Meta VR CLI - Agentic Tools Repo, full of skills - Claude Code + VS Code - Unity 6 + Unity MCP - Meta XR Core + Meta ISDK + MRUK - OpenAI Image 2.0 for concept generation - Adobe Photoshop for all the store assets 💡Honestly, this project taught me so much about what modern VR/MR development workflows can look like when you combine Unity with our agentic workflows.
0:30

🏀 Arcade Hoops is now available on the official Meta Horizon Store! 🚀 This was such a fun test: taking an idea and shipping it to the Meta Horizon Store in exactly 4 weeks. I built it using: - Meta VR CLI - Agentic Tools Repo, full of skills - Claude Code + VS Code - Unity 6 + Unity MCP - Meta XR Core + Meta ISDK + MRUK - OpenAI Image 2.0 for concept generation - Adobe Photoshop for all the store assets 💡Honestly, this project taught me so much about what modern VR/MR development workflows can look like when you combine Unity with our agentic workflows.

Dilmer

25,908 просмотров • 1 месяц назад

Alright, here are the Indie Games of the Week 👇 So many insanely talented devs building right now - from solo creators to small teams. Honestly, it’s a privilege getting to connect with you all, read every comment, and watch every trailer. Thank you for engaging with me! If anything catches your eye, show the devs some love - like, comment, reshare and follow. That sort of support is everything for indie devs trying to build visibility. Featured in this spotlight (in order): Peter Brand - Wishlist The Void Manthos Lappas | ASTHENIA-Demo out now! Grey November Wilderings 🐝 Wishlist now! Nicholas McDonnell SlimyStudio Ryan Arata | Wishlist Gate Breaker: Ascension Roll Together | Wishlist on Steam! COVEN - Game Studio Abyss Of Doom
11:03

Alright, here are the Indie Games of the Week 👇 So many insanely talented devs building right now - from solo creators to small teams. Honestly, it’s a privilege getting to connect with you all, read every comment, and watch every trailer. Thank you for engaging with me! If anything catches your eye, show the devs some love - like, comment, reshare and follow. That sort of support is everything for indie devs trying to build visibility. Featured in this spotlight (in order): Peter Brand - Wishlist The Void Manthos Lappas | ASTHENIA-Demo out now! Grey November Wilderings 🐝 Wishlist now! Nicholas McDonnell SlimyStudio Ryan Arata | Wishlist Gate Breaker: Ascension Roll Together | Wishlist on Steam! COVEN - Game Studio Abyss Of Doom

Lockie

22,044 просмотров • 3 месяцев назад

Got introduced to , an AI code assistant specialised for Unity by Julian Park and after dabbling with it for a day, I am really impressed with how good it is for vibe coding on the Unity Game Engine. Bezi early impressions: - Bezi works direcly on Unity with a Plugin, this means that I don't need a Unity MCP - Because Bezi is built for Unity, the success rate of feature implementations is visibly higher than general coding models - It was able to integrate Unity store assets like a Weather system to this game pretty seamlessly - I was able to add a fishing database, lighting and weather systems into this game fairly quickly I'm very impressed with the results with Bezi so far. I feel that vibe coding a full indie game on Unity and releasing it on Steam, Mobile and Web is within reach. This also validates one thing that I have been suspecting: A specialised model designed for a specific use case can perform better than a general model at the particular domain. Very exciting!
0:30

Got introduced to , an AI code assistant specialised for Unity by Julian Park and after dabbling with it for a day, I am really impressed with how good it is for vibe coding on the Unity Game Engine. Bezi early impressions: - Bezi works direcly on Unity with a Plugin, this means that I don't need a Unity MCP - Because Bezi is built for Unity, the success rate of feature implementations is visibly higher than general coding models - It was able to integrate Unity store assets like a Weather system to this game pretty seamlessly - I was able to add a fishing database, lighting and weather systems into this game fairly quickly I'm very impressed with the results with Bezi so far. I feel that vibe coding a full indie game on Unity and releasing it on Steam, Mobile and Web is within reach. This also validates one thing that I have been suspecting: A specialised model designed for a specific use case can perform better than a general model at the particular domain. Very exciting!

Danny Limanseta

48,991 просмотров • 4 месяцев назад

I Built an AI Game Development Toolkit & Game Engine (and you can use it too) link in the comments This has been my every waking hour for the last 5 months... I think it's coming along nicely, with a lot still planned, Basically: it's an ever-expanding toolkit to help make asset creation and AI powered coding smoother and more streamlined for game devs. Hope you guys like and I'm entirely open to feature requests and suggestions - My goal is to make this suite as useful and streamlined as possible. #gamedev #aigamedev #vibecoding
2:58

I Built an AI Game Development Toolkit & Game Engine (and you can use it too) link in the comments This has been my every waking hour for the last 5 months... I think it's coming along nicely, with a lot still planned, Basically: it's an ever-expanding toolkit to help make asset creation and AI powered coding smoother and more streamlined for game devs. Hope you guys like and I'm entirely open to feature requests and suggestions - My goal is to make this suite as useful and streamlined as possible. #gamedev #aigamedev #vibecoding

DevDude

47,058 просмотров • 1 месяц назад

MIT engineers built an AI wristband that controls robots by reading your hand muscles. It works by using an ultrasound to capture images of the muscles and tendons in your wrist. An AI algorithm then translates those images into the exact position of all 5 fingers, tracking 22 different ways your hand can bend, twist, and extend. In demos, wearers directed a robotic hand to play piano just by moving their own fingers. To put the complexity in perspective, it takes: > 34 muscles > 27 joints > 100+ tendons ...Just to scroll your phone This device captures it all from a band the size of a smartwatch. They tested across 8 volunteers with different hand sizes, tracking everything from sign language letters to holding scissors. The team is now collecting data from hundreds more users to train robots in surgical procedures. Something like this could one day become the universal remote for robots and virtual worlds, and we're way closer than most people expect.
2:40

MIT engineers built an AI wristband that controls robots by reading your hand muscles. It works by using an ultrasound to capture images of the muscles and tendons in your wrist. An AI algorithm then translates those images into the exact position of all 5 fingers, tracking 22 different ways your hand can bend, twist, and extend. In demos, wearers directed a robotic hand to play piano just by moving their own fingers. To put the complexity in perspective, it takes: > 34 muscles > 27 joints > 100+ tendons ...Just to scroll your phone This device captures it all from a band the size of a smartwatch. They tested across 8 volunteers with different hand sizes, tracking everything from sign language letters to holding scissors. The team is now collecting data from hundreds more users to train robots in surgical procedures. Something like this could one day become the universal remote for robots and virtual worlds, and we're way closer than most people expect.

Rowan Cheung

27,999 просмотров • 3 месяцев назад

Finally, we have published Horizon OS UI Set for ISDK-Unity and Figma with the Interaction SDK v69 release on 10/9! This is our first public release of official UI components and design resources based on the Quest Design System. UI Set for Meta XR Interaction SDK: Figma Design file: By using UI Set, you can achieve consistent input modality support, visual feedback, and interaction behaviors. In addition to UI components and common UI pattern examples, theming capability can help you bring your own brand identity into your UI. We hope these UI Set Unity components + Figma design assets + Guideline docs - can help you designers, developers, and creators design, experiment, and build great spatial app experiences for Horizon OS platform. Including a personal blog post - How to build a simple spatial panel app with Meta Horizon OS UI Set, an image viewer with NASA Mars Rover API: #MetaQuest #MixedReality #MetaHorizonOS #InteractionSDK #MetaXRSDK #SpatialComputing
0:44

Finally, we have published Horizon OS UI Set for ISDK-Unity and Figma with the Interaction SDK v69 release on 10/9! This is our first public release of official UI components and design resources based on the Quest Design System. UI Set for Meta XR Interaction SDK: Figma Design file: By using UI Set, you can achieve consistent input modality support, visual feedback, and interaction behaviors. In addition to UI components and common UI pattern examples, theming capability can help you bring your own brand identity into your UI. We hope these UI Set Unity components + Figma design assets + Guideline docs - can help you designers, developers, and creators design, experiment, and build great spatial app experiences for Horizon OS platform. Including a personal blog post - How to build a simple spatial panel app with Meta Horizon OS UI Set, an image viewer with NASA Mars Rover API: #MetaQuest #MixedReality #MetaHorizonOS #InteractionSDK #MetaXRSDK #SpatialComputing

Yoon Park (박동윤)

59,115 просмотров • 1 год назад

This is Jump Ship. A 4 player co-op PvE indie game by a new indie studio created by Former Minecraft developers: - FPS PvE with Space Ship Combat - Seamlessly go on and off ship, into space exploration into enemy ships, the gameplay looks insanely impressive. - A variety hand crafted missions with random elements. "No two runs will be exactly the same" - Upgrade & Repir your ship - Scavenge for parts to upgrade or repair it, and adapt it to fit your needs. - Playable in both Solo and Coop - Coming to Xbox and PC (Unfortunately no PS5 release) - Demo available on Steam right now! This game looks genuinely incredible and I will definitely be trying out the demo as soon as I am free, there's a bunch of Hazelight (A Way Out, It Takes Two) developers on this as well, I really think this has the potential to be one of the biggest co-op games we've seen in a long time.
2:24

This is Jump Ship. A 4 player co-op PvE indie game by a new indie studio created by Former Minecraft developers: - FPS PvE with Space Ship Combat - Seamlessly go on and off ship, into space exploration into enemy ships, the gameplay looks insanely impressive. - A variety hand crafted missions with random elements. "No two runs will be exactly the same" - Upgrade & Repir your ship - Scavenge for parts to upgrade or repair it, and adapt it to fit your needs. - Playable in both Solo and Coop - Coming to Xbox and PC (Unfortunately no PS5 release) - Demo available on Steam right now! This game looks genuinely incredible and I will definitely be trying out the demo as soon as I am free, there's a bunch of Hazelight (A Way Out, It Takes Two) developers on this as well, I really think this has the potential to be one of the biggest co-op games we've seen in a long time.

Synth Potato🥔

198,701 просмотров • 1 год назад

Playing #VR games "without" a headset... ... Absolute genius or total abomination? This is called PortalVR and it lets you play any SteamVR game or app on your Windows PC without wearing a headset. Just plug in your #MetaQuest via USB, put it on your desk facing you, and use your controllers while facing your screen. The setup and connection is quite seamless and the team came up with a clever locomotion system to simulate turning the user's head by just tapping the top of the thumbstick. Now the biggest question is: does this make any sense? In my opinion, to play "standard" VR #games, it doesn't. You lose the beauty of being immersed and reaching out to grab objects or looking around can be tricky. On the other hand, I think there might be experiences specifically designed with this interaction in mind like interactive installations or educational experiences that could greatly benefit from a more tactile interface than a mouse and a keyboard
1:10

Playing #VR games "without" a headset... ... Absolute genius or total abomination? This is called PortalVR and it lets you play any SteamVR game or app on your Windows PC without wearing a headset. Just plug in your #MetaQuest via USB, put it on your desk facing you, and use your controllers while facing your screen. The setup and connection is quite seamless and the team came up with a clever locomotion system to simulate turning the user's head by just tapping the top of the thumbstick. Now the biggest question is: does this make any sense? In my opinion, to play "standard" VR #games, it doesn't. You lose the beauty of being immersed and reaching out to grab objects or looking around can be tricky. On the other hand, I think there might be experiences specifically designed with this interaction in mind like interactive installations or educational experiences that could greatly benefit from a more tactile interface than a mouse and a keyboard

Gabriele Romagnoli

66,345 просмотров • 7 месяцев назад

This is the latest Google research on XR Interaction: World Mouse. Instead of using hand rays or gestures to point at things in the physical space, you move a cursor with a mouse and the system figures out where that cursor should sit in the 3D world. It works in two main ways: - On an object, the cursor follows the surface, so you can move precisely across walls, screens, furniture, or virtual objects. - Between objects, the system creates a smooth bridge through space, so the cursor can travel from one surface to another. That means you can go from a 2D panel to a 3D object, place content on a real wall, manipulate virtual objects, or interact with physical devices through digital proxies. This is the type of news, tools and product updates I share weekly in my newsletter. If you are into 3D XR and AI make sure to check it out (link on top of my profile). Based on “World Mouse: Exploring Interactions with a Cross-Reality Cursor” by Esen K. Tütüncü, Mar Gonzalez-Franco, Khushman Patel, and Eric J. Gonzalez
0:42

This is the latest Google research on XR Interaction: World Mouse. Instead of using hand rays or gestures to point at things in the physical space, you move a cursor with a mouse and the system figures out where that cursor should sit in the 3D world. It works in two main ways: - On an object, the cursor follows the surface, so you can move precisely across walls, screens, furniture, or virtual objects. - Between objects, the system creates a smooth bridge through space, so the cursor can travel from one surface to another. That means you can go from a 2D panel to a 3D object, place content on a real wall, manipulate virtual objects, or interact with physical devices through digital proxies. This is the type of news, tools and product updates I share weekly in my newsletter. If you are into 3D XR and AI make sure to check it out (link on top of my profile). Based on “World Mouse: Exploring Interactions with a Cross-Reality Cursor” by Esen K. Tütüncü, Mar Gonzalez-Franco, Khushman Patel, and Eric J. Gonzalez

Gabriele Romagnoli

28,945 просмотров • 3 месяцев назад

THIS GUY BUILT REAL FLYING SWORD DRONES AND CONTROLS THEM WITH HAND GESTURES fan shisan is a physics student in chengdu who coded and built flying drones shaped like actual swords he controls them entirely with hand gestures. no controller or a phone. just his hands wave your hand and the sword follows. point and it flies where you direct it. multiple swords in the air at the same time responding to different gestures he built the gesture recognition system HIMSELF and coded the flight control algorithms. designed the drone hardware in the shape of swords. the gesture tracking uses sensors that read the position and movement of his hands in real time and translate them into flight commands for each drone independently he even built one large enough to ride on a physics student with coding skills just brought something straight out of a kung fu movie into the real world the line between science fiction and side projects is getting thinner every month
0:23

THIS GUY BUILT REAL FLYING SWORD DRONES AND CONTROLS THEM WITH HAND GESTURES fan shisan is a physics student in chengdu who coded and built flying drones shaped like actual swords he controls them entirely with hand gestures. no controller or a phone. just his hands wave your hand and the sword follows. point and it flies where you direct it. multiple swords in the air at the same time responding to different gestures he built the gesture recognition system HIMSELF and coded the flight control algorithms. designed the drone hardware in the shape of swords. the gesture tracking uses sensors that read the position and movement of his hands in real time and translate them into flight commands for each drone independently he even built one large enough to ride on a physics student with coding skills just brought something straight out of a kung fu movie into the real world the line between science fiction and side projects is getting thinner every month

Om Patel

307,321 просмотров • 1 месяц назад

For the past five years, I have been working on building a company I truly believe has the power to disrupt Hollywood and empower indie artists. It’s called LOOR TV, pronounced like “Folklore.” The goal is simple: Allow pure indie creators to pitch their dream projects directly to paying monthly subscribers. Instead of the monthly subscription dollars going to executives who control gatekeeping and influence, we let the monthly subscribers fund indie artists directly. Our focus is on good stories that mainstream Hollywood would reject. Your monthly subscription converts into weekly amounts of our own in-game-style currency, which creators can cash out to fund their projects. When a project is fully funded and completed, it streams on the platform. Of course, you can always directly fund artists without a monthly subscription. The point is that the audience builds the streaming library. The audience is the rightful gatekeeper. We’ve proven this patronage streaming model allows us to make more money per subscriber than Netflix or Disney+ can per month. It also gives us the least risk of any entertainment company because all content is funded by the audience, not multi-million-dollar checks written by executives making big bets in advance. Our company profits via each transaction. Exactly like most video game currency stores. Gamification brings in more revenue than Hollywood. And younger generations are familiar with how that works already. The goal is not to make multi-million-dollar box office films, but to incubate a new underground counterculture to Hollywood. The same indie culture that built MTV, Channel 101, and Adult Swim. It gives new artists, whether they are traditional or AI filmmakers, animators, comedians, or video game designers, a way to pitch their projects directly to real people, not algorithms. A way for artists to retain creative control. We’ve been testing this for a while. Our CEO, Shon Tomlin, built FUEL TV for Fox Cable Networks and is no stranger to indie filmmaking and monetizing subcultures. I truly believe this is the way forward: directly putting people who love films in front of people who love making them, and letting the audience choose where their money goes. We’re very early and have lots of plans for how to use this new gamified streaming platform. We have an incredible team, but we need help spreading the word and proving that people believe in this model so we can raise capital to focus on scaling this full-time. Here’s a preview of everything we’ve premiered and pitched to our audience so far. We are just getting started.
1:15

For the past five years, I have been working on building a company I truly believe has the power to disrupt Hollywood and empower indie artists. It’s called LOOR TV, pronounced like “Folklore.” The goal is simple: Allow pure indie creators to pitch their dream projects directly to paying monthly subscribers. Instead of the monthly subscription dollars going to executives who control gatekeeping and influence, we let the monthly subscribers fund indie artists directly. Our focus is on good stories that mainstream Hollywood would reject. Your monthly subscription converts into weekly amounts of our own in-game-style currency, which creators can cash out to fund their projects. When a project is fully funded and completed, it streams on the platform. Of course, you can always directly fund artists without a monthly subscription. The point is that the audience builds the streaming library. The audience is the rightful gatekeeper. We’ve proven this patronage streaming model allows us to make more money per subscriber than Netflix or Disney+ can per month. It also gives us the least risk of any entertainment company because all content is funded by the audience, not multi-million-dollar checks written by executives making big bets in advance. Our company profits via each transaction. Exactly like most video game currency stores. Gamification brings in more revenue than Hollywood. And younger generations are familiar with how that works already. The goal is not to make multi-million-dollar box office films, but to incubate a new underground counterculture to Hollywood. The same indie culture that built MTV, Channel 101, and Adult Swim. It gives new artists, whether they are traditional or AI filmmakers, animators, comedians, or video game designers, a way to pitch their projects directly to real people, not algorithms. A way for artists to retain creative control. We’ve been testing this for a while. Our CEO, Shon Tomlin, built FUEL TV for Fox Cable Networks and is no stranger to indie filmmaking and monetizing subcultures. I truly believe this is the way forward: directly putting people who love films in front of people who love making them, and letting the audience choose where their money goes. We’re very early and have lots of plans for how to use this new gamified streaming platform. We have an incredible team, but we need help spreading the word and proving that people believe in this model so we can raise capital to focus on scaling this full-time. Here’s a preview of everything we’ve premiered and pitched to our audience so far. We are just getting started.

Marcus Pittman

16,992 просмотров • 3 месяцев назад

I recreated Meta’s new AI Glasses on my Quest, and the complete source code is available! 👓 Hey everyone! I’ve received a lot of feedback and messages about my latest project, where I used the Quest to recreate the features shown during Meta’s keynote. To answer your questions I decided to create a cool video to explain how I built it but also, share the full source code on Patreon 👇 Watch the making-of: Download the source code: This project includes: ✨ A UI navigable with microgestures 🤏 A pinch & twist hand-tracking input system 🎧 An audio player with volume control via pinch & twist 📸 A camera that zooms with pinch & twist 🖼️ A carousel to browse captured pictures 🧠 And a contextual AI that reacts to what you’re looking at Hope you guys will like it and that it will help you on your own project!! 😊
0:43

I recreated Meta’s new AI Glasses on my Quest, and the complete source code is available! 👓 Hey everyone! I’ve received a lot of feedback and messages about my latest project, where I used the Quest to recreate the features shown during Meta’s keynote. To answer your questions I decided to create a cool video to explain how I built it but also, share the full source code on Patreon 👇 Watch the making-of: Download the source code: This project includes: ✨ A UI navigable with microgestures 🤏 A pinch & twist hand-tracking input system 🎧 An audio player with volume control via pinch & twist 📸 A camera that zooms with pinch & twist 🖼️ A carousel to browse captured pictures 🧠 And a contextual AI that reacts to what you’re looking at Hope you guys will like it and that it will help you on your own project!! 😊

Quentin Valembois

15,977 просмотров • 9 месяцев назад

Build and customize complex AI applications with a flexible framework in this new short course, Building AI Applications with Haystack. Created in collaboration with deepset, makers of Haystack, and taught by Tuana, who is the developer relations lead for Haystack at deepset. Generative AI technology is changing rapidly and it can be challenging to integrate APIs from different LLMs, vector databases, and various tools such as web search. In this course, you will learn how to use the Haystack framework to make your development process more modular, allowing you to manage complexity and focus more on building your application. In detail, you’ll: - Build a RAG pipeline using Haystack’s main building blocks – components, pipelines, and document stores. - Create custom components in your pipeline by building a Hacker News summarizer that extends your app’s ability to access APIs. - Use conditional routing to create a branching pipeline with a fallback to web search mechanism when the LLM does not have the necessary context to respond to the user's query. - Build a self-reflecting agent for named entity recognition that loops using an output validator custom component. - Create a chat agent using OpenAI's function-calling capabilities which allow you to provide Haystack pipelines as tools to the LLM, enhancing that agent's capabilities. By the end of this course, you will learn a high-level orchestration framework that can help make your applications flexible, extendible, and maintainable, even as the technology stack changes, new user needs arise, and you add new features to your application. Please sign up here:
3:31

Build and customize complex AI applications with a flexible framework in this new short course, Building AI Applications with Haystack. Created in collaboration with deepset, makers of Haystack, and taught by Tuana, who is the developer relations lead for Haystack at deepset. Generative AI technology is changing rapidly and it can be challenging to integrate APIs from different LLMs, vector databases, and various tools such as web search. In this course, you will learn how to use the Haystack framework to make your development process more modular, allowing you to manage complexity and focus more on building your application. In detail, you’ll: - Build a RAG pipeline using Haystack’s main building blocks – components, pipelines, and document stores. - Create custom components in your pipeline by building a Hacker News summarizer that extends your app’s ability to access APIs. - Use conditional routing to create a branching pipeline with a fallback to web search mechanism when the LLM does not have the necessary context to respond to the user's query. - Build a self-reflecting agent for named entity recognition that loops using an output validator custom component. - Create a chat agent using OpenAI's function-calling capabilities which allow you to provide Haystack pipelines as tools to the LLM, enhancing that agent's capabilities. By the end of this course, you will learn a high-level orchestration framework that can help make your applications flexible, extendible, and maintainable, even as the technology stack changes, new user needs arise, and you add new features to your application. Please sign up here:

Andrew Ng

53,788 просмотров • 1 год назад

Prototyped another iteration of a hand-tracking-based BoxelXR toolbar. This time, it's a circular menu spawned in front of a user once the index pinch is triggered. Notes: 1) It works great with four elements, but it's hard to scale for a higher number; 2) The selection interaction is forgiving for spatial positioning errors. This is because a 3D hand span is interpreted through a 1D angle range (a 1D subspace in the polar coordinate system of 2D projection space, which is a subspace of the 3D space of the experience, respectively). This prevents false positives and makes it easy for users to execute. Precise muscle coordination is not required, either. Design tip: Lower the dimensionality of your interaction to reduce cognitive loads and make it more accessible. 3) Using depth-based animations to show different UI states is a great way to leverage the third dimension and add something interesting to the experience. But be careful. When the UI faces a user's face, the contrast in the motion might be low, so use it only as an additional layer. In this prototype, color coding is the primary way to mark changes in a UI state. ⬇️🐙🐱 Download the prototype — #handtracking #xrinteraction #xri #xr #virtualreality #csharp #unity3d #prototyping #spatialcomputing #spatialdesign #spatialui #ux #ui #xrdevelopment
0:25

Prototyped another iteration of a hand-tracking-based BoxelXR toolbar. This time, it's a circular menu spawned in front of a user once the index pinch is triggered. Notes: 1) It works great with four elements, but it's hard to scale for a higher number; 2) The selection interaction is forgiving for spatial positioning errors. This is because a 3D hand span is interpreted through a 1D angle range (a 1D subspace in the polar coordinate system of 2D projection space, which is a subspace of the 3D space of the experience, respectively). This prevents false positives and makes it easy for users to execute. Precise muscle coordination is not required, either. Design tip: Lower the dimensionality of your interaction to reduce cognitive loads and make it more accessible. 3) Using depth-based animations to show different UI states is a great way to leverage the third dimension and add something interesting to the experience. But be careful. When the UI faces a user's face, the contrast in the motion might be low, so use it only as an additional layer. In this prototype, color coding is the primary way to mark changes in a UI state. ⬇️🐙🐱 Download the prototype — #handtracking #xrinteraction #xri #xr #virtualreality #csharp #unity3d #prototyping #spatialcomputing #spatialdesign #spatialui #ux #ui #xrdevelopment

Oleg Frolov

11,746 просмотров • 2 лет назад

📣 𝗖𝗮𝗹𝗹 𝗳𝗼𝗿 𝗿𝗲𝘀𝗲𝗮𝗿𝗰𝗵 𝗶𝗻𝘀𝘁𝗶𝘁𝘂𝘁𝗶𝗼𝗻𝘀 𝗮𝗻𝗱 𝗰𝗼𝗿𝗽𝗼𝗿𝗮𝘁𝗲𝘀 with projects and use cases focusing on the intersection of XR+AI! With Meta's release of 𝗣𝗿𝗼𝗷𝗲𝗰𝘁 𝗔𝗿𝗶𝗮 𝗥𝗲𝘀𝗲𝗮𝗿𝗰𝗵 𝗞𝗶𝘁, your innovators will work with XR Bootcamp, 𝗫𝗥 𝗣𝗿𝗼 𝗖𝗼𝗹𝗹𝗲𝗰𝘁𝗶𝘃𝗲 and xraihack's greatest minds who have already built over 𝟮𝟲 𝗔𝗜-𝗽𝗼𝘄𝗲𝗿𝗲𝗱 𝗫𝗥 𝗽𝗿𝗼𝗷𝗲𝗰𝘁𝘀 to date on various use cases and will get the chance to make use of this new kit. Retweet or comment below if you are interested! We are also planning to unlock funding opportunities for promising projects with the help of our regional partners. So many use cases to explore like embodied AI, contextualized AI, human-computer interaction (HCI), robotics, and more... There is no better time to start your first 100% context-aware projects or apps than today! More details about Meta Reality Labs announcement: Aria Research Kit includes: - Aria Glasses - Machine Perception Cloud Services - Client SDK and Companion app
2:20

📣 𝗖𝗮𝗹𝗹 𝗳𝗼𝗿 𝗿𝗲𝘀𝗲𝗮𝗿𝗰𝗵 𝗶𝗻𝘀𝘁𝗶𝘁𝘂𝘁𝗶𝗼𝗻𝘀 𝗮𝗻𝗱 𝗰𝗼𝗿𝗽𝗼𝗿𝗮𝘁𝗲𝘀 with projects and use cases focusing on the intersection of XR+AI! With Meta's release of 𝗣𝗿𝗼𝗷𝗲𝗰𝘁 𝗔𝗿𝗶𝗮 𝗥𝗲𝘀𝗲𝗮𝗿𝗰𝗵 𝗞𝗶𝘁, your innovators will work with XR Bootcamp, 𝗫𝗥 𝗣𝗿𝗼 𝗖𝗼𝗹𝗹𝗲𝗰𝘁𝗶𝘃𝗲 and xraihack's greatest minds who have already built over 𝟮𝟲 𝗔𝗜-𝗽𝗼𝘄𝗲𝗿𝗲𝗱 𝗫𝗥 𝗽𝗿𝗼𝗷𝗲𝗰𝘁𝘀 to date on various use cases and will get the chance to make use of this new kit. Retweet or comment below if you are interested! We are also planning to unlock funding opportunities for promising projects with the help of our regional partners. So many use cases to explore like embodied AI, contextualized AI, human-computer interaction (HCI), robotics, and more... There is no better time to start your first 100% context-aware projects or apps than today! More details about Meta Reality Labs announcement: Aria Research Kit includes: - Aria Glasses - Machine Perception Cloud Services - Client SDK and Companion app

XR Bootcamp

14,243 просмотров • 1 год назад