Loading video...

Video Failed to Load

There was a problem loading this video. This could be due to a temporary network issue or the video might be unavailable.

Made another prototype to explore how you can create a voxel with hand-tracking. When you push the main voxel, it generates “wireframe” voxels along its path. The interaction itself feels fun and effortless, but it requires generated voxels to be in a wireframe or ghost mode to avoid overlapping... show more

Oleg Frolov

7,062 subscribers

51,552 views • 5 months ago •via X (Twitter)

Anya Rossi• Live Now

Private livecam show

0 Comments

No comments available

Comments from the original post will appear here

Related Videos

I've made a bunch of optimizations to the voxel simulations in Lay of the Land. Thousands of moving voxels can now be simulated with little performance loss. Also you can now become buried in sand. #gamedev #indiedev #voxelgame #voxelart #voxel #procedural #UnrealEngine

I've made a bunch of optimizations to the voxel simulations in Lay of the Land. Thousands of moving voxels can now be simulated with little performance loss. Also you can now become buried in sand. #gamedev #indiedev #voxelgame #voxelart #voxel #procedural #UnrealEngine

Tooley1998

319,791 views • 1 year ago

#VRAGE3 water system listens to voxel edits and adjusts its flow when needed. Here you can see a hole made into the mountain lake's shore: it starts leaking water towards the sea below. What would YOU do with voxel edits and water?

#VRAGE3 water system listens to voxel edits and adjusts its flow when needed. Here you can see a hole made into the mountain lake's shore: it starts leaking water towards the sea below. What would YOU do with voxel edits and water?

Jan Hloušek

23,188 views • 2 years ago

You can now experience Apple Maps using Gaussian splats on Apple Vision Pro. Looking forward to the day when we can walk these streets and explore buildings in a fully immersive mode, alone or with other Personas.

You can now experience Apple Maps using Gaussian splats on Apple Vision Pro. Looking forward to the day when we can walk these streets and explore buildings in a fully immersive mode, alone or with other Personas.

Nathie

28,197 views • 1 month ago

Started experimenting with hand-tracking-based interactions for my little voxel editor – BoxelXR. There are a lot of things to tune, but overall it feels good. Though it would require some decent work in sound design to compensate for the lack of haptic feedback.

Started experimenting with hand-tracking-based interactions for my little voxel editor – BoxelXR. There are a lot of things to tune, but overall it feels good. Though it would require some decent work in sound design to compensate for the lack of haptic feedback.

Oleg Frolov

915,010 views • 8 months ago

🦯 How to help visually impaired people easily navigate through everyday life with the Apple Vision Pro? I know it's not the expected use case of an XR headset, but you can do it with real-time meshing, hand tracking, and spatial audio.

🦯 How to help visually impaired people easily navigate through everyday life with the Apple Vision Pro? I know it's not the expected use case of an XR headset, but you can do it with real-time meshing, hand tracking, and spatial audio.

Stijn Spanhove

21,808 views • 2 years ago

Your phone is a tracking device. But you CAN take back control. Switching to GrapheneOS can stop your data constantly flowing to Apple or Google. Here’s how to install it and set it up.

Your phone is a tracking device. But you CAN take back control. Switching to GrapheneOS can stop your data constantly flowing to Apple or Google. Here’s how to install it and set it up.

Naomi Brockwell priv/acc

57,173 views • 4 months ago

I loved being one of the first directors to use Apple Vision Pro! I was completely blown away with how it helps you play, create, and explore new worlds. Watch Wicked now on the Apple TV app, and experience it in 3D on Apple Vision Pro.

I loved being one of the first directors to use Apple Vision Pro! I was completely blown away with how it helps you play, create, and explore new worlds. Watch Wicked now on the Apple TV app, and experience it in 3D on Apple Vision Pro.

Jon M. Chu

378,694 views • 1 year ago

Hand Menu Interaction. The simplest trick to improve the accessibility of floating hand-attached UI panels for spatial interactions is to smooth their movement. It allows us to stabilize them and mitigate a hand tremor due to hand-tracking imperfection and/or physiological condition. (Interestingly, the visual stabilization helps reduce the physical tremor itself. I guess it normalizes the hand muscles/brain feedback loop when you target the interactables). By the way, if you are curious about how to design and prototype spatial hand-tracking-based interactions like this — join my little workshop at Hatch Conference. #handtracking #prototyping #menuinteraction #interactiondesign #spatialdesign #spatialcomputing #mixedreality #vr #virtualreality #xr #metaquest #uxdesign #uidesign #spatialui

Hand Menu Interaction. The simplest trick to improve the accessibility of floating hand-attached UI panels for spatial interactions is to smooth their movement. It allows us to stabilize them and mitigate a hand tremor due to hand-tracking imperfection and/or physiological condition. (Interestingly, the visual stabilization helps reduce the physical tremor itself. I guess it normalizes the hand muscles/brain feedback loop when you target the interactables). By the way, if you are curious about how to design and prototype spatial hand-tracking-based interactions like this — join my little workshop at Hatch Conference. #handtracking #prototyping #menuinteraction #interactiondesign #spatialdesign #spatialcomputing #mixedreality #vr #virtualreality #xr #metaquest #uxdesign #uidesign #spatialui

Oleg Frolov

27,218 views • 2 years ago

Codex is unusable. I generated one image with GPT Image 2.0, gave it to Codex, and used one simple prompt: “Create me a web game from this image.” You give it a simple image like this, and suddenly you realize you can build: • a voxel map • an editor • tile animations • a playable browser prototype This is getting ridiculous.

Codex is unusable. I generated one image with GPT Image 2.0, gave it to Codex, and used one simple prompt: “Create me a web game from this image.” You give it a simple image like this, and suddenly you realize you can build: • a voxel map • an editor • tile animations • a playable browser prototype This is getting ridiculous.

Givros

83,052 views • 2 months ago

jihoon wants us to promise to have more fun at treasure concerts, film with your left hand and have fun with your right hand 🤙🏻 #지훈 🐶 you’re asking how yesterday was? yesterday was seriously so fun. it really was fun, but hmmm you guys need to have even more fun.. 🐶 you guys need to have more fun. teumes can def go harder than this, but you’re holding back. you guys can def do more, seriously, you really can but everyone kind of hesitates a little. just go out there and enjoy the atmosphere, got it? ok~? 🐶 i’m not saying don’t film or anything like that. you can film, it’s fine, i don’t mind it, because i think that’s the fans’ freedom. but i mean… film with one hand, your left hand, and use your right hand to hold your lightstick and have fun 🐶 but when both hands are on your phone like this… and i’m right in front of you… why are you looking at me through a camera filter first? you came to see me, so why… when i’m standing right in front of you, are you still only looking at me through your phone? it’s just a little disappointing to me 🐶 i’m not saying anyone is doing something wrong or anything like that, i’m just saying it feels a bit sad. i’m literally right in front of you, so why are you still looking at me inside your phone even when i’m right here? 🐶 and i know you want to take pictures, it’s okay. you can film it, keep it. it’s fine, because it’s not prohibited. in concerts where filming isn’t banned, ofc you can film. you want to take photos. ofc you want to take photos when your favorite singer is right in front of you, ofc you want to film it. i know that, we all know that. you can film it but film with your left hand and have fun with your right hand. let’s all make that promise. seriously, let’s really do it, film with your left hand and have fun with your right hand 🐶 because… when i’m like this, from up on stage when we look out like this, your gazes, your lightsticks, those kinds of things... when i feel like i’m directly interacting with each and every one of you like that.. i get out of breath like i might die, i get dizzy and everything, and my adrenaline gets pushed to the limit. but then if it’s all just iphone 17 pro maxes everywhere… it feels a bit disappointing 🐶 but i really do like that you film. i just feel a little regretful like if you film with one hand and have fun with the other.. like use your right hand properly to have fun, and use your left hand to film and capture everything… that’s how it should be, i guess. that kind of feeling 🐶 i’m not saying this to hear sorry from you guys. that’s not what i mean. i’m not saying you’re doing anything wrong, i just mean let’s all have fun together like that 💬 but oppa, if you’re playing with your right hand, the video in your left hand does get shaky so i just jump around and go all out 🐶 but even that shaking… i think of it as part of the live feeling

jihoon wants us to promise to have more fun at treasure concerts, film with your left hand and have fun with your right hand 🤙🏻 #지훈 🐶 you’re asking how yesterday was? yesterday was seriously so fun. it really was fun, but hmmm you guys need to have even more fun.. 🐶 you guys need to have more fun. teumes can def go harder than this, but you’re holding back. you guys can def do more, seriously, you really can but everyone kind of hesitates a little. just go out there and enjoy the atmosphere, got it? ok~? 🐶 i’m not saying don’t film or anything like that. you can film, it’s fine, i don’t mind it, because i think that’s the fans’ freedom. but i mean… film with one hand, your left hand, and use your right hand to hold your lightstick and have fun 🐶 but when both hands are on your phone like this… and i’m right in front of you… why are you looking at me through a camera filter first? you came to see me, so why… when i’m standing right in front of you, are you still only looking at me through your phone? it’s just a little disappointing to me 🐶 i’m not saying anyone is doing something wrong or anything like that, i’m just saying it feels a bit sad. i’m literally right in front of you, so why are you still looking at me inside your phone even when i’m right here? 🐶 and i know you want to take pictures, it’s okay. you can film it, keep it. it’s fine, because it’s not prohibited. in concerts where filming isn’t banned, ofc you can film. you want to take photos. ofc you want to take photos when your favorite singer is right in front of you, ofc you want to film it. i know that, we all know that. you can film it but film with your left hand and have fun with your right hand. let’s all make that promise. seriously, let’s really do it, film with your left hand and have fun with your right hand 🐶 because… when i’m like this, from up on stage when we look out like this, your gazes, your lightsticks, those kinds of things... when i feel like i’m directly interacting with each and every one of you like that.. i get out of breath like i might die, i get dizzy and everything, and my adrenaline gets pushed to the limit. but then if it’s all just iphone 17 pro maxes everywhere… it feels a bit disappointing 🐶 but i really do like that you film. i just feel a little regretful like if you film with one hand and have fun with the other.. like use your right hand properly to have fun, and use your left hand to film and capture everything… that’s how it should be, i guess. that kind of feeling 🐶 i’m not saying this to hear sorry from you guys. that’s not what i mean. i’m not saying you’re doing anything wrong, i just mean let’s all have fun together like that 💬 but oppa, if you’re playing with your right hand, the video in your left hand does get shaky so i just jump around and go all out 🐶 but even that shaking… i think of it as part of the live feeling

행복지수 314%

23,355 views • 2 months ago

Let a friend or family member experience your Apple Vision Pro. You can let someone experience your Apple Vision Pro, and they can save their data for 30 days if they’re going to use it again. Here’s how it works in #visionOS2.

Let a friend or family member experience your Apple Vision Pro. You can let someone experience your Apple Vision Pro, and they can save their data for 30 days if they’re going to use it again. Here’s how it works in #visionOS2.

Apple Support

55,343 views • 1 year ago

Indiedev day 79: retro wireframe renderer with trackball functionality! As someone noted, my retro UI was missing rotating wireframes, I added one! In the drone loaout screen you can now see a very low poly version of the drone in proper retro fashion! I created a cross platform wireframe renderer and trackball funcionality to interact with the mesh. For fun I also made a world space position floor function for the mesh vertexes so that the mesh jitters a bit when it rotates, mimicking the unstable 3D geometry from games in the 80s and before. The UI is still completely unfinished, but I decided to post the cool wireframe feature as I just finished it today. #indiegame #buildinpublic

Indiedev day 79: retro wireframe renderer with trackball functionality! As someone noted, my retro UI was missing rotating wireframes, I added one! In the drone loaout screen you can now see a very low poly version of the drone in proper retro fashion! I created a cross platform wireframe renderer and trackball funcionality to interact with the mesh. For fun I also made a world space position floor function for the mesh vertexes so that the mesh jitters a bit when it rotates, mimicking the unstable 3D geometry from games in the 80s and before. The UI is still completely unfinished, but I decided to post the cool wireframe feature as I just finished it today. #indiegame #buildinpublic

Jussi Kemppainen | Drivers of the Apocalypse

12,562 views • 2 years ago

You guys are gonna love my app, Mirage. Fully wireless peer to peer screen sharing (like Sidecar) at pixel perfect streaming. 120fps, Display P3, up to 5k (supports the Studio Display). It resizes the stream to be exactly the window size on your client (iPad, Vision Pro, or another Mac). Can work wired. Here’s the real kicker, you can stream individual windows and have it be more cohesive with iPadOS. Just want Xcode and Terminal? Stream both every window from Xcode and Terminal as separate windows on your device as if they’re running directly on your device

You guys are gonna love my app, Mirage. Fully wireless peer to peer screen sharing (like Sidecar) at pixel perfect streaming. 120fps, Display P3, up to 5k (supports the Studio Display). It resizes the stream to be exactly the window size on your client (iPad, Vision Pro, or another Mac). Can work wired. Here’s the real kicker, you can stream individual windows and have it be more cohesive with iPadOS. Just want Xcode and Terminal? Stream both every window from Xcode and Terminal as separate windows on your device as if they’re running directly on your device

Ethan Lipnik

503,268 views • 6 months ago

pazu's the main character! and you HAVE to like him :) things got out of hand with this one i didn't mean to like. work on it this hard or for this long. but i had a lot of fun with it and i hope you enjoy ghost boy being insufferable as ever 🤍

Sensitive content

pazu's the main character! and you HAVE to like him :) things got out of hand with this one i didn't mean to like. work on it this hard or for this long. but i had a lot of fun with it and i hope you enjoy ghost boy being insufferable as ever 🤍

dr. mochi

108,169 views • 2 years ago

The news doesn’t stop there – GitHub Copilot is also gaining a new sense: Sight 👀👀👀 With vision for GitHub Copilot, you can use images, like a napkin sketch or a Figma wireframe, to give Copilot instructions and inspiration. Check it out:

The news doesn’t stop there – GitHub Copilot is also gaining a new sense: Sight 👀👀👀 With vision for GitHub Copilot, you can use images, like a napkin sketch or a Figma wireframe, to give Copilot instructions and inspiration. Check it out:

Thomas Dohmke

107,269 views • 1 year ago

After I shared my prototype with an AR Camera Portal, a few people asked me what would happen if it was not a camera stream, but the scene itself was attached to the portal with all the physics affected. Good question! I made a quick prototype to test it. And the answer... You can see it! It's FUN. Of course, the behavior might seem wholly messed up, but when one sees a failure, another sees an opportunity. You might be able to leverage these two modes to activate some game mechanics, like solving puzzles or repurposing your weaponry. #mixedreality #prototyping #spatialcomputing #3dmath #xr #xrdesign #xrdevelopment

After I shared my prototype with an AR Camera Portal, a few people asked me what would happen if it was not a camera stream, but the scene itself was attached to the portal with all the physics affected. Good question! I made a quick prototype to test it. And the answer... You can see it! It's FUN. Of course, the behavior might seem wholly messed up, but when one sees a failure, another sees an opportunity. You might be able to leverage these two modes to activate some game mechanics, like solving puzzles or repurposing your weaponry. #mixedreality #prototyping #spatialcomputing #3dmath #xr #xrdesign #xrdevelopment

Oleg Frolov

54,355 views • 1 year ago

With Google Flow Tools, you can now use natural language to create bespoke tools and workflows. In this video, you'll see how you can: ➡️ Explore and try the various Tools within Google Flow ➡️ Remix a tool to make it even more relevant for your unique workflow ➡️Create your own tool from scratch with a natural language prompt ➡️ Share your tools with a friend for them to try out Whether you’re looking for an image editor, video resizer or custom shaders, you can now create them in Google Flow, no coding experience required.

With Google Flow Tools, you can now use natural language to create bespoke tools and workflows. In this video, you'll see how you can: ➡️ Explore and try the various Tools within Google Flow ➡️ Remix a tool to make it even more relevant for your unique workflow ➡️Create your own tool from scratch with a natural language prompt ➡️ Share your tools with a friend for them to try out Whether you’re looking for an image editor, video resizer or custom shaders, you can now create them in Google Flow, no coding experience required.

Google Flow

19,473 views • 1 month ago

Here is another haptic feedback experiment with hand tracking. This time there are more boxes! Or cuboids, for greater scientific rigor. I tried using different haptic patterns for different hover effects — it worked very well. Really, haptics are a missing piece in the hand-tracking experience to make it feel solid. Tools: Unity3D + C# MR Device: Quest3 Haptic device: HapticLabs's Prototyping Kit Music: PO-12 and Orchid

Here is another haptic feedback experiment with hand tracking. This time there are more boxes! Or cuboids, for greater scientific rigor. I tried using different haptic patterns for different hover effects — it worked very well. Really, haptics are a missing piece in the hand-tracking experience to make it feel solid. Tools: Unity3D + C# MR Device: Quest3 Haptic device: HapticLabs's Prototyping Kit Music: PO-12 and Orchid

Oleg Frolov

50,326 views • 7 months ago

With ChatGPT Work, you can kick off cloud tasks directly from the desktop or mobile app. It can use your configured plugins to work across your repos, docs, Slack, and the other tools you already use. I use it constantly from my phone: hand off a task, let it run asynchronously in the cloud, and come back when the work is done.

With ChatGPT Work, you can kick off cloud tasks directly from the desktop or mobile app. It can use your configured plugins to work across your repos, docs, Slack, and the other tools you already use. I use it constantly from my phone: hand off a task, let it run asynchronously in the cloud, and come back when the work is done.

Vaibhav (VB) Srivastav

37,684 views • 10 days ago

Added an AR Display to my phone joystick. It smoothly follows your hand's position. You can also switch to a big screen view. It will move along your sight direction and stay static. In future iterations, I will add a dedicated section in the phone app to control it (distance, size, surface snapping, anchoring, etc.). Another thing to try is to replace a video stream with a portal of the game itself. Originally, I started developing this prototype for the Quest platform, but now I realize that it makes more sense in Apple's ecosystem since they already have cross-device mirroring functionality, and what I showed would be a logical extension of their approach. I probably need to rewrite it for Vision Pro 😊

Added an AR Display to my phone joystick. It smoothly follows your hand's position. You can also switch to a big screen view. It will move along your sight direction and stay static. In future iterations, I will add a dedicated section in the phone app to control it (distance, size, surface snapping, anchoring, etc.). Another thing to try is to replace a video stream with a portal of the game itself. Originally, I started developing this prototype for the Quest platform, but now I realize that it makes more sense in Apple's ecosystem since they already have cross-device mirroring functionality, and what I showed would be a logical extension of their approach. I probably need to rewrite it for Vision Pro 😊

Oleg Frolov

35,822 views • 1 year ago