Loading video...

Video Failed to Load

There was a problem loading this video. This could be due to a temporary network issue or the video might be unavailable.

Made another prototype to explore how you can create a voxel with hand-tracking. When you push the main voxel, it generates “wireframe” voxels along its path. The interaction itself feels fun and effortless, but it requires generated voxels to be in a wireframe or ghost mode to avoid overlapping... show more

Oleg Frolov

7,116 subscribers

51,742 views • 9 months ago •via X (Twitter)

Anya Rossi• Live Now

Private livecam show

24 Comments

Sherry Jiang9 months ago

wow gorgeous

Sebastian Buzdugan9 months ago

wireframe mode is clever, keeps depth cues readable

cloud platform anatomy9 months ago

hand tracking + voxels is such a satisfying combo. wireframe ghosts to avoid hand overlap feels like a smart constraint not a hack. vision pro interactions are getting playful 🤯

Jon Kakaley9 months ago

love how this is evolving!

HashP100D9 months ago

Can you make a 3d btc chart

∞9 months ago

CRazy

Doeon Kwon9 months ago

you made really cool thing

Eddie Hudson9 months ago

Dude this is rad

AK9 months ago

wow this looks awesome

Brian Chew9 months ago

this is so coool!

Sajyd Rajput9 months ago

Mind-blowing 🤯

Evolves Studios9 months ago

Wow

Chirag Gadhvi9 months ago

Is this using VR

Dominion9 months ago

I feel like 3d snake would be a good test for this interaction wise

Raunak Singh Jolly9 months ago

wow that looks fun

#STARTABUSINESS 🚢➿💬🖥️🪽9 months ago

🌐

T10009 months ago

Cyberpunk to the core

Vision Monk Pro ☸️ ᯅ9 months ago

Very cool!

nicolas9 months ago

Sickkk

Jordan V.9 months ago

😃

Yeab - engg / core was in Palo Alto🌴9 months ago

cool

Framer Geeks9 months ago

That sounds fascinating, Oleg! The interplay of hand-tracking and voxel creation seems innovative.

Scarlet 𓃦9 months ago

Looks fun :o

Maktabi Jr.9 months ago

Wow

Related Videos

I've made a bunch of optimizations to the voxel simulations in Lay of the Land. Thousands of moving voxels can now be simulated with little performance loss. Also you can now become buried in sand. #gamedev #indiedev #voxelgame #voxelart #voxel #procedural #UnrealEngine

I've made a bunch of optimizations to the voxel simulations in Lay of the Land. Thousands of moving voxels can now be simulated with little performance loss. Also you can now become buried in sand. #gamedev #indiedev #voxelgame #voxelart #voxel #procedural #UnrealEngine

Tooley1998

320,250 views • 1 year ago

#VRAGE3 water system listens to voxel edits and adjusts its flow when needed. Here you can see a hole made into the mountain lake's shore: it starts leaking water towards the sea below. What would YOU do with voxel edits and water?

#VRAGE3 water system listens to voxel edits and adjusts its flow when needed. Here you can see a hole made into the mountain lake's shore: it starts leaking water towards the sea below. What would YOU do with voxel edits and water?

Jan Hloušek

23,208 views • 2 years ago

Started experimenting with hand-tracking-based interactions for my little voxel editor – BoxelXR. There are a lot of things to tune, but overall it feels good. Though it would require some decent work in sound design to compensate for the lack of haptic feedback.

Started experimenting with hand-tracking-based interactions for my little voxel editor – BoxelXR. There are a lot of things to tune, but overall it feels good. Though it would require some decent work in sound design to compensate for the lack of haptic feedback.

Oleg Frolov

917,111 views • 11 months ago

You can now experience Apple Maps using Gaussian splats on Apple Vision Pro. Looking forward to the day when we can walk these streets and explore buildings in a fully immersive mode, alone or with other Personas.

You can now experience Apple Maps using Gaussian splats on Apple Vision Pro. Looking forward to the day when we can walk these streets and explore buildings in a fully immersive mode, alone or with other Personas.

Nathie

28,238 views • 4 months ago

Working on voxel-by-voxel customization for weapons, armor and jewelry! You can now even remove voxels from the original model and pick colors. Glow-in-the-dark spirit cubes are back, too! ✨ #cubeworld #cubeworldomega

Working on voxel-by-voxel customization for weapons, armor and jewelry! You can now even remove voxels from the original model and pick colors. Glow-in-the-dark spirit cubes are back, too! ✨ #cubeworld #cubeworldomega

Wolfram von Funck

171,710 views • 2 months ago

Gemini 3.7 Flash with one prompt: I gave it a detailed prompt to recreate a voxel-style Japanese pagoda garden in Three.js ~16.5K voxels, cherry blossoms, pond, torii gate, particles, lighting, camera controls and interactive UI. It generated the complete single-file HTML + JavaScript. Pretty damn impressive.

Gemini 3.7 Flash with one prompt: I gave it a detailed prompt to recreate a voxel-style Japanese pagoda garden in Three.js ~16.5K voxels, cherry blossoms, pond, torii gate, particles, lighting, camera controls and interactive UI. It generated the complete single-file HTML + JavaScript. Pretty damn impressive.

Noctus

122,096 views • 2 months ago

🦯 How to help visually impaired people easily navigate through everyday life with the Apple Vision Pro? I know it's not the expected use case of an XR headset, but you can do it with real-time meshing, hand tracking, and spatial audio.

🦯 How to help visually impaired people easily navigate through everyday life with the Apple Vision Pro? I know it's not the expected use case of an XR headset, but you can do it with real-time meshing, hand tracking, and spatial audio.

Stijn Spanhove

21,860 views • 2 years ago

Your phone is a tracking device. But you CAN take back control. Switching to GrapheneOS can stop your data constantly flowing to Apple or Google. Here’s how to install it and set it up.

Your phone is a tracking device. But you CAN take back control. Switching to GrapheneOS can stop your data constantly flowing to Apple or Google. Here’s how to install it and set it up.

Naomi Brockwell priv/acc

57,173 views • 7 months ago

Netflix but simple ✨ Prototype with xcode and swiftUI Netflix Apple

Netflix but simple ✨ Prototype with xcode and swiftUI Netflix Apple

Harin Nitisvaar

69,296 views • 9 months ago

I loved being one of the first directors to use Apple Vision Pro! I was completely blown away with how it helps you play, create, and explore new worlds. Watch Wicked now on the Apple TV app, and experience it in 3D on Apple Vision Pro.

I loved being one of the first directors to use Apple Vision Pro! I was completely blown away with how it helps you play, create, and explore new worlds. Watch Wicked now on the Apple TV app, and experience it in 3D on Apple Vision Pro.

Jon M. Chu

379,300 views • 1 year ago

splat-transform is a free and open source library and CLI tool for processing 3D Gaussian splats. It can create lightweight, accurate, voxel-based collision at scale. No human intervention required. This gym scene's voxels are perfectly generated - even large fully transparent windows are correctly filled. The voxel data file is 118KB. Start building 3D Gaussian splat apps today with PlayCanvas and splat-transform. 🧑‍💻

splat-transform is a free and open source library and CLI tool for processing 3D Gaussian splats. It can create lightweight, accurate, voxel-based collision at scale. No human intervention required. This gym scene's voxels are perfectly generated - even large fully transparent windows are correctly filled. The voxel data file is 118KB. Start building 3D Gaussian splat apps today with PlayCanvas and splat-transform. 🧑‍💻

Will Eastcott

20,508 views • 5 months ago

Hand Menu Interaction. The simplest trick to improve the accessibility of floating hand-attached UI panels for spatial interactions is to smooth their movement. It allows us to stabilize them and mitigate a hand tremor due to hand-tracking imperfection and/or physiological condition. (Interestingly, the visual stabilization helps reduce the physical tremor itself. I guess it normalizes the hand muscles/brain feedback loop when you target the interactables). By the way, if you are curious about how to design and prototype spatial hand-tracking-based interactions like this — join my little workshop at Hatch Conference. #handtracking #prototyping #menuinteraction #interactiondesign #spatialdesign #spatialcomputing #mixedreality #vr #virtualreality #xr #metaquest #uxdesign #uidesign #spatialui

Hand Menu Interaction. The simplest trick to improve the accessibility of floating hand-attached UI panels for spatial interactions is to smooth their movement. It allows us to stabilize them and mitigate a hand tremor due to hand-tracking imperfection and/or physiological condition. (Interestingly, the visual stabilization helps reduce the physical tremor itself. I guess it normalizes the hand muscles/brain feedback loop when you target the interactables). By the way, if you are curious about how to design and prototype spatial hand-tracking-based interactions like this — join my little workshop at Hatch Conference. #handtracking #prototyping #menuinteraction #interactiondesign #spatialdesign #spatialcomputing #mixedreality #vr #virtualreality #xr #metaquest #uxdesign #uidesign #spatialui

Oleg Frolov

27,218 views • 3 years ago

With efficient reallocation and defragmentation of voxels in place (see prev tweet), I recently added cascading to my irradiance cache. This enables a (relatively) low probe count without sacrificing voxel resolution near the camera. 🧵

With efficient reallocation and defragmentation of voxels in place (see prev tweet), I recently added cascading to my irradiance cache. This enables a (relatively) low probe count without sacrificing voxel resolution near the camera. 🧵

Rasmus Rønn Nielsen

11,184 views • 2 years ago

Dynamic collapsing voxel structures with parts that shatter in response to both weight and impact forces. Uses greedy meshing for the voxels and a system that propagates stress values between parts to simulate weight. Watch unmuted for the best experience. #RobloxDev #Roblox

Dynamic collapsing voxel structures with parts that shatter in response to both weight and impact forces. Uses greedy meshing for the voxels and a system that propagates stress values between parts to simulate weight. Watch unmuted for the best experience. #RobloxDev #Roblox

angeld23

13,241 views • 1 year ago

Codex is unusable. I generated one image with GPT Image 2.0, gave it to Codex, and used one simple prompt: “Create me a web game from this image.” You give it a simple image like this, and suddenly you realize you can build: • a voxel map • an editor • tile animations • a playable browser prototype This is getting ridiculous.

Codex is unusable. I generated one image with GPT Image 2.0, gave it to Codex, and used one simple prompt: “Create me a web game from this image.” You give it a simple image like this, and suddenly you realize you can build: • a voxel map • an editor • tile animations • a playable browser prototype This is getting ridiculous.

Givros

83,376 views • 5 months ago

In #visionOS26, guests can save their eye and hand setup from one Apple Vision Pro to their iPhone, then easily bring it to another Apple Vision Pro to get up and running quickly. Check out the video to see what’s new in Guest User.

In #visionOS26, guests can save their eye and hand setup from one Apple Vision Pro to their iPhone, then easily bring it to another Apple Vision Pro to get up and running quickly. Check out the video to see what’s new in Guest User.

Apple Support

39,040 views • 1 year ago

jihoon wants us to promise to have more fun at treasure concerts, film with your left hand and have fun with your right hand 🤙🏻 #지훈 🐶 you’re asking how yesterday was? yesterday was seriously so fun. it really was fun, but hmmm you guys need to have even more fun.. 🐶 you guys need to have more fun. teumes can def go harder than this, but you’re holding back. you guys can def do more, seriously, you really can but everyone kind of hesitates a little. just go out there and enjoy the atmosphere, got it? ok~? 🐶 i’m not saying don’t film or anything like that. you can film, it’s fine, i don’t mind it, because i think that’s the fans’ freedom. but i mean… film with one hand, your left hand, and use your right hand to hold your lightstick and have fun 🐶 but when both hands are on your phone like this… and i’m right in front of you… why are you looking at me through a camera filter first? you came to see me, so why… when i’m standing right in front of you, are you still only looking at me through your phone? it’s just a little disappointing to me 🐶 i’m not saying anyone is doing something wrong or anything like that, i’m just saying it feels a bit sad. i’m literally right in front of you, so why are you still looking at me inside your phone even when i’m right here? 🐶 and i know you want to take pictures, it’s okay. you can film it, keep it. it’s fine, because it’s not prohibited. in concerts where filming isn’t banned, ofc you can film. you want to take photos. ofc you want to take photos when your favorite singer is right in front of you, ofc you want to film it. i know that, we all know that. you can film it but film with your left hand and have fun with your right hand. let’s all make that promise. seriously, let’s really do it, film with your left hand and have fun with your right hand 🐶 because… when i’m like this, from up on stage when we look out like this, your gazes, your lightsticks, those kinds of things... when i feel like i’m directly interacting with each and every one of you like that.. i get out of breath like i might die, i get dizzy and everything, and my adrenaline gets pushed to the limit. but then if it’s all just iphone 17 pro maxes everywhere… it feels a bit disappointing 🐶 but i really do like that you film. i just feel a little regretful like if you film with one hand and have fun with the other.. like use your right hand properly to have fun, and use your left hand to film and capture everything… that’s how it should be, i guess. that kind of feeling 🐶 i’m not saying this to hear sorry from you guys. that’s not what i mean. i’m not saying you’re doing anything wrong, i just mean let’s all have fun together like that 💬 but oppa, if you’re playing with your right hand, the video in your left hand does get shaky so i just jump around and go all out 🐶 but even that shaking… i think of it as part of the live feeling

jihoon wants us to promise to have more fun at treasure concerts, film with your left hand and have fun with your right hand 🤙🏻 #지훈 🐶 you’re asking how yesterday was? yesterday was seriously so fun. it really was fun, but hmmm you guys need to have even more fun.. 🐶 you guys need to have more fun. teumes can def go harder than this, but you’re holding back. you guys can def do more, seriously, you really can but everyone kind of hesitates a little. just go out there and enjoy the atmosphere, got it? ok~? 🐶 i’m not saying don’t film or anything like that. you can film, it’s fine, i don’t mind it, because i think that’s the fans’ freedom. but i mean… film with one hand, your left hand, and use your right hand to hold your lightstick and have fun 🐶 but when both hands are on your phone like this… and i’m right in front of you… why are you looking at me through a camera filter first? you came to see me, so why… when i’m standing right in front of you, are you still only looking at me through your phone? it’s just a little disappointing to me 🐶 i’m not saying anyone is doing something wrong or anything like that, i’m just saying it feels a bit sad. i’m literally right in front of you, so why are you still looking at me inside your phone even when i’m right here? 🐶 and i know you want to take pictures, it’s okay. you can film it, keep it. it’s fine, because it’s not prohibited. in concerts where filming isn’t banned, ofc you can film. you want to take photos. ofc you want to take photos when your favorite singer is right in front of you, ofc you want to film it. i know that, we all know that. you can film it but film with your left hand and have fun with your right hand. let’s all make that promise. seriously, let’s really do it, film with your left hand and have fun with your right hand 🐶 because… when i’m like this, from up on stage when we look out like this, your gazes, your lightsticks, those kinds of things... when i feel like i’m directly interacting with each and every one of you like that.. i get out of breath like i might die, i get dizzy and everything, and my adrenaline gets pushed to the limit. but then if it’s all just iphone 17 pro maxes everywhere… it feels a bit disappointing 🐶 but i really do like that you film. i just feel a little regretful like if you film with one hand and have fun with the other.. like use your right hand properly to have fun, and use your left hand to film and capture everything… that’s how it should be, i guess. that kind of feeling 🐶 i’m not saying this to hear sorry from you guys. that’s not what i mean. i’m not saying you’re doing anything wrong, i just mean let’s all have fun together like that 💬 but oppa, if you’re playing with your right hand, the video in your left hand does get shaky so i just jump around and go all out 🐶 but even that shaking… i think of it as part of the live feeling

행복지수 314%

23,355 views • 5 months ago

Let a friend or family member experience your Apple Vision Pro. You can let someone experience your Apple Vision Pro, and they can save their data for 30 days if they’re going to use it again. Here’s how it works in #visionOS2.

Let a friend or family member experience your Apple Vision Pro. You can let someone experience your Apple Vision Pro, and they can save their data for 30 days if they’re going to use it again. Here’s how it works in #visionOS2.

Apple Support

55,343 views • 2 years ago

Another attempt at the voxel physics idea where voxels rejoin the grid. They now join over time once slow enough, and lerp into position

Another attempt at the voxel physics idea where voxels rejoin the grid. They now join over time once slow enough, and lerp into position

Lee Vermeulen

240,901 views • 7 months ago

How to create a shiny card with mirror effect in SwiftUI Xcode project:

How to create a shiny card with mirror effect in SwiftUI Xcode project:

Meng To

30,667 views • 2 years ago