Loading video...

Video Failed to Load

Go Home

Started experimenting with hand-tracking-based interactions for my little voxel editor – BoxelXR. There are a lot of things to tune, but overall it feels good. Though it would require some decent work in sound design to compensate for the lack of haptic feedback.

Volorf's profile picture

Oleg Frolov

7,050 subscribers

914,017 views • 7 months ago •via X (Twitter)

GamingEducationScience & Technology
LIVE

Anya Rossi• Live Now

Private livecam show

0 Comments

No comments available

Comments from the original post will appear here

Related Videos

Here is another haptic feedback experiment with hand tracking. This time there are more boxes! Or cuboids, for greater scientific rigor. I tried using different haptic patterns for different hover effects — it worked very well. Really, haptics are a missing piece in the hand-tracking experience to make it feel solid. Tools: Unity3D + C# MR Device: Quest3 Haptic device: HapticLabs's Prototyping Kit Music: PO-12 and Orchid
1:04

Here is another haptic feedback experiment with hand tracking. This time there are more boxes! Or cuboids, for greater scientific rigor. I tried using different haptic patterns for different hover effects — it worked very well. Really, haptics are a missing piece in the hand-tracking experience to make it feel solid. Tools: Unity3D + C# MR Device: Quest3 Haptic device: HapticLabs's Prototyping Kit Music: PO-12 and Orchid

Oleg Frolov

50,296 views • 6 months ago

Hand Menu Interaction. The simplest trick to improve the accessibility of floating hand-attached UI panels for spatial interactions is to smooth their movement. It allows us to stabilize them and mitigate a hand tremor due to hand-tracking imperfection and/or physiological condition. (Interestingly, the visual stabilization helps reduce the physical tremor itself. I guess it normalizes the hand muscles/brain feedback loop when you target the interactables). By the way, if you are curious about how to design and prototype spatial hand-tracking-based interactions like this — join my little workshop at Hatch Conference. #handtracking #prototyping #menuinteraction #interactiondesign #spatialdesign #spatialcomputing #mixedreality #vr #virtualreality #xr #metaquest #uxdesign #uidesign #spatialui
0:28

Hand Menu Interaction. The simplest trick to improve the accessibility of floating hand-attached UI panels for spatial interactions is to smooth their movement. It allows us to stabilize them and mitigate a hand tremor due to hand-tracking imperfection and/or physiological condition. (Interestingly, the visual stabilization helps reduce the physical tremor itself. I guess it normalizes the hand muscles/brain feedback loop when you target the interactables). By the way, if you are curious about how to design and prototype spatial hand-tracking-based interactions like this — join my little workshop at Hatch Conference. #handtracking #prototyping #menuinteraction #interactiondesign #spatialdesign #spatialcomputing #mixedreality #vr #virtualreality #xr #metaquest #uxdesign #uidesign #spatialui

Oleg Frolov

27,218 views • 2 years ago

Experimenting with reimplementing my CellFluids addon in Unity. Same algorithm but in GPU. (I dont know what to do with it yet. Making an asset out of it would require too much work) #madewithunity #unity3d
1:12

Experimenting with reimplementing my CellFluids addon in Unity. Same algorithm but in GPU. (I dont know what to do with it yet. Making an asset out of it would require too much work) #madewithunity #unity3d

Shahzod Boyhonov

43,892 views • 2 years ago

Kaiju Battle (Part 2)!!! Had a lot of fun with this. Looking back at it, I'd make some changes but overall, I like it. Hope you like it too! Sorry for the poor sound design btw. #Kaiju #Godzilla #3Danimation #animation
1:01

Kaiju Battle (Part 2)!!! Had a lot of fun with this. Looking back at it, I'd make some changes but overall, I like it. Hope you like it too! Sorry for the poor sound design btw. #Kaiju #Godzilla #3Danimation #animation

Alon Helman

43,375 views • 2 years ago

Some more sound design fun, to the tune of the ending of "Dying for Pie."
1:39

Some more sound design fun, to the tune of the ending of "Dying for Pie."

ThePickleMan

351,779 views • 2 years ago

Made another prototype to explore how you can create a voxel with hand-tracking. When you push the main voxel, it generates “wireframe” voxels along its path. The interaction itself feels fun and effortless, but it requires generated voxels to be in a wireframe or ghost mode to avoid overlapping with your hand. Tools: XCode + RealityKit + SwiftUI Device: Apple Vision Pro
0:37

Made another prototype to explore how you can create a voxel with hand-tracking. When you push the main voxel, it generates “wireframe” voxels along its path. The interaction itself feels fun and effortless, but it requires generated voxels to be in a wireframe or ghost mode to avoid overlapping with your hand. Tools: XCode + RealityKit + SwiftUI Device: Apple Vision Pro

Oleg Frolov

51,552 views • 5 months ago

I´m experimenting with using ultrasonic surface waves on the trackpad of the laptop project to enable multi-touch haptic feedback. This should make it possible to generate haptic feedback under individual fingers for multi-touch gestures. Elmer FEM software is a really helpful tool to model the interface between the piezo elements and the coverglass as well as the wave propagation. Best of all it is open-source 😁
0:20

I´m experimenting with using ultrasonic surface waves on the trackpad of the laptop project to enable multi-touch haptic feedback. This should make it possible to generate haptic feedback under individual fingers for multi-touch gestures. Elmer FEM software is a really helpful tool to model the interface between the piezo elements and the coverglass as well as the wave propagation. Best of all it is open-source 😁

Lukas Henkel

42,295 views • 2 years ago

It was a lovely year. Implemented all planned features for BoxelXR and started developing a version for VisionOS with the hand-tracking first approach. Prototyped a ton of spatial experiences. Gave a few talks about Spatial Design and, most importantly, met many great and inspiring folks. Thank you all ❤️ Happy New Year 🥳
0:32

It was a lovely year. Implemented all planned features for BoxelXR and started developing a version for VisionOS with the hand-tracking first approach. Prototyped a ton of spatial experiences. Gave a few talks about Spatial Design and, most importantly, met many great and inspiring folks. Thank you all ❤️ Happy New Year 🥳

Oleg Frolov

44,386 views • 1 year ago

If you are getting Black Ops 6. I would get it for Zombies and Warzone... I Love a lot of what they are trying to do in the game. But unless we see a radical shift in MP design, it is a bit of a mess, a fun mess for some, but ultimately, this is why it is 16 versions of Shipment:
2:21

If you are getting Black Ops 6. I would get it for Zombies and Warzone... I Love a lot of what they are trying to do in the game. But unless we see a radical shift in MP design, it is a bit of a mess, a fun mess for some, but ultimately, this is why it is 16 versions of Shipment:

TacticalBrit

13,656 views • 1 year ago

Babe, wake up, Super Mario 64 on PS1 is now real. The port is being done by a mad genius Malucart who's been working on it for a while. A lot of the things are still WIP and a bit broken (good for creepypasta material though!), but overall it's an incredible work!
1:50

Babe, wake up, Super Mario 64 on PS1 is now real. The port is being done by a mad genius Malucart who's been working on it for a while. A lot of the things are still WIP and a bit broken (good for creepypasta material though!), but overall it's an incredible work!

Elias Daler

727,672 views • 7 months ago

I've started adding my own design tools to my prototypes to better tune interactions, timings, densities, add more properties... things that have always held me back before the future of design is going to be wild
0:30

I've started adding my own design tools to my prototypes to better tune interactions, timings, densities, add more properties... things that have always held me back before the future of design is going to be wild

Tom Johnson

17,717 views • 4 months ago

It may not be good now, but if you’ll keep the faith, all things are going to work together for your good. God knows how to bring good out of a bad situation. Tune into Joel’s message today, "Keep the Faith"!
0:56

It may not be good now, but if you’ll keep the faith, all things are going to work together for your good. God knows how to bring good out of a bad situation. Tune into Joel’s message today, "Keep the Faith"!

Joel Osteen

139,074 views • 2 years ago

The African continent "has a lot of resources & a lot of things going for it. But there are also many challenges," says WTO head Ngozi Okonjo-Iweala. "It costs 20% more for us to trade w/each other on the continent than with others externally." But "I think this is an exciting continent... in spite of the challenges."
4:11

The African continent "has a lot of resources & a lot of things going for it. But there are also many challenges," says WTO head Ngozi Okonjo-Iweala. "It costs 20% more for us to trade w/each other on the continent than with others externally." But "I think this is an exciting continent... in spite of the challenges."

Christiane Amanpour

37,608 views • 8 months ago

how it feels to want to do a lot of things but you’re stuck
0:35

how it feels to want to do a lot of things but you’re stuck

fish

289,456 views • 5 months ago

Rep. Roy: “I'm in my office now, continuing to work today. Got some meetings with the White House and others this afternoon. We're working in good faith… I want to be clear, there's a lot of progress made it that is reflected in the bill. There are some very good things in the bill, but it is such a big bill with so many complexities, I'm trying to be honest about what I'm seeing, which is that we see the front load of the tax policy and the back load of the spending restraint,”
0:47

Rep. Roy: “I'm in my office now, continuing to work today. Got some meetings with the White House and others this afternoon. We're working in good faith… I want to be clear, there's a lot of progress made it that is reflected in the bill. There are some very good things in the bill, but it is such a big bill with so many complexities, I'm trying to be honest about what I'm seeing, which is that we see the front load of the tax policy and the back load of the spending restraint,”

Rep. Chip Roy Press Office

57,089 views • 1 year ago

Sharing some thoughts from the week. It’s been a big year, a lot of global chaos but a lot of good things too. If you were to describe this year in one word what would it be?
1:30

Sharing some thoughts from the week. It’s been a big year, a lot of global chaos but a lot of good things too. If you were to describe this year in one word what would it be?

iyah may

25,176 views • 6 months ago

i see a lot of people comparing it to eddsworld which makes sense but even though chimptopia is similar in concept one obviously does better with expressing personality with good design
0:38

i see a lot of people comparing it to eddsworld which makes sense but even though chimptopia is similar in concept one obviously does better with expressing personality with good design

drew 💙 {MUTANT MAYHEM CEO}

79,201 views • 18 days ago

X has a lot of good things going for it, but they need to update the article system so it feeds into the algorithm.
2:54

X has a lot of good things going for it, but they need to update the article system so it feeds into the algorithm.

Ian Miles Cheong

12,147 views • 1 year ago

Sound Design work I did for "Fatui Harbringers - Stairway to Heaven" Directed by KIERU Grateful to work with such an amazing team, it was truly a unique experience. Had a lot of fun with the horror theme this time around for the SFX! Thanks for watching!🚪🫣
4:00

Sound Design work I did for "Fatui Harbringers - Stairway to Heaven" Directed by KIERU Grateful to work with such an amazing team, it was truly a unique experience. Had a lot of fun with the horror theme this time around for the SFX! Thanks for watching!🚪🫣

Michael Perez

33,678 views • 1 year ago