Experimenting with environment styles in my off-axis projection demo. These are Gaussian splats rendered in the browser, switching via keyboard. -> Blender basic layout -> World Labs (chisel) -> three.js / Spark 2.0 -> Mediapipe (face-tracking)

Here is basic blender scene I modeled before taking it into @theworldlabs as structured input

This is so awesome, I remember the Johnny Lee wiimote tracking demo like it was yesterday, I set that thing up as a kid and played with it for hours and hours. Would love to check out a repo with what you've done here.

Yes a minimal repo here!

he does it again

🫡🫡🫡 trying my best

It's honestly magic what's possible

🫡🪄

Please tell me you filed for a provisional patent? This is the coolest shit I've seen since 3D gaming. Someone's going to give you a billion dollars for this.

🙏🥹

Seriously though. It was $75 when i did it, gives you Patent Pending status for 12mo. Just make sure you submit the full patent within 12mo or it becomes public domain. This tech is going to be huge, bro! It's like 3D glasses but without the glasses.

@CorridorDigital, could you please do an episode on this? 🙏 It looks interesting.

dude wtf

The accelerometer APIs could also help with aligning the viewport for an inside out tracking thingy

This is cool.

howw

These are awesome; would be great to see how it feels in a game environment which is tuned for multi-dimensional gameplay.

There’s a world model hackathon in nyc this weekend and I would love to try this!

This is so dope‼️

this is absolutely amazing

@alightinastorm Wtffffff this is so cool

Super cool

This is very cool.

very smart use of face/eye tracking!

can we try a live demo somewhere ?

I have a basic demo here with main logic. I don’t have this current one up

how many splat quads for this level of detail?

Each GS is about 500k splats (optimized this a bit form the 1 million) then using to render them via three.js

Check out the game MOSS and MOSS 2 and think about, what is possible 😅

@the_OPX yes! One of my first and still favorite VR games I've every played. So well done

If you place a separate 3d object in the scene, could it be included with face tracking? Like I'm thinking minimal 3d interactive game. This is awesome. Keep up these nexgen ideas coming Ian

Yes! 100% also planned to have a character move around!

i don't even understand what i am looking at.

@threejs Wow this is truly mind-blowing. This is how I imagined Zoom and Google Meet's background should work

Great work 👏

yo!

Impressive demo! How expensive is this Chisel tool from World Labs?

Check out this, you have access via free account

Love these‼️

cool but really useless.

Dreaming of a Qubits World

That's Bushido-level precision. Keyboard switching with continuous face-tracking usually kills frame rates. You kept it locked.