Loading video...

Video Failed to Load

Go Home

Off-axis projection experiment no. 2 mediapipe for face tracking, sparkjs for gaussian splat rendering via threejs

XRarchitect's profile picture

Ian Curtis

25,953 subscribers

51,892 views • 8 months ago •via X (Twitter)

LIVE

Anya Rossi• Live Now

Private livecam show

0 Comments

No comments available

Comments from the original post will appear here

Related Videos

another #threejs / #tonejs av experiment using mediapipe face tracking in the browser.
1:42

another #threejs / #tonejs av experiment using mediapipe face tracking in the browser.

vincemckelvie

12,994 views • 3 years ago

Experimenting with environment styles in my off-axis projection demo. These are Gaussian splats rendered in the browser, switching via keyboard. -> Blender basic layout -> World Labs (chisel) -> three.js / Spark 2.0 -> Mediapipe (face-tracking)
0:39

Experimenting with environment styles in my off-axis projection demo. These are Gaussian splats rendered in the browser, switching via keyboard. -> Blender basic layout -> World Labs (chisel) -> three.js / Spark 2.0 -> Mediapipe (face-tracking)

Ian Curtis

87,533 views • 6 months ago

Quick experiment with Sora (text 2 video) -> Gaussian Splat -> WebAR 🚀. Can't wait to generate more! #8thwall #threejs #sora
0:35

Quick experiment with Sora (text 2 video) -> Gaussian Splat -> WebAR 🚀. Can't wait to generate more! #8thwall #threejs #sora

Stijn Spanhove

38,110 views • 2 years ago

shader effects for 3d gaussian splats are a fun way to add reality bending effects to your 3d scans. made using sparkjs which is an open source 3dgs renderer for threejs.
0:40

shader effects for 3d gaussian splats are a fun way to add reality bending effects to your 3d scans. made using sparkjs which is an open source 3dgs renderer for threejs.

Bilawal Sidhu

45,359 views • 6 months ago

The PlayCanvas team has solved collision for 3D Gaussian splats. Install splat-transform via NPM to get a CLI tool + library that can output high quality voxel-based collision. Here you can see a splat navigated in first person mode with voxel rendering toggled on/off. 🧵
0:37

The PlayCanvas team has solved collision for 3D Gaussian splats. Install splat-transform via NPM to get a CLI tool + library that can output high quality voxel-based collision. Here you can see a splat navigated in first person mode with voxel rendering toggled on/off. 🧵

Will Eastcott

30,303 views • 5 months ago

gemini 3 pro: build a jarvis HUD interface for tony stark a quick experiment with mediapipe computer vision, threejs, next js
0:41

gemini 3 pro: build a jarvis HUD interface for tony stark a quick experiment with mediapipe computer vision, threejs, next js

Suryansh Chourasia

11,676 views • 10 months ago

Open Sourcing Forge: 3D Gaussian splat rendering for web developers! 3DGS has become a dominant paradigm for differentiable rendering, combining high visual quality and real-time rendering. However, support for splatting on the web still lags behind its adoption in AI.
0:53

Open Sourcing Forge: 3D Gaussian splat rendering for web developers! 3DGS has become a dominant paradigm for differentiable rendering, combining high visual quality and real-time rendering. However, support for splatting on the web still lags behind its adoption in AI.

spark

120,050 views • 1 year ago

Last week I spent a few hours replicating the old good Off Axis Projection trick using #LudoGL (this gag will never end lol) I added face tracking for desktop and the DeviceOrientation for mobile Quite fun tbh 🫠 Demo: Repo:
0:30

Last week I spent a few hours replicating the old good Off Axis Projection trick using #LudoGL (this gag will never end lol) I added face tracking for desktop and the DeviceOrientation for mobile Quite fun tbh 🫠 Demo: Repo:

Marco Ludovico Perego

10,942 views • 1 year ago

Utter and total insanity(!!!) My vote for most hardcore splat demo ever. DOOM entirely in splats. Sprites, status bar, characters, gun rendering, all splats. Rendering and sorting with WebGPU. Dynamic lighting updating splats in real time. Sparkjs LoD to render entire levels.
0:57

Utter and total insanity(!!!) My vote for most hardcore splat demo ever. DOOM entirely in splats. Sprites, status bar, characters, gun rendering, all splats. Rendering and sorting with WebGPU. Dynamic lighting updating splats in real time. Sparkjs LoD to render entire levels.

martin_casado

29,875 views • 5 days ago

PlayCanvas Engine 2.18.0 is here! 🚀 Your free and open source 3D engine for the web ⚡️ Prototype WebGPU Compute splat renderer 🐟 Fish-eye projection for 3D Gaussian splats ⛈️ Procedural splat-based weather effects 🌫️ Fog now affects splats
0:48

PlayCanvas Engine 2.18.0 is here! 🚀 Your free and open source 3D engine for the web ⚡️ Prototype WebGPU Compute splat renderer 🐟 Fish-eye projection for 3D Gaussian splats ⛈️ Procedural splat-based weather effects 🌫️ Fog now affects splats

PlayCanvas

13,606 views • 5 months ago

With the exodus of Gaussian Splat folks away from PostShot ($$$ now), a new ecosystem emerges around the free Brush and LichtFeld Studio tools. I've been working on a new plugin for Blender called Splat-Tools to do my part. Test: Rendering my fav LEGO sets! [1/2]
0:29

With the exodus of Gaussian Splat folks away from PostShot ($$$ now), a new ecosystem emerges around the free Brush and LichtFeld Studio tools. I've been working on a new plugin for Blender called Splat-Tools to do my part. Test: Rendering my fav LEGO sets! [1/2]

Arash Keshmirian

14,124 views • 11 months ago

Woah, Gaussian splats in mixed reality look so good! Tech stack: lichtfeld studio for splattering training, virtual desktop for PC VR streaming and passthrough MR using a virtual green screen, gracia for VR splat rendering using the green screen background feature
0:26

Woah, Gaussian splats in mixed reality look so good! Tech stack: lichtfeld studio for splattering training, virtual desktop for PC VR streaming and passthrough MR using a virtual green screen, gracia for VR splat rendering using the green screen background feature

Azad Balabanian

38,080 views • 6 months ago

Created a PlayCanvas Engine example that shows how to create hotspots and annotations for 3D Gaussian Splat based scenes! 🪄 [1 / 2]
0:29

Created a PlayCanvas Engine example that shows how to create hotspots and annotations for 3D Gaussian Splat based scenes! 🪄 [1 / 2]

Will Eastcott

14,061 views • 8 months ago

AirVis Studio: Lets you convert Images / Video (Including 360 video) to Gaussian Splat scene locally in your machine for free. Now Available in Windows, works with Intel, AMD, NVIDIA. Also available in Mac with Apple Silicon. No sign up, No subscription, No limits. Enjoy !!! Technical Details: - Metal / Vulkan accelerated SFM (Colmap fork) and Splat Trainer for maximum speed and compatibility. - A 5 Min 360 video took about 2 hours in a modern PC with dedicated GPU. - Ships with SOTA Splat rendering engine : Auto LOD and Collision generation, tested on scenes with more than 250 million splats. And yes, No LOD popping. - Render and export videos with keyframes. - One click publish to AirVis and share with others. Also view in VR, standalone or CloudXR with Foveated Rendering for VisionPro. - And many more, check it out.
0:50

AirVis Studio: Lets you convert Images / Video (Including 360 video) to Gaussian Splat scene locally in your machine for free. Now Available in Windows, works with Intel, AMD, NVIDIA. Also available in Mac with Apple Silicon. No sign up, No subscription, No limits. Enjoy !!! Technical Details: - Metal / Vulkan accelerated SFM (Colmap fork) and Splat Trainer for maximum speed and compatibility. - A 5 Min 360 video took about 2 hours in a modern PC with dedicated GPU. - Ships with SOTA Splat rendering engine : Auto LOD and Collision generation, tested on scenes with more than 250 million splats. And yes, No LOD popping. - Render and export videos with keyframes. - One click publish to AirVis and share with others. Also view in VR, standalone or CloudXR with Foveated Rendering for VisionPro. - And many more, check it out.

Arun Kurian

50,738 views • 1 month ago

splat-transform is a free and open source library and CLI tool for processing 3D Gaussian splats. It can create lightweight, accurate, voxel-based collision at scale. No human intervention required. This gym scene's voxels are perfectly generated - even large fully transparent windows are correctly filled. The voxel data file is 118KB. Start building 3D Gaussian splat apps today with PlayCanvas and splat-transform. 🧑‍💻
0:43

splat-transform is a free and open source library and CLI tool for processing 3D Gaussian splats. It can create lightweight, accurate, voxel-based collision at scale. No human intervention required. This gym scene's voxels are perfectly generated - even large fully transparent windows are correctly filled. The voxel data file is 118KB. Start building 3D Gaussian splat apps today with PlayCanvas and splat-transform. 🧑‍💻

Will Eastcott

20,508 views • 4 months ago

Alibaba just dropped TaoAvatar on Hugging Face Real-Time Lifelike Full-Body Talking Avatars for Augmented Reality via 3D Gaussian Splatting
0:41

Alibaba just dropped TaoAvatar on Hugging Face Real-Time Lifelike Full-Body Talking Avatars for Augmented Reality via 3D Gaussian Splatting

AK

329,222 views • 1 year ago

PlayCanvas Engine v2.13.0 is here 🚀 Your free and open source 3D engine for the web ✅ Streamed LOD system for 3D Gaussian Splats ✅ Splat shader effects framework ✅ Globally sorted splats [1 / 2]
1:09

PlayCanvas Engine v2.13.0 is here 🚀 Your free and open source 3D engine for the web ✅ Streamed LOD system for 3D Gaussian Splats ✅ Splat shader effects framework ✅ Globally sorted splats [1 / 2]

PlayCanvas

37,578 views • 10 months ago

Painting with 3D Gaussian Splat Brushes Contributions: • Designing a set of interactive tools and brush parameters for artistic brush creation and control using 3DGS content. • Computing oriented 3D Gaussian splat brushes for stamp-based painting on 3D surfaces represented as meshes or 3DGS scenes. • Deforming the splats in a brush stamp to ensure a smooth appearance of the painted 3D stroke. • Producing seamless brush strokes despite overlapping brush stamps, using diffusion inpainting. • Efficient modeling and rendering of brush strokes to facilitate 3DGS painting in real time.
0:27

Painting with 3D Gaussian Splat Brushes Contributions: • Designing a set of interactive tools and brush parameters for artistic brush creation and control using 3DGS content. • Computing oriented 3D Gaussian splat brushes for stamp-based painting on 3D surfaces represented as meshes or 3DGS scenes. • Deforming the splats in a brush stamp to ensure a smooth appearance of the painted 3D stroke. • Producing seamless brush strokes despite overlapping brush stamps, using diffusion inpainting. • Efficient modeling and rendering of brush strokes to facilitate 3DGS painting in real time.

MrNeRF

23,060 views • 1 year ago