Loading video...

Video Failed to Load

Go Home

demo combining gaussian splat rendering from spark with a collider mesh baked out from the gaussians, using rapier physics in Three.js

BenMildenhall's profile picture

Ben Mildenhall

8,524 subscribers

24,981 views • 1 year ago •via X (Twitter)

LIVE

Anya Rossi• Live Now

Private livecam show

6 Comments

Ben Mildenhall's profile picture
Ben Mildenhall1 year ago

code @ mostly thanks to @cursor_ai :) try it @

Hugo Duprez's profile picture
Hugo Duprez1 year ago

@sparkjsdev @threejs Very cool! Played around something similar for FPS

Silicon Jungle's profile picture
Silicon Jungle1 year ago

@sparkjsdev @threejs pretty cool

Vincent Woo's profile picture
Vincent Woo1 year ago

@sparkjsdev @threejs Any tips for baking meshes from gaussians?

Doeon Kwon's profile picture
Doeon Kwon1 year ago

@sparkjsdev @threejs this so cool, I gotta try it asap to my product

Wyrd's profile picture
Wyrd1 year ago

@sparkjsdev @threejs

Related Videos

Really cool seeing this on the quest in mixed reality. I put together a quick demo using WebXR (Three.js), Spark (LoD), and Danny’s raspberry Gaussian splat capture.
0:34

Really cool seeing this on the quest in mixed reality. I put together a quick demo using WebXR (Three.js), Spark (LoD), and Danny’s raspberry Gaussian splat capture.

Ian Curtis

66,039 views • 1 month ago

Spark 2.0 is here! 🚀 We’re redefining what’s possible on the web with a streamable LoD system for 3D Gaussian Splatting. Built on Three.js, you can now stream massive 100M+ splat worlds to any device from mobile to VR using WebGL2. All open-source. Dive into the tech 👇
0:39

Spark 2.0 is here! 🚀 We’re redefining what’s possible on the web with a streamable LoD system for 3D Gaussian Splatting. Built on Three.js, you can now stream massive 100M+ splat worlds to any device from mobile to VR using WebGL2. All open-source. Dive into the tech 👇

spark

417,641 views • 3 months ago

Open Sourcing Forge: 3D Gaussian splat rendering for web developers! 3DGS has become a dominant paradigm for differentiable rendering, combining high visual quality and real-time rendering. However, support for splatting on the web still lags behind its adoption in AI.
0:53

Open Sourcing Forge: 3D Gaussian splat rendering for web developers! 3DGS has become a dominant paradigm for differentiable rendering, combining high visual quality and real-time rendering. However, support for splatting on the web still lags behind its adoption in AI.

spark

119,827 views • 1 year ago

AI 3D workflows for web are getting scary good. Here is a demo with a large splat background (+LoD), mesh character, spatial audio, VR support, and lighting. I was able to create it in a few hours (repo in reply). built with Three.js spark World Labs Audio on :)
1:03

AI 3D workflows for web are getting scary good. Here is a demo with a large splat background (+LoD), mesh character, spatial audio, VR support, and lighting. I was able to create it in a few hours (repo in reply). built with Three.js spark World Labs Audio on :)

martin_casado

82,439 views • 7 months ago

Made a gaussian splat of a norwegian fjord from a youtube video using my tool slang-splat ( Really love how these places look. Turned out better than I expected from a yt vid. Photometric compensation helped a lot with floaters.
1:09

Made a gaussian splat of a norwegian fjord from a youtube video using my tool slang-splat ( Really love how these places look. Turned out better than I expected from a yt vid. Photometric compensation helped a lot with floaters.

Mykhailo Moroz

80,493 views • 27 days ago

New 3D scan from my Ruins of Ani series “Monastery of the Hripsimian Virgins” Links to view/download a mesh and Gaussian splat bellow 👇
0:53

New 3D scan from my Ruins of Ani series “Monastery of the Hripsimian Virgins” Links to view/download a mesh and Gaussian splat bellow 👇

Azad Balabanian ᯅ

10,430 views • 1 year ago

I generated this 3D enviroment using a single image using "Marble" from World Labs. The new version can generate a mesh from the splat and is directly usable in Unreal Engine 5.7.
0:35

I generated this 3D enviroment using a single image using "Marble" from World Labs. The new version can generate a mesh from the splat and is directly usable in Unreal Engine 5.7.

Matt Workman

42,460 views • 8 months ago

In the Orbit of Solaris – A gaussian splat reconstruction of a scene from Tarkovsky’s masterpiece
0:50

In the Orbit of Solaris – A gaussian splat reconstruction of a scene from Tarkovsky’s masterpiece

Benjamin Bardou

44,636 views • 4 months ago

40m Coit Tower Gaussian splat in my living room. Built with GPT-5.5 + three.js (Spark 2.0 LoD). Running fully on-device via quest 3 If we could just get WebXR passthrough on Vision Pro too…
0:47

40m Coit Tower Gaussian splat in my living room. Built with GPT-5.5 + three.js (Spark 2.0 LoD). Running fully on-device via quest 3 If we could just get WebXR passthrough on Vision Pro too…

Ian Curtis

48,700 views • 2 months ago

3D Gaussian Splat of Symposion Lindabrunn in Austria. Reality compressed to 39 MB with SOG from @PlayCanvas. 🗜️ Scan by Chris-RDT using XGRIDS PortalCam.
0:46

3D Gaussian Splat of Symposion Lindabrunn in Austria. Reality compressed to 39 MB with SOG from @PlayCanvas. 🗜️ Scan by Chris-RDT using XGRIDS PortalCam.

Will Eastcott

17,396 views • 9 months ago

Nintendo doesn't know about this but I'm making a Super Mario movie game that plays in the browser and It's almost done 🚀 Rendering: Three.js & PixiJS (UI) Physics: #rapier by dimforge Architecture: ECS w/ miniplex Inspiration: some guys in Japan
0:55

Nintendo doesn't know about this but I'm making a Super Mario movie game that plays in the browser and It's almost done 🚀 Rendering: Three.js & PixiJS (UI) Physics: #rapier by dimforge Architecture: ECS w/ miniplex Inspiration: some guys in Japan

Tommy Leung

68,133 views • 3 years ago

With the exodus of Gaussian Splat folks away from PostShot ($$$ now), a new ecosystem emerges around the free Brush and LichtFeld Studio tools. I've been working on a new plugin for Blender called Splat-Tools to do my part. Test: Rendering my fav LEGO sets! [1/2]
0:29

With the exodus of Gaussian Splat folks away from PostShot ($$$ now), a new ecosystem emerges around the free Brush and LichtFeld Studio tools. I've been working on a new plugin for Blender called Splat-Tools to do my part. Test: Rendering my fav LEGO sets! [1/2]

Arash Keshmirian

14,124 views • 9 months ago

Gaussian splats are captures frozen in time — not anymore. ⚡ Experimental RELIGHTING of splat scenes in the PlayCanvas engine, driven by a proxy mesh: swap the sky, drag the sun with its soft shadows, drop in point lights — all live on a captured scene. 🔗 Runnable demo👇
1:26

Gaussian splats are captures frozen in time — not anymore. ⚡ Experimental RELIGHTING of splat scenes in the PlayCanvas engine, driven by a proxy mesh: swap the sky, drag the sun with its soft shadows, drop in point lights — all live on a captured scene. 🔗 Runnable demo👇

Martin Valigursky

15,388 views • 1 month ago

Porting over some HLSL point cloud shaders over to spark, a gaussian splatting renderer for Three.js. Some of the effects look a bit messy with 3DGS, but fun to play around with! Also using their new depth of field here which looks really nice. Demo coming soon!
1:21

Porting over some HLSL point cloud shaders over to spark, a gaussian splatting renderer for Three.js. Some of the effects look a bit messy with 3DGS, but fun to play around with! Also using their new depth of field here which looks really nice. Demo coming soon!

grade eterna

10,946 views • 1 year ago

Interactive rug shader - A Three.js port of Dervish's Unity shader. Done in #r3f with Physics via Rapier. Fun project over coffee Live: Code: #creativecoding #threejs #webgl
0:20

Interactive rug shader - A Three.js port of Dervish's Unity shader. Done in #r3f with Physics via Rapier. Fun project over coffee Live: Code: #creativecoding #threejs #webgl

Faraz

17,266 views • 1 year ago

VAST AI releases Triplane Meets Gaussian Splatting on Hugging Face Fast and Generalizable Single-View 3D Reconstruction with Transformers demo: TGS enables fast reconstruction from single-view image. It builds the 3D representation upon a hybrid Triplane-Gaussian representation by evaluating a transformer-based framework, from which 3D Gaussians would be decoded
0:23

VAST AI releases Triplane Meets Gaussian Splatting on Hugging Face Fast and Generalizable Single-View 3D Reconstruction with Transformers demo: TGS enables fast reconstruction from single-view image. It builds the 3D representation upon a hybrid Triplane-Gaussian representation by evaluating a transformer-based framework, from which 3D Gaussians would be decoded

AK

113,226 views • 2 years ago

Experimenting with environment styles in my off-axis projection demo. These are Gaussian splats rendered in the browser, switching via keyboard. -> Blender basic layout -> World Labs (chisel) -> three.js / Spark 2.0 -> Mediapipe (face-tracking)
0:39

Experimenting with environment styles in my off-axis projection demo. These are Gaussian splats rendered in the browser, switching via keyboard. -> Blender basic layout -> World Labs (chisel) -> three.js / Spark 2.0 -> Mediapipe (face-tracking)

Ian Curtis

76,943 views • 3 months ago

This raspberry splat from Dany is incredible. Link to hosted version with spark in reply.
0:24

This raspberry splat from Dany is incredible. Link to hosted version with spark in reply.

martin_casado

18,414 views • 1 month ago

Nvidia announces GAvatar: Animatable 3D Gaussian Avatars with Implicit Mesh Learning paper page: Gaussian splatting has emerged as a powerful 3D representation that harnesses the advantages of both explicit (mesh) and implicit (NeRF) 3D representations. In this paper, we seek to leverage Gaussian splatting to generate realistic animatable avatars from textual descriptions, addressing the limitations (e.g., flexibility and efficiency) imposed by mesh or NeRF-based representations. However, a naive application of Gaussian splatting cannot generate high-quality animatable avatars and suffers from learning instability; it also cannot capture fine avatar geometries and often leads to degenerate body parts. To tackle these problems, we first propose a primitive-based 3D Gaussian representation where Gaussians are defined inside pose-driven primitives to facilitate animation. Second, to stabilize and amortize the learning of millions of Gaussians, we propose to use neural implicit fields to predict the Gaussian attributes (e.g., colors). Finally, to capture fine avatar geometries and extract detailed meshes, we propose a novel SDF-based implicit mesh learning approach for 3D Gaussians that regularizes the underlying geometries and extracts highly detailed textured meshes. Our proposed method, GAvatar, enables the large-scale generation of diverse animatable avatars using only text prompts. GAvatar significantly surpasses existing methods in terms of both appearance and geometry quality, and achieves extremely fast rendering (100 fps) at 1K resolution.
5:36

Nvidia announces GAvatar: Animatable 3D Gaussian Avatars with Implicit Mesh Learning paper page: Gaussian splatting has emerged as a powerful 3D representation that harnesses the advantages of both explicit (mesh) and implicit (NeRF) 3D representations. In this paper, we seek to leverage Gaussian splatting to generate realistic animatable avatars from textual descriptions, addressing the limitations (e.g., flexibility and efficiency) imposed by mesh or NeRF-based representations. However, a naive application of Gaussian splatting cannot generate high-quality animatable avatars and suffers from learning instability; it also cannot capture fine avatar geometries and often leads to degenerate body parts. To tackle these problems, we first propose a primitive-based 3D Gaussian representation where Gaussians are defined inside pose-driven primitives to facilitate animation. Second, to stabilize and amortize the learning of millions of Gaussians, we propose to use neural implicit fields to predict the Gaussian attributes (e.g., colors). Finally, to capture fine avatar geometries and extract detailed meshes, we propose a novel SDF-based implicit mesh learning approach for 3D Gaussians that regularizes the underlying geometries and extracts highly detailed textured meshes. Our proposed method, GAvatar, enables the large-scale generation of diverse animatable avatars using only text prompts. GAvatar significantly surpasses existing methods in terms of both appearance and geometry quality, and achieves extremely fast rendering (100 fps) at 1K resolution.

AK

140,992 views • 2 years ago

Millions of Gaussian splats, rendered directly in the browser. For ICARE, the creative team designed and iterated 7 worlds with Marble, then streamed them in real time using Spark 2.0 and Three.js Here's how the pipeline works ↓🧵
3:05

Millions of Gaussian splats, rendered directly in the browser. For ICARE, the creative team designed and iterated 7 worlds with Marble, then streamed them in real time using Spark 2.0 and Three.js Here's how the pipeline works ↓🧵

World Labs

12,179 views • 1 month ago