正在加载视频...

视频加载失败

返回首页

demo combining gaussian splat rendering from spark with a collider mesh baked out from the gaussians, using rapier physics in Three.js

BenMildenhall's profile picture

Ben Mildenhall

8,524 subscribers

24,981 次观看 • 1 年前 •via X (Twitter)

LIVE

Anya Rossi• Live Now

Private livecam show

6 条评论

Ben Mildenhall 的头像
Ben Mildenhall1 年前

code @ mostly thanks to @cursor_ai :) try it @

Hugo Duprez 的头像
Hugo Duprez1 年前

@sparkjsdev @threejs Very cool! Played around something similar for FPS

Silicon Jungle 的头像
Silicon Jungle1 年前

@sparkjsdev @threejs pretty cool

Vincent Woo 的头像
Vincent Woo1 年前

@sparkjsdev @threejs Any tips for baking meshes from gaussians?

Doeon Kwon 的头像
Doeon Kwon1 年前

@sparkjsdev @threejs this so cool, I gotta try it asap to my product

Wyrd 的头像
Wyrd1 年前

@sparkjsdev @threejs

相关视频

Really cool seeing this on the quest in mixed reality. I put together a quick demo using WebXR (Three.js), Spark (LoD), and Danny’s raspberry Gaussian splat capture.
0:34

Really cool seeing this on the quest in mixed reality. I put together a quick demo using WebXR (Three.js), Spark (LoD), and Danny’s raspberry Gaussian splat capture.

Ian Curtis

66,039 次观看 • 3 个月前

Spark 2.0 is here! 🚀 We’re redefining what’s possible on the web with a streamable LoD system for 3D Gaussian Splatting. Built on Three.js, you can now stream massive 100M+ splat worlds to any device from mobile to VR using WebGL2. All open-source. Dive into the tech 👇
0:39

Spark 2.0 is here! 🚀 We’re redefining what’s possible on the web with a streamable LoD system for 3D Gaussian Splatting. Built on Three.js, you can now stream massive 100M+ splat worlds to any device from mobile to VR using WebGL2. All open-source. Dive into the tech 👇

spark

420,013 次观看 • 4 个月前

Open Sourcing Forge: 3D Gaussian splat rendering for web developers! 3DGS has become a dominant paradigm for differentiable rendering, combining high visual quality and real-time rendering. However, support for splatting on the web still lags behind its adoption in AI.
0:53

Open Sourcing Forge: 3D Gaussian splat rendering for web developers! 3DGS has become a dominant paradigm for differentiable rendering, combining high visual quality and real-time rendering. However, support for splatting on the web still lags behind its adoption in AI.

spark

119,926 次观看 • 1 年前

AI 3D workflows for web are getting scary good. Here is a demo with a large splat background (+LoD), mesh character, spatial audio, VR support, and lighting. I was able to create it in a few hours (repo in reply). built with Three.js spark World Labs Audio on :)
1:03

AI 3D workflows for web are getting scary good. Here is a demo with a large splat background (+LoD), mesh character, spatial audio, VR support, and lighting. I was able to create it in a few hours (repo in reply). built with Three.js spark World Labs Audio on :)

martin_casado

82,670 次观看 • 9 个月前

Made a gaussian splat of a norwegian fjord from a youtube video using my tool slang-splat ( Really love how these places look. Turned out better than I expected from a yt vid. Photometric compensation helped a lot with floaters.
1:09

Made a gaussian splat of a norwegian fjord from a youtube video using my tool slang-splat ( Really love how these places look. Turned out better than I expected from a yt vid. Photometric compensation helped a lot with floaters.

Mykhailo Moroz

81,245 次观看 • 2 个月前

I generated this 3D enviroment using a single image using "Marble" from World Labs. The new version can generate a mesh from the splat and is directly usable in Unreal Engine 5.7.
0:35

I generated this 3D enviroment using a single image using "Marble" from World Labs. The new version can generate a mesh from the splat and is directly usable in Unreal Engine 5.7.

Matt Workman

42,460 次观看 • 9 个月前

In the Orbit of Solaris – A gaussian splat reconstruction of a scene from Tarkovsky’s masterpiece
0:50

In the Orbit of Solaris – A gaussian splat reconstruction of a scene from Tarkovsky’s masterpiece

Benjamin Bardou

44,636 次观看 • 6 个月前

40m Coit Tower Gaussian splat in my living room. Built with GPT-5.5 + three.js (Spark 2.0 LoD). Running fully on-device via quest 3 If we could just get WebXR passthrough on Vision Pro too…
0:47

40m Coit Tower Gaussian splat in my living room. Built with GPT-5.5 + three.js (Spark 2.0 LoD). Running fully on-device via quest 3 If we could just get WebXR passthrough on Vision Pro too…

Ian Curtis

48,774 次观看 • 4 个月前

3D Gaussian Splat of Symposion Lindabrunn in Austria. Reality compressed to 39 MB with SOG from @PlayCanvas. 🗜️ Scan by Chris-RDT using XGRIDS PortalCam.
0:46

3D Gaussian Splat of Symposion Lindabrunn in Austria. Reality compressed to 39 MB with SOG from @PlayCanvas. 🗜️ Scan by Chris-RDT using XGRIDS PortalCam.

Will Eastcott

17,396 次观看 • 11 个月前

With the exodus of Gaussian Splat folks away from PostShot ($$$ now), a new ecosystem emerges around the free Brush and LichtFeld Studio tools. I've been working on a new plugin for Blender called Splat-Tools to do my part. Test: Rendering my fav LEGO sets! [1/2]
0:29

With the exodus of Gaussian Splat folks away from PostShot ($$$ now), a new ecosystem emerges around the free Brush and LichtFeld Studio tools. I've been working on a new plugin for Blender called Splat-Tools to do my part. Test: Rendering my fav LEGO sets! [1/2]

Arash Keshmirian

14,124 次观看 • 11 个月前

Nintendo doesn't know about this but I'm making a Super Mario movie game that plays in the browser and It's almost done 🚀 Rendering: Three.js & PixiJS (UI) Physics: #rapier by dimforge Architecture: ECS w/ miniplex Inspiration: some guys in Japan
0:55

Nintendo doesn't know about this but I'm making a Super Mario movie game that plays in the browser and It's almost done 🚀 Rendering: Three.js & PixiJS (UI) Physics: #rapier by dimforge Architecture: ECS w/ miniplex Inspiration: some guys in Japan

Tommy Leung

68,212 次观看 • 3 年前

Gaussian splats are captures frozen in time — not anymore. ⚡ Experimental RELIGHTING of splat scenes in the PlayCanvas engine, driven by a proxy mesh: swap the sky, drag the sun with its soft shadows, drop in point lights — all live on a captured scene. 🔗 Runnable demo👇
1:26

Gaussian splats are captures frozen in time — not anymore. ⚡ Experimental RELIGHTING of splat scenes in the PlayCanvas engine, driven by a proxy mesh: swap the sky, drag the sun with its soft shadows, drop in point lights — all live on a captured scene. 🔗 Runnable demo👇

Martin Valigursky

15,536 次观看 • 2 个月前

Porting over some HLSL point cloud shaders over to spark, a gaussian splatting renderer for Three.js. Some of the effects look a bit messy with 3DGS, but fun to play around with! Also using their new depth of field here which looks really nice. Demo coming soon!
1:21

Porting over some HLSL point cloud shaders over to spark, a gaussian splatting renderer for Three.js. Some of the effects look a bit messy with 3DGS, but fun to play around with! Also using their new depth of field here which looks really nice. Demo coming soon!

grade eterna

10,946 次观看 • 1 年前

VAST AI releases Triplane Meets Gaussian Splatting on Hugging Face Fast and Generalizable Single-View 3D Reconstruction with Transformers demo: TGS enables fast reconstruction from single-view image. It builds the 3D representation upon a hybrid Triplane-Gaussian representation by evaluating a transformer-based framework, from which 3D Gaussians would be decoded
0:23

VAST AI releases Triplane Meets Gaussian Splatting on Hugging Face Fast and Generalizable Single-View 3D Reconstruction with Transformers demo: TGS enables fast reconstruction from single-view image. It builds the 3D representation upon a hybrid Triplane-Gaussian representation by evaluating a transformer-based framework, from which 3D Gaussians would be decoded

AK

113,242 次观看 • 2 年前

Nvidia announces GAvatar: Animatable 3D Gaussian Avatars with Implicit Mesh Learning paper page: Gaussian splatting has emerged as a powerful 3D representation that harnesses the advantages of both explicit (mesh) and implicit (NeRF) 3D representations. In this paper, we seek to leverage Gaussian splatting to generate realistic animatable avatars from textual descriptions, addressing the limitations (e.g., flexibility and efficiency) imposed by mesh or NeRF-based representations. However, a naive application of Gaussian splatting cannot generate high-quality animatable avatars and suffers from learning instability; it also cannot capture fine avatar geometries and often leads to degenerate body parts. To tackle these problems, we first propose a primitive-based 3D Gaussian representation where Gaussians are defined inside pose-driven primitives to facilitate animation. Second, to stabilize and amortize the learning of millions of Gaussians, we propose to use neural implicit fields to predict the Gaussian attributes (e.g., colors). Finally, to capture fine avatar geometries and extract detailed meshes, we propose a novel SDF-based implicit mesh learning approach for 3D Gaussians that regularizes the underlying geometries and extracts highly detailed textured meshes. Our proposed method, GAvatar, enables the large-scale generation of diverse animatable avatars using only text prompts. GAvatar significantly surpasses existing methods in terms of both appearance and geometry quality, and achieves extremely fast rendering (100 fps) at 1K resolution.
5:36

Nvidia announces GAvatar: Animatable 3D Gaussian Avatars with Implicit Mesh Learning paper page: Gaussian splatting has emerged as a powerful 3D representation that harnesses the advantages of both explicit (mesh) and implicit (NeRF) 3D representations. In this paper, we seek to leverage Gaussian splatting to generate realistic animatable avatars from textual descriptions, addressing the limitations (e.g., flexibility and efficiency) imposed by mesh or NeRF-based representations. However, a naive application of Gaussian splatting cannot generate high-quality animatable avatars and suffers from learning instability; it also cannot capture fine avatar geometries and often leads to degenerate body parts. To tackle these problems, we first propose a primitive-based 3D Gaussian representation where Gaussians are defined inside pose-driven primitives to facilitate animation. Second, to stabilize and amortize the learning of millions of Gaussians, we propose to use neural implicit fields to predict the Gaussian attributes (e.g., colors). Finally, to capture fine avatar geometries and extract detailed meshes, we propose a novel SDF-based implicit mesh learning approach for 3D Gaussians that regularizes the underlying geometries and extracts highly detailed textured meshes. Our proposed method, GAvatar, enables the large-scale generation of diverse animatable avatars using only text prompts. GAvatar significantly surpasses existing methods in terms of both appearance and geometry quality, and achieves extremely fast rendering (100 fps) at 1K resolution.

AK

141,058 次观看 • 2 年前

Experimenting with environment styles in my off-axis projection demo. These are Gaussian splats rendered in the browser, switching via keyboard. -> Blender basic layout -> World Labs (chisel) -> three.js / Spark 2.0 -> Mediapipe (face-tracking)
0:39

Experimenting with environment styles in my off-axis projection demo. These are Gaussian splats rendered in the browser, switching via keyboard. -> Blender basic layout -> World Labs (chisel) -> three.js / Spark 2.0 -> Mediapipe (face-tracking)

Ian Curtis

87,083 次观看 • 5 个月前

This raspberry splat from Dany is incredible. Link to hosted version with spark in reply.
0:24

This raspberry splat from Dany is incredible. Link to hosted version with spark in reply.

martin_casado

18,414 次观看 • 3 个月前

Interactive rug shader - A Three.js port of @_Dervishh's Unity shader. Done in #r3f with Physics via Rapier. Fun project over coffee Live: Code: #creativecoding #threejs #webgl
0:20

Interactive rug shader - A Three.js port of @_Dervishh's Unity shader. Done in #r3f with Physics via Rapier. Fun project over coffee Live: Code: #creativecoding #threejs #webgl

Faraz

17,380 次观看 • 1 年前

Millions of Gaussian splats, rendered directly in the browser. For ICARE, the creative team designed and iterated 7 worlds with Marble, then streamed them in real time using Spark 2.0 and Three.js Here's how the pipeline works ↓🧵
3:05

Millions of Gaussian splats, rendered directly in the browser. For ICARE, the creative team designed and iterated 7 worlds with Marble, then streamed them in real time using Spark 2.0 and Three.js Here's how the pipeline works ↓🧵

World Labs

13,495 次观看 • 3 个月前