Video wird geladen...

Video konnte nicht geladen werden

Zur Startseite

Working on a tool to generate low poly collision meshes from gaussian splats. It uses marching cubes and quadric error metric (QEM) decimation. Results are pretty good, it can get a usable sub 10Mb collision mesh from a 50Mb splat.

martin_casado's profile picture

martin_casado

80,303 subscribers

49,759 Aufrufe • vor 5 Monaten •via X (Twitter)

Wissenschaft & Technologie
LIVE

Anya Rossi• Live Now

Private livecam show

0 Kommentare

Keine Kommentare verfügbar

Kommentare vom Original-Post werden hier angezeigt

Ähnliche Videos

The low poly meshes I created are much, much faster with physics / collision than those directly from the splat to mesh translation. Amazing. I now have an end to end workflow for generated 3D worlds with usable collisions. Works great in VR and mobile too ...
0:36

The low poly meshes I created are much, much faster with physics / collision than those directly from the splat to mesh translation. Amazing. I now have an end to end workflow for generated 3D worlds with usable collisions. Works great in VR and mobile too ...

martin_casado

54,452 Aufrufe • vor 5 Monaten

The PlayCanvas team has solved collision for 3D Gaussian splats. Install splat-transform via NPM to get a CLI tool + library that can output high quality voxel-based collision. Here you can see a splat navigated in first person mode with voxel rendering toggled on/off. 🧵
0:37

The PlayCanvas team has solved collision for 3D Gaussian splats. Install splat-transform via NPM to get a CLI tool + library that can output high quality voxel-based collision. Here you can see a splat navigated in first person mode with voxel rendering toggled on/off. 🧵

Will Eastcott

30,097 Aufrufe • vor 2 Monaten

Collisions are finally coming! Automatic splat to conversion is tough given how messy AI generated splats are. So I created a simple editor that does down sampling, opacity filtering and then basic marching cubes and the results are pretty OK! 🥳
0:57

Collisions are finally coming! Automatic splat to conversion is tough given how messy AI generated splats are. So I created a simple editor that does down sampling, opacity filtering and then basic marching cubes and the results are pretty OK! 🥳

martin_casado

46,726 Aufrufe • vor 6 Monaten

PlayCanvas is making it possible to turn Gaussian splats into videogames. Today's update to splat-transform solves collision. Stats for this scene: 🖼️ Splat: 16.2MB 🧊 Voxel Collision: 1.5MB Splat link 👇
0:31

PlayCanvas is making it possible to turn Gaussian splats into videogames. Today's update to splat-transform solves collision. Stats for this scene: 🖼️ Splat: 16.2MB 🧊 Voxel Collision: 1.5MB Splat link 👇

Will Eastcott

40,969 Aufrufe • vor 1 Monat

splat-transform is a free and open source library and CLI tool for processing 3D Gaussian splats. It can create lightweight, accurate, voxel-based collision at scale. No human intervention required. This gym scene's voxels are perfectly generated - even large fully transparent windows are correctly filled. The voxel data file is 118KB. Start building 3D Gaussian splat apps today with PlayCanvas and splat-transform. 🧑‍💻
0:43

splat-transform is a free and open source library and CLI tool for processing 3D Gaussian splats. It can create lightweight, accurate, voxel-based collision at scale. No human intervention required. This gym scene's voxels are perfectly generated - even large fully transparent windows are correctly filled. The voxel data file is 118KB. Start building 3D Gaussian splat apps today with PlayCanvas and splat-transform. 🧑‍💻

Will Eastcott

20,265 Aufrufe • vor 1 Monat

3D Gaussian Splats are cool, but they're static (Part 25). DG-Mesh can reconstruct high-quality and time-consistent 3D meshes from a single video and track mesh vertices over time, which enables texture editing on dynamic objects.
0:22

3D Gaussian Splats are cool, but they're static (Part 25). DG-Mesh can reconstruct high-quality and time-consistent 3D meshes from a single video and track mesh vertices over time, which enables texture editing on dynamic objects.

Dreaming Tulpa 🥓👑

79,033 Aufrufe • vor 2 Jahren

Got SDF collision mesh generation (via marching cubes) working with Jolt Physics! The collision mesh is regenerated when the SDF scene changes. Individual SDF primitives can be made "dynamic", which adds them as physics objects. 1/
0:28

Got SDF collision mesh generation (via marching cubes) working with Jolt Physics! The collision mesh is regenerated when the SDF scene changes. Individual SDF primitives can be made "dynamic", which adds them as physics objects. 1/

Mike Turitzin

10,942 Aufrufe • vor 1 Jahr

Voxel collision in SuperSplat is a game changer. 🧊 It turns any Gaussian splat into accurate 5 cm voxels, automatically. It's super-compressed and far more efficient than a mesh, yet solid enough to climb stairs and walk crossbeams. Free & open source from PlayCanvas 👇
0:42

Voxel collision in SuperSplat is a game changer. 🧊 It turns any Gaussian splat into accurate 5 cm voxels, automatically. It's super-compressed and far more efficient than a mesh, yet solid enough to climb stairs and walk crossbeams. Free & open source from PlayCanvas 👇

Will Eastcott

89,162 Aufrufe • vor 8 Tagen

Sparkjs streaming+LoD is now stable(ish). This flythrough is over 100m splats rendered in browser. The splats are chunked into ~900 pages with a working set of around 16million splats. I think it can handle arbitrary size worlds now. Anyone have a 1 billion splat I can try?
1:31

Sparkjs streaming+LoD is now stable(ish). This flythrough is over 100m splats rendered in browser. The splats are chunked into ~900 pages with a working set of around 16million splats. I think it can handle arbitrary size worlds now. Anyone have a 1 billion splat I can try?

martin_casado

27,100 Aufrufe • vor 6 Monaten

I generated this 3D enviroment using a single image using "Marble" from World Labs. The new version can generate a mesh from the splat and is directly usable in Unreal Engine 5.7.
0:35

I generated this 3D enviroment using a single image using "Marble" from World Labs. The new version can generate a mesh from the splat and is directly usable in Unreal Engine 5.7.

Matt Workman

42,460 Aufrufe • vor 7 Monaten

Wild. Single shot text to 3D scene (gaussian splat) with no editing. This is approaching a usable scene asset for a game / 3D application.
0:21

Wild. Single shot text to 3D scene (gaussian splat) with no editing. This is approaching a usable scene asset for a game / 3D application.

martin_casado

56,136 Aufrufe • vor 11 Monaten

What happens if you try to push and squash a Gaussian splat? :) Been playing with adding simplified deformation and a lightweight physics simulation layer to Gaussian splats, running directly in real time on mobile. Instead of simulating every splat, this uses a small CPU lattice to drive the deformation, plus a per-splat transform so they actually stretch and compress properly. No mesh conversion, no retraining. Just layered on top of the renderer. You can push, bend, squash a scan and it holds together surprisingly well... Still early, but I can see the potential in making splats feel more real, from static captures to something more tactile, something you can touch, throw, bounce around… or well just fold and squash on the floor :) #GaussianSplatting #3DGS #Unity
0:39

What happens if you try to push and squash a Gaussian splat? :) Been playing with adding simplified deformation and a lightweight physics simulation layer to Gaussian splats, running directly in real time on mobile. Instead of simulating every splat, this uses a small CPU lattice to drive the deformation, plus a per-splat transform so they actually stretch and compress properly. No mesh conversion, no retraining. Just layered on top of the renderer. You can push, bend, squash a scan and it holds together surprisingly well... Still early, but I can see the potential in making splats feel more real, from static captures to something more tactile, something you can touch, throw, bounce around… or well just fold and squash on the floor :) #GaussianSplatting #3DGS #Unity

𝐑𝐔𝐁𝐄𝐍🥽𝐅𝐑𝐎

50,905 Aufrufe • vor 3 Monaten

Instant Skinned Gaussian Avatars for Web, Mobile and VR Applications Short summary: In our system, we animate a background 3D mesh and have the Gaussian splats follow the mesh’s vertices. During preprocessing, splats are assigned to mesh vertices, and their relative transformations are stored. Once this data is saved, you can instantly use it in your applications without further preprocessing. At runtime, we animate the background 3D mesh, update the Gaussian splats in parallel, and resort all Gaussian splats every frame based on the viewer’s perspective.
1:10

Instant Skinned Gaussian Avatars for Web, Mobile and VR Applications Short summary: In our system, we animate a background 3D mesh and have the Gaussian splats follow the mesh’s vertices. During preprocessing, splats are assigned to mesh vertices, and their relative transformations are stored. Once this data is saved, you can instantly use it in your applications without further preprocessing. At runtime, we animate the background 3D mesh, update the Gaussian splats in parallel, and resort all Gaussian splats every frame based on the viewer’s perspective.

MrNeRF

66,016 Aufrufe • vor 8 Monaten

AI aided 3D world building is getting ridiculous. This is a large, multi-room gaussian splat (~6million splats). Has streaming, LoD, character support, spatial audio, physics, collisions, VR support, and streaming video. Audio on ... Great place to watch a movie :)
0:58

AI aided 3D world building is getting ridiculous. This is a large, multi-room gaussian splat (~6million splats). Has streaming, LoD, character support, spatial audio, physics, collisions, VR support, and streaming video. Audio on ... Great place to watch a movie :)

martin_casado

47,535 Aufrufe • vor 5 Monaten

SuperSplat's voxel collision is a game changer for 3D Gaussian splat creators. Generate a highly accurate, inescapable voxel representation of any splat, regardless of quality. Generation is performed on the GPU, so it's super-fast. The voxel representation is tiny - only 418KB for this scene. And all this magic is free and open source, courtesy of the splat-transform library from PlayCanvas.
0:50

SuperSplat's voxel collision is a game changer for 3D Gaussian splat creators. Generate a highly accurate, inescapable voxel representation of any splat, regardless of quality. Generation is performed on the GPU, so it's super-fast. The voxel representation is tiny - only 418KB for this scene. And all this magic is free and open source, courtesy of the splat-transform library from PlayCanvas.

Will Eastcott

12,653 Aufrufe • vor 1 Monat

AI 3D workflows for web are getting scary good. Here is a demo with a large splat background (+LoD), mesh character, spatial audio, VR support, and lighting. I was able to create it in a few hours (repo in reply). built with Three.js spark World Labs Audio on :)
1:03

AI 3D workflows for web are getting scary good. Here is a demo with a large splat background (+LoD), mesh character, spatial audio, VR support, and lighting. I was able to create it in a few hours (repo in reply). built with Three.js spark World Labs Audio on :)

martin_casado

82,439 Aufrufe • vor 7 Monaten

DiffSplat Repurposing Image Diffusion Models for Scalable Gaussian Splat Generation DiffSplat is a generative framework to synthesize 3D Gaussian Splats from text prompts & single-view images in ⚡️ 1~2 seconds. It is fine-tuned directly from a pretrained text-to-image diffusion model.
0:24

DiffSplat Repurposing Image Diffusion Models for Scalable Gaussian Splat Generation DiffSplat is a generative framework to synthesize 3D Gaussian Splats from text prompts & single-view images in ⚡️ 1~2 seconds. It is fine-tuned directly from a pretrained text-to-image diffusion model.

AK

38,416 Aufrufe • vor 1 Jahr

Think meshes are the best for e-commerce? Think again. 3D Gaussian Splats are fast and cheap to generate...and with the new SOG format from PlayCanvas, this one is only 5.8MB. 🪄 [1 / 2]
0:32

Think meshes are the best for e-commerce? Think again. 3D Gaussian Splats are fast and cheap to generate...and with the new SOG format from PlayCanvas, this one is only 5.8MB. 🪄 [1 / 2]

Will Eastcott

75,123 Aufrufe • vor 9 Monaten

I've made Gaussian Splat Coloring Book for Vision Pro. Still rough on the edges, but working in splats on AVP is super rewarding, and now I'm thinking about full blown Gaussian Splats editor instead of just a coloring book :D
0:56

I've made Gaussian Splat Coloring Book for Vision Pro. Still rough on the edges, but working in splats on AVP is super rewarding, and now I'm thinking about full blown Gaussian Splats editor instead of just a coloring book :D

Adam Roszyk

46,384 Aufrufe • vor 8 Monaten

I built a new mesh gradient tool that can create beautiful gradients from photographs. The results are often dreamlike and capture a general vibe. I'm calling it Photo Gradient, it's free on web and soon a Figma plugin, link below
0:58

I built a new mesh gradient tool that can create beautiful gradients from photographs. The results are often dreamlike and capture a general vibe. I'm calling it Photo Gradient, it's free on web and soon a Figma plugin, link below

Daniel Destefanis

102,982 Aufrufe • vor 1 Jahr