Video wird geladen...

Video konnte nicht geladen werden

Zur Startseite

So i vibe coded a threejs webgpu splat renderer from scratch in an evening with gpt 5.4 Introducing Spark++ Give it a week or two, performance is slightly worse on fast camera movements but 60 fps on my toaster in less dense areas. Had to reduce overall density for...

32,650 Aufrufe • vor 7 Monaten •via X (Twitter)

25 Kommentare

Profilbild von martin_casado
martin_casadovor 7 Monaten

Amazing. Keep it up! Make sure it support LoD and streaming. Target size, 100 million splats. That's when things get difficult.

Profilbild von robot 2.0
robot 2.0vor 7 Monaten

it has LOD, no streaming, what is target size? It wouldn't ever render 100 million, it slices the entire splat into lots of small pages and only renders what's visible in the camera

Profilbild von martin_casado
martin_casadovor 7 Monaten

Yeah, so LoD generally builds an LoD tree where splats close by are high resolution, and those far away are lower resolution. Generally this is done by having the highest resolution be leafs on a tree, which aggregate up and create blended colors (and increased size) as you go. You can set a splat budget (e.g. 2 million) for being on the screen at all times. However, they're all stored in memory since you're simply saving GPU time. Streaming is where you normally deal with memory and bandwidth contention by carving the scene into pages, and then loading them incrementally. This saves you loading time (e.g. you can see the scene immediately) and you can fix total memory usage by evicting pages that are too far away. Here is an example of a 16million splat scene with LoD and streaming. It also has a proxy mesh that takes a moment to load:

Profilbild von robot 2.0
robot 2.0vor 7 Monaten

isn't building, sorting and filtering the tree taking up massive cpu time?

Profilbild von martin_casado
martin_casadovor 7 Monaten

Building the LoD tree(s) is generally done offline. But yeah, for traversal, sorting, multi-views etc it's really hard to get it performant. In particular if you have multi-device support. For example Spark supports VR and mobile. Spark is currently at or ahead of the state of the art. So there really isn't any literature or prior code for the models to draw from. It gets even harder if you want to implement portals. Because now you need multiple multiple LoD trees and clipping which has to happen with shaders to be performant. And all that has to interact with the streaming / paging system.

Profilbild von robot 2.0
robot 2.0vor 7 Monaten

do u have a large splat for me

Profilbild von martin_casado
martin_casadovor 7 Monaten

Yeah. Will send in a bit

Profilbild von alyssa 🫪
alyssa 🫪vor 7 Monaten

🗿🖤

Profilbild von Isaac Bratzel
Isaac Bratzelvor 7 Monaten

Nice

Profilbild von loground
logroundvor 7 Monaten

banger

Profilbild von robot 2.0
robot 2.0vor 7 Monaten

just vibin lately

Profilbild von loground
logroundvor 7 Monaten

the only way

Profilbild von Nitin Khanna
Nitin Khannavor 7 Monaten

You got further than me using claude :) Claude just messed up all compute shaders of the base project so left. Will try codex on my claude wip and see if I can get it to work.

Profilbild von Tiger Abrodi
Tiger Abrodivor 7 Monaten

cracked 🔥

Profilbild von renderfiction
renderfictionvor 7 Monaten

Bro what, how the..

Profilbild von jeantimex
jeantimexvor 7 Monaten

Nice, I also vibe coded one:

Profilbild von Nicolas Craske
Nicolas Craskevor 7 Monaten

Rad work.

Profilbild von Anish
Anishvor 7 Monaten

lovely

Profilbild von Nick Oak
Nick Oakvor 7 Monaten

I’ve coded splats viewer that renders in symbols in a same way 👀

Profilbild von Johannes Tscharn
Johannes Tscharnvor 7 Monaten

What the hell I worked with SparkJS quite a bit and always considered it basically magic, especially the 2.0 version which has LODs (so you can limit the amount of splats drawn to n)

Profilbild von robot 2.0
robot 2.0vor 7 Monaten

it is magic still

Profilbild von Dan Monaghan
Dan Monaghanvor 7 Monaten

Right now you just have a point cloud (a dark one at that) so they are not actual splats yet. You need to get the ellipsoid shape, scale and rotation working, which prob won’t effect render speed, just decoding.

Profilbild von robot 2.0
robot 2.0vor 7 Monaten

check the link i've updated it since

Profilbild von Evgeny Muryshkin
Evgeny Muryshkinvor 7 Monaten

AI trap... you did not know how it work, now you have a thing, but still does not know how it works..

Profilbild von Sadi Moodi
Sadi Moodivor 7 Monaten

60fps on a toaster with webgpu splats? That's actually wild. The real question: did GPT 5.4 figure out the math or just copy-paste from threejs examples? Either way, the fact that it works at all is the real flex here.

Ähnliche Videos