正在加载视频...

视频加载失败

So i vibe coded a threejs webgpu splat renderer from scratch in an evening with gpt 5.4 Introducing Spark++ Give it a week or two, performance is slightly worse on fast camera movements but 60 fps on my toaster in less dense areas. Had to reduce overall density for...

32,650 次观看 • 7 个月前 •via X (Twitter)

25 条评论

martin_casado 的头像
martin_casado7 个月前

Amazing. Keep it up! Make sure it support LoD and streaming. Target size, 100 million splats. That's when things get difficult.

robot 2.0 的头像
robot 2.07 个月前

it has LOD, no streaming, what is target size? It wouldn't ever render 100 million, it slices the entire splat into lots of small pages and only renders what's visible in the camera

martin_casado 的头像
martin_casado7 个月前

Yeah, so LoD generally builds an LoD tree where splats close by are high resolution, and those far away are lower resolution. Generally this is done by having the highest resolution be leafs on a tree, which aggregate up and create blended colors (and increased size) as you go. You can set a splat budget (e.g. 2 million) for being on the screen at all times. However, they're all stored in memory since you're simply saving GPU time. Streaming is where you normally deal with memory and bandwidth contention by carving the scene into pages, and then loading them incrementally. This saves you loading time (e.g. you can see the scene immediately) and you can fix total memory usage by evicting pages that are too far away. Here is an example of a 16million splat scene with LoD and streaming. It also has a proxy mesh that takes a moment to load:

robot 2.0 的头像
robot 2.07 个月前

isn't building, sorting and filtering the tree taking up massive cpu time?

martin_casado 的头像
martin_casado7 个月前

Building the LoD tree(s) is generally done offline. But yeah, for traversal, sorting, multi-views etc it's really hard to get it performant. In particular if you have multi-device support. For example Spark supports VR and mobile. Spark is currently at or ahead of the state of the art. So there really isn't any literature or prior code for the models to draw from. It gets even harder if you want to implement portals. Because now you need multiple multiple LoD trees and clipping which has to happen with shaders to be performant. And all that has to interact with the streaming / paging system.

robot 2.0 的头像
robot 2.07 个月前

do u have a large splat for me

martin_casado 的头像
martin_casado7 个月前

Yeah. Will send in a bit

alyssa 🫪 的头像
alyssa 🫪7 个月前

🗿🖤

Isaac Bratzel 的头像
Isaac Bratzel7 个月前

Nice

loground 的头像
loground7 个月前

banger

robot 2.0 的头像
robot 2.07 个月前

just vibin lately

loground 的头像
loground7 个月前

the only way

Nitin Khanna 的头像
Nitin Khanna7 个月前

You got further than me using claude :) Claude just messed up all compute shaders of the base project so left. Will try codex on my claude wip and see if I can get it to work.

Tiger Abrodi 的头像
Tiger Abrodi7 个月前

cracked 🔥

renderfiction 的头像
renderfiction7 个月前

Bro what, how the..

jeantimex 的头像
jeantimex7 个月前

Nice, I also vibe coded one:

Nicolas Craske 的头像
Nicolas Craske7 个月前

Rad work.

Anish 的头像
Anish7 个月前

lovely

Nick Oak 的头像
Nick Oak7 个月前

I’ve coded splats viewer that renders in symbols in a same way 👀

Johannes Tscharn 的头像
Johannes Tscharn7 个月前

What the hell I worked with SparkJS quite a bit and always considered it basically magic, especially the 2.0 version which has LODs (so you can limit the amount of splats drawn to n)

robot 2.0 的头像
robot 2.07 个月前

it is magic still

Dan Monaghan 的头像
Dan Monaghan7 个月前

Right now you just have a point cloud (a dark one at that) so they are not actual splats yet. You need to get the ellipsoid shape, scale and rotation working, which prob won’t effect render speed, just decoding.

robot 2.0 的头像
robot 2.07 个月前

check the link i've updated it since

Evgeny Muryshkin 的头像
Evgeny Muryshkin7 个月前

AI trap... you did not know how it work, now you have a thing, but still does not know how it works..

Sadi Moodi 的头像
Sadi Moodi7 个月前

60fps on a toaster with webgpu splats? That's actually wild. The real question: did GPT 5.4 figure out the math or just copy-paste from threejs examples? Either way, the fact that it works at all is the real flex here.

相关视频