Semantically annotating 3D gaussian splats on the fly using gemini 3.1 + sparkjs
Bilawal Sidhu
Visit on X@bilawalsidhu108K followers
56,910 views
Semantically annotating 3D gaussian splats on the fly using gemini 3.1 + sparkjs
1. Load any 3D scene and hit scan
2. Get 2D detections from VLM
3. Cluster outputs & project into 3D world space
4. Save as a persistent 3D semantic layer
Inspired by Alexander Chen's experiments with gemini visual intelligence. Just had to try to lift it from 2D to 3D!
Comments
Comments from the original post on X (Twitter)
No comments yet
