Video yükleniyor...

Video Yüklenemedi

Ana Sayfaya Dön

Gaussian splats look impressive—but robotics needs more than photorealism. Niantic Spatial generates an aligned collision mesh alongside every Gaussian splat, creating machine-readable digital twins with accurate geometry, depth, and collision awareness. Built for Spatial AI, Physical AI, and simulation in NVIDIA Robotics Isaac Sim. Learn more: #GaussianSplats #SpatialAI #PhysicalAI...

54,070 görüntüleme • 1 ay önce •via X (Twitter)

7 Yorum

ResinBody profil fotoğrafı
ResinBody1 ay önce

How does the collision mesh handle thin structures like railings or cables? They can look fine in the splat and still be hard to represent as usable geometry.

arpu profil fotoğrafı
arpu1 ay önce

is it opensource?

worksrecorded.com - AI news, construction profil fotoğrafı
worksrecorded.com - AI news, construction1 ay önce

For jobsite robots, the collision mesh also needs an operational confidence layer: capture age, occlusion zones, tolerance by object class, and a clear invalidation rule after site changes. Geometry is actionable only when the robot knows where it may be wrong.

Ian Smith profil fotoğrafı
Ian Smith1 ay önce

👀

Geωrge profil fotoğrafı
Geωrge1 ay önce

I love this technology... It's amazing

Pratik Sharda profil fotoğrafı
Pratik Sharda1 ay önce

Collision mesh alongside the splat is the practical bit. Sim geometry is only useful if the onboard perception stack sees the same world at runtime, and that's where the gap usually opens: depth from a real camera on an Orin is noisier and slower than the twin implies. We spend most of our PipeGen work at CraftifAI closing exactly that sim-to-device gap.

Alexi Derkatsch profil fotoğrafı
Alexi Derkatsch1 ay önce

interesting

Benzer Videolar

Trained a humanoid entirely in a 3D scan of the office. Zero real-world fine-tuning. It just walked in and worked. RL needs hundreds of thousands of attempts, and real robots can't afford to crash. A misjudged gap or a glass door collision breaks hardware and costs hours resetting. So you train in a sim. But sim policies usually train on randomized, untextured geometry; depth is easy to fake. The robot learns structure, not the real world: no materials, no lighting, no idea what anything actually is. RGB cameras carry all of that but training RGB policies in generic fake worlds won’t generalize to the real world. Niantic Spatial 🌎 Scaniverse reconstructs your scan of the real deployment site. One 360° camera walkthrough → photorealistic 3D Gaussian splat at metric scale → collision mesh pulled from the same reconstruction, so vision and physics match exactly. Drops straight into NVIDIA Isaac Sim/Lab, no manual conversion. Flexion simulation-first approach then seamlessly enables the training of RGB-only nav policies inside that reconstruction. With added domain randomization + large image encoders for robustness, this deploys straight to hardware. No real-world fine-tuning. Deployment: months of on-site adaptation → days. Tune into the NVIDIA livestream on 12 August to hear how these companies are closing the sim2real gap: NVIDIA Robotics ~~ ♻️ Join the weekly robotics newsletter, and never miss any news →

Lukas Ziegler

119,739 görüntüleme • 1 ay önce