Loading video...

Video Failed to Load

There was a problem loading this video. This could be due to a temporary network issue or the video might be unavailable.

Most Powerful Spatial AI for 3D Segmentation in #GaussianSplatting Major upgrade to our #SpatialAI! By defining just a few camera views, you can now segment extremely complex 3D objects with intricate geometries, including construction beams, industrial machinery, and beyond. ✅ No #3DGS retraining is required. Our spatial AI works... show more

Gauzilla Pro

1,524 subscribers

13,963 views • 3 days ago •via X (Twitter)

#GaussianSplatting #SpatialAI

Anya Rossi• Live Now

Private livecam show

2 Comments

Gauzilla Pro3 days ago

Scene credits: @Tesla, @Esri, Skender, Adam Havkin, Musée de l'Air et de l'Espace, and Andrii Shramko

Ben Xth2 days ago

Thank god….you guys did it!

Related Videos

Introducing WorldView 3D, a first-of-its-kind satellite tasking product that delivers up-to-date 3D ground truth anywhere on Earth. From GPS-denied autonomy and intelligence analysis to consumer-grade mapping and disaster response, the world's most important missions increasingly depend on accurate, up-to-date 3D terrain. But for years, keeping 3D maps current at global scale hasn't been possible. WorldView 3D changes that. Built on Vantor’s trusted spatial foundation, our new tasking capability empowers customers to task and receive updated 3D data within 24 hours of image collection. For missions that require greater fidelity, they can also produce high-definition 3D maps anywhere in the world. 3D is the future of spatial intelligence, and Vantor is leading the change. Our trusted spatial foundation already includes 100 million sq km of the world mapped inhighly accurate 3D. Now customers can update the locations that matter most with the speed, scale, and fidelity required for critical missions. Read the full announcement:

Introducing WorldView 3D, a first-of-its-kind satellite tasking product that delivers up-to-date 3D ground truth anywhere on Earth. From GPS-denied autonomy and intelligence analysis to consumer-grade mapping and disaster response, the world's most important missions increasingly depend on accurate, up-to-date 3D terrain. But for years, keeping 3D maps current at global scale hasn't been possible. WorldView 3D changes that. Built on Vantor’s trusted spatial foundation, our new tasking capability empowers customers to task and receive updated 3D data within 24 hours of image collection. For missions that require greater fidelity, they can also produce high-definition 3D maps anywhere in the world. 3D is the future of spatial intelligence, and Vantor is leading the change. Our trusted spatial foundation already includes 100 million sq km of the world mapped inhighly accurate 3D. Now customers can update the locations that matter most with the speed, scale, and fidelity required for critical missions. Read the full announcement:

Vantor

16,608 views • 2 months ago

🏗️ Applied Showcase: Photorealistic 3D scenes from video, running entirely in your browser. Gauzilla Pro (Gauzilla Pro) turns drone and smartphone footage into navigable digital twins with AI-powered segmentation. The platform runs on WebAssembly with no CUDA or Python installs. The core renderer is open-source Rust if you want to see how the splatting math actually works. 🔗 #GaussianSplatting #DigitalTwins #WebAssembly #3DReconstruction #AEC

🏗️ Applied Showcase: Photorealistic 3D scenes from video, running entirely in your browser. Gauzilla Pro (Gauzilla Pro) turns drone and smartphone footage into navigable digital twins with AI-powered segmentation. The platform runs on WebAssembly with no CUDA or Python installs. The core renderer is open-source Rust if you want to see how the splatting math actually works. 🔗 #GaussianSplatting #DigitalTwins #WebAssembly #3DReconstruction #AEC

WebGL / WebGPU

18,677 views • 8 months ago

📸 A few photos. ⚡ A few seconds. A high-quality 3D scene！🎬 Meet Topos-Lite, our new 3D Gaussian Splatting model. With just a few sparse multi-view images, it can generate a high-quality, renderable 3D scene in few seconds We’re excited to share more soon. The technical report is coming shortly — stay tuned and stay in touch. 👀 #ToposLite #3DGS #3DGeneration #SpatialAI #AIGC #photograph #3DArtwork

📸 A few photos. ⚡ A few seconds. A high-quality 3D scene！🎬 Meet Topos-Lite, our new 3D Gaussian Splatting model. With just a few sparse multi-view images, it can generate a high-quality, renderable 3D scene in few seconds We’re excited to share more soon. The technical report is coming shortly — stay tuned and stay in touch. 👀 #ToposLite #3DGS #3DGeneration #SpatialAI #AIGC #photograph #3DArtwork

InSpatio｜影溯

23,098 views • 2 months ago

🚀 Announcing Echo — our new frontier model for 3D world generation. Echo turns a simple text prompt or image into a fully explorable, 3D-consistent world. Instead of disconnected views, the result is a single, coherent spatial representation you can move through freely. This is part of a bigger shift in AI: from generating pixels and tokens to generating spaces. Echo predicts a geometry-grounded 3D scene at metric scale, meaning every novel view, depth map, and interaction comes from the same underlying world — not independent hallucinations. Once generated, the world is interactive in real time. You control the camera, explore from any angle, and render instantly — even on low-end hardware, directly in the browser. High-quality 3D world exploration is no longer gated by expensive equipment. Under the hood, Echo infers a physically grounded 3D representation and converts it into a renderable format. For our web demo, we use 3D Gaussian Splatting (3DGS) for fast, GPU-friendly rendering — but the representation itself is flexible and can be easily adapted. Why this matters: consistent 3D worlds unlock real workflows — digital twins, 3D design, game environments, robotics simulation, and more. From a single photo or a line of text, Echo builds worlds that are reliable, editable, and spatially faithful. Echo also enables scene editing and restyling. Change materials, remove or add objects, explore design variations — all while preserving global 3D consistency. Editing no longer breaks the world. This is only the beginning. Echo is the foundation for future world models with dynamics, physical reasoning, and richer interaction — environments that don’t just look right, but behave right. Explore the generated worlds on our website and sign up for the closed beta. The era of spatial intelligence starts here. 🌍 #Echo #WorldModels #SpatialAI #3DFoundationModels Check it out:

🚀 Announcing Echo — our new frontier model for 3D world generation. Echo turns a simple text prompt or image into a fully explorable, 3D-consistent world. Instead of disconnected views, the result is a single, coherent spatial representation you can move through freely. This is part of a bigger shift in AI: from generating pixels and tokens to generating spaces. Echo predicts a geometry-grounded 3D scene at metric scale, meaning every novel view, depth map, and interaction comes from the same underlying world — not independent hallucinations. Once generated, the world is interactive in real time. You control the camera, explore from any angle, and render instantly — even on low-end hardware, directly in the browser. High-quality 3D world exploration is no longer gated by expensive equipment. Under the hood, Echo infers a physically grounded 3D representation and converts it into a renderable format. For our web demo, we use 3D Gaussian Splatting (3DGS) for fast, GPU-friendly rendering — but the representation itself is flexible and can be easily adapted. Why this matters: consistent 3D worlds unlock real workflows — digital twins, 3D design, game environments, robotics simulation, and more. From a single photo or a line of text, Echo builds worlds that are reliable, editable, and spatially faithful. Echo also enables scene editing and restyling. Change materials, remove or add objects, explore design variations — all while preserving global 3D consistency. Editing no longer breaks the world. This is only the beginning. Echo is the foundation for future world models with dynamics, physical reasoning, and richer interaction — environments that don’t just look right, but behave right. Explore the generated worlds on our website and sign up for the closed beta. The era of spatial intelligence starts here. 🌍 #Echo #WorldModels #SpatialAI #3DFoundationModels Check it out:

SpAItial AI

177,073 views • 9 months ago

HunyuanWorld-Voyager is here and fully open-source! The world’s first ultra-long-range world model with native 3D reconstruction, redefining AI-driven spatial intelligence for VR, gaming, and simulations. ✅Direct 3D Output: Exports point cloud videos to 3D formats without tools like COLMAP, enabling instant 3D application use. ✅Innovative 3D Memory: Introduces a scalable world caching mechanism, ensuring geometric consistency across any camera trajectory. ✅Top-Ranked Performance: #1 on Stanford’s WorldScore, excelling in video generation and 3D reconstruction benchmarks.( Built on HunyuanWorld 1.0, Voyager blends video generation with 3D modeling, delivering camera-controlled, high-fidelity RGB-D sequences. Control scenes via keyboard or joystick for unmatched 3D consistency. Explore now: 🌐Project Page: 🔗GitHub: 🤗HuggingFace: 📝Technical Details:

HunyuanWorld-Voyager is here and fully open-source! The world’s first ultra-long-range world model with native 3D reconstruction, redefining AI-driven spatial intelligence for VR, gaming, and simulations. ✅Direct 3D Output: Exports point cloud videos to 3D formats without tools like COLMAP, enabling instant 3D application use. ✅Innovative 3D Memory: Introduces a scalable world caching mechanism, ensuring geometric consistency across any camera trajectory. ✅Top-Ranked Performance: #1 on Stanford’s WorldScore, excelling in video generation and 3D reconstruction benchmarks.( Built on HunyuanWorld 1.0, Voyager blends video generation with 3D modeling, delivering camera-controlled, high-fidelity RGB-D sequences. Control scenes via keyboard or joystick for unmatched 3D consistency. Explore now: 🌐Project Page: 🔗GitHub: 🤗HuggingFace: 📝Technical Details:

Tencent Hy

198,391 views • 1 year ago

🙏Thanks I'm overwhelmed by all the response!😍 ✨ Quick test with Pano360Sharp Just playing around with the output... 4M splats Added my Unity re-lighting and that dreamy tilt-shift blur effect 🎬 There's something magical about turning a single 360° photo into a little 3D world you can fly through 2-3 seconds to generate! #3DGS #GaussianSplatting #ComputerVision #AI #madewithunity #Splats

🙏Thanks I'm overwhelmed by all the response!😍 ✨ Quick test with Pano360Sharp Just playing around with the output... 4M splats Added my Unity re-lighting and that dreamy tilt-shift blur effect 🎬 There's something magical about turning a single 360° photo into a little 3D world you can fly through 2-3 seconds to generate! #3DGS #GaussianSplatting #ComputerVision #AI #madewithunity #Splats

Daniel Skaale

25,097 views • 9 months ago

🚀 Alpha Launch: Insta360 Integration is NOW LIVE on OVER! We're building the world's largest 3D dataset, and you can help! 🛠️ Turn your Insta360 camera into a powerful 3D mapping tool. Create navigable Mega Gaussian Splats & stunning, scalable 3D maps up to 30x faster! With your Insta360, you can map over 60 OVRLands in just 10 minutes!

🚀 Alpha Launch: Insta360 Integration is NOW LIVE on OVER! We're building the world's largest 3D dataset, and you can help! 🛠️ Turn your Insta360 camera into a powerful 3D mapping tool. Create navigable Mega Gaussian Splats & stunning, scalable 3D maps up to 30x faster! With your Insta360, you can map over 60 OVRLands in just 10 minutes!

Over the Reality 🌐

65,122 views • 11 months ago

WE DID IT! +100,000 OVRMAPS 🚀 A major milestone in decentralized spatial computing. A huge thank you to our incredible community of mappers and our technical team! ↳ 30M sqm of 3D-mapped terrain ↳ 55TB of image data processed with cutting-edge AI models ↳ Powered by DePIN and a global network of mappers This is the future of Spatial Computing. Let’s break it down: 🧵👇

WE DID IT! +100,000 OVRMAPS 🚀 A major milestone in decentralized spatial computing. A huge thank you to our incredible community of mappers and our technical team! ↳ 30M sqm of 3D-mapped terrain ↳ 55TB of image data processed with cutting-edge AI models ↳ Powered by DePIN and a global network of mappers This is the future of Spatial Computing. Let’s break it down: 🧵👇

Over the Reality 🌐

493,928 views • 1 year ago

Fun weekend project: using AI at Meta Sam3 to segment objects inside a SpAItial AI scene. Pipeline: -> Generate a world on SpAItial AI app and export as .ply -> PlayCanvas viewer to render splat + a uniform spatial grid over splat centers -> Capture frames + camera pose, POST to a local SAM3 server -> Lift each 2D mask → 3D: frustum-cull splats via the grid, reproject with the pose -> Recolor / isolate the segmented Gaussians This is all running locally on my Mac. Static scene, segment once, reuse persisted mask. All open source (link in comment), you can clone and build on top of this 👇🏽

Fun weekend project: using AI at Meta Sam3 to segment objects inside a SpAItial AI scene. Pipeline: -> Generate a world on SpAItial AI app and export as .ply -> PlayCanvas viewer to render splat + a uniform spatial grid over splat centers -> Capture frames + camera pose, POST to a local SAM3 server -> Lift each 2D mask → 3D: frustum-cull splats via the grid, reproject with the pose -> Recolor / isolate the segmented Gaussians This is all running locally on my Mac. Static scene, segment once, reuse persisted mask. All open source (link in comment), you can clone and build on top of this 👇🏽

RO2⚡️

22,375 views • 3 months ago

3D-LLM: Injecting the 3D World into Large Language Models paper page: Large language models (LLMs) and Vision-Language Models (VLMs) have been proven to excel at multiple tasks, such as commonsense reasoning. Powerful as these models can be, they are not grounded in the 3D physical world, which involves richer concepts such as spatial relationships, affordances, physics, layout, and so on. In this work, we propose to inject the 3D world into large language models and introduce a whole new family of 3D-LLMs. Specifically, 3D-LLMs can take 3D point clouds and their features as input and perform a diverse set of 3D-related tasks, including captioning, dense captioning, 3D question answering, task decomposition, 3D grounding, 3D-assisted dialog, navigation, and so on. Using three types of prompting mechanisms that we design, we are able to collect over 300k 3D-language data covering these tasks. To efficiently train 3D-LLMs, we first utilize a 3D feature extractor that obtains 3D features from rendered multi- view images. Then, we use 2D VLMs as our backbones to train our 3D-LLMs. By introducing a 3D localization mechanism, 3D-LLMs can better capture 3D spatial information. Experiments on ScanQA show that our model outperforms state-of-the-art baselines by a large margin (e.g., the BLEU-1 score surpasses state-of-the-art score by 9%). Furthermore, experiments on our held-in datasets for 3D captioning, task composition, and 3D-assisted dialogue show that our model outperforms 2D VLMs. Qualitative examples also show that our model could perform more tasks beyond the scope of existing LLMs and VLMs.

3D-LLM: Injecting the 3D World into Large Language Models paper page: Large language models (LLMs) and Vision-Language Models (VLMs) have been proven to excel at multiple tasks, such as commonsense reasoning. Powerful as these models can be, they are not grounded in the 3D physical world, which involves richer concepts such as spatial relationships, affordances, physics, layout, and so on. In this work, we propose to inject the 3D world into large language models and introduce a whole new family of 3D-LLMs. Specifically, 3D-LLMs can take 3D point clouds and their features as input and perform a diverse set of 3D-related tasks, including captioning, dense captioning, 3D question answering, task decomposition, 3D grounding, 3D-assisted dialog, navigation, and so on. Using three types of prompting mechanisms that we design, we are able to collect over 300k 3D-language data covering these tasks. To efficiently train 3D-LLMs, we first utilize a 3D feature extractor that obtains 3D features from rendered multi- view images. Then, we use 2D VLMs as our backbones to train our 3D-LLMs. By introducing a 3D localization mechanism, 3D-LLMs can better capture 3D spatial information. Experiments on ScanQA show that our model outperforms state-of-the-art baselines by a large margin (e.g., the BLEU-1 score surpasses state-of-the-art score by 9%). Furthermore, experiments on our held-in datasets for 3D captioning, task composition, and 3D-assisted dialogue show that our model outperforms 2D VLMs. Qualitative examples also show that our model could perform more tasks beyond the scope of existing LLMs and VLMs.

AK

249,798 views • 3 years ago

🚀 The Segment Anything Model (SAM) has been upgraded to SAM2, featuring an efficient image encoder for segmenting images and videos. But does SAM2 outperform SAM1 in medical image and video segmentation? We're thrilled to present our paper "Segment Anything in Medical Images and Videos: Benchmark and Deployment"! We comprehensively benchmark SAM2 across 11 medical image modalities and videos. 📄 Paper: 💻 Code: **Highlights:** 1. SAM2 doesn’t always outperform SAM1 in 2D medical images, but excels in video segmentation, making it more accurate and efficient for 3D images, such as CT and MR scans. 2. MedSAM still outperforms SAM2 on most 2D modalities, but SAM2 surpasses MedSAM for 3D image segmentation in a slice-by-slice approach. 3. Segmentation performance varies with model size; sometimes the smallest model outperforms larger ones. 4. Fine-tuning SAM2 significantly boosts its performance for medical image segmentation. While SAM2 may struggle with challenging objects that have unclear boundaries or low contrast, it excels in generating good initial segmentation masks for common medical images and videos. However, the official interface doesn’t support medical data formats and has limitations on video length. To address this, we've developed a 3D Slicer Plugin and Gradio API for efficient 3D medical image and video segmentation. We invite you to try them out and provide feedback! 🔧 Deployment: - 3D Slicer Plugin: - Gradio API: (Note: Due to GPU limitations, the online API is available for only 12 hours and may be slow. We highly recommend deploying the Gradio API with your own computing resources: A big shoutout to Jun Ma (JunMa) who recently joined our UHN AI hub (UHN AI Hub) as Machine Learning Lead, and kudos to all co-authors: Sumin Kim, Feifei Li, Mohammed Baharoon (Mohammed Baharoon), Reza Asakereh, and Hongwei Lyu! This is true teamwork! Looking forward to collaborating with the community to advance 3D medical image and video segmentation foundation models! University Health Network U of T Department of Computer Science Department of Laboratory Medicine & Pathobiology Temerty Centre for AI in Medicine (T-CAIREM) Vector Institute #MedTech #AIinHealthcare #DeepLearning #MedicalImaging #SAM2 #MedSAM #AIResearch

🚀 The Segment Anything Model (SAM) has been upgraded to SAM2, featuring an efficient image encoder for segmenting images and videos. But does SAM2 outperform SAM1 in medical image and video segmentation? We're thrilled to present our paper "Segment Anything in Medical Images and Videos: Benchmark and Deployment"! We comprehensively benchmark SAM2 across 11 medical image modalities and videos. 📄 Paper: 💻 Code: Highlights: 1. SAM2 doesn’t always outperform SAM1 in 2D medical images, but excels in video segmentation, making it more accurate and efficient for 3D images, such as CT and MR scans. 2. MedSAM still outperforms SAM2 on most 2D modalities, but SAM2 surpasses MedSAM for 3D image segmentation in a slice-by-slice approach. 3. Segmentation performance varies with model size; sometimes the smallest model outperforms larger ones. 4. Fine-tuning SAM2 significantly boosts its performance for medical image segmentation. While SAM2 may struggle with challenging objects that have unclear boundaries or low contrast, it excels in generating good initial segmentation masks for common medical images and videos. However, the official interface doesn’t support medical data formats and has limitations on video length. To address this, we've developed a 3D Slicer Plugin and Gradio API for efficient 3D medical image and video segmentation. We invite you to try them out and provide feedback! 🔧 Deployment: - 3D Slicer Plugin: - Gradio API: (Note: Due to GPU limitations, the online API is available for only 12 hours and may be slow. We highly recommend deploying the Gradio API with your own computing resources: A big shoutout to Jun Ma (JunMa) who recently joined our UHN AI hub (UHN AI Hub) as Machine Learning Lead, and kudos to all co-authors: Sumin Kim, Feifei Li, Mohammed Baharoon (Mohammed Baharoon), Reza Asakereh, and Hongwei Lyu! This is true teamwork! Looking forward to collaborating with the community to advance 3D medical image and video segmentation foundation models! University Health Network U of T Department of Computer Science Department of Laboratory Medicine & Pathobiology Temerty Centre for AI in Medicine (T-CAIREM) Vector Institute #MedTech #AIinHealthcare #DeepLearning #MedicalImaging #SAM2 #MedSAM #AIResearch

Bo Wang

178,666 views • 2 years ago

New in Notch 2026.2: fully interactive Gaussian Splats. Imported objects and environments can be lit, reflected, and cast shadows, sitting naturally alongside any other element in the production. In this sample, we used a splat of a library cafe with a few 3D objects dropped inside to show it in action. Grab the sample scene from the Launcher and try it for yourself. Splat by:

New in Notch 2026.2: fully interactive Gaussian Splats. Imported objects and environments can be lit, reflected, and cast shadows, sitting naturally alongside any other element in the production. In this sample, we used a splat of a library cafe with a few 3D objects dropped inside to show it in action. Grab the sample scene from the Launcher and try it for yourself. Splat by:

Notch

11,312 views • 2 months ago

3D hand tracking on smart glasses Not only can we stream camera data with our Wearables SDK, but we can run MediaPipe for hand tracking, applying it in WebXR environments like Three.js and A-Frame Works with compatible smart glasses, in this case the Omi AI Omi Glass, based on the Seeed Studio XIAO ESP32-S3 Sense (running our custom Firmware)

3D hand tracking on smart glasses Not only can we stream camera data with our Wearables SDK, but we can run MediaPipe for hand tracking, applying it in WebXR environments like Three.js and A-Frame Works with compatible smart glasses, in this case the Omi AI Omi Glass, based on the Seeed Studio XIAO ESP32-S3 Sense (running our custom Firmware)

Brilliant Wear

79,540 views • 8 months ago

2D is what the camera sees.👀 3D is what the world is. 🌍 Today, we’re proudly open-sourcing QuerySplat — an open-source feed-forward 3D model that turns a few unposed images into a navigable 3D scene in seconds (run on 4090🪶). Your input: a few unposed images Our output: a sharp, navigable 3D scene — generated in seconds! 🚀 🧠 organize scenes with 3D queries, not pixel-bound Gaussians 📷 no camera poses or manual calibration required ⚡ reconstruct new scenes in a single forward pass ✨ preserve sharp geometry and high-frequency appearance 🏆 achieve state-of-the-art results on DL3DV-Evaluation 🔓 code and model weights are now open-source From pixels to scenes, we are making 3D generation scalable. Try our free iOS app — it’s a lot of fun! 😆 🔗 Try it on the Web: 🔗 Paper: 🔗 Code & weights: 🔗 Project page: 🔗 #AIGC #3DGS #AI #Computervision #3D #artist #3dartist #3d

2D is what the camera sees.👀 3D is what the world is. 🌍 Today, we’re proudly open-sourcing QuerySplat — an open-source feed-forward 3D model that turns a few unposed images into a navigable 3D scene in seconds (run on 4090🪶). Your input: a few unposed images Our output: a sharp, navigable 3D scene — generated in seconds! 🚀 🧠 organize scenes with 3D queries, not pixel-bound Gaussians 📷 no camera poses or manual calibration required ⚡ reconstruct new scenes in a single forward pass ✨ preserve sharp geometry and high-frequency appearance 🏆 achieve state-of-the-art results on DL3DV-Evaluation 🔓 code and model weights are now open-source From pixels to scenes, we are making 3D generation scalable. Try our free iOS app — it’s a lot of fun! 😆 🔗 Try it on the Web: 🔗 Paper: 🔗 Code & weights: 🔗 Project page: 🔗 #AIGC #3DGS #AI #Computervision #3D #artist #3dartist #3d

InSpatio｜影溯

29,806 views • 1 month ago

🇺🇸 Insta360 Spatial Capture is officially coming to the U.S. on Sep. 28! Update the Insta360 app to the latest version (2.34.0) via your mobile app store or download it from our website, and experience Spatial Capture with Insta360 X4 Air, X5, and X6. Powered by 3D Gaussian Splatting, Spatial Capture lets you scan a room or object with a 360 video and turn it into a fully explorable 3D model—all directly in the Insta360 app. With high quality imaging and native 360 video recording, Insta360 cameras make 3D Gaussian Splatting scanning more accessible, so it's easier than ever to capture and preserve your memories in an immersive 3D format.

🇺🇸 Insta360 Spatial Capture is officially coming to the U.S. on Sep. 28! Update the Insta360 app to the latest version (2.34.0) via your mobile app store or download it from our website, and experience Spatial Capture with Insta360 X4 Air, X5, and X6. Powered by 3D Gaussian Splatting, Spatial Capture lets you scan a room or object with a 360 video and turn it into a fully explorable 3D model—all directly in the Insta360 app. With high quality imaging and native 360 video recording, Insta360 cameras make 3D Gaussian Splatting scanning more accessible, so it's easier than ever to capture and preserve your memories in an immersive 3D format.

Insta360

36,848 views • 5 days ago

We are thrilled to share that our first paper from my new lab, Spateo ( for spatiotemporal modeling of molecular holograms, is now online in Cell: Spateo is a comprehensive analytical framework for 3D whole-embryo spatiotemporal modeling. Its advanced features include: • 3D alignment and reconstruction at the whole-mouse-embryo scale (see the animation). • 3D spatial domain digitization and cell-cell communication analysis to understand spatial gene expression gradients and both inter- and intracellular communication. • 3D morphometric and volumetric analyses along with 3D morphogenesis vector field modeling to quantify dynamics such as surface area, volume, and cell density across organs, and to dissect the interplay between morphogenesis factors and cell migration. • A “Google Earth”-like browser, Spateo-viewer ( and for interactive and intuitive exploration of 3D spatial data. • Additional features, such as RNA signal-based single-cell segmentation. We are also honored that Nature “News and Views” has highlighted this work as well: This is really an amazing outcome after two years' heroic revision process that rewrite the entire paper using a new data ( for whole mouse embryos.

We are thrilled to share that our first paper from my new lab, Spateo ( for spatiotemporal modeling of molecular holograms, is now online in Cell: Spateo is a comprehensive analytical framework for 3D whole-embryo spatiotemporal modeling. Its advanced features include: • 3D alignment and reconstruction at the whole-mouse-embryo scale (see the animation). • 3D spatial domain digitization and cell-cell communication analysis to understand spatial gene expression gradients and both inter- and intracellular communication. • 3D morphometric and volumetric analyses along with 3D morphogenesis vector field modeling to quantify dynamics such as surface area, volume, and cell density across organs, and to dissect the interplay between morphogenesis factors and cell migration. • A “Google Earth”-like browser, Spateo-viewer ( and for interactive and intuitive exploration of 3D spatial data. • Additional features, such as RNA signal-based single-cell segmentation. We are also honored that Nature “News and Views” has highlighted this work as well: This is really an amazing outcome after two years' heroic revision process that rewrite the entire paper using a new data ( for whole mouse embryos.

evo-devo

58,508 views • 1 year ago

Wow. That's cool. Researchers just released World, an open-source Unreal Engine 5 simulator for training and testing LLM and VLM agents in realistic 3D environments. The platform supports RGB, depth, and segmentation sensors, along with navigation, vehicles, pedestrians, robots and procedural city generation. It's built with a Gym-like Python interface, it allows AI agents to learn physical and social reasoning in complex virtual worlds before real world deployment. We're moving from AI that only understands information to AI that can perceive, reason and act inside realistic simulated environments.

Wow. That's cool. Researchers just released World, an open-source Unreal Engine 5 simulator for training and testing LLM and VLM agents in realistic 3D environments. The platform supports RGB, depth, and segmentation sensors, along with navigation, vehicles, pedestrians, robots and procedural city generation. It's built with a Gym-like Python interface, it allows AI agents to learn physical and social reasoning in complex virtual worlds before real world deployment. We're moving from AI that only understands information to AI that can perceive, reason and act inside realistic simulated environments.

SciTech Era

47,751 views • 3 months ago

Introducing powered by Over the Reality. FreeGaussian is a new way to transform your existing photos, videos, and 360 captures for free into high-quality 3D Gaussian splats, directly in your browser. Whether you already have: ↳ a 360 recording captured with any 360 camera ↳ a set of photos ↳ or even a simple video from a place you visited you can now turn it into a photorealistic 3D Gaussian splat. Just go to upload your content, and let the reconstruction happen. Once it’s ready, you can download your 3D Gaussian splat and point cloud, and use them across your own projects, pipelines, or applications.

Introducing powered by Over the Reality. FreeGaussian is a new way to transform your existing photos, videos, and 360 captures for free into high-quality 3D Gaussian splats, directly in your browser. Whether you already have: ↳ a 360 recording captured with any 360 camera ↳ a set of photos ↳ or even a simple video from a place you visited you can now turn it into a photorealistic 3D Gaussian splat. Just go to upload your content, and let the reconstruction happen. Once it’s ready, you can download your 3D Gaussian splat and point cloud, and use them across your own projects, pipelines, or applications.

Over the Reality 🌐

86,340 views • 5 months ago

The first global, city-scale 3D map is taking shape, and it’s machine-readable. City-scale environments can now be reconstructed in high-fidelity, reaching a level of detail that is becoming almost indistinguishable from reality. This leap is made possible by large-scale mapping using just an Insta360 X5 and Over the Reality technology. So far, our dataset includes: - 220,000+ 3D mapped locations - 97M images - 1,000TB of spatial data Growing by more than 10,000+ newly mapped locations every week. Enabling Visual AI, Robotics, VPS, XR, and Digital twins.

The first global, city-scale 3D map is taking shape, and it’s machine-readable. City-scale environments can now be reconstructed in high-fidelity, reaching a level of detail that is becoming almost indistinguishable from reality. This leap is made possible by large-scale mapping using just an Insta360 X5 and Over the Reality technology. So far, our dataset includes: - 220,000+ 3D mapped locations - 97M images - 1,000TB of spatial data Growing by more than 10,000+ newly mapped locations every week. Enabling Visual AI, Robotics, VPS, XR, and Digital twins.

Over the Reality 🌐

69,822 views • 5 months ago

PantheonOS allows any biologist to perform complex data analyses of emerging single cell, multi-omics and spatial transcriptomics datasets end to end through AI agent and human collaboration. We are releasing six replays of use cases trajectories. Each "trajectory" is a complete end-to-end run, from prompt to analysis, to figures, and finally to report, and in fully inspectable and reproducible manner. See the six user cases in our PantheonOS Gallery: 1. 3D mouse embryo analysis: Tangram deconvolution and PyVista-based 3D visualization of E6 mouse embryo spatial transcriptomics data 2. 3D human fetal heart analysis: Spatial mapping of heart disease gene patterns using MERFISH data 3. Multi-omics spatial integration: Single cell multi-omics-to-spatial mapping with MOSCOT optimal transport 4. Gene panel design: 1000-plex immune-oncology MERFISH gene panel optimization 5. Cell segmentation benchmarking: Comparative evaluation of Cellpose-SAM, InstanSeg, StarDist, and other tools 6. Spatial disease biology: Ligand–receptor analysis of disease-associated tissue microenvironments We would love to hear how you can use PantheonOS for your research! Got an interesting agent run of your own and want to share? In the Pantheon UI, click Export Bundle (top-right of any chat) to package the full trajectory — chat history, code, figures, report — then submit it here:

PantheonOS allows any biologist to perform complex data analyses of emerging single cell, multi-omics and spatial transcriptomics datasets end to end through AI agent and human collaboration. We are releasing six replays of use cases trajectories. Each "trajectory" is a complete end-to-end run, from prompt to analysis, to figures, and finally to report, and in fully inspectable and reproducible manner. See the six user cases in our PantheonOS Gallery: 1. 3D mouse embryo analysis: Tangram deconvolution and PyVista-based 3D visualization of E6 mouse embryo spatial transcriptomics data 2. 3D human fetal heart analysis: Spatial mapping of heart disease gene patterns using MERFISH data 3. Multi-omics spatial integration: Single cell multi-omics-to-spatial mapping with MOSCOT optimal transport 4. Gene panel design: 1000-plex immune-oncology MERFISH gene panel optimization 5. Cell segmentation benchmarking: Comparative evaluation of Cellpose-SAM, InstanSeg, StarDist, and other tools 6. Spatial disease biology: Ligand–receptor analysis of disease-associated tissue microenvironments We would love to hear how you can use PantheonOS for your research! Got an interesting agent run of your own and want to share? In the Pantheon UI, click Export Bundle (top-right of any chat) to package the full trajectory — chat history, code, figures, report — then submit it here:

evo-devo

13,440 views • 4 months ago