We are presenting **SAD** (Segment Any RGBD): SAD is... able to perform 3D segmentation (segment out any 3D object) with RGBD inputs (or rendered depth images only). - Code: - Demo Hugging Face:show more

Segment Any 3D Gaussians paper page: Interactive 3D segmentation... in radiance fields is an appealing task since its importance in 3D scene understanding and manipulation. However, existing methods face challenges in either achieving fine-grained, multi-granularity segmentation or contending with substantial computational overhead, inhibiting real-time interaction. In this paper, we introduce Segment Any 3D GAussians (SAGA), a novel 3D interactive segmentation approach that seamlessly blends a 2D segmentation foundation model with 3D Gaussian Splatting (3DGS), a recent breakthrough of radiance fields. SAGA efficiently embeds multi-granularity 2D segmentation results generated by the segmentation foundation model into 3D Gaussian point features through well-designed contrastive training. Evaluation on existing benchmarks demonstrates that SAGA can achieve competitive performance with state-of-the-art methods. Moreover, SAGA achieves multi-granularity segmentation and accommodates various prompts, including points, scribbles, and 2D masks. Notably, SAGA can finish the 3D segmentation within milliseconds, achieving nearly 1000x acceleration compared to previous SOTA.show more

Today we're releasing the Segment Anything Model (SAM) —... a step toward the first foundation model for image segmentation. SAM is capable of one-click segmentation of any object from any photo or video + zero-shot transfer to other segmentation tasks ➡️show more

Huge drop by Meta: ActionMesh turns any video into... an animated 3D mesh. Demo available on Hugging Face ⬇️show more

How to turn any 2d object into 3d!

upgrading famous statues using womp easily add goopy 3d... to any 3d mesh or object using our newest imports tool 🫢 #womp3dshow more

Distill-Any-Depth app is live on Hugging Face! 🔥🔥

Apply Texture Qwen Image Edit LoRA by tarn59 works... with EVERYTHING! 👉🪵🧶, this model trains so well I've built this demo so you can apply *any* texture to *any* object on Hugging Faceshow more

NVIDIA finally released Neuralangelo's source code! The model can... turn videos from any device into detailed 3D structures, fully replicating buildings, sculptures, or other real aworld objects or spaces virtually. Here's how it works: A model utilizes a 2D video with multiple angles of an object or scene. I selects frames from different viewpoints to understand depth, size, and shape. The AI creates an initial 3D representation, similar to a sculptor shaping a subject. The render is optimized to enhance details, like a sculptor refining texture. The outcome is a 3D object or scene suitable for virtual reality, digital twins, or robotics.show more

3Dfy anything from a single image! Very thrilled to... announce SAM 3D. From an input image, select any object you want, 3Dfy it! Blog: Demo:show more

Segment Anything is fun and powerful but still requires... full mask annotation for supervised training. Our new work MaskFreeVIS appearing at #CVPR2023 shows we can get accurate video instance segmentation WITHOUT any video or image mask annotations. More atshow more

Lightplane Highly-Scalable Components for Neural 3D Fields Contemporary 3D... research, particularly in reconstruction and generation, heavily relies on 2D images for inputs or supervision. However, current designs for these 2D-3D mapping are memory-intensive, posing ashow more

(1/2) Check out 𝐆𝐚𝐮𝐬𝐬𝐢𝐚𝐧𝐀𝐯𝐚𝐭𝐚𝐫𝐬: Photorealistic Head Avatars with Rigged... 3D Gaussians! We create photorealistic head avatars by animating 3D Gaussians on a parametric face model - edited and rendered in *real-time*!show more

🚀 The Segment Anything Model (SAM) has been upgraded... to SAM2, featuring an efficient image encoder for segmenting images and videos. But does SAM2 outperform SAM1 in medical image and video segmentation? We're thrilled to present our paper "Segment Anything in Medical Images and Videos: Benchmark and Deployment"! We comprehensively benchmark SAM2 across 11 medical image modalities and videos. 📄 Paper: 💻 Code: **Highlights:** 1. SAM2 doesn’t always outperform SAM1 in 2D medical images, but excels in video segmentation, making it more accurate and efficient for 3D images, such as CT and MR scans. 2. MedSAM still outperforms SAM2 on most 2D modalities, but SAM2 surpasses MedSAM for 3D image segmentation in a slice-by-slice approach. 3. Segmentation performance varies with model size; sometimes the smallest model outperforms larger ones. 4. Fine-tuning SAM2 significantly boosts its performance for medical image segmentation. While SAM2 may struggle with challenging objects that have unclear boundaries or low contrast, it excels in generating good initial segmentation masks for common medical images and videos. However, the official interface doesn’t support medical data formats and has limitations on video length. To address this, we've developed a 3D Slicer Plugin and Gradio API for efficient 3D medical image and video segmentation. We invite you to try them out and provide feedback! 🔧 Deployment: - 3D Slicer Plugin: - Gradio API: (Note: Due to GPU limitations, the online API is available for only 12 hours and may be slow. We highly recommend deploying the Gradio API with your own computing resources: A big shoutout to Jun Ma (JunMa) who recently joined our UHN AI hub (UHN AI Hub) as Machine Learning Lead, and kudos to all co-authors: Sumin Kim, Feifei Li, Mohammed Baharoon (Mohammed Baharoon), Reza Asakereh, and Hongwei Lyu! This is true teamwork! Looking forward to collaborating with the community to advance 3D medical image and video segmentation foundation models! University Health Network U of T Department of Computer Science Department of Laboratory Medicine & Pathobiology Temerty Centre for AI in Medicine (T-CAIREM) Vector Institute #MedTech #AIinHealthcare #DeepLearning #MedicalImaging #SAM2 #MedSAM #AIResearchshow more

First Sachi 3D file is ready which you are... able to use your character where you want in any metaverse, for rendering or in animation as a few example. Use the link below to try it out👇show more

Introducing Claude code for 3D modeling You can now... create a production-level 3D models from any agent you are using. Ready to plug into your own apps or games Made possible by Suzanne and Monidshow more

Soon, thanks to AI, we’ll be able to turn... any 2D character we create in Midjourney into fully customizable 3D assets!show more

🚨 Meta introduces Segment Anything Model 2 (SAM 2)... — the first unified model for real-time, promptable object segmentation in images & videos. 🚀SAM 2 is available today under Apache 2.0 so that anyone can use it to build their own experiences ➡️show more

In Sanatan Dharma if any elderly person losses the... life we don't perform any functions like marriage or any major festivals. I felt really sad after this sharab shabab video of Supriya Sule's daughter's marriage video. I am sorry #AjitPawar sir. 🙏🏻show more

WebGL2 3D engine built from scratch I made it... to benchmark 3D on web without any libraries, achieving a smooth 120FPS and scoring 4 x 100 in Lighthouse. Code below Also, the whole JavaScript is only 10kb. Rain shader from . tutorial 3D models from pikuma.com courseshow more

As we move more and more into 3D, texturing... 3D assets will be essential ☝️ Repainting 3D Assets is a new AI method that can take any 3D asset and paint it with a given text prompt. The results, while low-resolution, are pretty impressive.show more