Video wird geladen...

Video konnte nicht geladen werden

Zur Startseite

Meet SAM 3, a unified model that enables detection, segmentation, and tracking of objects across images and videos. SAM 3 introduces some of our most highly requested features like text and exemplar prompts to segment all objects of a target category. Learnings from SAM 3 will help power new...

195,252 Aufrufe • vor 10 Monaten •via X (Twitter)

21 Kommentare

Profilbild von AI at Meta
AI at Metavor 10 Monaten

We’re sharing SAM 3 under the SAM License so others can use it to build their own experiences. Alongside the model, we’re releasing a new evaluation benchmark, model checkpoint, and open-source code for inference and fine-tuning. These resources are designed to support advanced applications in media editing, scientific analysis, and beyond. 🔗 Download the models:

Profilbild von AI at Meta
AI at Metavor 10 Monaten

We've partnered with @Roboflow to enable people to annotate data, fine-tune, and deploy SAM 3 for their particular needs. Try it here:

Profilbild von AI at Meta
AI at Metavor 10 Monaten

SAM 3 tackles a challenging problem in vision: unifying a model architecture for detection and tracking. Christoph, a researcher on SAM 3, shares how the team made it possible. 🔗 Read the SAM 3 research paper:

Profilbild von Tim Hughes
Tim Hughesvor 10 Monaten

This is insane! It's so fast wtf!

Profilbild von FARHAN AKBAR
FARHAN AKBARvor 10 Monaten

SAM 3 delivering detection, segmentation, AND tracking in one unified model is a serious upgrade and text + exemplar prompts are exactly what creators have been waiting for. Bringing this tech straight into Instagram Edits and Vibes is going to level up the entire creator ecosystem.

Profilbild von SKYLINE🥷
SKYLINE🥷vor 10 Monaten

cool upgrade, creators definitely gonna love this

Profilbild von Pourush Siddharth
Pourush Siddharthvor 10 Monaten

The integration into 'Instagram Vibes' is the real story here. Meta just murdered 500+ 'AI Video Editor' startups with a single update. If native tools offer SOTA segmentation via text prompts, the 'Wrapper' era is officially dead. You can't compete with free, native.

Profilbild von Sam
Samvor 10 Monaten

Cool 👍

Profilbild von Roman M • building gotmoat.ai • curo.you - e/acc
Roman M • building gotmoat.ai • curo.you - e/accvor 10 Monaten

This is dope!

Profilbild von md roki
md rokivor 10 Monaten

real build hours

Profilbild von IsroPR🇮🇳
IsroPR🇮🇳vor 10 Monaten

Now this afternoon G3

Profilbild von CENTRAL ✱ ✱
CENTRAL ✱ ✱vor 10 Monaten

@Rotankwot Nice to have sam3

Profilbild von Jahid
Jahidvor 10 Monaten

That's good to see, as I do use SAM model for research experiments.

Profilbild von max iuliani ハリ🌐
max iuliani ハリ🌐vor 10 Monaten

Impressive work with SAM 3 — segmentation is evolving fast. But there’s still a missing layer in today’s AI systems: the ability to *understand humans contextually* — not just objects. We’re working on a human-aligned architecture focused on predictive empathy, contextual safety, and multi-channel perception of real-world situations. When SAM “sees”, HARI understands *why it matters*. If Meta is exploring the next step — human-context reasoning — I’d be glad to share a concise technical outline. #AI #AISafety #HumanAlignedAI

Profilbild von Oscar Davies
Oscar Daviesvor 10 Monaten

computers will never be "intelligent"

Profilbild von Fury
Furyvor 10 Monaten

Yo this is fucking HUGE

Profilbild von Luma5
Luma5vor 10 Monaten

🚀🚀🚀

Profilbild von bvc
bvcvor 10 Monaten

🔥🔥🔥

Profilbild von 無限 💀 acc/acc
無限 💀 acc/accvor 10 Monaten

hype :). tomorrow with this one.

Profilbild von Chris Strom
Chris Stromvor 10 Monaten

@grok what are the larger use cases for this tech in the future?

Profilbild von Paternal Path
Paternal Pathvor 10 Monaten

Every time AI learns to see with this much precision, you can feel the future inch a little closer. SAM 3 is a real shift.

Ähnliche Videos

Everyone is sleeping on Meta's SAM 3 release. But it's actually a big deal. Here's why: Companies spend millions paying humans to label images and videos frame by frame. A single autonomous driving dataset? Months of work, hundreds of annotators, millions in cost. Without labeled data, you can't train custom models. Without custom models, you're stuck with generic solutions. This is why most companies never move past pilots. SAM 3 breaks this cycle. First let's look at the evolution: SAM 1 segmented objects when you clicked on them. Revolutionary, but one object at a time. SAM 2 added video tracking with memory. Game-changing, but you still manually prompted every object. SAM 3 changes everything with text prompts. Type "yellow school bus" and it finds ALL of them in your image or video. Not just one. Every instance across thousands of frames. Now here's where people get confused: "Can't I just use GPT-5 or Gemini for this?" No, and here's why that's a terrible approach. Large multimodal LLMs are great for reasoning, but they're slow and expensive for production visual tasks. You're paying API costs per image, waiting seconds for responses, getting inconsistent results. SAM 3 runs in 30 milliseconds on a single GPU for 100+ objects. That's 100x faster, and you own the infrastructure. More importantly, SAM 3 gives you precise pixel-level masks, not descriptions. Try asking an LLM to segment every defective part on a manufacturing line in real-time. It won't work. SAM 3 does this effortlessly. The real breakthrough is their data engine. Meta built an AI-human hybrid system that's 5x faster for complex annotations. They trained SAM 3 on 4 million unique visual concepts - 50x more than existing benchmarks like LVIS. SAM 3 is trained on 4 million unique visual concepts, it handles everything: - Text-based concept search - Interactive refinement with clicks - Video tracking across frames - Zero-shot detection of new concepts The model is open source. Weights, code, and benchmarks are on GitHub. If you're building computer vision applications, this is the foundation model to evaluate. The annotation time savings alone will pay for integration costs within weeks. Find the relevant links in the next tweet!

Akshay 🚀

46,438 Aufrufe • vor 10 Monaten

🚀 The Segment Anything Model (SAM) has been upgraded to SAM2, featuring an efficient image encoder for segmenting images and videos. But does SAM2 outperform SAM1 in medical image and video segmentation? We're thrilled to present our paper "Segment Anything in Medical Images and Videos: Benchmark and Deployment"! We comprehensively benchmark SAM2 across 11 medical image modalities and videos. 📄 Paper: 💻 Code: **Highlights:** 1. SAM2 doesn’t always outperform SAM1 in 2D medical images, but excels in video segmentation, making it more accurate and efficient for 3D images, such as CT and MR scans. 2. MedSAM still outperforms SAM2 on most 2D modalities, but SAM2 surpasses MedSAM for 3D image segmentation in a slice-by-slice approach. 3. Segmentation performance varies with model size; sometimes the smallest model outperforms larger ones. 4. Fine-tuning SAM2 significantly boosts its performance for medical image segmentation. While SAM2 may struggle with challenging objects that have unclear boundaries or low contrast, it excels in generating good initial segmentation masks for common medical images and videos. However, the official interface doesn’t support medical data formats and has limitations on video length. To address this, we've developed a 3D Slicer Plugin and Gradio API for efficient 3D medical image and video segmentation. We invite you to try them out and provide feedback! 🔧 Deployment: - 3D Slicer Plugin: - Gradio API: (Note: Due to GPU limitations, the online API is available for only 12 hours and may be slow. We highly recommend deploying the Gradio API with your own computing resources: A big shoutout to Jun Ma (JunMa) who recently joined our UHN AI hub (UHN AI Hub) as Machine Learning Lead, and kudos to all co-authors: Sumin Kim, Feifei Li, Mohammed Baharoon (Mohammed Baharoon), Reza Asakereh, and Hongwei Lyu! This is true teamwork! Looking forward to collaborating with the community to advance 3D medical image and video segmentation foundation models! University Health Network U of T Department of Computer Science Department of Laboratory Medicine & Pathobiology Temerty Centre for AI in Medicine (T-CAIREM) Vector Institute #MedTech #AIinHealthcare #DeepLearning #MedicalImaging #SAM2 #MedSAM #AIResearch

Bo Wang

178,744 Aufrufe • vor 2 Jahren