Video yükleniyor...

Video Yüklenemedi

Ana Sayfaya Dön

MetaAI's SAM 2 struggles when things move fast or when there are crowded, fast-moving objects! Introducing SAMURAI: An adaptation of the Segment Anything Model for Zero-Shot Visual Tracking with Motion-Aware Memory. 100% Open Source

Sumanth_077's profile picture

Sumanth

76,665 subscribers

324,580 görüntüleme • 1 yıl önce •via X (Twitter)

EğitimBilim & Teknoloji
LIVE

Anya Rossi• Live Now

Private livecam show

11 Yorum

Sumanth profil fotoğrafı
Sumanth1 yıl önce

Github Repo:

Sumanth profil fotoğrafı
Sumanth1 yıl önce

If you find this useful, RT to share it with your friends. Don't forget to follow me @Sumanth_077 for more such content and tutorials on Python, AI & ML!

Page to Pixel Publishing profil fotoğrafı
Page to Pixel Publishing2 yıl önce

The Art of Flight is a homage to 80s/90s arcade action shmups with a fresh twist on the genre. Pilot multiple ships at the same time to take on oncoming waves of enemies in this fast paced space shooter. Wishlist on Steam today!

Rethynk AI profil fotoğrafı
Rethynk AI1 yıl önce

That’s a brilliant upgrade! SAMURAI sounds like a game-changer for dynamic environments where traditional SAM models fall short. Motion-aware memory could make zero-shot visual tracking far more robust, especially in real-world applications like sports analysis or autonomous vehicles.

Sumanth profil fotoğrafı
Sumanth1 yıl önce

Absolutely!

anarki🌟 profil fotoğrafı
anarki🌟1 yıl önce

instant @arXivBangers haha let’s gooooo!!!!!

Pérry Odé 🇪🇺🇩🇪🇺🇦🇮🇱 profil fotoğrafı
Pérry Odé 🇪🇺🇩🇪🇺🇦🇮🇱1 yıl önce

If I were a producer of self-shooting and AI-driven drones, SAMURAI would be preferable in this case. 👍

Machine Learning Community ⭐️ profil fotoğrafı
Machine Learning Community ⭐️1 yıl önce

Impressive!

Sumanth profil fotoğrafı
Sumanth1 yıl önce

Indeed!

Appy Pie profil fotoğrafı
Appy Pie1 yıl önce

MetaAI's SAM 2 meets its match with fast motion and crowded scenes, but SAMURAI steps in! Motion-aware memory and zero-shot visual tracking make it a game-changer. Plus, it's 100% open source!

tarama profil fotoğrafı
tarama1 yıl önce

@BenjaminDEKR fyi

Benzer Videolar

SAMURAI: Adapting Segment Anything Model for Zero-Shot Visual Tracking with Motion-Aware check out this SAM2 vs SAMURAI comparison! - paper: - code: - license: Apache-2.0
0:25

SAMURAI: Adapting Segment Anything Model for Zero-Shot Visual Tracking with Motion-Aware check out this SAM2 vs SAMURAI comparison! - paper: - code: - license: Apache-2.0

SkalskiP

124,358 görüntüleme • 1 yıl önce

SAMURAI gives SAM 2 motion-aware memory! And the results look mind-blowing. This is zero-shot 🤯 Links ⬇️d
0:33

SAMURAI gives SAM 2 motion-aware memory! And the results look mind-blowing. This is zero-shot 🤯 Links ⬇️d

Dreaming Tulpa 🥓👑

116,471 görüntüleme • 1 yıl önce

Just read a neat AI paper called SAMURAI -- it takes SAM 2 (Meta's "segment anything" model) and makes it way better at tracking objects in videos. Basic problem is SAM 2 gets confused when things move fast or there's a crowd of similar objects (big problem for VFX and video intelligence alike). The fix? They basically gave it a sense of motion and smarter memory selection using our old friend the Kalman filter -- helps it remember where things were going instead of just where they are. No retraining needed and runs in realtime. Elegant solution that matches (and even beats!) a lot of purpose built tracking systems. Nice example of how sometimes you don't need fancy new architectures -- just smart ways to use what the model already knows, plus some tried & tested classical methods. Every time someone's like "we solved tracking!" I check the methods section and... yep, there's our boy Kalman, still crushing it after all these years. Sometimes the old school stuff just works.
0:27

Just read a neat AI paper called SAMURAI -- it takes SAM 2 (Meta's "segment anything" model) and makes it way better at tracking objects in videos. Basic problem is SAM 2 gets confused when things move fast or there's a crowd of similar objects (big problem for VFX and video intelligence alike). The fix? They basically gave it a sense of motion and smarter memory selection using our old friend the Kalman filter -- helps it remember where things were going instead of just where they are. No retraining needed and runs in realtime. Elegant solution that matches (and even beats!) a lot of purpose built tracking systems. Nice example of how sometimes you don't need fancy new architectures -- just smart ways to use what the model already knows, plus some tried & tested classical methods. Every time someone's like "we solved tracking!" I check the methods section and... yep, there's our boy Kalman, still crushing it after all these years. Sometimes the old school stuff just works.

Bilawal Sidhu

47,246 görüntüleme • 1 yıl önce

Segment Anything Model 2 (SAM 2) is a foundation model from Meta FAIR for promptable visual segmentation in images & videos. Available now for anyone to build on for free, open source under an Apache license. Try the demo ➡️
0:35

Segment Anything Model 2 (SAM 2) is a foundation model from Meta FAIR for promptable visual segmentation in images & videos. Available now for anyone to build on for free, open source under an Apache license. Try the demo ➡️

AI at Meta

97,733 görüntüleme • 1 yıl önce

Introducing CerebrasCoder! An open-source app that generates websites with Llama3.3-70b from as fast as you can type. 100% free and open-source.
2:08

Introducing CerebrasCoder! An open-source app that generates websites with Llama3.3-70b from as fast as you can type. 100% free and open-source.

Steve Krouse

240,119 görüntüleme • 1 yıl önce

✨ CVPR 2025 highlight: A Distractor-Aware Memory for Visual Object Tracking with SAM2 the authors propose a new distractor-aware memory model for SAM2 and an introspection-based update strategy that jointly addresses the segmentation accuracy as well as tracking robustness 🏡 (1/n)🧵👇
0:34

✨ CVPR 2025 highlight: A Distractor-Aware Memory for Visual Object Tracking with SAM2 the authors propose a new distractor-aware memory model for SAM2 and an introspection-based update strategy that jointly addresses the segmentation accuracy as well as tracking robustness 🏡 (1/n)🧵👇

GeekyRakshit (e/mad)

32,669 görüntüleme • 1 yıl önce

The Segment Anything Model (SAM) by Meta AI is a step toward the first foundation model for image segmentation. SAM is capable of one-click segmentation of any object from photos or videos + zero-shot transfer to other segmentation tasks. Try the demo ➡️
0:51

The Segment Anything Model (SAM) by Meta AI is a step toward the first foundation model for image segmentation. SAM is capable of one-click segmentation of any object from photos or videos + zero-shot transfer to other segmentation tasks. Try the demo ➡️

AI at Meta

186,324 görüntüleme • 3 yıl önce

The last stage of Segment-Anything-Model-2 (SAM-2) is filled with what look to be dead GELUs. It's a graveyard out there.
0:31

The last stage of Segment-Anything-Model-2 (SAM-2) is filled with what look to be dead GELUs. It's a graveyard out there.

Rudy Gilman

26,564 görüntüleme • 1 yıl önce

Introducing VT Tensiontrack a cylindrical tracking scenario with a mix of fast, short & long strafes. Uniquely made on @Aimlab with an indicator that informs the player when to increase tension or loosen up. Great for practicing tension control! ✏️ @Lowgravity56 | 🎯 VT Matty
0:46

Introducing VT Tensiontrack a cylindrical tracking scenario with a mix of fast, short & long strafes. Uniquely made on @Aimlab with an indicator that informs the player when to increase tension or loosen up. Great for practicing tension control! ✏️ @Lowgravity56 | 🎯 VT Matty

Voltaic

27,028 görüntüleme • 2 yıl önce

Things are moving fast! We’re headed for tribulation
3:14

Things are moving fast! We’re headed for tribulation

ittybittytara

23,559 görüntüleme • 1 yıl önce

It's out, and it comes with a demo🔥 Introducing Flux.2 [klein] Move ✨ > specialized move & resize LoRA for Flux.2 [klein] 9B > draw boxes manually or pick from auto-detected objects > works with fast 4-8 step inference 💨
0:20

It's out, and it comes with a demo🔥 Introducing Flux.2 [klein] Move ✨ > specialized move & resize LoRA for Flux.2 [klein] 9B > draw boxes manually or pick from auto-detected objects > works with fast 4-8 step inference 💨

Linoy Tsaban

59,059 görüntüleme • 2 ay önce

That's very impressive You can now use an audio-visual AI model in REAL TIME. So you're not just generating a one-shot video but you can: > interact with it > create a real time character > speak and receive replies Things are moving so fast
0:24

That's very impressive You can now use an audio-visual AI model in REAL TIME. So you're not just generating a one-shot video but you can: > interact with it > create a real time character > speak and receive replies Things are moving so fast

Paul Couvert

44,495 görüntüleme • 15 gün önce

You know that things are moving far too fast when even the 1990s feel as if they're a lifetime ago.
3:32

You know that things are moving far too fast when even the 1990s feel as if they're a lifetime ago.

Vinnie Sullivan

88,636 görüntüleme • 7 gün önce

Lots of things are happening. We are moving pretty fast.
3:32

Lots of things are happening. We are moving pretty fast.

SkriptkeeperElect

135,387 görüntüleme • 1 yıl önce

✨ Introducing 𝐎𝐩𝐞𝐧𝐕𝐋𝐀 — an open-source vision-language-action model for robotics! 👐 - SOTA generalist policy - 7B params - outperforms Octo, RT-2-X on zero-shot evals 🦾 - trained on 970k episodes from OpenX dataset 🤖 - fully open: model/code/data all online 🤗 🧵👇
1:11

✨ Introducing 𝐎𝐩𝐞𝐧𝐕𝐋𝐀 — an open-source vision-language-action model for robotics! 👐 - SOTA generalist policy - 7B params - outperforms Octo, RT-2-X on zero-shot evals 🦾 - trained on 970k episodes from OpenX dataset 🤖 - fully open: model/code/data all online 🤗 🧵👇

Moo Jin Kim

226,991 görüntüleme • 2 yıl önce

I spent most of today preparing for CVPR 2024 "Matching Anything by Segmenting Anything" particularly caught my attention. Here are the fast open-vocabulary tracking examples (MASA + YOLO-World). link: ↓ read more
1:05

I spent most of today preparing for CVPR 2024 "Matching Anything by Segmenting Anything" particularly caught my attention. Here are the fast open-vocabulary tracking examples (MASA + YOLO-World). link: ↓ read more

SkalskiP

114,506 görüntüleme • 2 yıl önce

Finishing too fast can be a problem. But some things are better when they’re fast. Watch till the end & join our Gold Fast or Go Home challenge. 👀
0:45

Finishing too fast can be a problem. But some things are better when they’re fast. Watch till the end & join our Gold Fast or Go Home challenge. 👀

Bitget TradFi

14,770,947 görüntüleme • 1 ay önce

Remarkably lifelike motion and fluidity. BeyondMimic is a framework for training humanoid whole-body control from large mocap datasets. First, an open-source motion-tracking pipeline to reproduce diverse, highly dynamic human skills on real hardware, then distilling them into a guided state-action diffusion model for zero-shot, task-specific control. Project page:
2:42

Remarkably lifelike motion and fluidity. BeyondMimic is a framework for training humanoid whole-body control from large mocap datasets. First, an open-source motion-tracking pipeline to reproduce diverse, highly dynamic human skills on real hardware, then distilling them into a guided state-action diffusion model for zero-shot, task-specific control. Project page:

The Humanoid Hub

58,081 görüntüleme • 10 ay önce

Introducing Chroma Cloud: an open-source serverless search database that is fast, cost-effective, scalable, and reliable.
0:40

Introducing Chroma Cloud: an open-source serverless search database that is fast, cost-effective, scalable, and reliable.

Chroma

127,662 görüntüleme • 10 ay önce

"Things can move really fast when you make decisions." - Jon Moxley #AEWDynamite
0:32

"Things can move really fast when you make decisions." - Jon Moxley #AEWDynamite

All Elite Wrestling

103,062 görüntüleme • 9 ay önce