Video wird geladen...

Video konnte nicht geladen werden

Zur Startseite

I'm experimenting with using SAM2 for automatic tracking of NBA players; it's mind-blowing how well this model performs out of the box. we might even add a SAM2-based tracker to the trackers package at some point. trackers:

292,965 Aufrufe • vor 1 Jahr •via X (Twitter)

11 Kommentare

Profilbild von SkalskiP
SkalskiPvor 1 Jahr

I found this SAM2 fork that addresses my main issue with the original implementation—it allows running SAM2 on video streams!

Profilbild von SkalskiP
SkalskiPvor 1 Jahr

the results aren’t perfect every time, but a cool idea would be to use SAM2 for automatic labeling of datasets for object detection, instance segmentation, or tracking.

Profilbild von SkalskiP
SkalskiPvor 1 Jahr

if you want to learn more about SAM2 and how to use it for image and video segmentation, here’s a link to my stream from a few months ago.

Profilbild von Brandon Tyler
Brandon Tylervor 1 Jahr

So cool! Looking for stats analytics for basketball. I use @veotechnologies but they don’t offer basketball and the ai teaching is so expensive

Profilbild von SkalskiP
SkalskiPvor 1 Jahr

@veotechnologies stay tuned I’ll be dropping more demos over the next few weeks

Profilbild von phillpafford
phillpaffordvor 1 Jahr

This is awesome, any volleyball efforts?

Profilbild von SkalskiP
SkalskiPvor 1 Jahr

not from me… but I saw some people on X playing with volleyball usecases

Profilbild von HiFi-Ai / Tom Laroc
HiFi-Ai / Tom Larocvor 1 Jahr

@ImgMotion

Profilbild von uɐɥdǝʇS
uɐɥdǝʇSvor 1 Jahr

yeah it’s bananas

Profilbild von Darin
Darinvor 1 Jahr

Can you segment each player at the joints?

Profilbild von SkalskiP
SkalskiPvor 1 Jahr

what to you mean by „joints”?

Ähnliche Videos

🎋MOCOPI vs VIVE TRACKERS🎋 I got a crazy crazy upgrade on full body tracking thanks to the support of my bambuds, so I made a silly dance comparison to compare the tracking between my old FBT and my new one!! ✨ I danced Bibbidiba by Suisei! (ft. bae as my guide lol) I had to use a different model for the Vive comparison because my Toffee model doesn't work well with the trackers! PROS AND CONS 🔽 1. Mocopi is SO MUCH EASIER to set up! It's very very beginner friendly as well and a great asset to get if you're just starting on doing 3D stuff or want to try it out! Vive trackers are lowkey a pain to set up each time! 2. Vive trackers are EXPENSIIIVEEEE!!!!! The tracking is so so so good but only invest in it if you plan to do lots of 3D content! Mocopi is a much affordable option! 3. Related to point 2, but you get what you pay for when it comes to tracking. Vive may be more expensive, but the tracking quality and accuracy makes it worth it. 4. This is only for people that don't have the Valve Headset, but I use a Quest 3 and I have to do EXTRA SETUP to calibrate the trackers with an external program to use in VRChat! (Mocopi also needs an external program (SlimeVR) but it's much easier to set up imo). 5. Since calibration is paired to your headset with the vive trackers, if your headset goes to sleep or something the calibration will be LOST and you will have to recalibrate again which may take 1 to 2 minutes. Mocopi doesn't have this issue and recalibrating is only one button. 6. Mocopi is an IMU so no base stations required but because of this the trackers need to be recalibrated A LOT of times. This may be annoying if you're streaming and you constantly have to press the button to recalibrate. Vive trackers may take longer but you VERY RARELY have to recalibrate if your headset doesn't go to sleep. 7. Vive trackers take a lot of space on your setup. Each tracker needs to be connected to the PC so if you have a lot you may need to buy an USD hub! 8. You need to have a good room space to use vive trackers properly because the base stations need to have a clear view of your trackers or else they can lose tracking! Mocopi is an IMU, so no amount of obstruction will make the trackers lose tracking. 9. The amount of poses and movement that you can do with vive trackers is NIGHT AND DAY compared to the mocopi. A lot of poses or rapid movements will make the mocopis mess up their tracking and you will have to recalibrate. Vive trackers will not need any recalibration. Basically if you're a vtuber that only wants to dabble into 3D content as a fun little thing I think mocopis are very much a good choice! But if you'd like to do 3D stuff that require more intensive tracking like dancing, vive trackers are excellent and very much worth the price!

Toffee 🐾🎋

80,586 Aufrufe • vor 10 Monaten

"Aydan why don't you make videos anymore?" Why? Because over the last two years every single time I get in vr to try and film. This shit happens. It makes it so fucking hard to get motivated to do it when I can't get one locked off angle shot. Before you say something like "Have you covered all the reflective surfaces?" "Have you re-paired the trackers?" "Try replacing the lighthouses?" "Try replacing the cables?" "The Dongles might be bad?" "The Trackers might be bad?" "The Controllers might be bad?" "Try a USB hub?" "Try USB Ports?" "Try this 7-1 in one dongle hub?" "Try Tundra Trackers?" "Try This 3-1 dongle hub?" "Try pairing one controller each to a dongle, and pair the trackers to a single dongle too?" "Have you tried reinstalling the software? "Have you tried Steam VR Beta?" "Try Slime trackers?" "Try Quest Pro?" "Try less 2.4ghz band devices?" "Maybe your Wifi bulbs are interfering?" "Try Bigscreen Beyond 2e?" "Try 2 Lighthouses?" "Try 3 Lighthouses?" "Try 4 Lighthouses?" "Maybe your computers bad? Get a new one?" YES. I have fucking tried all that shit. Literally have spent thousands of dollars trouble shooting this issues. I currently own 3 tracking headsets 9 lighthouses 6 vive trackers 3 tundra trackers 8 slime trackers 5 pairs of index controllers. And I've tried on 3 different computers. I have talked to like 20 different people. No one has an answer. I'm at the end of my rope at this point. Every time I get into VR I'm filled with dread because I know I'm going to get mad or frustrated. I'm just...sad. I want to make content, but I don't fucking know what to do at this point.

Aydan

12,663 Aufrufe • vor 3 Monaten

🚀 The Segment Anything Model (SAM) has been upgraded to SAM2, featuring an efficient image encoder for segmenting images and videos. But does SAM2 outperform SAM1 in medical image and video segmentation? We're thrilled to present our paper "Segment Anything in Medical Images and Videos: Benchmark and Deployment"! We comprehensively benchmark SAM2 across 11 medical image modalities and videos. 📄 Paper: 💻 Code: **Highlights:** 1. SAM2 doesn’t always outperform SAM1 in 2D medical images, but excels in video segmentation, making it more accurate and efficient for 3D images, such as CT and MR scans. 2. MedSAM still outperforms SAM2 on most 2D modalities, but SAM2 surpasses MedSAM for 3D image segmentation in a slice-by-slice approach. 3. Segmentation performance varies with model size; sometimes the smallest model outperforms larger ones. 4. Fine-tuning SAM2 significantly boosts its performance for medical image segmentation. While SAM2 may struggle with challenging objects that have unclear boundaries or low contrast, it excels in generating good initial segmentation masks for common medical images and videos. However, the official interface doesn’t support medical data formats and has limitations on video length. To address this, we've developed a 3D Slicer Plugin and Gradio API for efficient 3D medical image and video segmentation. We invite you to try them out and provide feedback! 🔧 Deployment: - 3D Slicer Plugin: - Gradio API: (Note: Due to GPU limitations, the online API is available for only 12 hours and may be slow. We highly recommend deploying the Gradio API with your own computing resources: A big shoutout to Jun Ma (JunMa) who recently joined our UHN AI hub (UHN AI Hub) as Machine Learning Lead, and kudos to all co-authors: Sumin Kim, Feifei Li, Mohammed Baharoon (Mohammed Baharoon), Reza Asakereh, and Hongwei Lyu! This is true teamwork! Looking forward to collaborating with the community to advance 3D medical image and video segmentation foundation models! University Health Network U of T Department of Computer Science Department of Laboratory Medicine & Pathobiology Temerty Centre for AI in Medicine (T-CAIREM) Vector Institute #MedTech #AIinHealthcare #DeepLearning #MedicalImaging #SAM2 #MedSAM #AIResearch

Bo Wang

178,455 Aufrufe • vor 1 Jahr