Загрузка видео...
Не удалось загрузить видео
here's a follow up ground based drone tracker :> this little setup runs with 100Hz+ tracking updates, ~20ms latency, low light, no motion blur. (4d object tracking + 6dof pose/velocity)
116,816 просмотров • 4 месяцев назад •via X (Twitter)
Комментарии: 44

In case you want to do more tests check this dataset from our lab: @miccunifi

@miccunifi this appears to be mainly static? the dataset seems to only be a static camera, no moving cameras.

so this uses an event camera to identify drones?

it can track any object, the drones were just an example! for instance, the prev post showed it tracking bullets

this is so cool! beyond tracking, can it also locate where the object is in space, i.e. give the (x,y,z) coordinates? and can it track in all weather conditions or just when the image is well lit etc?

yep! :) you can check out more:

How the hell did it see any of that? Lol is there radar attached to it?

finally a tracker that doesn't choke on motion blur, though i'd bet the 100hz update rate needs a dedicated nvidia card to stay smooth

this is sick

İf camera move as well can you get same result ?

yep! ill share some videos later but this camera can be mounted on a drone and track other drones in flight as well.

Tracking when the background not is the sky is impressive.

jamming solution: blow some dandelions in front of the sensor

Could be used to find UAPs too. Ignoring the 'cause' of UAPs. But one of these mounted in a high-observe area, that activates a standard camera to focus in on the location of movement.

Cool! You starting something or looking for a role?

yep! in the look for investors/vcs at the moment!

dm me!

sent!

very cool

20ms is pretty slow.

if you look at the video, it states <5ms latency lol i was just being conservative

Why is it 2 frames behind? 20ms latency at 120hz seems to be more accurate based on this…

the video is rendered at like 30fps and not synced to the detection rates :)

So the videos aren't synced...your OP said ~20ms latency...the text that reads "<5ms" is not a real time readout, just a static caption... This doesn't seem worth my time to try to clarify.

The processing time it takes to make a new detection is about 3-4 ms, 1ms to get the data from the sensor. lol sorry if it’s hard for you to understand things faster than your eyes can see

Have you tested with different drone colors?

yep this is entirely color invariant

Cool stuff, I’ll have to read more about this

What kind of radar is being used?

So its using triangular vision to map spacial location?

Hi, What's your hardware setup?

Not gonna help much when 500 drones dive in at 200mph from all directions.

200m only?

Хм, а як зрозуміти, що він бачить саме дрон? Тренувати нейронку?

Why so low? Why not crank up the frequency

This fails at night though with drones that don't have lights on them. I don't know of any event cameras that operate in swir or lwir bands.

@Mister3DMaker

Sell to Ukraine.

@GrandpaRoy2

Is it possible to merge two pie pieces together, seamlessly? Or merge a broader shortrange seamlessly with it? Seamless, two systems merge in one output?

Esto es genial. ¿Sabes cuántos watts consume el sistema o alguna estimación?

Is this open source ?

Are you using voxel projection to convert the stereo image into 3d data?

where can i buy this?
