正在加载视频...
视频加载失败
Excited to release the first worldwide aerial image localization method (and demo!) Take an aerial or satellite image from anywhere in the world, and AstroLoc can (probably) find its location, and provide a precise footprint! Links to paper, demo and full-length (5 min) video ⬇️
13 条评论

AstroLoc is an image retrieval model trained on 5M satellite images and 300k photos by astronauts on the ISS. We use two contrastive losses, one with pairs of satellite-astronaut photos, and one with only satellite images, mined as per the distribution of astronaut photos.

How does the demo work? It uses a worldwide database of over 50M images, multiple resolutions (mpp) and orientations, in order to work also for non-north-up images. The predictions are post-processed with EarthMatch, using matchers like RoMa and LightGlue

Strengths and limitations? AstroLoc works well for very unusual images, including photos of wildfires, old images taken by the Space Shuttle and more. The demo is limited...

to images with land area between 10 km2 and 2M km2 (yes, it spans 6 orders of magnitudes!), so it won't be able to localize photos taken by a standard low altitude drone. Increasing this range is a potential future work.

Why is it useful? The main reason for this project is for NASA to geo-locate millions of photos taken by astronauts on the ISS. You read that right! Part of being an astronaut on the ISS is to take photos of Earth, which have unique...

characteristics and are complimentary to more common satellite images. Check out @DonPetit, who’s on ISS right now, for some awesome recent examples.

Why do astronauts on the ISS take photos of Earth and why do we need to localize them? Many reasons, ranging from natural disaster management (for which footprint localization is really important) and climate change studies. More info on the paper and here

If you're more curious about how they take photos, check out this video from @smartereveryday, where he's interviewing ISS astronaut @dominickmatthew on the subject

And if you want to know why they take these photos, check out this video from @NASA @NASAEarth

A big thanks to AstroLoc's co-authors! @AlexStoken @masone_carlo The demo is built with @Gradio, such an amazing tool!

Link to demo (the link to the demo expires in 3 days, then I'll post a new link): Link to paper: Link to full-length (5 minutes) demo video:

And tagging some people that I think might like the demo @robmarkcole @isaaccorley_ @AshFunction @Mouthofmorrison @normconstant @d_kerkow @Cgeoconsulting @stian_h_haugen @yohaniddawela @theepicmap

Excited about the latest tech for your drone product? Our NDAA-compliant, US-made flight controllers are designed to accelerate your path to market and provide a solid platform for developing your autonomous software. Check them out! #Drones #UAV #UAS #Robotics #MadeInUSA
