正在加载视频...

视频加载失败

Excited to release the first worldwide aerial image localization method (and demo!) Take an aerial or satellite image from anywhere in the world, and AstroLoc can (probably) find its location, and provide a precise footprint! Links to paper, demo and full-length (5 min) video ⬇️

34,062 次观看 • 1 年前 •via X (Twitter)

13 条评论

Gabriele Berton 的头像
Gabriele Berton1 年前

AstroLoc is an image retrieval model trained on 5M satellite images and 300k photos by astronauts on the ISS. We use two contrastive losses, one with pairs of satellite-astronaut photos, and one with only satellite images, mined as per the distribution of astronaut photos.

Gabriele Berton 的头像
Gabriele Berton1 年前

How does the demo work? It uses a worldwide database of over 50M images, multiple resolutions (mpp) and orientations, in order to work also for non-north-up images. The predictions are post-processed with EarthMatch, using matchers like RoMa and LightGlue

Gabriele Berton 的头像
Gabriele Berton1 年前

Strengths and limitations? AstroLoc works well for very unusual images, including photos of wildfires, old images taken by the Space Shuttle and more. The demo is limited...

Gabriele Berton 的头像
Gabriele Berton1 年前

to images with land area between 10 km2 and 2M km2 (yes, it spans 6 orders of magnitudes!), so it won't be able to localize photos taken by a standard low altitude drone. Increasing this range is a potential future work.

Gabriele Berton 的头像
Gabriele Berton1 年前

Why is it useful? The main reason for this project is for NASA to geo-locate millions of photos taken by astronauts on the ISS. You read that right! Part of being an astronaut on the ISS is to take photos of Earth, which have unique...

Gabriele Berton 的头像
Gabriele Berton1 年前

characteristics and are complimentary to more common satellite images. Check out @DonPetit, who’s on ISS right now, for some awesome recent examples.

Gabriele Berton 的头像
Gabriele Berton1 年前

Why do astronauts on the ISS take photos of Earth and why do we need to localize them? Many reasons, ranging from natural disaster management (for which footprint localization is really important) and climate change studies. More info on the paper and here

Gabriele Berton 的头像
Gabriele Berton1 年前

If you're more curious about how they take photos, check out this video from @smartereveryday, where he's interviewing ISS astronaut @dominickmatthew on the subject

Gabriele Berton 的头像
Gabriele Berton1 年前

And if you want to know why they take these photos, check out this video from @NASA @NASAEarth

Gabriele Berton 的头像
Gabriele Berton1 年前

A big thanks to AstroLoc's co-authors! @AlexStoken @masone_carlo The demo is built with @Gradio, such an amazing tool!

Gabriele Berton 的头像
Gabriele Berton1 年前

Link to demo (the link to the demo expires in 3 days, then I'll post a new link): Link to paper: Link to full-length (5 minutes) demo video:

Gabriele Berton 的头像
Gabriele Berton1 年前

And tagging some people that I think might like the demo @robmarkcole @isaaccorley_ @AshFunction @Mouthofmorrison @normconstant @d_kerkow @Cgeoconsulting @stian_h_haugen @yohaniddawela @theepicmap

ARK Electronics 的头像
ARK Electronics2 年前

Excited about the latest tech for your drone product? Our NDAA-compliant, US-made flight controllers are designed to accelerate your path to market and provide a solid platform for developing your autonomous software. Check them out! #Drones #UAV #UAS #Robotics #MadeInUSA

相关视频