Video yükleniyor...

Video Yüklenemedi

Ana Sayfaya Dön

I am really impressed by how easy Spectacular AI makes visual-inertial odometry with an OAK camera. Just "pip install spectacularAI" and run a Python script. Running VIO/SLAM used to be much harder in my opinion.

70,818 görüntüleme • 9 ay önce •via X (Twitter)

26 Yorum

Marco Franzon profil fotoğrafı
Marco Franzon9 ay önce

Really impressive! Perfect for drones

r3333d profil fotoğrafı
r3333d9 ay önce

I'm actually researching monocular SLAM right now. I want to run in real-time from a drone video stream.

Yu Xiang profil fotoğrafı
Yu Xiang9 ay önce

You can try the spectacularAI package if you have an OAK camera, very easy to run

MechatronicsEngineer profil fotoğrafı
MechatronicsEngineer9 ay önce

Crazy how much simpler it’s getting did you tweak anything, or just ran it as is?

Yu Xiang profil fotoğrafı
Yu Xiang9 ay önce

Plug the camera and run it. Because they already have support for these cameras:

payback profil fotoğrafı
payback9 ay önce

spectacular ai doesn't work on arm , hence useless for embedded applications, also it's a proprietary sdk, u can do vio slam with native depthai sdk

Danilo Gasques, Ph.D. profil fotoğrafı
Danilo Gasques, Ph.D.9 ay önce

This looks so good

AIトレンド速報|最新ニュース & 活用術 profil fotoğrafı
AIトレンド速報|最新ニュース & 活用術9 ay önce

Yeah, the pip install + script approach really simplifies VIO/SLAM with OAK. Huge improvement!

Hongyu Li profil fotoğrafı
Hongyu Li9 ay önce

How's their depth quality?

Yu Xiang profil fotoğrafı
Yu Xiang9 ay önce

It is active vision using IR. So the depth quality is not that great. The plan is to get depth from FoundationStereo

Arash Tajik profil fotoğrafı
Arash Tajik9 ay önce

curious how your experience was with different cameras; I saw you have been trying OAK and other brands in previous posts.

Yu Xiang profil fotoğrafı
Yu Xiang9 ay önce

I am trying to find a RGB-D/stereo camera for ego-centric data. So far, I decided to use OAK-D Pro W for its wider FOV. Overall, ZED and OAK cameras have more options.

Andrey Tatarinov profil fotoğrafı
Andrey Tatarinov9 ay önce

Curious, can it work on a monocular video?

Yu Xiang profil fotoğrafı
Yu Xiang9 ay önce

Yes, it can be used with one camera

Sir Kabuchanga profil fotoğrafı
Sir Kabuchanga9 ay önce

@OpenRoboticsOrg Wow interesting, am trying to imagine a the applicants.

Tyler Gibson profil fotoğrafı
Tyler Gibson9 ay önce

Would be cool for 360 cams

nyx profil fotoğrafı
nyx9 ay önce

the gap between "theoretically possible" and "actually usable by normal humans" is where most good tools die. nice to see one that made it across

Ashley Feng profil fotoğrafı
Ashley Feng9 ay önce

sounds super cool, i love when tech gets easier to use

Jeffery Wang profil fotoğrafı
Jeffery Wang9 ay önce

How's position track quality, and drift performance? using the native free spectacular AI pack?

Yu Xiang profil fotoğrafı
Yu Xiang9 ay önce

Looks pretty good to me

Jeffery Wang profil fotoğrafı
Jeffery Wang9 ay önce

Nice, Thanks !

Leo Chien profil fotoğrafı
Leo Chien9 ay önce

How fast the odometry data can output with the camera?

luke profil fotoğrafı
luke9 ay önce

Does it support ZED cameras? I'm a big fan of ZED 2i

United Records profil fotoğrafı
United Records9 ay önce

wow

setoFPV profil fotoğrafı
setoFPV4 ay önce

can we use T265 with Spectacular AI libs?

Himanshu Kumar profil fotoğrafı
Himanshu Kumar9 ay önce

I'm impressed; Spectacular AI's visual-inertial odometry is easy with an OAK camera.

Benzer Videolar

Can an inexpensive, off-the-shelf IMU be the only sensor to estimate the full state (position, velocity, orientation) of a quadrotor flying through a track at high speed and even be on-pair with vision-based localization? The answer is yes, within certain limitations! In this #RAL2023 paper, we propose a learning-based odometry algorithm that couples a model-based filter driven by the inertial measurements with a learning-based module with access to the control commands. Our system outperforms by a large margin the state-of-the-art visual-inertial odometry (#VIO) algorithms and the state-of-the-art learned-inertial odometry algorithm, #TLIO, for the task of drone racing. Additionally, we show that our system is as accurate as a VIO algorithm that uses a camera to localize to a known map of the racing track. The main limitation of our approach is that it cannot generalize to trajectories that have not been seen at training time. However, in drone racing competitions, the track is known beforehand. Human pilots spend hours or even days of practice on the race track before the competition. Similarly, our system can be trained with the data collected during practice time and deployed during the competition. Future work will investigate how to generalize to trajectories not seen at training time. The code is released! Paper: Video: Code: Kudos to Giovanni Cioffi Leonard Bauersfeld Elia Kaufmann European Research Council (ERC) University of Zurich UZH Science UZH Space Hub NCCR Robotics Aerial Core #RAL2023 #IROS2023 #SLAM

Davide Scaramuzza

37,061 görüntüleme • 3 yıl önce