Video yükleniyor...

Video Yüklenemedi

Ana Sayfaya Dön

GPS-free visual-inertial navigation in real time on Raspberry Pi 5 with a consumer-grade IMU and camera (and this is not even the slowest CPU this runs on!)

oseiskar's profile picture

Otto Seiskari

1,938 subscribers

264,553 görüntüleme • 1 yıl önce •via X (Twitter)

Bilim & TeknolojiEğitim
LIVE

Anya Rossi• Live Now

Private livecam show

11 Yorum

Otto Seiskari profil fotoğrafı
Otto Seiskari1 yıl önce

Features of the new Spectacular AI SDK 1.38 include: ⭐ ONNX-based VPS acceleration: allows full VIO+VPS operation even on Cortex A53s ⭐ Built-in IMU-camera calibration Python tool, based on our fork of Basalt (separate post to follow) For more details:

PDF GPT profil fotoğrafı
PDF GPT2 yıl önce

Stop wasting time reading 50 page documents. This AI tool is like ChatGPT for reading faster. Just upload any PDF and ask a question. It will give you an answer with page citations in seconds. Try it for free.

CrookedToe profil fotoğrafı
CrookedToe1 yıl önce

mfw i need to drop ~2kg of hospital supplies on remote hikers in a famously GPS spotty area

Corey Hauer e/acc profil fotoğrafı
Corey Hauer e/acc1 yıl önce

This is truly amazing work. I have a friend in the military that was talking about GPS denied environments being a challenge. I have to imagine people like Anduril are going to integrate this into our military systems. $60 of compute + $18 barometer + $5 camera + IMU. Just wow. Sadly, commercial and civilian aviation near war zones can be subject to GPS denial as well. IMO, this is a technology that @doge needs to look at with regard to improving aviation safety. LFG!

Nick Parker profil fotoğrafı
Nick Parker1 yıl önce

What's the ratio of data : navigable area here? Assuming you have either map data or like, latents of map data that you're loading in a mission dependent way right? Like this isn't a pi-sized blob of data that can navigate all of Earth right?

Otto Seiskari profil fotoğrafı
Otto Seiskari1 yıl önce

This demo used a 100 x 100 km² map, which easily fits into an SD card (a 1 km x 1000 km map would take practically the same space). The ballpark size is "gigabytes" and is adjustable with a few settings that allow balancing between CPU, disk and accuracy.

DK 🔞⛔🇺🇦 profil fotoğrafı
DK 🔞⛔🇺🇦1 yıl önce

Could this be also used for marine navigation? Think celestial navigation with a INS / IMU.

Otto Seiskari profil fotoğrafı
Otto Seiskari1 yıl önce

Good question. This solution is not suitable for marine navigation, since VIO does not work at sea. Combining IMU / INS with star trackers probably works in the marine context, but it's not the same thing as this method

Master2u profil fotoğrafı
Master2u1 yıl önce

Are you developing this for weapons? There seems to be no real usefulness for this in the commercial industry

Roman | Swapback array profil fotoğrafı
Roman | Swapback array1 yıl önce

bookmarked. what's list of benefits of it? more accurate? or cheaper?

fr0g profil fotoğrafı
fr0g1 yıl önce

raspi5 is a beast.

Benzer Videolar

First demo of our new aerial Visual-Inertial Positioning System (VIO+VPS): 40m positioning accuracy (CEP) in a 50 kilometer flight using a camera, consumer-grade IMU and a barometer! No GPS
0:58

First demo of our new aerial Visual-Inertial Positioning System (VIO+VPS): 40m positioning accuracy (CEP) in a 50 kilometer flight using a camera, consumer-grade IMU and a barometer! No GPS

Otto Seiskari

101,530 görüntüleme • 1 yıl önce

Raspberry Pi gets a comeback as the Star Trek communicator with OpenClaw! Raspberry Pi was popular in the 2010s and now faces a comeback as the personification of OpenClaw in a Tamagotchi shape - it listens, it thinks and it even talks! And it is not even that expensive! Sebastian Volkl created his Raspberry Pi project with just $100. Do you want your own OpenClaw Tamagotchi? #tamagotchi #openclaw #raspberrypi #ai #tech Sebastian Völkl
0:52

Raspberry Pi gets a comeback as the Star Trek communicator with OpenClaw! Raspberry Pi was popular in the 2010s and now faces a comeback as the personification of OpenClaw in a Tamagotchi shape - it listens, it thinks and it even talks! And it is not even that expensive! Sebastian Volkl created his Raspberry Pi project with just $100. Do you want your own OpenClaw Tamagotchi? #tamagotchi #openclaw #raspberrypi #ai #tech Sebastian Völkl

This Week in Startups

16,116 görüntüleme • 4 ay önce

🇮🇷 Iran’s “low-cost” cruise missile navigation is smart layering They combine 3 layers: -Cheap commercial GPS for basic positioning -Inertial navigation to keep flying without signals -Terrain matching to correct errors using preloaded maps and ground scans The key is terrain matching, where the missile compares the ground below with stored elevation maps and continuously corrects its path in real time, even if GPS is jammed. Nothing revolutionary. This tech exists for decades. What matters is the approach: cheap components, open data, and multiple backups working together. End result: not perfect, but reliable enough to hit targets without needing a military satellite network. Source: loadedlore YT
0:53

🇮🇷 Iran’s “low-cost” cruise missile navigation is smart layering They combine 3 layers: -Cheap commercial GPS for basic positioning -Inertial navigation to keep flying without signals -Terrain matching to correct errors using preloaded maps and ground scans The key is terrain matching, where the missile compares the ground below with stored elevation maps and continuously corrects its path in real time, even if GPS is jammed. Nothing revolutionary. This tech exists for decades. What matters is the approach: cheap components, open data, and multiple backups working together. End result: not perfect, but reliable enough to hit targets without needing a military satellite network. Source: loadedlore YT

Mario Nawfal

62,414 görüntüleme • 3 ay önce

This AI is ridiculous - Makes studio grade songs in seconds - Free & open source - Runs on low VRAM or just CPU Full Ace-Step 1.5 tutorial: God bless ACE Music
0:55

This AI is ridiculous - Makes studio grade songs in seconds - Free & open source - Runs on low VRAM or just CPU Full Ace-Step 1.5 tutorial: God bless ACE Music

⚡AI Search⚡

15,105 görüntüleme • 5 ay önce

Raspberry Pi power meets industrial smarts with SECO Pi Vision 10.1 CM5. Pi Vision 10.1 CM5 is a rugged, ready-to-roll platform built around Raspberry Pi Compute Module 5. It’s tailor-made for IoT developers and system integrators. This isn’t just any old human–machine interface. It’s a Raspberry Pi gone pro.
1:27

Raspberry Pi power meets industrial smarts with SECO Pi Vision 10.1 CM5. Pi Vision 10.1 CM5 is a rugged, ready-to-roll platform built around Raspberry Pi Compute Module 5. It’s tailor-made for IoT developers and system integrators. This isn’t just any old human–machine interface. It’s a Raspberry Pi gone pro.

Raspberry Pi

16,610 görüntüleme • 8 ay önce

Haven't seen any demos of using vibe coding to prototype gadgets like this So I made one. Everything here is generated with code Parts of the code and logic can even be reused on a Raspberry Pi to build the real thing Some tips ↓
0:40

Haven't seen any demos of using vibe coding to prototype gadgets like this So I made one. Everything here is generated with code Parts of the code and logic can even be reused on a Raspberry Pi to build the real thing Some tips ↓

Dilum Sanjaya

105,362 görüntüleme • 18 gün önce

THIS PORTABLE HACKER KIT PACKS A RASPBERRY PI 5 WITH 16GB OF RAM AND A 512GB NVME THAT ALSO RUNS LOCAL LLMs, KILLED $200 CLAUDE CODE MAX AND $200 CHATGPT PRO SUBSCRIPTIONS THE DAY IT WENT MOBILE 00:08 he sets down the pi and starts the tour, "this is my raspberry pi 5, 16 gigs of ram, 512 gigabyte nvme ssd storage, this thing means business" the kit stacks the pi next to a bluetooth analyzer, a 5g wifi router with a battery, and a pen-testing dongle for packet injection, the whole rig runs off usb-c and fits in a shoulder bag he uses it for evil-twin wifi tests and bluetooth device audits, and the same pi 5 also handles ollama with a 7b or 14b model locally at usable speed with every packet capture staying inside the case claude code points at localhost through a single environment variable, the cli behaves identically to the cloud version except every token generates on the pi in his hand and the api bill never arrives $200 chatgpt pro and $200 claude code max used to hit the same card that pays his internet, the whole subscription stack died the day the pi got mobile and ai bills went to zero because the model runs on the same box that runs his packet capture bookmark this and read the article below
1:03

THIS PORTABLE HACKER KIT PACKS A RASPBERRY PI 5 WITH 16GB OF RAM AND A 512GB NVME THAT ALSO RUNS LOCAL LLMs, KILLED $200 CLAUDE CODE MAX AND $200 CHATGPT PRO SUBSCRIPTIONS THE DAY IT WENT MOBILE 00:08 he sets down the pi and starts the tour, "this is my raspberry pi 5, 16 gigs of ram, 512 gigabyte nvme ssd storage, this thing means business" the kit stacks the pi next to a bluetooth analyzer, a 5g wifi router with a battery, and a pen-testing dongle for packet injection, the whole rig runs off usb-c and fits in a shoulder bag he uses it for evil-twin wifi tests and bluetooth device audits, and the same pi 5 also handles ollama with a 7b or 14b model locally at usable speed with every packet capture staying inside the case claude code points at localhost through a single environment variable, the cli behaves identically to the cloud version except every token generates on the pi in his hand and the api bill never arrives $200 chatgpt pro and $200 claude code max used to hit the same card that pays his internet, the whole subscription stack died the day the pi got mobile and ai bills went to zero because the model runs on the same box that runs his packet capture bookmark this and read the article below

starmex

25,094 görüntüleme • 13 gün önce

Testing #RePlayOS Alpha in Raspberry Pi 5. Interlaced video, 24bit audio quality, on-the-fly instant resolution changes, and more… Powered by RGB-Pi 💪
2:13

Testing #RePlayOS Alpha in Raspberry Pi 5. Interlaced video, 24bit audio quality, on-the-fly instant resolution changes, and more… Powered by RGB-Pi 💪

RTA

10,175 görüntüleme • 2 yıl önce

Free Blender AI motion capture plugin: Connects to 1080P camera, runs on a local computer with a 10-billion-parameter model, and requires 8GB VRAM for real-time processing. Supports both real-time capture and video uploads.
1:19

Free Blender AI motion capture plugin: Connects to 1080P camera, runs on a local computer with a 10-billion-parameter model, and requires 8GB VRAM for real-time processing. Supports both real-time capture and video uploads.

CYANPUPPETS

233,749 görüntüleme • 1 yıl önce

How to build a Home Assistant controller *and* a CarPlay touchscreen with the new Raspberry Pi Touch Display 2 (FULL video, first time on X!)
8:57

How to build a Home Assistant controller *and* a CarPlay touchscreen with the new Raspberry Pi Touch Display 2 (FULL video, first time on X!)

Jeff Geerling

177,247 görüntüleme • 1 yıl önce

Total insanity. This is using an adaptive LOD scheme in sparksjs (not merged yet). The entire scene has 16million splats and this is real time navigation ... 😱😱
1:32

Total insanity. This is using an adaptive LOD scheme in sparksjs (not merged yet). The entire scene has 16million splats and this is real time navigation ... 😱😱

martin_casado

317,275 görüntüleme • 9 ay önce

we are working on level design aspects! this time is the camera! the level will switch between free camera and fixed camera! #fangame
0:36

we are working on level design aspects! this time is the camera! the level will switch between free camera and fixed camera! #fangame

Mario & Luigi : Star Journey

241,024 görüntüleme • 2 yıl önce

"There is not and not even Fernando Mendoza. I have a higher grade on Shedeur Sanders than I did on anybody in this draft class." 🚨 Emory Hunt with Jonathan Peterlin and Daryl Ruiter on how #Browns QB Shedeur Sanders stacks up to this rookie class 🏈
1:21

"There is not and not even Fernando Mendoza. I have a higher grade on Shedeur Sanders than I did on anybody in this draft class." 🚨 Emory Hunt with Jonathan Peterlin and Daryl Ruiter on how #Browns QB Shedeur Sanders stacks up to this rookie class 🏈

92.3 The Fan

57,150 görüntüleme • 4 ay önce

getting on camera is terrifying sharing my goals in public is probs even more scary lol but today I decided to do both this is just the beginning and this time I am not quitting
2:19

getting on camera is terrifying sharing my goals in public is probs even more scary lol but today I decided to do both this is just the beginning and this time I am not quitting

Maya

23,976 görüntüleme • 2 gün önce

We've mapped our 28,000 sq ft office and built this fly-through in real-time on-device using NVIDIA Orin Nano 4GB and 5 consumer-grade cameras (<$10 at scale). This exact flythrough feature is now live to everyone in the Matic App. Designed for homes, our sensing stack and algorithms scale to larger spaces such as warehouses, malls, and more! Navneet Dalal Mehul #SLAM #Robotics
1:23

We've mapped our 28,000 sq ft office and built this fly-through in real-time on-device using NVIDIA Orin Nano 4GB and 5 consumer-grade cameras (<$10 at scale). This exact flythrough feature is now live to everyone in the Matic App. Designed for homes, our sensing stack and algorithms scale to larger spaces such as warehouses, malls, and more! Navneet Dalal Mehul #SLAM #Robotics

Matic Robots

23,769 görüntüleme • 1 yıl önce

And here we go - running Llama 3.2 3B on Raspberry Pi 5 with AI HAT+ 2. This thing is not going to break any speed records, but it’s incredible that we can now get such a powerful model on such a constrained system. Just a little over 3 years since ChatGPT launched.
0:40

And here we go - running Llama 3.2 3B on Raspberry Pi 5 with AI HAT+ 2. This thing is not going to break any speed records, but it’s incredible that we can now get such a powerful model on such a constrained system. Just a little over 3 years since ChatGPT launched.

Bojan Tunguz

27,108 görüntüleme • 5 ay önce

THIS DEVELOPER LINES UP EVERY SMALL COMPUTER FROM RASPBERRY PI TO MAC MINI - AND EVERY SINGLE ONE CAN RUN LOCAL AI Raspberry Pi Zero 2W for $15, Odroid, thin client, AMD BC250 - a whole range of computers from credit card size to full desktop replacement AMD BC250 is an entire mid-range gaming computer on one card - they come in boxes of 12 and every single one runs local LLMs Mac Mini, N97 with 16GB RAM, 13th gen i7 - any of them replaces $236/month in subscriptions and costs $3/month in electricity you don't need an expensive server - even a $15 Raspberry Pi can run something useful locally without cloud and without subscriptions $600 once, one evening of setup - and AI that runs 24/7 on hardware that might already be sitting in your house
2:30

THIS DEVELOPER LINES UP EVERY SMALL COMPUTER FROM RASPBERRY PI TO MAC MINI - AND EVERY SINGLE ONE CAN RUN LOCAL AI Raspberry Pi Zero 2W for $15, Odroid, thin client, AMD BC250 - a whole range of computers from credit card size to full desktop replacement AMD BC250 is an entire mid-range gaming computer on one card - they come in boxes of 12 and every single one runs local LLMs Mac Mini, N97 with 16GB RAM, 13th gen i7 - any of them replaces $236/month in subscriptions and costs $3/month in electricity you don't need an expensive server - even a $15 Raspberry Pi can run something useful locally without cloud and without subscriptions $600 once, one evening of setup - and AI that runs 24/7 on hardware that might already be sitting in your house

Cortex

16,937 görüntüleme • 16 gün önce

I saw Alex Aljoe do this with Luis Diaz earlier in the season and was hugely impressed. It’s such a skill to talk and translate in real time whilst live on camera with producers in your ear the whole time.
3:28

I saw Alex Aljoe do this with Luis Diaz earlier in the season and was hugely impressed. It’s such a skill to talk and translate in real time whilst live on camera with producers in your ear the whole time.

HLTCO

854,789 görüntüleme • 1 yıl önce

I taught a speech model to understand context in conversation. This is what happened It adjusts voice and tone to express urgency, comfort, understanding from the dialogue. Just like a real human being 520M model. Runs locally on consumer devices How this is achieved 🧵
1:32

I taught a speech model to understand context in conversation. This is what happened It adjusts voice and tone to express urgency, comfort, understanding from the dialogue. Just like a real human being 520M model. Runs locally on consumer devices How this is achieved 🧵

Luozhu

21,692 görüntüleme • 4 ay önce