Video yükleniyor...

Video Yüklenemedi

Ana Sayfaya Dön

another example: a developer used the exact same $8 ESP32-S3 chip and local AI setup to build a real-time object recognition camera the fact that this is running entirely offline, on an eight-dollar microcontroller, without any cloud API calls, is wild... it captures the video feed, processes it locally...

230,333 görüntüleme • 3 ay önce •via X (Twitter)

46 Yorum

Marc The Shark profil fotoğrafı
Marc The Shark3 ay önce

I’m doing something similar but just running computer vision at the edge and then gets laid back to my agents as needed. I like what you were doing.

ard profil fotoğrafı
ard3 ay önce

your implementation sounds cool!

ɢᴀᴅɢᴇᴛɢᴀᴢ ⌁⌁ profil fotoğrafı
ɢᴀᴅɢᴇᴛɢᴀᴢ ⌁⌁3 ay önce

I used one to build this.

ard profil fotoğrafı
ard3 ay önce

this is really cool, have you thought about working on this as a commercial product?

ɢᴀᴅɢᴇᴛɢᴀᴢ ⌁⌁ profil fotoğrafı
ɢᴀᴅɢᴇᴛɢᴀᴢ ⌁⌁3 ay önce

Thanks, i have actually there is definitely a gap in the market for smart cat toys. The ones on the market all do the same thing just a laser or a bit that spins, cats are incredibly intelligent and soon predict the patterns and get bored. Thats what made me build it, this is just version 1 next I’m gonna add a camera so it knows when the cat is present and its location with the computer vision ai model. Then use that information to move the feather accordingly and automatically evading the cat like a real prey animal would.

Jurly profil fotoğrafı
Jurly3 ay önce

that's a powerful demo of edge AI — the real test is how well it handles occlusion and lighting changes at that price po

ard profil fotoğrafı
ard3 ay önce

i think at this price it doesn't matter at all

MAX profil fotoğrafı
MAX3 ay önce

Cheap hardware plus local AI is opening up a lot of possibilities.

ard profil fotoğrafı
ard3 ay önce

fact

Misato profil fotoğrafı
Misato3 ay önce

the $8 chip doing this is still insane🔥

ard profil fotoğrafı
ard3 ay önce

hell yeah

Tony Scott 🧄(🦆🐓🐵🧪🧬🪪)❌=↑🧄🧄🧄🥩🥚🧀↓👽👾🤖 profil fotoğrafı
Tony Scott 🧄(🦆🐓🐵🧪🧬🪪)❌=↑🧄🧄🧄🥩🥚🧀↓👽👾🤖3 ay önce

Object detection means autonomous targeting capability.

Kaworu profil fotoğrafı
Kaworu3 ay önce

we are giving dumb objects a brain now🙃

ard profil fotoğrafı
ard3 ay önce

i'm waiting for this device to run Doom using a local AI

david profil fotoğrafı
david3 ay önce

Excellent. I have the same ESP32, and let me replicate.

ard profil fotoğrafı
ard3 ay önce

you can try this

M1Lo profil fotoğrafı
M1Lo3 ay önce

How mucho local memory?

ard profil fotoğrafı
ard3 ay önce

512 KB of fast SRAM and 16 MB of flash

Richard Rice profil fotoğrafı
Richard Rice3 ay önce

Woot woot. Pieces 😉

christian coler profil fotoğrafı
christian coler3 ay önce

Idiots who have a child's understanding of LLMs and zero understanding of microcontrollers talking about a "hardware barrier" being shattered by this or a tiny LLM running on an ESP32, as if the former is revolutionary or later is beneficial to an average person's usecase

Ahnaf Shahriar profil fotoğrafı
Ahnaf Shahriar3 ay önce

Yolo models are goated in local image recognitions 🔥

ɢᴀᴅɢᴇᴛɢᴀᴢ ⌁⌁ profil fotoğrafı
ɢᴀᴅɢᴇᴛɢᴀᴢ ⌁⌁3 ay önce

This chip will get you running but the camera will have its limitations. Such as resolution and sensors this will give you at best VGA quality.

Aenish Shrestha profil fotoğrafı
Aenish Shrestha3 ay önce

Is this an open source project ?

🎶 profil fotoğrafı
🎶3 ay önce

Important step towards singularity immersion

Nicolas S. 🛰️ profil fotoğrafı
Nicolas S. 🛰️3 ay önce

Not sure but you said “$8 chip *and local AI setup*”. So my understanding is that the ESP32-S2 only captures, streams to video feed to a nearby, potentially beefy, laptop and *that’s* what running the AI and doing the recognition, correct? Or are you saying the S2 is autonomous?

Osaker profil fotoğrafı
Osaker3 ay önce

老实说,对比一个中国量产带PTZ的 CCTV,这个价格对这程度的功能,CP值并不算高…

CB profil fotoğrafı
CB3 ay önce

Bit of an overstatement

EVIL:/GriN profil fotoğrafı
EVIL:/GriN3 ay önce

Ah the last time I tried esp32 cam it got turned to crisp 😭

Nico profil fotoğrafı
Nico3 ay önce

Well done to the dev! Inference rate is too slow for anything safety related but slap that onto your home security and for $10 bucks you’ve got a killer setup.

AI Mastery Guide profil fotoğrafı
AI Mastery Guide3 ay önce

Real time object recognition for under $10, that barrier is really gone now.

SushiDude profil fotoğrafı
SushiDude3 ay önce

my 10yo son made this a year ago for birds outside with Claude Cli

ard profil fotoğrafı
ard3 ay önce

this is so cute...

Sebastian Buzdugan profil fotoğrafı
Sebastian Buzdugan3 ay önce

the hard part is not esp32-s3 inference, it is stable camera input in bad light

🏴‍☠️BOSSDOG🏴‍☠️ profil fotoğrafı
🏴‍☠️BOSSDOG🏴‍☠️3 ay önce

lol Blue Iris has been doing this for 10 or more years with yolo.

𝛼 ✨ profil fotoğrafı
𝛼 ✨3 ay önce

how the hell is this possible

Proyecto5T ➡️ 2024-2030 profil fotoğrafı
Proyecto5T ➡️ 2024-20303 ay önce

@BrianRoemmele

Zak Allal profil fotoğrafı
Zak Allal3 ay önce

fact-check this tweet by @ardchain. The $8 ESP32 isn’t running YOLO11, it’s a webcam feeding the PC that is running YOLO11. The LLM was trained only on TinyStories &its author says it “will not answer questions, nor follow instructions, nor write code, nor know facts.” The 512KB claim omits the 8MB PSRAM. No barrier was shattered.

Anthum AI profil fotoğrafı
Anthum AI3 ay önce

$8 for real-time local object recognition is genuinely nuts. No cloud, no API cost, just glue it onto whatever you want.

安叫兽|Bird🕊️ 🔶 BNB profil fotoğrafı
安叫兽|Bird🕊️ 🔶 BNB3 ay önce

八美元小板子跑成这样,离线这点太狠了

Modernus Cicero profil fotoğrafı
Modernus Cicero3 ay önce

The S3 is a nice little package.

Vova profil fotoğrafı
Vova3 ay önce

I’ve built that using ESP32

ard profil fotoğrafı
ard3 ay önce

looks stylish

Terri St. Quill profil fotoğrafı
Terri St. Quill3 ay önce

I have GOT to know more about this!!

unchosen.eth profil fotoğrafı
unchosen.eth3 ay önce

edge ai keeps becoming more practical

MAGIC KOM chanell profil fotoğrafı
MAGIC KOM chanell2 ay önce

Cool stuf

Chuck Petras profil fotoğrafı
Chuck Petras3 ay önce

@BrianRoemmele

Benzer Videolar

I made a Draconia Malfoid Visual Novel. I used Vivix's new W1 model, which is unique for it's real-time interaction. No more static cut-outs of characters and still backgrounds. Vivix's W1 model costs $0.003 per second and is fully interactive, shattering the cost barrier while being high quality and real-time. Vivix W1 is also different. It's not a simple clip model, its beta API offers something unique - it lets you modify the video on the fly, a real-time interactive video model. Most AI video is prompt in, clip out, then repeat. Every prompt a break or cut in the video. Vivix W1 is continuous, creating a seamless video experience. That means you can have an LLM handle the conversation, and stream the new chat and emotions and scenes as signals into the API to direct the character's video in real-time, without pauses. You can take characters anywhere in the world, any setting. That's kinda nuts. Vivix reached out to see if I was interested, so I put together a quick AI Visual Novel system with their API. The prototype video is impressive at this speed. The W1 model is directable in real-time. The responses, outfit changes and the dances are all live. The W1 seamless responsiveness is something no clip generator offers. At just about 10 bucks/hour of video, gaming applications are within reach. I do wish the audio was better, it tends to have drop-outs, and it currently doesn't do seamless scene transitions. But the model is in full scale training now, and I hope to have characters moving from location to location with the player. The site is clip-only for now, real-time is the beta API, browser interaction is later. This is the part I am most interested in. You can check it out at: *Sponsored by Vivix.AI

Grummz

76,723 görüntüleme • 16 gün önce