Video wird geladen...

Video konnte nicht geladen werden

Zur Startseite

another example: a developer used the exact same $8 ESP32-S3 chip and local AI setup to build a real-time object recognition camera the fact that this is running entirely offline, on an eight-dollar microcontroller, without any cloud API calls, is wild... it captures the video feed, processes it locally...

230,333 Aufrufe • vor 3 Monaten •via X (Twitter)

46 Kommentare

Profilbild von Marc The Shark
Marc The Sharkvor 3 Monaten

I’m doing something similar but just running computer vision at the edge and then gets laid back to my agents as needed. I like what you were doing.

Profilbild von ard
ardvor 3 Monaten

your implementation sounds cool!

Profilbild von ɢᴀᴅɢᴇᴛɢᴀᴢ ⌁⌁
ɢᴀᴅɢᴇᴛɢᴀᴢ ⌁⌁vor 3 Monaten

I used one to build this.

Profilbild von ard
ardvor 3 Monaten

this is really cool, have you thought about working on this as a commercial product?

Profilbild von ɢᴀᴅɢᴇᴛɢᴀᴢ ⌁⌁
ɢᴀᴅɢᴇᴛɢᴀᴢ ⌁⌁vor 3 Monaten

Thanks, i have actually there is definitely a gap in the market for smart cat toys. The ones on the market all do the same thing just a laser or a bit that spins, cats are incredibly intelligent and soon predict the patterns and get bored. Thats what made me build it, this is just version 1 next I’m gonna add a camera so it knows when the cat is present and its location with the computer vision ai model. Then use that information to move the feather accordingly and automatically evading the cat like a real prey animal would.

Profilbild von Jurly
Jurlyvor 3 Monaten

that's a powerful demo of edge AI — the real test is how well it handles occlusion and lighting changes at that price po

Profilbild von ard
ardvor 3 Monaten

i think at this price it doesn't matter at all

Profilbild von MAX
MAXvor 3 Monaten

Cheap hardware plus local AI is opening up a lot of possibilities.

Profilbild von ard
ardvor 3 Monaten

fact

Profilbild von Misato
Misatovor 3 Monaten

the $8 chip doing this is still insane🔥

Profilbild von ard
ardvor 3 Monaten

hell yeah

Profilbild von Tony Scott 🧄(🦆🐓🐵🧪🧬🪪)❌=↑🧄🧄🧄🥩🥚🧀↓👽👾🤖
Tony Scott 🧄(🦆🐓🐵🧪🧬🪪)❌=↑🧄🧄🧄🥩🥚🧀↓👽👾🤖vor 3 Monaten

Object detection means autonomous targeting capability.

Profilbild von Kaworu
Kaworuvor 3 Monaten

we are giving dumb objects a brain now🙃

Profilbild von ard
ardvor 3 Monaten

i'm waiting for this device to run Doom using a local AI

Profilbild von david
davidvor 3 Monaten

Excellent. I have the same ESP32, and let me replicate.

Profilbild von ard
ardvor 3 Monaten

you can try this

Profilbild von M1Lo
M1Lovor 3 Monaten

How mucho local memory?

Profilbild von ard
ardvor 3 Monaten

512 KB of fast SRAM and 16 MB of flash

Profilbild von Richard Rice
Richard Ricevor 3 Monaten

Woot woot. Pieces 😉

Profilbild von christian coler
christian colervor 3 Monaten

Idiots who have a child's understanding of LLMs and zero understanding of microcontrollers talking about a "hardware barrier" being shattered by this or a tiny LLM running on an ESP32, as if the former is revolutionary or later is beneficial to an average person's usecase

Profilbild von Ahnaf Shahriar
Ahnaf Shahriarvor 3 Monaten

Yolo models are goated in local image recognitions 🔥

Profilbild von ɢᴀᴅɢᴇᴛɢᴀᴢ ⌁⌁
ɢᴀᴅɢᴇᴛɢᴀᴢ ⌁⌁vor 3 Monaten

This chip will get you running but the camera will have its limitations. Such as resolution and sensors this will give you at best VGA quality.

Profilbild von Aenish Shrestha
Aenish Shresthavor 3 Monaten

Is this an open source project ?

Profilbild von 🎶
🎶vor 3 Monaten

Important step towards singularity immersion

Profilbild von Nicolas S. 🛰️
Nicolas S. 🛰️vor 3 Monaten

Not sure but you said “$8 chip *and local AI setup*”. So my understanding is that the ESP32-S2 only captures, streams to video feed to a nearby, potentially beefy, laptop and *that’s* what running the AI and doing the recognition, correct? Or are you saying the S2 is autonomous?

Profilbild von Osaker
Osakervor 3 Monaten

老实说,对比一个中国量产带PTZ的 CCTV,这个价格对这程度的功能,CP值并不算高…

Profilbild von CB
CBvor 3 Monaten

Bit of an overstatement

Profilbild von EVIL:/GriN
EVIL:/GriNvor 3 Monaten

Ah the last time I tried esp32 cam it got turned to crisp 😭

Profilbild von Nico
Nicovor 3 Monaten

Well done to the dev! Inference rate is too slow for anything safety related but slap that onto your home security and for $10 bucks you’ve got a killer setup.

Profilbild von AI Mastery Guide
AI Mastery Guidevor 3 Monaten

Real time object recognition for under $10, that barrier is really gone now.

Profilbild von SushiDude
SushiDudevor 3 Monaten

my 10yo son made this a year ago for birds outside with Claude Cli

Profilbild von ard
ardvor 3 Monaten

this is so cute...

Profilbild von Sebastian Buzdugan
Sebastian Buzduganvor 3 Monaten

the hard part is not esp32-s3 inference, it is stable camera input in bad light

Profilbild von 🏴‍☠️BOSSDOG🏴‍☠️
🏴‍☠️BOSSDOG🏴‍☠️vor 3 Monaten

lol Blue Iris has been doing this for 10 or more years with yolo.

Profilbild von 𝛼 ✨
𝛼 ✨vor 3 Monaten

how the hell is this possible

Profilbild von Proyecto5T ➡️ 2024-2030
Proyecto5T ➡️ 2024-2030vor 3 Monaten

@BrianRoemmele

Profilbild von Zak Allal
Zak Allalvor 3 Monaten

fact-check this tweet by @ardchain. The $8 ESP32 isn’t running YOLO11, it’s a webcam feeding the PC that is running YOLO11. The LLM was trained only on TinyStories &its author says it “will not answer questions, nor follow instructions, nor write code, nor know facts.” The 512KB claim omits the 8MB PSRAM. No barrier was shattered.

Profilbild von Anthum AI
Anthum AIvor 3 Monaten

$8 for real-time local object recognition is genuinely nuts. No cloud, no API cost, just glue it onto whatever you want.

Profilbild von 安叫兽|Bird🕊️ 🔶 BNB
安叫兽|Bird🕊️ 🔶 BNBvor 3 Monaten

八美元小板子跑成这样,离线这点太狠了

Profilbild von Modernus Cicero
Modernus Cicerovor 3 Monaten

The S3 is a nice little package.

Profilbild von Vova
Vovavor 3 Monaten

I’ve built that using ESP32

Profilbild von ard
ardvor 3 Monaten

looks stylish

Profilbild von Terri St. Quill
Terri St. Quillvor 3 Monaten

I have GOT to know more about this!!

Profilbild von unchosen.eth
unchosen.ethvor 3 Monaten

edge ai keeps becoming more practical

Profilbild von MAGIC KOM chanell
MAGIC KOM chanellvor 2 Monaten

Cool stuf

Profilbild von Chuck Petras
Chuck Petrasvor 3 Monaten

@BrianRoemmele

Ähnliche Videos

I made a Draconia Malfoid Visual Novel. I used Vivix's new W1 model, which is unique for it's real-time interaction. No more static cut-outs of characters and still backgrounds. Vivix's W1 model costs $0.003 per second and is fully interactive, shattering the cost barrier while being high quality and real-time. Vivix W1 is also different. It's not a simple clip model, its beta API offers something unique - it lets you modify the video on the fly, a real-time interactive video model. Most AI video is prompt in, clip out, then repeat. Every prompt a break or cut in the video. Vivix W1 is continuous, creating a seamless video experience. That means you can have an LLM handle the conversation, and stream the new chat and emotions and scenes as signals into the API to direct the character's video in real-time, without pauses. You can take characters anywhere in the world, any setting. That's kinda nuts. Vivix reached out to see if I was interested, so I put together a quick AI Visual Novel system with their API. The prototype video is impressive at this speed. The W1 model is directable in real-time. The responses, outfit changes and the dances are all live. The W1 seamless responsiveness is something no clip generator offers. At just about 10 bucks/hour of video, gaming applications are within reach. I do wish the audio was better, it tends to have drop-outs, and it currently doesn't do seamless scene transitions. But the model is in full scale training now, and I hope to have characters moving from location to location with the player. The site is clip-only for now, real-time is the beta API, browser interaction is later. This is the part I am most interested in. You can check it out at: *Sponsored by Vivix.AI

Grummz

76,723 Aufrufe • vor 16 Tagen