Загрузка видео...

Не удалось загрузить видео

На главную

another example: a developer used the exact same $8 ESP32-S3 chip and local AI setup to build a real-time object recognition camera the fact that this is running entirely offline, on an eight-dollar microcontroller, without any cloud API calls, is wild... it captures the video feed, processes it locally...

230,333 просмотров • 3 месяцев назад •via X (Twitter)

Комментарии: 46

Фото профиля Marc The Shark
Marc The Shark3 месяцев назад

I’m doing something similar but just running computer vision at the edge and then gets laid back to my agents as needed. I like what you were doing.

Фото профиля ard
ard3 месяцев назад

your implementation sounds cool!

Фото профиля ɢᴀᴅɢᴇᴛɢᴀᴢ ⌁⌁
ɢᴀᴅɢᴇᴛɢᴀᴢ ⌁⌁3 месяцев назад

I used one to build this.

Фото профиля ard
ard3 месяцев назад

this is really cool, have you thought about working on this as a commercial product?

Фото профиля ɢᴀᴅɢᴇᴛɢᴀᴢ ⌁⌁
ɢᴀᴅɢᴇᴛɢᴀᴢ ⌁⌁3 месяцев назад

Thanks, i have actually there is definitely a gap in the market for smart cat toys. The ones on the market all do the same thing just a laser or a bit that spins, cats are incredibly intelligent and soon predict the patterns and get bored. Thats what made me build it, this is just version 1 next I’m gonna add a camera so it knows when the cat is present and its location with the computer vision ai model. Then use that information to move the feather accordingly and automatically evading the cat like a real prey animal would.

Фото профиля Jurly
Jurly3 месяцев назад

that's a powerful demo of edge AI — the real test is how well it handles occlusion and lighting changes at that price po

Фото профиля ard
ard3 месяцев назад

i think at this price it doesn't matter at all

Фото профиля MAX
MAX3 месяцев назад

Cheap hardware plus local AI is opening up a lot of possibilities.

Фото профиля ard
ard3 месяцев назад

fact

Фото профиля Misato
Misato3 месяцев назад

the $8 chip doing this is still insane🔥

Фото профиля ard
ard3 месяцев назад

hell yeah

Фото профиля Tony Scott 🧄(🦆🐓🐵🧪🧬🪪)❌=↑🧄🧄🧄🥩🥚🧀↓👽👾🤖
Tony Scott 🧄(🦆🐓🐵🧪🧬🪪)❌=↑🧄🧄🧄🥩🥚🧀↓👽👾🤖3 месяцев назад

Object detection means autonomous targeting capability.

Фото профиля Kaworu
Kaworu3 месяцев назад

we are giving dumb objects a brain now🙃

Фото профиля ard
ard3 месяцев назад

i'm waiting for this device to run Doom using a local AI

Фото профиля david
david3 месяцев назад

Excellent. I have the same ESP32, and let me replicate.

Фото профиля ard
ard3 месяцев назад

you can try this

Фото профиля M1Lo
M1Lo3 месяцев назад

How mucho local memory?

Фото профиля ard
ard3 месяцев назад

512 KB of fast SRAM and 16 MB of flash

Фото профиля Richard Rice
Richard Rice3 месяцев назад

Woot woot. Pieces 😉

Фото профиля christian coler
christian coler3 месяцев назад

Idiots who have a child's understanding of LLMs and zero understanding of microcontrollers talking about a "hardware barrier" being shattered by this or a tiny LLM running on an ESP32, as if the former is revolutionary or later is beneficial to an average person's usecase

Фото профиля Ahnaf Shahriar
Ahnaf Shahriar3 месяцев назад

Yolo models are goated in local image recognitions 🔥

Фото профиля ɢᴀᴅɢᴇᴛɢᴀᴢ ⌁⌁
ɢᴀᴅɢᴇᴛɢᴀᴢ ⌁⌁3 месяцев назад

This chip will get you running but the camera will have its limitations. Such as resolution and sensors this will give you at best VGA quality.

Фото профиля Aenish Shrestha
Aenish Shrestha3 месяцев назад

Is this an open source project ?

Фото профиля 🎶
🎶3 месяцев назад

Important step towards singularity immersion

Фото профиля Nicolas S. 🛰️
Nicolas S. 🛰️3 месяцев назад

Not sure but you said “$8 chip *and local AI setup*”. So my understanding is that the ESP32-S2 only captures, streams to video feed to a nearby, potentially beefy, laptop and *that’s* what running the AI and doing the recognition, correct? Or are you saying the S2 is autonomous?

Фото профиля Osaker
Osaker3 месяцев назад

老实说,对比一个中国量产带PTZ的 CCTV,这个价格对这程度的功能,CP值并不算高…

Фото профиля CB
CB3 месяцев назад

Bit of an overstatement

Фото профиля EVIL:/GriN
EVIL:/GriN3 месяцев назад

Ah the last time I tried esp32 cam it got turned to crisp 😭

Фото профиля Nico
Nico3 месяцев назад

Well done to the dev! Inference rate is too slow for anything safety related but slap that onto your home security and for $10 bucks you’ve got a killer setup.

Фото профиля AI Mastery Guide
AI Mastery Guide3 месяцев назад

Real time object recognition for under $10, that barrier is really gone now.

Фото профиля SushiDude
SushiDude3 месяцев назад

my 10yo son made this a year ago for birds outside with Claude Cli

Фото профиля ard
ard3 месяцев назад

this is so cute...

Фото профиля Sebastian Buzdugan
Sebastian Buzdugan3 месяцев назад

the hard part is not esp32-s3 inference, it is stable camera input in bad light

Фото профиля 🏴‍☠️BOSSDOG🏴‍☠️
🏴‍☠️BOSSDOG🏴‍☠️3 месяцев назад

lol Blue Iris has been doing this for 10 or more years with yolo.

Фото профиля 𝛼 ✨
𝛼 ✨3 месяцев назад

how the hell is this possible

Фото профиля Proyecto5T ➡️ 2024-2030
Proyecto5T ➡️ 2024-20303 месяцев назад

@BrianRoemmele

Фото профиля Zak Allal
Zak Allal3 месяцев назад

fact-check this tweet by @ardchain. The $8 ESP32 isn’t running YOLO11, it’s a webcam feeding the PC that is running YOLO11. The LLM was trained only on TinyStories &its author says it “will not answer questions, nor follow instructions, nor write code, nor know facts.” The 512KB claim omits the 8MB PSRAM. No barrier was shattered.

Фото профиля Anthum AI
Anthum AI3 месяцев назад

$8 for real-time local object recognition is genuinely nuts. No cloud, no API cost, just glue it onto whatever you want.

Фото профиля 安叫兽|Bird🕊️ 🔶 BNB
安叫兽|Bird🕊️ 🔶 BNB3 месяцев назад

八美元小板子跑成这样,离线这点太狠了

Фото профиля Modernus Cicero
Modernus Cicero3 месяцев назад

The S3 is a nice little package.

Фото профиля Vova
Vova3 месяцев назад

I’ve built that using ESP32

Фото профиля ard
ard3 месяцев назад

looks stylish

Фото профиля Terri St. Quill
Terri St. Quill3 месяцев назад

I have GOT to know more about this!!

Фото профиля unchosen.eth
unchosen.eth3 месяцев назад

edge ai keeps becoming more practical

Фото профиля MAGIC KOM chanell
MAGIC KOM chanell2 месяцев назад

Cool stuf

Фото профиля Chuck Petras
Chuck Petras3 месяцев назад

@BrianRoemmele

Похожие видео

I made a Draconia Malfoid Visual Novel. I used Vivix's new W1 model, which is unique for it's real-time interaction. No more static cut-outs of characters and still backgrounds. Vivix's W1 model costs $0.003 per second and is fully interactive, shattering the cost barrier while being high quality and real-time. Vivix W1 is also different. It's not a simple clip model, its beta API offers something unique - it lets you modify the video on the fly, a real-time interactive video model. Most AI video is prompt in, clip out, then repeat. Every prompt a break or cut in the video. Vivix W1 is continuous, creating a seamless video experience. That means you can have an LLM handle the conversation, and stream the new chat and emotions and scenes as signals into the API to direct the character's video in real-time, without pauses. You can take characters anywhere in the world, any setting. That's kinda nuts. Vivix reached out to see if I was interested, so I put together a quick AI Visual Novel system with their API. The prototype video is impressive at this speed. The W1 model is directable in real-time. The responses, outfit changes and the dances are all live. The W1 seamless responsiveness is something no clip generator offers. At just about 10 bucks/hour of video, gaming applications are within reach. I do wish the audio was better, it tends to have drop-outs, and it currently doesn't do seamless scene transitions. But the model is in full scale training now, and I hope to have characters moving from location to location with the player. The site is clip-only for now, real-time is the beta API, browser interaction is later. This is the part I am most interested in. You can check it out at: *Sponsored by Vivix.AI

Grummz

76,723 просмотров • 16 дней назад