Video wird geladen...

Video konnte nicht geladen werden

Zur Startseite

AN $8 ESP32 IS RUNNING LOCAL AI WITH ZERO LATENCY A creator deployed a computer vision model on an ESP32 microcontroller to track human movement locally in real time, showing what’s possible without a GPU.

RoundtableSpace's profile picture

0xMarioNawfal

258,620 subscribers

58,032 Aufrufe • vor 19 Tagen •via X (Twitter)

LIVE

Anya Rossi• Live Now

Private livecam show

0 Kommentare

Keine Kommentare verfügbar

Kommentare vom Original-Post werden hier angezeigt

Ähnliche Videos

MotionStream Real-Time Video Generation with Interactive Motion Controls model runs in real time on a single NVIDIA H100 GPU (29 FPS, 0.4s Latency)
0:19

MotionStream Real-Time Video Generation with Interactive Motion Controls model runs in real time on a single NVIDIA H100 GPU (29 FPS, 0.4s Latency)

AK

22,304 Aufrufe • vor 9 Monaten

AI deployed Robotic Traffic cones. A road could have 1000s to respond to an emergency situation in real-time. ConeBot is on the job…
0:13

AI deployed Robotic Traffic cones. A road could have 1000s to respond to an emergency situation in real-time. ConeBot is on the job…

Brian Roemmele

57,799 Aufrufe • vor 7 Tagen

Apple wasn’t kidding, the iPhone 17 Pro is really built for running LLMs Here’s LFM2 8B A1B by running on-device with MLX in Locally AI - Local AI Chat, the iPhone runs the 8B model with zero struggle Thanks Prince Canuma for the port to MLX, it made the MLX Swift port possible
0:17

Apple wasn’t kidding, the iPhone 17 Pro is really built for running LLMs Here’s LFM2 8B A1B by running on-device with MLX in Locally AI - Local AI Chat, the iPhone runs the 8B model with zero struggle Thanks Prince Canuma for the port to MLX, it made the MLX Swift port possible

Adrien Grondin

493,561 Aufrufe • vor 10 Monaten

I received a message in my direct messages asking how difficult it would be to use computer vision to track cell movement. > SAM zero shot for the immune cell > YOLO finetuned on a small dataset for bacteria Realization time: ~2 hours
0:13

I received a message in my direct messages asking how difficult it would be to use computer vision to track cell movement. > SAM zero shot for the immune cell > YOLO finetuned on a small dataset for bacteria Realization time: ~2 hours

Marco Franzon

188,212 Aufrufe • vor 2 Monaten

ABot World 0.5B is out! we have now world models at home, running in real-time on consumer GPU feed it an initial image, steer it with with your keyboard 🌎 you can run it locally or play now on spaces ▶️
0:18

ABot World 0.5B is out! we have now world models at home, running in real-time on consumer GPU feed it an initial image, steer it with with your keyboard 🌎 you can run it locally or play now on spaces ▶️

Hugging Apps

140,628 Aufrufe • vor 18 Tagen

I 3D printed a ship wheel that’s connected to a rotary encoder + ESP32. It connects to a local WebSocket server to send updates. On the right is a PI3 acting as a server, hosting multiple WebSocket servers to connect devices and also AI requests
0:11

I 3D printed a ship wheel that’s connected to a rotary encoder + ESP32. It connects to a local WebSocket server to send updates. On the right is a PI3 acting as a server, hosting multiple WebSocket servers to connect devices and also AI requests

Colin Duffy 🇺🇦

10,294 Aufrufe • vor 3 Monaten

"I'm not a human." Fed it to Qwen 3.5 0.8B running locally on my Mac Studio M2 Ultra. It solved it. The CAPTCHA is fake. But sending images to the local model? Very real. I'm not breaking the internet. Yet.
0:12

"I'm not a human." Fed it to Qwen 3.5 0.8B running locally on my Mac Studio M2 Ultra. It solved it. The CAPTCHA is fake. But sending images to the local model? Very real. I'm not breaking the internet. Yet.

stevibe

69,433 Aufrufe • vor 5 Monaten

We made it easy to run local models on your computer and use them from your phone. A secure, end-to-end encrypted connection in just a few clicks. Available now with LM Studio and Locally AI - Local AI Chat.
0:16

We made it easy to run local models on your computer and use them from your phone. A secure, end-to-end encrypted connection in just a few clicks. Available now with LM Studio and Locally AI - Local AI Chat.

Adrien Grondin

12,045 Aufrufe • vor 2 Monaten

forget the $699 AI pins. this $8 chip just shattered the barrier for local AI hardware. a developer just forced a 28.9 million-parameter LLM onto a standard ESP32-S3 microcontroller. it costs roughly 8 dollars, runs completely offline, and draws the power of a single LED. conventional wisdom said a model of this size simply would not fit. the chip only has 512 KB of fast SRAM and 16 MB of flash. the breakthrough is architectural. the developer moved the bulk of the embedding table into flash memory and memory-mapped it. the chip only needs to pull about 450 bytes per token, keeping the active working memory inside the fast SRAM. this means you can now embed a capable language model into a physical node for the price of two coffees. and we are already seeing the beginnings of this custom physical hardware. in the video, a creator built a minimalist voice-controlled universal remote using an ESP32. it captures voice and remotely controls the computer over bluetooth LE. he simply says "open chrome and open 20 new tabs", and the custom hardware executes it instantly. we have spent years watching model sizes explode upward. but the true frontier is the opposite direction. when an eight-dollar chip can power offline intelligence and custom physical interfaces, AI becomes local infrastructure rather than a cloud service.
0:19

forget the $699 AI pins. this $8 chip just shattered the barrier for local AI hardware. a developer just forced a 28.9 million-parameter LLM onto a standard ESP32-S3 microcontroller. it costs roughly 8 dollars, runs completely offline, and draws the power of a single LED. conventional wisdom said a model of this size simply would not fit. the chip only has 512 KB of fast SRAM and 16 MB of flash. the breakthrough is architectural. the developer moved the bulk of the embedding table into flash memory and memory-mapped it. the chip only needs to pull about 450 bytes per token, keeping the active working memory inside the fast SRAM. this means you can now embed a capable language model into a physical node for the price of two coffees. and we are already seeing the beginnings of this custom physical hardware. in the video, a creator built a minimalist voice-controlled universal remote using an ESP32. it captures voice and remotely controls the computer over bluetooth LE. he simply says "open chrome and open 20 new tabs", and the custom hardware executes it instantly. we have spent years watching model sizes explode upward. but the true frontier is the opposite direction. when an eight-dollar chip can power offline intelligence and custom physical interfaces, AI becomes local infrastructure rather than a cloud service.

ard

424,888 Aufrufe • vor 23 Tagen

I love this opensource project! Someone just put a 28.9M parameter AI model on an ESP32-S3. A chip that costs only a few dollars. No cloud. No API. No internet. It runs locally at ~9.5 tokens/s and can generate stories on a tiny screen. This changes the way we think about AI hardware. The next generation of AI toys, robots, and IoT devices may not need the cloud at all. Small chips are getting smarter. 🤖
0:11

I love this opensource project! Someone just put a 28.9M parameter AI model on an ESP32-S3. A chip that costs only a few dollars. No cloud. No API. No internet. It runs locally at ~9.5 tokens/s and can generate stories on a tiny screen. This changes the way we think about AI hardware. The next generation of AI toys, robots, and IoT devices may not need the cloud at all. Small chips are getting smarter. 🤖

Steven Cheng

104,329 Aufrufe • vor 15 Tagen

Just wrapped up a local meetup teaching people how to build their MVP in an hour using Replit ⠕. Participants walked out with their first web/mobile app and a new appreciation for what’s possible with AI.
0:11

Just wrapped up a local meetup teaching people how to build their MVP in an hour using Replit ⠕. Participants walked out with their first web/mobile app and a new appreciation for what’s possible with AI.

Raymmar

12,390 Aufrufe • vor 3 Monaten

A real-time AI motion capture model with 1B parameters. Connects to a 1080P camera or processes uploaded video to generate 3D motion data in real time. Supports Unreal Engine, Unity, and Blender, requiring 8GB of GPU VRAM for real-time processing.
0:13

A real-time AI motion capture model with 1B parameters. Connects to a 1080P camera or processes uploaded video to generate 3D motion data in real time. Supports Unreal Engine, Unity, and Blender, requiring 8GB of GPU VRAM for real-time processing.

CYANPUPPETS

36,950 Aufrufe • vor 5 Monaten

Depth Anything V2 is a total beast for real-time 3D. Built a website that hits 30fps+ depth reconstructions from a single camera feed, extruding 12k voxels via WebGPU. Pure ML running local Vision Transformers with Three.js and zero backend lag. Lmk in the comments if you want a copy! 🙌 Experience and music made with AI in Omma AI (tool by Spline).
0:15

Depth Anything V2 is a total beast for real-time 3D. Built a website that hits 30fps+ depth reconstructions from a single camera feed, extruding 12k voxels via WebGPU. Pure ML running local Vision Transformers with Three.js and zero backend lag. Lmk in the comments if you want a copy! 🙌 Experience and music made with AI in Omma AI (tool by Spline).

Gábor Pribék

142,321 Aufrufe • vor 3 Monaten

Gemma 4 analyzes the video. Generates key questions. Calls Falcon Perception. "Find all the people." 156 found. "Detect only white cars." 8 found. A 26B model is running agentic multi-QA vision orchestration. The models are running locally on a MacBook with MLX. No API.
0:16

Gemma 4 analyzes the video. Generates key questions. Calls Falcon Perception. "Find all the people." 156 found. "Detect only white cars." 8 found. A 26B model is running agentic multi-QA vision orchestration. The models are running locally on a MacBook with MLX. No API.

Maziyar PANAHI

158,918 Aufrufe • vor 4 Monaten

Gemma 4 just dropped. I had it captioning video in real-time within an hour. Running locally on a MacBook. No cloud. No API. Real-time scene understanding. Oh and SAM3 is segmenting every object in the same frame. Same laptop.
0:16

Gemma 4 just dropped. I had it captioning video in real-time within an hour. Running locally on a MacBook. No cloud. No API. Real-time scene understanding. Oh and SAM3 is segmenting every object in the same frame. Same laptop.

Maziyar PANAHI

196,846 Aufrufe • vor 4 Monaten

this guy 3D printed and vibe coded a tiny Claude robot for his desk it's called "Clawd Mochi." runs on an ESP32 chip with a tiny display that shows animated expressions. > hosts its own WiFi hotspot. zero cloud and zero internet required. fully offline > live-switch between animated faces, a terminal emulator, and a drawing canvas from your browser > total cost: under $8 > takes less than an hour to build 3D print files AND the full build are both open source too this is the greatest thing anyone has built with vibe coding
0:15

this guy 3D printed and vibe coded a tiny Claude robot for his desk it's called "Clawd Mochi." runs on an ESP32 chip with a tiny display that shows animated expressions. > hosts its own WiFi hotspot. zero cloud and zero internet required. fully offline > live-switch between animated faces, a terminal emulator, and a drawing canvas from your browser > total cost: under $8 > takes less than an hour to build 3D print files AND the full build are both open source too this is the greatest thing anyone has built with vibe coding

Om Patel

154,373 Aufrufe • vor 4 Monaten

Cool new work on real-time video generation with motion control. MotionStream enables sub-second latency streaming on a single GPU. You can also control what parts of an image do & don't move, like the video below. 👏 to Xun Huang, Joonghyuk Shin, and team!
0:16

Cool new work on real-time video generation with motion control. MotionStream enables sub-second latency streaming on a single GPU. You can also control what parts of an image do & don't move, like the video below. 👏 to Xun Huang, Joonghyuk Shin, and team!

Justine Moore

21,780 Aufrufe • vor 9 Monaten

Wow! This is amazing! Segmented every car locally in real time with Meta's SAM3 converted to MLX. Just on-device (M2 laptop) vision getting absurdly good. Local AI is moving faster than most people realize! What other models should we test? what kind of videos?
0:12

Wow! This is amazing! Segmented every car locally in real time with Meta's SAM3 converted to MLX. Just on-device (M2 laptop) vision getting absurdly good. Local AI is moving faster than most people realize! What other models should we test? what kind of videos?

Maziyar PANAHI

177,270 Aufrufe • vor 4 Monaten

Is it time to made an experimental action film about young Asian femme fatale? 🤸‍♀️ I’m experimenting with a single, consistent character executing movement shots—running, jumping, crouching, and swinging a sword—using the AI tools Midjourney and Hailuo AI (MiniMax) .
0:11

Is it time to made an experimental action film about young Asian femme fatale? 🤸‍♀️ I’m experimenting with a single, consistent character executing movement shots—running, jumping, crouching, and swinging a sword—using the AI tools Midjourney and Hailuo AI (MiniMax) .

Junie Lau

20,540 Aufrufe • vor 1 Jahr

generate an artifact in Midjourney turn into a 3D model with 3DAIStudio 3D print the AI artifact on an UltiMaker generate paint ideas using retexture in MJ paint the artifact with acrylics AI to real life and back again
0:12

generate an artifact in Midjourney turn into a 3D model with 3DAIStudio 3D print the AI artifact on an UltiMaker generate paint ideas using retexture in MJ paint the artifact with acrylics AI to real life and back again

Nick St. Pierre

75,545 Aufrufe • vor 1 Jahr