AN $8 ESP32 IS RUNNING LOCAL AI WITH ZERO... LATENCY A creator deployed a computer vision model on an ESP32 microcontroller to track human movement locally in real time, showing what’s possible without a GPU.show more

three GitHub projects show how much vision can fit... inside an ESP32-S3 esp32-camera handles the first layer: sensor data, JPEG frames, PSRAM, and frame buffers 🖇️ once the camera pipeline works, esp-who adds ready-made vision tasks such as face detection, pedestrian detection, and QR recognition 🖇️ the third project explores a smaller but more ambitious setup: training and deploying a custom vision model directly on the microcontroller 🖇️ put the pieces together and the loop becomes straightforward: capture an image run the model turn the result into a decision trigger something in the physical world a light, a servo, an MQTT event, or a local log the useful part is the short path from something the camera sees to something the hardware doesshow more

MotionStream Real-Time Video Generation with Interactive Motion Controls model... runs in real time on a single NVIDIA H100 GPU (29 FPS, 0.4s Latency)show more

Who says microcontrollers are only for sensors and IoT?... One developer used an ESP32-S3 to create an entire collection of interactive generative art, proving that embedded systems can be a creative medium too. The projects use Adafruit Qualia ESP32-S3 with a 2.1" round TFT display and an IMU for motion-based interaction, while the artwork is first prototyped in JavaScript and then ported to C++ and deployed with the Arduino IDE. Along the way, you will learn about computer graphics, embedded displays, animation, IMU sensors, generative art, optimization, and real-time rendering on resource-constrained hardware.show more

AI deployed Robotic Traffic cones. A road could have... 1000s to respond to an emergency situation in real-time. ConeBot is on the job…show more

Apple wasn’t kidding, the iPhone 17 Pro is really... built for running LLMs Here’s LFM2 8B A1B by running on-device with MLX in Locally AI - Local AI Chat, the iPhone runs the 8B model with zero struggle Thanks Prince Canuma for the port to MLX, it made the MLX Swift port possibleshow more

I received a message in my direct messages asking... how difficult it would be to use computer vision to track cell movement. > SAM zero shot for the immune cell > YOLO finetuned on a small dataset for bacteria Realization time: ~2 hoursshow more

ABot World 0.5B is out! we have now world... models at home, running in real-time on consumer GPU feed it an initial image, steer it with with your keyboard 🌎 you can run it locally or play now on spaces ▶️show more

"I'm not a human." Fed it to Qwen 3.5... 0.8B running locally on my Mac Studio M2 Ultra. It solved it. The CAPTCHA is fake. But sending images to the local model? Very real. I'm not breaking the internet. Yet.show more

We made it easy to run local models on... your computer and use them from your phone. A secure, end-to-end encrypted connection in just a few clicks. Available now with LM Studio and Locally AI - Local AI Chat.show more

I 3D printed a ship wheel that’s connected to... a rotary encoder + ESP32. It connects to a local WebSocket server to send updates. On the right is a PI3 acting as a server, hosting multiple WebSocket servers to connect devices and also AI requestsshow more

forget the $699 AI pins. this $8 chip just... shattered the barrier for local AI hardware. a developer just forced a 28.9 million-parameter LLM onto a standard ESP32-S3 microcontroller. it costs roughly 8 dollars, runs completely offline, and draws the power of a single LED. conventional wisdom said a model of this size simply would not fit. the chip only has 512 KB of fast SRAM and 16 MB of flash. the breakthrough is architectural. the developer moved the bulk of the embedding table into flash memory and memory-mapped it. the chip only needs to pull about 450 bytes per token, keeping the active working memory inside the fast SRAM. this means you can now embed a capable language model into a physical node for the price of two coffees. and we are already seeing the beginnings of this custom physical hardware. in the video, a creator built a minimalist voice-controlled universal remote using an ESP32. it captures voice and remotely controls the computer over bluetooth LE. he simply says "open chrome and open 20 new tabs", and the custom hardware executes it instantly. we have spent years watching model sizes explode upward. but the true frontier is the opposite direction. when an eight-dollar chip can power offline intelligence and custom physical interfaces, AI becomes local infrastructure rather than a cloud service.show more

I love this opensource project! Someone just put a... 28.9M parameter AI model on an ESP32-S3. A chip that costs only a few dollars. No cloud. No API. No internet. It runs locally at ~9.5 tokens/s and can generate stories on a tiny screen. This changes the way we think about AI hardware. The next generation of AI toys, robots, and IoT devices may not need the cloud at all. Small chips are getting smarter. 🤖show more

Just wrapped up a local meetup teaching people how... to build their MVP in an hour using Replit ⠕. Participants walked out with their first web/mobile app and a new appreciation for what’s possible with AI.show more

GEMMA 4 26B ON AN RTX 4060 WITH A... 248K TOKEN CONTEXT WINDOW 20 tokens per second and a context window so large you can feed it entire codebases, books and research papers in a single prompt this is not a cloud api and not a server rack, this is a regular consumer gpu running locally with llama.cpp and q4_k_xl quantization 248k context on an 8gb vram card was not supposed to be possible and here it is just running on someone’s desk the article below covers exactly which tools and configs make this kind of setup work in 2026 ↓show more

A real-time AI motion capture model with 1B parameters.... Connects to a 1080P camera or processes uploaded video to generate 3D motion data in real time. Supports Unreal Engine, Unity, and Blender, requiring 8GB of GPU VRAM for real-time processing.show more

Depth Anything V2 is a total beast for real-time... 3D. Built a website that hits 30fps+ depth reconstructions from a single camera feed, extruding 12k voxels via WebGPU. Pure ML running local Vision Transformers with Three.js and zero backend lag. Lmk in the comments if you want a copy! 🙌 Experience and music made with AI in Omma AI (tool by Spline).show more

Gemma 4 analyzes the video. Generates key questions. Calls... Falcon Perception. "Find all the people." 156 found. "Detect only white cars." 8 found. A 26B model is running agentic multi-QA vision orchestration. The models are running locally on a MacBook with MLX. No API.show more

Gemma 4 just dropped. I had it captioning video... in real-time within an hour. Running locally on a MacBook. No cloud. No API. Real-time scene understanding. Oh and SAM3 is segmenting every object in the same frame. Same laptop.show more

this guy 3D printed and vibe coded a tiny... Claude robot for his desk it's called "Clawd Mochi." runs on an ESP32 chip with a tiny display that shows animated expressions. > hosts its own WiFi hotspot. zero cloud and zero internet required. fully offline > live-switch between animated faces, a terminal emulator, and a drawing canvas from your browser > total cost: under $8 > takes less than an hour to build 3D print files AND the full build are both open source too this is the greatest thing anyone has built with vibe codingshow more

Cool new work on real-time video generation with motion... control. MotionStream enables sub-second latency streaming on a single GPU. You can also control what parts of an image do & don't move, like the video below. 👏 to Xun Huang, Joonghyuk Shin, and team!show more