正在加载视频...
视频加载失败
Mirror: A hackable AI-powered Mirror on Your Laptop. Mirror is a simple yet powerful web app that runs 100% locally, where the AI (Georgi Gerganov's llama.cpp + skunkworks's Bakllava) constantly watches your webcam feed and sends you messages. And you can try it too, right now.
140,263 次观看 • 2 年前 •via X (Twitter)
10 条评论

Github link:

Mirror was inspired by the amazing Realtime Bakllava project by @Karmedge I extended the realtime-bakllava logic and added the web UI, so it runs in a browser and displays the AI messages inline along with the video feed.

The cool thing about Mirror is that you can actually edit the prompt inline to customize how the AI responds to the video feed, in REALTIME. 1. What am I holding? 2. Describe some notable events in the image. 3. How many people are in this picture? 4. See anything weird? etc.

Guess what web framework I used to build Mirror? @Gradio The entire app is just an image component (with webcam source) as input and a text component as output. Thanks to the custom CSS feature, I could completely customize it while taking advantage of the gradio features.

Here's the 1 Click Installer: NOTE: Make sure to update to the LATEST version of Pinokio (0.1.49).

The BEST part: Unlike hosted AI services that you need to pay per usage, you can keep Mirror running 24/7 on your laptop, 100% for FREE. Forever. This means all kinds of crazy experiments.

Mirror is completely hackable. Start by changing the prompts around, and then maybe even try tweaking the code, the entire app is just a single gr.Interface() call. If you have any cool ideas feel free to send PRs or join the Discord and share ideas.

@ggerganov @skunkworks_ai I don't see the specifics of the use case yet, but this has VERY big implications on security and has so much potential

@ggerganov @skunkworks_ai Can confirm V2 will is being trained to see a lot more cats 🐈🐈⬛

@ggerganov @skunkworks_ai Could you use that to keep an eye out for Herons at your fish pond.for example?
