ServiceNow-AI/Apriel-1.5-15b-Thinker running on a single GPU using `transformers serve`... 🔥 great to have some very nice reasoning models that can run locally! next step, trying it on mps 👀show more

ABot World 0.5B is out! we have now world... models at home, running in real-time on consumer GPU feed it an initial image, steer it with with your keyboard 🌎 you can run it locally or play now on spaces ▶️show more

BOOM! STANFORD LAUNCHES FRAMEPACK A FREE OPEN SOURCE AI... THAT CAN RUN ON 6 GB LAPTOP GPU TO GENERATE MINUTE LONG 30FPS VIDEO FROM SINGLE IMAGE. It is game changing…show more

Running MiniCPM5-2B locally on a 16GB MacBook 💻 It... beats Qwen3.5-4B on benchmarks, so we asked it to find recent AI news, it called web search, pulled back 10 results and summarized the key developments inside Atomic Chat Run local models viashow more

this is the worst local AI will ever be.... tomorrow it gets faster. next month the models get smarter. next year your GPU runs what a data center runs today. Qwen3.5-35B-A3B on a single 3090. told it to visualize its own expert routing. 256 experts, 8 active per token, rendered in 3D on the same GPU running inference. no API key. no subscription. no permission needed. closed AI isn't losing ground. it's losing the argument.show more

Qwen has just released a model on par with... GPT-4o... And you can run it locally easily 🤯 Yep. GPT-4o level AI running offline on a laptop. - Fully open source - Only 3B active parameters - 262k context length natively Quick steps to run it on your machine and details belowshow more

Wild that you can run a GPT-4 tier AI... on a laptop and serve it to your whole network. Llama 3.3 70B is a beast.show more

Pixel has always used AI to improve your photos.... And now, thanks to the help of Gemini models, it can help you become a better photographer. Camera Coach analyzes a single frame of your scene, and gives you step-by-step instructions on taking a great photo¹ 📷 #MadeByGoogleshow more

Apple just showcased the ultimate setup for running AI... models locally. These are 4 M5 Ultra Mac Studios running Kimi K2.7 Code locally to fix a bug in a 3D rendered scene on XCode. Each has 256GB RAM, so thats 1TB combined memory. Enough to run the biggest open AI models locally like Llama 4, Deepseek v3 and Qwen 3. Perfect for agentic coding when the project codebase is sensitive and you wan to keep it private. This is easily a $50K setup!show more

can run the SwiftUI app. I need to explore... that use case a bit further. It is technically fairly straightforward. I believe I can make it an easy experience. well... that's something to explore. running SwiftUI on iOS is next.show more

Our open-source RAG app, Verba, can now run Ollama... models locally to embed documents into Weaviate and generate answers without your data leaving your device! I tested it with Llama3, and it works great + super quickly on my M2; In this recording, I'm doing a little Verba-ception, asking Verba what Verba is 🤤 You can also use open-source models like Mistral, Claude, or your own custom LLMs. This will make doing RAG with sensitive data possible since you won't depend on APIs anymore. Looking forward to everyone trying it out 🤗 Update's coming next week!show more

✨ 3d models are now LIVE on Photo AI... 😊 You can now turn any AI photo you make into a 3d model by pressing [ 📦 Make 3d model ] And then you can view it inside Photo AI or download it as a .GLB 3d model file It's still very early in AI generated 3d model world but it's nice to have this feature working already As always, the models will keep improving, so this feature will keep getting better (like it did with video, it sucked before, now it's getting passable) Next would be nice to switch to .USDZ so you can load it straight into your iPhone with ARKit and put it in your room Available now for everyone on the Premium and Ultra planshow more

i want to show you guys how fast programming... is now i'm kind of resurrecting dingboard zig to see how fast i can make progress on it, using it as a test bed to see AI progress it took me 5 minutes to add a GPU accelerated (!) mirror button now, watch how fast this next thing isshow more

AI’s next frontier is Spatial Intelligence, a technology that... will turn seeing into reasoning, perception into action, and imagination into creation. But what is it? Why does it matter? How do we build it? And how can we use it? Today, I want to share with you my thoughts on building and using world models to unlock spatial intelligence in this essay below. 1/nshow more

this creator just built a zero-delay auto-aim system on... an $8 microcontroller he deployed a custom local AI algorithm on a cheap ESP-32 to track human movement with absolute 0-pixel accuracy. the system completely eliminates standard computation delay. it processes the bounding box and moves the sniper reticle instantly, locking onto the target in real time. the next step is hooking it up to a physical robotic arm. it proves you don't need a massive GPU rig to run complex computer vision. 1. runs locally on a microcontroller 2. local AI inference for zero latency 3. 100% targeting precision when an eight-dollar chip can track movement with zero latency, AI becomes dangerous local infrastructure. this article breaks down exactly how the ESP-32 is powering this physical hardware shift.show more

Running out of memory used to be a common... headache when running molecular simulations with neural network potentials. Not any more. Here Orb is simulating over half a million atoms on a single GPU (H200). This is a fully solvated COVID spike protein. (The trick is to specify brute_force_knn=False in the calculator.) This is more than an order of magnitude larger than some other universal models. I can get over 7,000 steps of molecular dynamics per day with it.show more

Introducing: Deploying tokens on BNB Chain with just one... prompt on X using Bink AI - DeFAI on BNB Tag Bink AI - DeFAI on BNB on X, type "get wallet address on BNB", then deposit some $BNB. Next, enter your prompt like in the vid and let magic happen. Bet CZ 🔶 BNB gonna love this one 👀 Let’s give it a try 🔥show more

GEMMA 4 26B ON AN RTX 4060 WITH A... 248K TOKEN CONTEXT WINDOW 20 tokens per second and a context window so large you can feed it entire codebases, books and research papers in a single prompt this is not a cloud api and not a server rack, this is a regular consumer gpu running locally with llama.cpp and q4_k_xl quantization 248k context on an 8gb vram card was not supposed to be possible and here it is just running on someone’s desk the article below covers exactly which tools and configs make this kind of setup work in 2026 ↓show more