Microsoft killed the GPU mafia 🤯 They finally open-sourced... their 1-bit LLM inference framework called bitnet.cpp. It lets you run 100B parameter models on your local CPU without GPUs. - 6.17x faster inference - 82.2% less energy on CPUs 100% Open Source.show more

Laika AI x Inference Labs Excited to announce our... partnership with Inference Labs We're providing our real-time RAG & AI model API to Inference Labs, powering their verification infrastructure with live blockchain data. Inference Labs delivers open-source, trustless verification for AI agent outputs, so you can trust what you see—without relying on centralized gatekeepers.show more

Step 4 to achieve truly serverless GPUs for AI... inference: skip over unserializable inference engine setup steps like CUDA graph capture and Torch compilation by stacking GPU snapshots and CPU snapshots.show more

A catalogue is useless if you can’t run it.... ⬟ The Playground is executable. Models are live, not listed. 100k+ models available for real inference. No local setup required. Browse less. Execute more.show more

Claude Code got a massive open-source rival 🤯 This... tool maps your entire codebase, automates terminal commands, and lets you use 500+ different AI models, including completely free ones. 100% Open-Source.show more

Now that we have amazing open source TTS with... fast inference, what are you building?show more

just made it possible to evaluate generalist robotics models... like Octo at 60-100x real world evaluation speeds via gpu simulation and rendering (~10x faster than original cpu sim code). All videos below are from our open source ManiSkill GPU sim!show more

Introducing Find the best local models based on real... data 1. People run and submit benchmarks 2. Stats aggregated over models / devices 3. Find the best model for you `npx whatcanirun`, fully open-sourceshow more

Google just open-sourced LangExtract Python library! It uses LLMs... to extract entities, attributes, and relations—with exact source grounding—from unstructured documents. Flexible LLM support (Gemini, OpenAI, Ollama) 100% open-source.show more

If you love open models, you’ll love this: Crush... now runs with Hugging Face Inference Providers 🤗✨show more

Someone just built a desktop app that that generates... 3D models from images and runs 100% locally. It's called Modly. It runs entirely on your GPU, no cloud, no API bills. Just drop an image and get a 3D mesh. 100% Open Source.show more

Depth Anything 3 now runs as pure C++/ggml (ggml)... . No Python, no PyTorch, no CUDA toolkit at inference, just one self-contained GGUF. It's faster than PyTorch on CPU! and ties speed on GPU. The CPU win came from the last place..I'd have looked. Quantized GGUF on Hugging Face🤗 Shout out to Georgi Gerganov for ggml (we are building a ggml-world!❤️) and to ByteDance Open Source and Depth Anything 3 authors Bingyi Kang Jun Hao Liew Donny Y. Chen !show more

private inference is live on the bankr llm gateway.... select models now run inside TEEs. prompts stay encrypted in use -- private, by design. pay with any coin you’re holding. get started below.show more

Introducing DeepThought-8B: Transparent reasoning model built on LLaMA-3.1 with... test-time compute scaling. - JSON-structured thought chains & controllable inference paths. - ~16GB VRAM, competitive w/ 70B models. - Open model weights, and inference scripts.show more

We’re thrilled to launch GPT-OSS—the 120B-parameter open-source LLM—on Phala... Cloud! 🚀 🔒 Run the fully OSS model inside a secure TEE for end-to-end confidential AI. Explore the build 👉show more

No more waitlist – Cerebras inference API is open... to all! 1M free tokens/day 20x GPU speed Reasoning in ~1 second It's time to build!show more

$AMD might be the most underrated AI stock on... the market. Everyone focuses on GPUs. But CEO Lisa Su says the CPU market alone could hit $120B by 2030 because of AI agents. $AMD gives you BOTH: • AI GPUs • AI CPUs The AI boom won’t run on GPUs alone. Don’t miss out again…show more

this is the worst local AI will ever be.... tomorrow it gets faster. next month the models get smarter. next year your GPU runs what a data center runs today. Qwen3.5-35B-A3B on a single 3090. told it to visualize its own expert routing. 256 experts, 8 active per token, rendered in 3D on the same GPU running inference. no API key. no subscription. no permission needed. closed AI isn't losing ground. it's losing the argument.show more

🔥 BREAKING: Open source just leveled up AI agents... Eigent gives you a fully local, customizable AI workforce....built to run on your laptop. → No vendor lock-in → No cloud dependency → 100% open source Just fast, private, parallel agents you control (Here's how):👇show more

Fireworks blazing fast LLM inference is now available on... Poe! Today, we’re excited to bring the power of the new Mistral 7B Instruct model to the Poe powered by our lightning-fast Fireworks inference platform. You can now have conversations with the Mistral 7B bot and even build your own bots on top of it. Try it here:show more

You can now run open-source AI coding agents without... paying for API keys 🤯 Cline CLI 2.0 just dropped with free access to Minimax M2.5. → Runs from your terminal → Parallel agents → Works with any editor Any model you want. 100% Open Source.show more