BOOOM! Both VLMs and LLMs now have a baked-in... http server w/ OpenAI spec compatible API in transformers Launch it with `transformers serve` and connect your favorite apps. Here I'm running Open WebUI with local transformers. LLM, VLM, tool calling is in, STT & TTS coming soon!show more

Up to 3x faster LLM generation with no extra... resources/requirements - ngram speculation has landed in 🤗 transformers! 🏎️💨 All you need to do is to add `prompt_lookup_num_tokens=10` to your `generate` call and you'll get faster LLMs🔥 🧵How does it work?show more

Depth Anything V2 is a total beast for real-time... 3D. Built a website that hits 30fps+ depth reconstructions from a single camera feed, extruding 12k voxels via WebGPU. Pure ML running local Vision Transformers with Three.js and zero backend lag. Lmk in the comments if you want a copy! 🙌 Experience and music made with AI in Omma AI (tool by Spline).show more

🚨 YOUR GPU IS PROBABLY WASTING MORE THAN YOU... THINK. vLLM is built to squeeze far more useful work out of your GPU when serving LLMs. Running an LLM at scale isn’t just about having a powerful GPU. The real problem is how efficiently you use its memory and compute. That’s where vLLM comes in. → High-throughput LLM inference and serving → PagedAttention for smarter KV-cache memory management → Continuous batching to keep GPUs busy → Prefix caching + chunked prefill → OpenAI-compatible API out of the box → Supports a huge range of modern LLM architectures → Quantization support for running models more efficiently And the crazy part? You can start an OpenAI-compatible inference server with: `vllm serve ` So your application can talk to your own model almost like it’s talking to OpenAI. The bigger idea: Don’t just buy more GPUs. Make the GPUs you already have work harder. That’s why vLLM has become such a major project in LLM inference. 🔥 #vLLM #AI #LLM #Inference #GPU #MachineLearning #AIInfrastructure #OpenSource #AIAgents #Developersshow more

SPEC Liquidity is coming to Launch a new pool... for any coin, no matter the launchpad, with its own rules built in. Set how fees flow, chose who gets rewarded and set your range. LPs earn on every trade. Coming soon, Only on $SPECshow more

After months of work, and with the help of... our awesome community, we're excited to finally share LM Studio 0.3.0! 🎉 🔥 What's new: - Built-in Chat with Documents, 100% offline - OpenAI-like 'Structured Outputs' API with any local model - Total UI revamp (with dark/light/sepia themes) - Load & serve multiple LLMs *on the local network* - Available in 7 languages! 🌎🌍🌏 - Download any supported model from Hugging Face - Update LLM runtimes (llama.cpp) separately from the app ... and tons more goodies! Let us know how you like it! 👾🤝show more

2 days left to schedule your launch for the... GPT-6 Astra Challenge. Launch on Product Hunt this Friday, September 18, for a chance to win. We've teamed up with OpenAI Developers to award the top five launches: · $10K in OpenAI API credits · 1 year of ChatGPT Pro for up to two team members If you’re building with Astra, get your product in front of the community and locked in on the calendar now. Schedule your launch here:show more

Introducing Singularity AI Machines. One-click deployable GPUs with built-in... LLMs. Deploy in one click, and within minutes you get an OpenAI-compatible API running high-speed inference on compute that stays under your control. You can literally deploy a machine and: 1. Apply to OpenRouter as a provider 2. Start your own AI business 3. Join Singularity Grid in one click without owning any hardware 4. Let AI agents launch and manage your machines for you Until now, becoming an AI provider felt like something only infra companies could do. We are making it accessible to literally everyone. Singularity AI Machines are live.show more

You can now classify documents with open-weight VLMs at... ultra-low cost with our TypeSafe AI Jev-compatible API in the VLM Run gateway! $1 buys you 6700+ pages, and the full 1,651-page OmniDocBench run cost 25 cents. It reads the page as pixels (no OCR->LLM hacks) and hands back one typed, calibrated decision per page - ~180ms p50 e2e. Jev really opened developers' eyes to re-thinking how we process data at the cost-pareto front. A week later we're bringing that to our APIs with vision as a first-class citizen. Try our gateway today - free to sign-up and try!show more

Claude Code is running on a remote server, along... with the web app it just built. You’re on your phone. You can still open localhost:3000 in Safari or Chrome. Just create a local port forwarding rule in Termius and securely tunnel the remote port to your device. No public ports. No extra setup.show more

3 days left to schedule your launch for the... GPT-6 Astra Challenge. Launch on Product Hunt this Friday, September 18, for a chance to win. The top five launches each get: · $10K in OpenAI Developers API credits · 1 year of ChatGPT Pro for up to two team members If you’re building with Astra, get your product in front of the community and locked in on the calendar now. Schedule your launch here:show more

Alchemist AI 3.5 is here 🪄 Try it out... now ▶️ ⚙️ Entirely rebuilt with a proprietary multi-agent engine ⚡️ Faster, smarter generations with real-time logic 🧠 16+ LLMs running in parallel across 8 orchestration layers 🎮 Build 3D games & apps live as you go Experience our flagship evolution and stay tuned for what's next!show more

Build with GPT-6 Astra. Launch on Product Hunt on... September 18. We've teamed up with OpenAI Developers for the GPT-6 Astra Challenge. The top five launches each win $10K in OpenAI API credits and a year of ChatGPT Pro for up to two team members. If you’re already building with Astra, this is a chance to share what you’ve made and put it in front of a wider audience. You can schedule your launch for Friday, September 18.show more

TrendTrack API & MCP are live Connect it to... Claude, GPT, Gemini or any tool you already use. What you can pull : Winning ads before they saturate Scaling stores before everyone spots them Email campaigns from your competitors Hooks that are converting right now Everything you see on TrendTrack can now be extracted and processed by AI. How to use it ? API → integrate TrendTrack data directly into your tools, dashboards, or custom apps MCP → connect TrendTrack to any LLM. Claude, GPT, Gemini, Perplexity. Ask a question, it pulls the data itself, responds in real time Start building now →show more

someone just open-sourced their own neuro-sama. and it might... be better than the original. it's called airi. a fully autonomous ai companion that speaks with you in real time, joins you in minecraft and factorio, chats through discord and telegram, and comes with a live2d/vrm avatar. runs entirely on your machine. → real-time voice chat and speech recognition → animated avatar with automatic blinking, eye tracking, and idle movements → persistent memory between sessions → local inference through webgpu, no api calls required supports 30+ llm providers, including openai, claude, gemini, deepseek, ollama, groq, mistral, xai, and local models. switch the brain with a config change. uses native cuda and apple metal for real gpu acceleration. 17.5k stars. 101 contributors. 46 releases. completely free. open source.show more

Having a platform where your favorite footballers have their... own space to share training days, travels, behind the scenes moments, and everyday life. is the perfect platform, you can get it all in one. This is the universe for both football players and their fans. As a fan it’s a more personal experience to engage and connect with your favourite players and have a lovely and incredible journey beyond the pitch. ⚽️🔥show more

most of you don't know how hard hermes agent... is optimized for local AI at the system level. watch the full setup flow on screen. you paste an openai-compatible v1 endpoint, hermes auto-detects every model running behind it. doesn't matter if it's llama.cpp or vllm or any compatible server, all your models surface and become selectable in seconds. no config gymnastics, no manual model list. then it goes deeper. hermes ships with per model parsers, prompt template auto-handling, tool call format detection per model architecture, thinking mode awareness, all the small friction points other harnesses leak on. these were not built for cloud apis with one canonical model. they were built for builders running 10 different local models across 10 different stacks. cloud first harnesses bolt local support on top. hermes agent is local first from the architecture out. that's the system level gap. if you're getting started on local AI, this is the harness you start with. try for yourself and find out. anyone serious about local AI lands here eventually.show more

Grok 4.5 is now in Codex now too. No... API key, no billing setup, no config file. If you have X Premium, you sign in with your X account and Grok 4.5 runs inside your Codex. OAuth handles it. Your subscription is your access. That's it. And Grok 4.5 just got a lot better, so if you already pay for X Premium, you can now run it in Codex for free.show more

GEMMA 4 26B ON AN RTX 4060 WITH A... 248K TOKEN CONTEXT WINDOW 20 tokens per second and a context window so large you can feed it entire codebases, books and research papers in a single prompt this is not a cloud api and not a server rack, this is a regular consumer gpu running locally with llama.cpp and q4_k_xl quantization 248k context on an 8gb vram card was not supposed to be possible and here it is just running on someone’s desk the article below covers exactly which tools and configs make this kind of setup work in 2026 ↓show more

🚨 I'm glad to announce is expanding to Middle... East! 🚨 We are bringing over TWO servers: • Open server for all skill levels running DAILY competitive ladders with leaderboards • Private server with no zone rules and our advanced drop map system technology with a set lobby based on skill level. - Fortnitetracker Leaderboard Integration in to see all live leaderboards of daily scrims/ladders. • Proper rank system ranking players based on FNCS/CashCup/Power Rankings Join now! Open Server: Private Server:show more

someone just open-sourced their own neuro-sama. and it might... be better than the original. it's called airi. a fully autonomous ai companion that talks to you in real time, plays minecraft and factorio with you, chats on discord and telegram, and has a live2d/vrm avatar body. runs entirely on your machine. → real-time voice conversations, speech recognition → animated avatar with auto-blink, eye tracking, idle animations → persistent memory across sessions → local inference via webgpu, no api calls needed supports 30+ llm providers, openai, claude, gemini, deepseek, ollama, groq, mistral, xai, local models. swap the brain with a config change. runs on native cuda and apple metal for real gpu acceleration. 17.5k stars. 101 contributors. 46 releases. 100% free. open source.show more