vLLM + open-webui running gpt-oss-120b on a tinybox green... v2 Just `vllm serve openai/gpt-oss-120b --tensor-parallel-size 4 --async-scheduling` and you have a local OpenAI API you can trust.show more

We’re thrilled to launch GPT-OSS—the 120B-parameter open-source LLM—on Phala... Cloud! 🚀 🔒 Run the fully OSS model inside a secure TEE for end-to-end confidential AI. Explore the build 👉show more

BOOOM! Both VLMs and LLMs now have a baked-in... http server w/ OpenAI spec compatible API in transformers Launch it with `transformers serve` and connect your favorite apps. Here I'm running Open WebUI with local transformers. LLM, VLM, tool calling is in, STT & TTS coming soon!show more

We’ve seen great results using GPT-4 for content policy... development and content moderation, enabling more consistent labeling, a faster feedback loop for policy refinement, and less involvement from human moderators. Built on top of the GPT-4 API:show more

Wild that you can run a GPT-4 tier AI... on a laptop and serve it to your whole network. Llama 3.3 70B is a beast.show more

Introducing DeepConf: Deep Think with Confidence 🚀 First method... to achieve 99.9% on AIME 2025 with open-source models! Using GPT-OSS-120B even without tools, we reached this almost-perfect accuracy while saving up to 85% generated tokens. It also delivers many strong advantages for parallel thinking: 🔥 Performance boost: ~10% accuracy across models & datasets ⚡ Ultra-efficient: Up to 85% fewer tokens generated 🔧 Plug & play: Works with ANY existing model - zero training needed (no hyperparameter tuning as well!) ⭐ Easy to deploy: Just ~50 lines of code in vLLM (see PR below) 📚 Paper: 🌐 Project: joint work with: Yichao Fu , xuewei_wang, Yuandong Tian (see details in the comments below)show more

🎉 Congrats to MiniMax (official) on releasing the open... weights for MiniMax H3! Day-0 support in vLLM-Omni! One model reads text, images, video, and audio as a single context and returns video with native stereo audio. Text-to-video, first/last-frame, and multi-reference generation, 4 to 15 seconds at up to 2K and 24 FPS. The MP4 comes back with H.264 video and a synchronized stereo track already muxed in. It serves over the OpenAI-compatible /v1/videos endpoint, synchronous or async with job polling. 🔊 The video ⬇️ was made with H3, served on vLLM-Omni.show more

Qwen has just released a model on par with... GPT-4o... And you can run it locally easily 🤯 Yep. GPT-4o level AI running offline on a laptop. - Fully open source - Only 3B active parameters - 262k context length natively Quick steps to run it on your machine and details belowshow more

GPT-4 is the new data scientist 🤯 With the... new OpenAI code interpreter model, you just have to upload the data and provide instructions in simple english. The model does everything from cleaning data to generating insightful visualizations on autopilot!!show more

👀 Asking all the new GPT-4.1 models from OpenAI... to draw… a pelican. Then comparing with Grok 3, LLaMA 4, and Gemini 2.5 Pro. Which one do you prefer? Try it yourself on 80+ models — 👇show more

BREAKING: You can now access all the top LLMs... from one API switch between GPT-5, Claude 4, Gemini 2.5, o3, Qwen Coders.. just with a single key here's how:show more

OpenAI’s GPT-5.6 Sol model can now run inside Claude... Code. There are two ways to do it, and both take minutes to set up, here’s how: Option 1, the official plugin: /plugin marketplace add openai/codex-plugin-cc /plugin install codex@openai-codex /reload-plugins, then /codex:setup That unlocks /codex:review, /codex:adversarial-review, and /codex:rescue. Claude writes, GPT critiques, you ship. Option 2, the proxy. One alias makes Sol your main model: alias claudex=‘CLAUDE_CODE_SUBAGENT_MODEL=gpt-5.6-sol CLAUDE_CODE_ALWAYS_ENABLE_EFFORT=1 claude –model gpt-5.6-sol’ Bonus: Claude Code lets you set subagent model and effort yourself. Sol Ultra runs can burn several times the tokens of a base run, so right-sizing delegated work saves real money.show more

CRITICAL: if you are running Mosaic 2.4 on a... VAX/VMS system, please be aware of this RCE that GPT-5.4 just found and exploited!show more

This peanut-sized chinese model just dethroned Gemini at reading... documents. It’s called glm-ocr. it’s a tiny 0.9b parameter vision-language model that is about to replace every expensive ocr api you use. → Handles text, tables, formulas, handwriting → Scored 94.62 on OmniDocBench V1.5 → 8 languages → vLLM, SGLang, Ollama And it’s 100% open-source.show more

Liquid's LFM2.5-8B-A1B smashed OpenAI's gpt-oss-20b on tool calling We... ran both locally on a MacBook Pro M5 Max, 64GB, and gave each the same trip-planning request that only completes if the model fires all 7 tool calls - weather for 3 cities, two currency conversions, an email and a reminder Outputs: LFM2.5-8B-A1B: 4.8 GB RAM usage, 7/7 tool-calls, 266 tok/s, 6.9s OpenAI gpt-oss-20b: 11 GB RAM usage, 3/7 tool-calls, 146 tok/s, 15.0s The 8B used less than half the RAM and still fired all 7 calls, while the 20B silently dropped more than half of its own. It also ran ~2x faster, wrapping the full agentic request in 6.9s against 15s. That's what 38T training tokens buy: a 1B-active MoE that nails the agentic tool calls a model 2.5x its active size keeps droppingshow more

🚀 New Video Alert – GPT-5 in Copilot Studio!... GPT-5 has officially arrived in Microsoft Copilot Studio, and I couldn’t resist putting it to the test. In this video, I explore: 🔍 GPT-5 Auto & GPT-5 Reasoning models for custom agents. 🛠 How I leveraged GPT-5 Chat inside a custom prompt for more tailored outputs. ⚖️ GPT-5 Chat Vs. GPT-4.1 to highlight improvements and trade-offs If you’ve been wondering what GPT-5 brings to Copilot Studio—this video is packed with real examples, practical tests, and insights to help you understand what these new experimental models have to offer. 🎥 Watch here: #CopilotStudio #GPT5 #AIBuilder #MicrosoftCopilot #LowCodeAI #OpenAI #AI #CopilotStudio #GPT5Auto #GPT5Reasoning #GPT5Chatshow more

It's over. OpenAI just crushed it. We have their... o3-level open-source model running on Groq Inc at 500 tokens per second. Watch it build an entire SaaS app in just a few seconds. This is the new standard. Why the hell would you use anything else??show more

Excited to introduce OpenAI o1—a new series of reasoning... models. Developers, we’d love for you to kick the tires, but don’t just hot-swap GPT-4o with o1! Send o1-preview and o1-mini your coding tasks or hard challenges, and share your feedback and most interesting results.show more

🚨 do you understand what is happening?! OpenAI and... Anthropic are putting the best models behind approval lists. Meanwhile GLM 5.2 is running locally on a Mac Studio, coding in a loop 24/7. If someone can turn off your AI, you are renting your intelligence layer. Local models are getting so good now that you can create gameplays like this.👇show more

If you've done work in OSS AI, or Local... AI and want to have you and your company on State of Local AI - 2026 Get in touch, you'll be on as a coauthor with the companies and people who make this all possible. We moved release date to August 7th, we have 6 contributors so farshow more

🚨 OpenAI GPT-5 model Summit spotted online and it... is best we have seen so far. Smarter than us. It can - generate a control panel of starship from distant future - create a streaming website - nails the SVG with robot walking - best pineapple defense game ever What did you try building with it? Available on LMArena. There is another model Zenith which is doing the rounds. Both are great at creative writing too. Sam Altman will once again make headlines with GPT-5 launch on ChatGPT in the coming week.show more