Loading video...

Video Failed to Load

There was a problem loading this video. This could be due to a temporary network issue or the video might be unavailable.

vLLM + open-webui running gpt-oss-120b on a tinybox green v2 Just `vllm serve openai/gpt-oss-120b --tensor-parallel-size 4 --async-scheduling` and you have a local OpenAI API you can trust.

the tiny corp

78,335 subscribers

36,677 views • 10 months ago •via X (Twitter)

Science & Technology Gaming Finance

Anya Rossi• Live Now

Private livecam show

0 Comments

No comments available

Comments from the original post will appear here

Related Videos

We’re thrilled to launch GPT-OSS—the 120B-parameter open-source LLM—on Phala Cloud! 🚀 🔒 Run the fully OSS model inside a secure TEE for end-to-end confidential AI. Explore the build 👉

We’re thrilled to launch GPT-OSS—the 120B-parameter open-source LLM—on Phala Cloud! 🚀 🔒 Run the fully OSS model inside a secure TEE for end-to-end confidential AI. Explore the build 👉

Phala

12,176 views • 11 months ago

BOOOM! Both VLMs and LLMs now have a baked-in http server w/ OpenAI spec compatible API in transformers Launch it with `transformers serve` and connect your favorite apps. Here I'm running Open WebUI with local transformers. LLM, VLM, tool calling is in, STT & TTS coming soon!

BOOOM! Both VLMs and LLMs now have a baked-in http server w/ OpenAI spec compatible API in transformers Launch it with `transformers serve` and connect your favorite apps. Here I'm running Open WebUI with local transformers. LLM, VLM, tool calling is in, STT & TTS coming soon!

Lysandre

16,256 views • 1 year ago

We’ve seen great results using GPT-4 for content policy development and content moderation, enabling more consistent labeling, a faster feedback loop for policy refinement, and less involvement from human moderators. Built on top of the GPT-4 API:

We’ve seen great results using GPT-4 for content policy development and content moderation, enabling more consistent labeling, a faster feedback loop for policy refinement, and less involvement from human moderators. Built on top of the GPT-4 API:

OpenAI

902,348 views • 2 years ago

Wild that you can run a GPT-4 tier AI on a laptop and serve it to your whole network. Llama 3.3 70B is a beast.

Wild that you can run a GPT-4 tier AI on a laptop and serve it to your whole network. Llama 3.3 70B is a beast.

Aaron Ng

35,676 views • 1 year ago

Introducing DeepConf: Deep Think with Confidence 🚀 First method to achieve 99.9% on AIME 2025 with open-source models! Using GPT-OSS-120B even without tools, we reached this almost-perfect accuracy while saving up to 85% generated tokens. It also delivers many strong advantages for parallel thinking: 🔥 Performance boost: ~10% accuracy across models & datasets ⚡ Ultra-efficient: Up to 85% fewer tokens generated 🔧 Plug & play: Works with ANY existing model - zero training needed (no hyperparameter tuning as well!) ⭐ Easy to deploy: Just ~50 lines of code in vLLM (see PR below) 📚 Paper: 🌐 Project: joint work with: Yichao Fu , xuewei_wang, Yuandong Tian (see details in the comments below)

Introducing DeepConf: Deep Think with Confidence 🚀 First method to achieve 99.9% on AIME 2025 with open-source models! Using GPT-OSS-120B even without tools, we reached this almost-perfect accuracy while saving up to 85% generated tokens. It also delivers many strong advantages for parallel thinking: 🔥 Performance boost: ~10% accuracy across models & datasets ⚡ Ultra-efficient: Up to 85% fewer tokens generated 🔧 Plug & play: Works with ANY existing model - zero training needed (no hyperparameter tuning as well!) ⭐ Easy to deploy: Just ~50 lines of code in vLLM (see PR below) 📚 Paper: 🌐 Project: joint work with: Yichao Fu , xuewei_wang, Yuandong Tian (see details in the comments below)

Jiawei Zhao

464,360 views • 10 months ago

Qwen has just released a model on par with GPT-4o... And you can run it locally easily 🤯 Yep. GPT-4o level AI running offline on a laptop. - Fully open source - Only 3B active parameters - 262k context length natively Quick steps to run it on your machine and details below

Qwen has just released a model on par with GPT-4o... And you can run it locally easily 🤯 Yep. GPT-4o level AI running offline on a laptop. - Fully open source - Only 3B active parameters - 262k context length natively Quick steps to run it on your machine and details below

Paul Couvert

503,787 views • 11 months ago

GPT-4 is the new data scientist 🤯 With the new OpenAI code interpreter model, you just have to upload the data and provide instructions in simple english. The model does everything from cleaning data to generating insightful visualizations on autopilot!!

GPT-4 is the new data scientist 🤯 With the new OpenAI code interpreter model, you just have to upload the data and provide instructions in simple english. The model does everything from cleaning data to generating insightful visualizations on autopilot!!

Shubham Saboo

1,693,371 views • 3 years ago

👀 Asking all the new GPT-4.1 models from OpenAI to draw… a pelican. Then comparing with Grok 3, LLaMA 4, and Gemini 2.5 Pro. Which one do you prefer? Try it yourself on 80+ models — 👇

👀 Asking all the new GPT-4.1 models from OpenAI to draw… a pelican. Then comparing with Grok 3, LLaMA 4, and Gemini 2.5 Pro. Which one do you prefer? Try it yourself on 80+ models — 👇

Pierre Valade

123,811 views • 1 year ago

BREAKING: You can now access all the top LLMs from one API switch between GPT-5, Claude 4, Gemini 2.5, o3, Qwen Coders.. just with a single key here's how:

BREAKING: You can now access all the top LLMs from one API switch between GPT-5, Claude 4, Gemini 2.5, o3, Qwen Coders.. just with a single key here's how:

Nelly;

67,848 views • 11 months ago

OpenAI’s GPT-5.6 Sol model can now run inside Claude Code. There are two ways to do it, and both take minutes to set up, here’s how: Option 1, the official plugin: /plugin marketplace add openai/codex-plugin-cc /plugin install codex@openai-codex /reload-plugins, then /codex:setup That unlocks /codex:review, /codex:adversarial-review, and /codex:rescue. Claude writes, GPT critiques, you ship. Option 2, the proxy. One alias makes Sol your main model: alias claudex=‘CLAUDE_CODE_SUBAGENT_MODEL=gpt-5.6-sol CLAUDE_CODE_ALWAYS_ENABLE_EFFORT=1 claude –model gpt-5.6-sol’ Bonus: Claude Code lets you set subagent model and effort yourself. Sol Ultra runs can burn several times the tokens of a base run, so right-sizing delegated work saves real money.

OpenAI’s GPT-5.6 Sol model can now run inside Claude Code. There are two ways to do it, and both take minutes to set up, here’s how: Option 1, the official plugin: /plugin marketplace add openai/codex-plugin-cc /plugin install codex@openai-codex /reload-plugins, then /codex:setup That unlocks /codex:review, /codex:adversarial-review, and /codex:rescue. Claude writes, GPT critiques, you ship. Option 2, the proxy. One alias makes Sol your main model: alias claudex=‘CLAUDE_CODE_SUBAGENT_MODEL=gpt-5.6-sol CLAUDE_CODE_ALWAYS_ENABLE_EFFORT=1 claude –model gpt-5.6-sol’ Bonus: Claude Code lets you set subagent model and effort yourself. Sol Ultra runs can burn several times the tokens of a base run, so right-sizing delegated work saves real money.

Alvaro Cintas

83,249 views • 5 days ago

CRITICAL: if you are running Mosaic 2.4 on a VAX/VMS system, please be aware of this RCE that GPT-5.4 just found and exploited!

CRITICAL: if you are running Mosaic 2.4 on a VAX/VMS system, please be aware of this RCE that GPT-5.4 just found and exploited!

Brendan Dolan-Gavitt

140,076 views • 3 months ago

This peanut-sized chinese model just dethroned Gemini at reading documents. It’s called glm-ocr. it’s a tiny 0.9b parameter vision-language model that is about to replace every expensive ocr api you use. → Handles text, tables, formulas, handwriting → Scored 94.62 on OmniDocBench V1.5 → 8 languages → vLLM, SGLang, Ollama And it’s 100% open-source.

This peanut-sized chinese model just dethroned Gemini at reading documents. It’s called glm-ocr. it’s a tiny 0.9b parameter vision-language model that is about to replace every expensive ocr api you use. → Handles text, tables, formulas, handwriting → Scored 94.62 on OmniDocBench V1.5 → 8 languages → vLLM, SGLang, Ollama And it’s 100% open-source.

Alvaro Cintas

37,525 views • 3 months ago

Liquid's LFM2.5-8B-A1B smashed OpenAI's gpt-oss-20b on tool calling We ran both locally on a MacBook Pro M5 Max, 64GB, and gave each the same trip-planning request that only completes if the model fires all 7 tool calls - weather for 3 cities, two currency conversions, an email and a reminder Outputs: LFM2.5-8B-A1B: 4.8 GB RAM usage, 7/7 tool-calls, 266 tok/s, 6.9s OpenAI gpt-oss-20b: 11 GB RAM usage, 3/7 tool-calls, 146 tok/s, 15.0s The 8B used less than half the RAM and still fired all 7 calls, while the 20B silently dropped more than half of its own. It also ran ~2x faster, wrapping the full agentic request in 6.9s against 15s. That's what 38T training tokens buy: a 1B-active MoE that nails the agentic tool calls a model 2.5x its active size keeps dropping

Liquid's LFM2.5-8B-A1B smashed OpenAI's gpt-oss-20b on tool calling We ran both locally on a MacBook Pro M5 Max, 64GB, and gave each the same trip-planning request that only completes if the model fires all 7 tool calls - weather for 3 cities, two currency conversions, an email and a reminder Outputs: LFM2.5-8B-A1B: 4.8 GB RAM usage, 7/7 tool-calls, 266 tok/s, 6.9s OpenAI gpt-oss-20b: 11 GB RAM usage, 3/7 tool-calls, 146 tok/s, 15.0s The 8B used less than half the RAM and still fired all 7 calls, while the 20B silently dropped more than half of its own. It also ran ~2x faster, wrapping the full agentic request in 6.9s against 15s. That's what 38T training tokens buy: a 1B-active MoE that nails the agentic tool calls a model 2.5x its active size keeps dropping

atomic.chat

90,063 views • 1 month ago

🚀 New Video Alert – GPT-5 in Copilot Studio! GPT-5 has officially arrived in Microsoft Copilot Studio, and I couldn’t resist putting it to the test. In this video, I explore: 🔍 GPT-5 Auto & GPT-5 Reasoning models for custom agents. 🛠 How I leveraged GPT-5 Chat inside a custom prompt for more tailored outputs. ⚖️ GPT-5 Chat Vs. GPT-4.1 to highlight improvements and trade-offs If you’ve been wondering what GPT-5 brings to Copilot Studio—this video is packed with real examples, practical tests, and insights to help you understand what these new experimental models have to offer. 🎥 Watch here: #CopilotStudio #GPT5 #AIBuilder #MicrosoftCopilot #LowCodeAI #OpenAI #AI #CopilotStudio #GPT5Auto #GPT5Reasoning #GPT5Chat

🚀 New Video Alert – GPT-5 in Copilot Studio! GPT-5 has officially arrived in Microsoft Copilot Studio, and I couldn’t resist putting it to the test. In this video, I explore: 🔍 GPT-5 Auto & GPT-5 Reasoning models for custom agents. 🛠 How I leveraged GPT-5 Chat inside a custom prompt for more tailored outputs. ⚖️ GPT-5 Chat Vs. GPT-4.1 to highlight improvements and trade-offs If you’ve been wondering what GPT-5 brings to Copilot Studio—this video is packed with real examples, practical tests, and insights to help you understand what these new experimental models have to offer. 🎥 Watch here: #CopilotStudio #GPT5 #AIBuilder #MicrosoftCopilot #LowCodeAI #OpenAI #AI #CopilotStudio #GPT5Auto #GPT5Reasoning #GPT5Chat

Daniel Christian

14,705 views • 11 months ago

Excited to introduce OpenAI o1—a new series of reasoning models. Developers, we’d love for you to kick the tires, but don’t just hot-swap GPT-4o with o1! Send o1-preview and o1-mini your coding tasks or hard challenges, and share your feedback and most interesting results.

Excited to introduce OpenAI o1—a new series of reasoning models. Developers, we’d love for you to kick the tires, but don’t just hot-swap GPT-4o with o1! Send o1-preview and o1-mini your coding tasks or hard challenges, and share your feedback and most interesting results.

Romain Huet

234,323 views • 1 year ago

It's over. OpenAI just crushed it. We have their o3-level open-source model running on Groq Inc at 500 tokens per second. Watch it build an entire SaaS app in just a few seconds. This is the new standard. Why the hell would you use anything else??

It's over. OpenAI just crushed it. We have their o3-level open-source model running on Groq Inc at 500 tokens per second. Watch it build an entire SaaS app in just a few seconds. This is the new standard. Why the hell would you use anything else??

Matt Shumer

498,609 views • 11 months ago

🚨 do you understand what is happening?! OpenAI and Anthropic are putting the best models behind approval lists. Meanwhile GLM 5.2 is running locally on a Mac Studio, coding in a loop 24/7. If someone can turn off your AI, you are renting your intelligence layer. Local models are getting so good now that you can create gameplays like this.👇

🚨 do you understand what is happening?! OpenAI and Anthropic are putting the best models behind approval lists. Meanwhile GLM 5.2 is running locally on a Mac Studio, coding in a loop 24/7. If someone can turn off your AI, you are renting your intelligence layer. Local models are getting so good now that you can create gameplays like this.👇

Vadim

14,609 views • 19 days ago

🚨 OpenAI GPT-5 model Summit spotted online and it is best we have seen so far. Smarter than us. It can - generate a control panel of starship from distant future - create a streaming website - nails the SVG with robot walking - best pineapple defense game ever What did you try building with it? Available on LMArena. There is another model Zenith which is doing the rounds. Both are great at creative writing too. Sam Altman will once again make headlines with GPT-5 launch on ChatGPT in the coming week.

🚨 OpenAI GPT-5 model Summit spotted online and it is best we have seen so far. Smarter than us. It can - generate a control panel of starship from distant future - create a streaming website - nails the SVG with robot walking - best pineapple defense game ever What did you try building with it? Available on LMArena. There is another model Zenith which is doing the rounds. Both are great at creative writing too. Sam Altman will once again make headlines with GPT-5 launch on ChatGPT in the coming week.

Prashant

27,584 views • 11 months ago

This free model just beat every closed-source AI on coding benchmarks. Open weights. 6x cheaper than Opus. The labs don't want you to know it exists. > GLM-5.2 from Zai just topped Code Arena - the first open-weights model to ever hold the #1 coding spot. Not a leaked weight, not a fine-tune. A fully open model beating GPT and Claude on their own turf. It's live on Hugging Face Inference API right now. 5 providers: Novita, Together AI, Fireworks, Deepinfra, Zai. OpenAI-compatible client. → Go to huggingface(.)co → grab HF_TOKEN from account settings → plug into any OpenAI-compatible client 6x cheaper than Opus. Companies bleeding on AI bills are already routing to this for orchestration, caching, and token optimization. The smart money moved before the headline dropped. > Now you know. huggingface(.)co/zai-org/GLM-5.2 Bookmark this before everyone else figures it out.

This free model just beat every closed-source AI on coding benchmarks. Open weights. 6x cheaper than Opus. The labs don't want you to know it exists. > GLM-5.2 from Zai just topped Code Arena - the first open-weights model to ever hold the #1 coding spot. Not a leaked weight, not a fine-tune. A fully open model beating GPT and Claude on their own turf. It's live on Hugging Face Inference API right now. 5 providers: Novita, Together AI, Fireworks, Deepinfra, Zai. OpenAI-compatible client. → Go to huggingface(.)co → grab HF_TOKEN from account settings → plug into any OpenAI-compatible client 6x cheaper than Opus. Companies bleeding on AI bills are already routing to this for orchestration, caching, and token optimization. The smart money moved before the headline dropped. > Now you know. huggingface(.)co/zai-org/GLM-5.2 Bookmark this before everyone else figures it out.

Atenov int.

12,395 views • 28 days ago

Haha. I just made this silly little Javascript game 100% with GPT-4. I have zero coding knowledge and I couldn't tell you what a single line of the code is doing. 🧵

Haha. I just made this silly little Javascript game 100% with GPT-4. I have zero coding knowledge and I couldn't tell you what a single line of the code is doing. 🧵

Matt Wolfe

508,421 views • 3 years ago