Loading video...

Video Failed to Load

Go Home

openai gpt-oss 20b model speed on rtx 4090 windows ollama

mertcobanov's profile picture

Mert Cobanov

34,737 subscribers

465,600 views • 1 year ago •via X (Twitter)

Health & WellnessScience & TechnologyEducation
LIVE

Anya Rossi• Live Now

Private livecam show

0 Comments

No comments available

Comments from the original post will appear here

Related Videos

Speed Is the Innovation - GPT-OSS:20B + llama.cpp + @neovim
16:21

Speed Is the Innovation - GPT-OSS:20B + llama.cpp + @neovim

Wes Higbee

13,489 views • 11 months ago

running gpt-oss:20b on ollama with Turbo and web search 🏎️ 💨 very happy with how the web search turned out :) and ofcourse – more improvements on the way!
0:28

running gpt-oss:20b on ollama with Turbo and web search 🏎️ 💨 very happy with how the web search turned out :) and ofcourse – more improvements on the way!

parth

54,124 views • 1 year ago

A big milestone for AI on Windows: gpt‑oss‑20b is now available in Windows AI Foundry and Azure AI Foundry! You can now run this open-source, frontier-class model locally on a high-performance Windows PC. It’s fast, capable, and built for real-world use. Brought to life through collaboration across Windows, Azure, and OpenAI teams. We can’t wait to see what you create. 🚀
0:35

A big milestone for AI on Windows: gpt‑oss‑20b is now available in Windows AI Foundry and Azure AI Foundry! You can now run this open-source, frontier-class model locally on a high-performance Windows PC. It’s fast, capable, and built for real-world use. Brought to life through collaboration across Windows, Azure, and OpenAI teams. We can’t wait to see what you create. 🚀

Pavan Davuluri

80,597 views • 1 year ago

gpt-oss with built-in websearch in ollama running fully locally on my mac with Exa for search shoutout to @DKundel OpenAI Developers for making it so easy :)
1:01

gpt-oss with built-in websearch in ollama running fully locally on my mac with Exa for search shoutout to @DKundel OpenAI Developers for making it so easy :)

parth

19,862 views • 11 months ago

OpenAI has finally released GPT OSS 20B!! This is probably the most powerful model you can run locally on a laptop. → Only 3.6B active parameters → Adjustable "Reasoning Effort" → Works with 16GB of RAM! Quick steps to use it 100% free and offline:
0:29

OpenAI has finally released GPT OSS 20B!! This is probably the most powerful model you can run locally on a laptop. → Only 3.6B active parameters → Adjustable "Reasoning Effort" → Works with 16GB of RAM! Quick steps to use it 100% free and offline:

Paul Couvert

595,592 views • 1 year ago

OpenAI just released GPT-OSS: An Open Source Language Model on Hugging Face Open source meaning: 💸 Free 🔒 Private 🔧 Customizable
0:47

OpenAI just released GPT-OSS: An Open Source Language Model on Hugging Face Open source meaning: 💸 Free 🔒 Private 🔧 Customizable

dylan

21,568 views • 1 year ago

GPT-oss 20BがGPUメモリ4GBで動いて14tok/sec出る！
0:35

GPT-oss 20BがGPUメモリ4GBで動いて14tok/sec出る！

きしだൠ(K1S)

108,833 views • 11 months ago

Introducing `gpt-oss Pro Mode`! Basically o3 Pro, but for the new OpenAI open source models :) Pro Mode chains together up to 10 instances of the new OpenAI GPT-OSS model, enabling it to produce a better answer than one instance alone could create! Open source, link here:
0:21

Introducing `gpt-oss Pro Mode`! Basically o3 Pro, but for the new OpenAI open source models :) Pro Mode chains together up to 10 instances of the new OpenAI GPT-OSS model, enabling it to produce a better answer than one instance alone could create! Open source, link here:

Matt Shumer

315,683 views • 1 year ago

PSA: OpenAI is putting the Open back in OpenAI and Groq Inc has Day 0 support. 🤗 GPT-OSS 20B and 120B, hybrid-reasoning models with built-in browser search and code execution are now live for instant inference. P.S. We've also launched OpenAI Responses API compatibility.
0:29

PSA: OpenAI is putting the Open back in OpenAI and Groq Inc has Day 0 support. 🤗 GPT-OSS 20B and 120B, hybrid-reasoning models with built-in browser search and code execution are now live for instant inference. P.S. We've also launched OpenAI Responses API compatibility.

Hatice Ozen

82,049 views • 1 year ago

The new gpt-oss-120b from OpenAI is now the best general purpose model to run on a Framework Desktop! ~40 tok/s on the MXFP4 version in LM Studio on Fedora 42.
0:57

The new gpt-oss-120b from OpenAI is now the best general purpose model to run on a Framework Desktop! ~40 tok/s on the MXFP4 version in LM Studio on Fedora 42.

Framework

129,716 views • 1 year ago

Introducing OpenChatKit 🚀 - The first open-source alternative to ChatGPT! A team of ex-OpenAI fellows at Together have released a 20B chat-GPT model, fine-tuned for chat using EleutherAI's GPT-NeoX-20B, with over 43 million instructions under the Apache-2.0 license. >>>
0:30

Introducing OpenChatKit 🚀 - The first open-source alternative to ChatGPT! A team of ex-OpenAI fellows at Together have released a 20B chat-GPT model, fine-tuned for chat using EleutherAI's GPT-NeoX-20B, with over 43 million instructions under the Apache-2.0 license. >>>

Itamar Golan 🤓

555,517 views • 3 years ago

OpenAI のオープンウェイトモデル gpt-oss-120b をローカル環境で動かしてみた！このくらいの速度が出ます！Ollama x Mac Studio M2 Ultra 192GB
0:42

OpenAI のオープンウェイトモデル gpt-oss-120b をローカル環境で動かしてみた！このくらいの速度が出ます！Ollama x Mac Studio M2 Ultra 192GB

ぬこぬこ | NUKO

221,218 views • 1 year ago

We teamed up with NVIDIA and Matthew Berman to teach you how to do Reinforcement Learning! Learn about: - RL environments, reward functions & reward hacking - Training OpenAI gpt-oss to automatically solve 2048 - Local Windows training with NVIDIA_AI_PC RTX GPUs - How RLVR (verifiable rewards) works - How to interpret RL metrics like KL Divergence Full video tutorial:
5:13

We teamed up with NVIDIA and Matthew Berman to teach you how to do Reinforcement Learning! Learn about: - RL environments, reward functions & reward hacking - Training OpenAI gpt-oss to automatically solve 2048 - Local Windows training with NVIDIA_AI_PC RTX GPUs - How RLVR (verifiable rewards) works - How to interpret RL metrics like KL Divergence Full video tutorial:

Unsloth AI

54,179 views • 7 months ago

Just a little bit faster than everyone else on OpenAI GPT-OSS-120B. > 10 times faster than the leading NVIDIA GPU provider
0:23

Just a little bit faster than everyone else on OpenAI GPT-OSS-120B. > 10 times faster than the leading NVIDIA GPU provider

Andrew Feldman

124,175 views • 11 months ago

A voice agent powered by gpt-oss. Running locally on my macBook. Demo recorded in a Waymo with WiFi turned off. I'm still on my space game voice AI kick, obviously. Code link below. For conversational voice AI, you want to set the gpt-oss reasoning behavior to "low". (The default is "medium".) Notes on how to do that and a jinja template you can use are in the repo. The LLM in the demo video is the big, 120B version of gpt-oss. You can use the smaller, 20B model for this, of course. But OpenAI really did a cool thing here designing the 120B model to run in "just" 80GB of VRAM. And the llama.cpp mlx inference is fast: ~250ms TTFT. Running a big model on-device feels like a time warp into the future of AI.
4:35

A voice agent powered by gpt-oss. Running locally on my macBook. Demo recorded in a Waymo with WiFi turned off. I'm still on my space game voice AI kick, obviously. Code link below. For conversational voice AI, you want to set the gpt-oss reasoning behavior to "low". (The default is "medium".) Notes on how to do that and a jinja template you can use are in the repo. The LLM in the demo video is the big, 120B version of gpt-oss. You can use the smaller, 20B model for this, of course. But OpenAI really did a cool thing here designing the 120B model to run in "just" 80GB of VRAM. And the llama.cpp mlx inference is fast: ~250ms TTFT. Running a big model on-device feels like a time warp into the future of AI.

kwindla

202,147 views • 1 year ago

Today’s a big day! We have something really exciting to share with the open-source community. We’re launching two open-weight language models: gpt-oss-120b and gpt-oss-20b. They’re incredible models, built for developers, trained for reasoning, efficiency, and real-world use.🧵
0:59

Today’s a big day! We have something really exciting to share with the open-source community. We’re launching two open-weight language models: gpt-oss-120b and gpt-oss-20b. They’re incredible models, built for developers, trained for reasoning, efficiency, and real-world use.🧵

Romain Huet

34,199 views • 1 year ago

OpenAI shows how gpt-oss can autonomously beat 2048 using reinforcement learning (RL). Training was done locally with Unsloth on NVIDIA DGX Spark. You can also do it free on Colab. 🦥 OpenAI DevDay notebook:
3:59

OpenAI shows how gpt-oss can autonomously beat 2048 using reinforcement learning (RL). Training was done locally with Unsloth on NVIDIA DGX Spark. You can also do it free on Colab. 🦥 OpenAI DevDay notebook:

Unsloth AI

98,881 views • 9 months ago

We’re excited to partner with OpenAI to launch their new open source models natively on Databricks! gpt-oss sets a new standard of quality for open language models, supporting advanced reasoning with the transparency, flexibility and control enterprises need. Running on Databricks, the gpt-oss models connect securely to your data and scale with built-in governance, and expand what you can build and do with GenAI. Try both the 20B and 120B today in the Mosaic AI Playground.
0:39

We’re excited to partner with OpenAI to launch their new open source models natively on Databricks! gpt-oss sets a new standard of quality for open language models, supporting advanced reasoning with the transparency, flexibility and control enterprises need. Running on Databricks, the gpt-oss models connect securely to your data and scale with built-in governance, and expand what you can build and do with GenAI. Try both the 20B and 120B today in the Mosaic AI Playground.

Databricks

10,132 views • 1 year ago

BOOOOM! You can now run OpenAI gpt-oss 20B natively in Colaboratory T4 for FREE! 🔥 Powered by Transformers ⚡ The setup takes a bit since everything is bleeding edge, but once done it should work as expected Link to our cookbook in comments 👇
1:15

BOOOOM! You can now run OpenAI gpt-oss 20B natively in Colaboratory T4 for FREE! 🔥 Powered by Transformers ⚡ The setup takes a bit since everything is bleeding edge, but once done it should work as expected Link to our cookbook in comments 👇

Vaibhav (VB) Srivastav

37,474 views • 1 year ago

Demo for the sharded inference engine on: gpt-oss-120b on 4090's, max input context 95k, max output context infinite (tok/s degrades with context) queue of max 12 prompts concurrently, use it wisely
0:43

Demo for the sharded inference engine on: gpt-oss-120b on 4090's, max input context 95k, max output context infinite (tok/s degrades with context) queue of max 12 prompts concurrently, use it wisely

leyten

90,860 views • 1 month ago