Video wird geladen...

Video konnte nicht geladen werden

Zur Startseite

Speed Is the Innovation - GPT-OSS:20B + llama.cpp + @neovim

g0t4's profile picture

Wes Higbee

1,150 subscribers

13,489 Aufrufe • vor 1 Jahr •via X (Twitter)

LIVE

Anya Rossi• Live Now

Private livecam show

0 Kommentare

Keine Kommentare verfügbar

Kommentare vom Original-Post werden hier angezeigt

Ähnliche Videos

openai gpt-oss 20b model speed on rtx 4090 windows ollama
0:40

openai gpt-oss 20b model speed on rtx 4090 windows ollama

Mert Cobanov

465,754 Aufrufe • vor 1 Jahr

GPT-oss 20BがGPUメモリ4GBで動いて14tok/sec出る！
0:35

GPT-oss 20BがGPUメモリ4GBで動いて14tok/sec出る！

きしだൠ(K1S)

108,833 Aufrufe • vor 1 Jahr

Today’s a big day! We have something really exciting to share with the open-source community. We’re launching two open-weight language models: gpt-oss-120b and gpt-oss-20b. They’re incredible models, built for developers, trained for reasoning, efficiency, and real-world use.🧵
0:59

Today’s a big day! We have something really exciting to share with the open-source community. We’re launching two open-weight language models: gpt-oss-120b and gpt-oss-20b. They’re incredible models, built for developers, trained for reasoning, efficiency, and real-world use.🧵

Romain Huet

34,199 Aufrufe • vor 1 Jahr

running gpt-oss:20b on ollama with Turbo and web search 🏎️ 💨 very happy with how the web search turned out :) and ofcourse – more improvements on the way!
0:28

running gpt-oss:20b on ollama with Turbo and web search 🏎️ 💨 very happy with how the web search turned out :) and ofcourse – more improvements on the way!

parth

54,124 Aufrufe • vor 1 Jahr

A voice agent powered by gpt-oss. Running locally on my macBook. Demo recorded in a Waymo with WiFi turned off. I'm still on my space game voice AI kick, obviously. Code link below. For conversational voice AI, you want to set the gpt-oss reasoning behavior to "low". (The default is "medium".) Notes on how to do that and a jinja template you can use are in the repo. The LLM in the demo video is the big, 120B version of gpt-oss. You can use the smaller, 20B model for this, of course. But OpenAI really did a cool thing here designing the 120B model to run in "just" 80GB of VRAM. And the llama.cpp mlx inference is fast: ~250ms TTFT. Running a big model on-device feels like a time warp into the future of AI.
4:35

A voice agent powered by gpt-oss. Running locally on my macBook. Demo recorded in a Waymo with WiFi turned off. I'm still on my space game voice AI kick, obviously. Code link below. For conversational voice AI, you want to set the gpt-oss reasoning behavior to "low". (The default is "medium".) Notes on how to do that and a jinja template you can use are in the repo. The LLM in the demo video is the big, 120B version of gpt-oss. You can use the smaller, 20B model for this, of course. But OpenAI really did a cool thing here designing the 120B model to run in "just" 80GB of VRAM. And the llama.cpp mlx inference is fast: ~250ms TTFT. Running a big model on-device feels like a time warp into the future of AI.

kwindla

202,211 Aufrufe • vor 1 Jahr

OpenAI has finally released GPT OSS 20B!! This is probably the most powerful model you can run locally on a laptop. → Only 3.6B active parameters → Adjustable "Reasoning Effort" → Works with 16GB of RAM! Quick steps to use it 100% free and offline:
0:29

OpenAI has finally released GPT OSS 20B!! This is probably the most powerful model you can run locally on a laptop. → Only 3.6B active parameters → Adjustable "Reasoning Effort" → Works with 16GB of RAM! Quick steps to use it 100% free and offline:

Paul Couvert

595,738 Aufrufe • vor 1 Jahr

BOOOOM! You can now run OpenAI gpt-oss 20B natively in Colaboratory T4 for FREE! 🔥 Powered by Transformers ⚡ The setup takes a bit since everything is bleeding edge, but once done it should work as expected Link to our cookbook in comments 👇
1:15

BOOOOM! You can now run OpenAI gpt-oss 20B natively in Colaboratory T4 for FREE! 🔥 Powered by Transformers ⚡ The setup takes a bit since everything is bleeding edge, but once done it should work as expected Link to our cookbook in comments 👇

Vaibhav (VB) Srivastav

37,474 Aufrufe • vor 1 Jahr

Meet your full-stack AI assistant, powered by OpenAI’s new open gpt-oss models (20B + 120B) and Groq. Includes search, code execution, STT/TTS, code-gen editor, AI notes, and custom tool calling. Build Fast.
1:05

Meet your full-stack AI assistant, powered by OpenAI’s new open gpt-oss models (20B + 120B) and Groq. Includes search, code execution, STT/TTS, code-gen editor, AI notes, and custom tool calling. Build Fast.

Groq Inc

13,101 Aufrufe • vor 1 Jahr

Behold... GPT-OSS (20B) running 100% locally in your browser on WebGPU. This shouldn't be possible — but with Transformers.js v4 and ONNX Runtime Web, it is! A new class of AI apps is emerging. Zero-install, infinite distribution. Simply visit a website and run models locally.
1:23

Behold... GPT-OSS (20B) running 100% locally in your browser on WebGPU. This shouldn't be possible — but with Transformers.js v4 and ONNX Runtime Web, it is! A new class of AI apps is emerging. Zero-install, infinite distribution. Simply visit a website and run models locally.

Xenova

311,512 Aufrufe • vor 7 Monaten

PSA: OpenAI is putting the Open back in OpenAI and Groq Inc has Day 0 support. 🤗 GPT-OSS 20B and 120B, hybrid-reasoning models with built-in browser search and code execution are now live for instant inference. P.S. We've also launched OpenAI Responses API compatibility.
0:29

PSA: OpenAI is putting the Open back in OpenAI and Groq Inc has Day 0 support. 🤗 GPT-OSS 20B and 120B, hybrid-reasoning models with built-in browser search and code execution are now live for instant inference. P.S. We've also launched OpenAI Responses API compatibility.

Hatice Ozen

82,049 Aufrufe • vor 1 Jahr

a demo of using both the gpt-oss-20b and qwen3-coder-480b in the hyperspace agentic browser. this spatial, AI-native UI is designed as an extension of the spatial space of our brain - which places some things more in recency to us, and adjacent to each other. pinch to zoom.
0:54

a demo of using both the gpt-oss-20b and qwen3-coder-480b in the hyperspace agentic browser. this spatial, AI-native UI is designed as an extension of the spatial space of our brain - which places some things more in recency to us, and adjacent to each other. pinch to zoom.

Varun

182,308 Aufrufe • vor 1 Jahr

Devs: GPT-OSS, but make it faster and cheaper. Groq: 🤓 Major price drop just hit both GPT-OSS models, with prompt caching rolling out.
0:29

Devs: GPT-OSS, but make it faster and cheaper. Groq: 🤓 Major price drop just hit both GPT-OSS models, with prompt caching rolling out.

Groq Inc

67,163 Aufrufe • vor 11 Monaten

🟧 Cerebras Inference self-serve is finally here 🟧 – Pay by credit card starting at $10 – Run Qwen3 Coder, GPT OSS & more at 2,000+ TPS – 20x the speed of GPU-based model providers Go ahead. Melt our wafers.
0:40

🟧 Cerebras Inference self-serve is finally here 🟧 – Pay by credit card starting at $10 – Run Qwen3 Coder, GPT OSS & more at 2,000+ TPS – 20x the speed of GPU-based model providers Go ahead. Melt our wafers.

Cerebras

52,825 Aufrufe • vor 11 Monaten

We’re excited to partner with OpenAI to launch their new open source models natively on Databricks! gpt-oss sets a new standard of quality for open language models, supporting advanced reasoning with the transparency, flexibility and control enterprises need. Running on Databricks, the gpt-oss models connect securely to your data and scale with built-in governance, and expand what you can build and do with GenAI. Try both the 20B and 120B today in the Mosaic AI Playground.
0:39

We’re excited to partner with OpenAI to launch their new open source models natively on Databricks! gpt-oss sets a new standard of quality for open language models, supporting advanced reasoning with the transparency, flexibility and control enterprises need. Running on Databricks, the gpt-oss models connect securely to your data and scale with built-in governance, and expand what you can build and do with GenAI. Try both the 20B and 120B today in the Mosaic AI Playground.

Databricks

10,132 Aufrufe • vor 1 Jahr

Rust is the Neovim of Programming Languages
2:47

Rust is the Neovim of Programming Languages

Тsфdiиg

61,018 Aufrufe • vor 1 Jahr

Introducing OpenChatKit 🚀 - The first open-source alternative to ChatGPT! A team of ex-OpenAI fellows at Together have released a 20B chat-GPT model, fine-tuned for chat using EleutherAI's GPT-NeoX-20B, with over 43 million instructions under the Apache-2.0 license. >>>
0:30

Introducing OpenChatKit 🚀 - The first open-source alternative to ChatGPT! A team of ex-OpenAI fellows at Together have released a 20B chat-GPT model, fine-tuned for chat using EleutherAI's GPT-NeoX-20B, with over 43 million instructions under the Apache-2.0 license. >>>

Itamar Golan 🤓

555,539 Aufrufe • vor 3 Jahren

Advice for AI engineers 💡 A small Visual Language Model fine-tuned on your custom dataset is as accurate as GPT-5... ... and costs 50 times less. For example, LFM2.5-VL-1.6B by Liquid AI running locally at full speed with llama.cpp ↓
0:24

Advice for AI engineers 💡 A small Visual Language Model fine-tuned on your custom dataset is as accurate as GPT-5... ... and costs 50 times less. For example, LFM2.5-VL-1.6B by Liquid AI running locally at full speed with llama.cpp ↓

Pau Labarta Bajo

80,258 Aufrufe • vor 7 Monaten

*NVIDIA IS GIVING AWAY FREE API ACCESS TO 80+ AI MODELS, INCLUDING KIMI, DEEPSEEK, MINIMAX, GLM, AND GPT-OSS.*
0:52

*NVIDIA IS GIVING AWAY FREE API ACCESS TO 80+ AI MODELS, INCLUDING KIMI, DEEPSEEK, MINIMAX, GLM, AND GPT-OSS.*

0xMarioNawfal

50,818 Aufrufe • vor 1 Monat