Загрузка видео...

Не удалось загрузить видео

На главную

Qwen3-Coder 30B running locally in the @GitHub Copilot app (ollama) spitting ~85 tokens per second on 96GB VRAM. It's not Sol, but we're getting somewhere.

burkeholland's profile picture

Burke Holland

26,628 subscribers

24,262 просмотров • 2 месяцев назад •via X (Twitter)

Наука и технологии
LIVE

Anya Rossi• Live Now

Private livecam show

Комментарии: 0

Нет доступных комментариев

Здесь появятся комментарии из оригинального поста

Похожие видео

Did I tell you that I vibe coded a Tamagotchi style TUI for my Moltbot running on a 1400 EUR beelink AMD Ryzen AI 9 HX 370 with 64GB LPDDR5X and Ollama serving a GLM-4.7-Flash 30B at 20 tokens per second
0:10

Did I tell you that I vibe coded a Tamagotchi style TUI for my Moltbot running on a 1400 EUR beelink AMD Ryzen AI 9 HX 370 with 64GB LPDDR5X and Ollama serving a GLM-4.7-Flash 30B at 20 tokens per second

Florian Roth ⚡️

88,501 просмотров • 9 месяцев назад

All new...go get the GitHub Copilot App. It's a delight.
0:11

All new...go get the GitHub Copilot App. It's a delight.

Scott Hanselman 🌮

85,927 просмотров • 5 месяцев назад

Introducing the GitHub Copilot app, the desktop home for agent-native software development on GitHub
0:18

Introducing the GitHub Copilot app, the desktop home for agent-native software development on GitHub

Pierce Boggan

31,335 просмотров • 5 месяцев назад

Qwen/Qwen3-30B-A3B is absolute game changer 🤯 ⬇️ Are you on a Mac? then use MLX weights - getting 100 tokens/sec here. It changes everything for real world use cases.
0:15

Qwen/Qwen3-30B-A3B is absolute game changer 🤯 ⬇️ Are you on a Mac? then use MLX weights - getting 100 tokens/sec here. It changes everything for real world use cases.

Victor M

142,543 просмотров • 1 год назад

Beginner-friendly sessions, in multiple languages. Register now for Let's Learn GitHub Copilot app 👇
0:18

Beginner-friendly sessions, in multiple languages. Register now for Let's Learn GitHub Copilot app 👇

GitHub

47,155 просмотров • 3 месяцев назад

Have you opened the GitHub Copilot app today? A pumpkin-spicy game awaits. 🎃 🎮
0:19

Have you opened the GitHub Copilot app today? A pumpkin-spicy game awaits. 🎃 🎮

GitHub

92,660 просмотров • 8 дней назад

GEMMA 4 26B ON AN RTX 4060 WITH A 248K TOKEN CONTEXT WINDOW 20 tokens per second and a context window so large you can feed it entire codebases, books and research papers in a single prompt this is not a cloud api and not a server rack, this is a regular consumer gpu running locally with llama.cpp and q4_k_xl quantization 248k context on an 8gb vram card was not supposed to be possible and here it is just running on someone’s desk the article below covers exactly which tools and configs make this kind of setup work in 2026 ↓
0:19

GEMMA 4 26B ON AN RTX 4060 WITH A 248K TOKEN CONTEXT WINDOW 20 tokens per second and a context window so large you can feed it entire codebases, books and research papers in a single prompt this is not a cloud api and not a server rack, this is a regular consumer gpu running locally with llama.cpp and q4_k_xl quantization 248k context on an 8gb vram card was not supposed to be possible and here it is just running on someone’s desk the article below covers exactly which tools and configs make this kind of setup work in 2026 ↓

leopardracer

56,865 просмотров • 5 месяцев назад

It's over. OpenAI just crushed it. We have their o3-level open-source model running on GroqInc at 500 tokens per second. Watch it build an entire SaaS app in just a few seconds. This is the new standard. Why the hell would you use anything else??
0:16

It's over. OpenAI just crushed it. We have their o3-level open-source model running on GroqInc at 500 tokens per second. Watch it build an entire SaaS app in just a few seconds. This is the new standard. Why the hell would you use anything else??

Matt Shumer

498,828 просмотров • 1 год назад

AI-generated descriptions in your pull requests? That's right, it's GitHub Copilot in your PRs. Enable your repository in the technical preview:
0:19

AI-generated descriptions in your pull requests? That's right, it's GitHub Copilot in your PRs. Enable your repository in the technical preview:

GitHub

190,994 просмотров • 3 лет назад

FPS in top left corner 40fps realtime with video & 4.6gb VRAM ✅ 50fps realtime with image & 1.7gb VRAM ✅ Running locally on a 4090 o3mini w/ Cursor go brrrrrrrrrrrrrrrrrrrrrrrrrrrrrr
0:16

FPS in top left corner 40fps realtime with video & 4.6gb VRAM ✅ 50fps realtime with image & 1.7gb VRAM ✅ Running locally on a 4090 o3mini w/ Cursor go brrrrrrrrrrrrrrrrrrrrrrrrrrrrrr

A.I.Warper

111,015 просмотров • 1 год назад

Right now, you may not have access to models like GPT‑5.6 Sol, GPT‑4.6 Terra, GPT‑5.6 Luna, Claude Mythos 5, or Claude Fable 5. But you can run something surprisingly powerful today, locally, and completely free. in the next 10 mins on your 8 GB VRAM gaming laptop. Gemma 4 26B A4B QAT (MoE) delivers strong performance on a standard 8 GB VRAM GPU using Ollama, with no API, no usage limits, and no external dependencies. Out of the box, it reaches around 20 tokens per second without any optimizations. Only one command in your terminal: Ollama run gemma4:26b This means: Full offline capability (privacy by default) Zero recurring cost Competitive performance for many real world tasks Fast enough for interactive use on cheap consumer hardware If you're waiting for cutting edge cloud models, you're missing what is already practical today: a capable, local LLM that runs entirely on your own machine.
0:19

Right now, you may not have access to models like GPT‑5.6 Sol, GPT‑4.6 Terra, GPT‑5.6 Luna, Claude Mythos 5, or Claude Fable 5. But you can run something surprisingly powerful today, locally, and completely free. in the next 10 mins on your 8 GB VRAM gaming laptop. Gemma 4 26B A4B QAT (MoE) delivers strong performance on a standard 8 GB VRAM GPU using Ollama, with no API, no usage limits, and no external dependencies. Out of the box, it reaches around 20 tokens per second without any optimizations. Only one command in your terminal: Ollama run gemma4:26b This means: Full offline capability (privacy by default) Zero recurring cost Competitive performance for many real world tasks Fast enough for interactive use on cheap consumer hardware If you're waiting for cutting edge cloud models, you're missing what is already practical today: a capable, local LLM that runs entirely on your own machine.

Alok

65,387 просмотров • 4 месяцев назад

The newer iPad Pros run 8B models easily. Here’s Llama running on-device at 30 tokens per second. Impressive for an iPad.
0:17

The newer iPad Pros run 8B models easily. Here’s Llama running on-device at 30 tokens per second. Impressive for an iPad.

Aaron Ng

18,617 просмотров • 1 год назад

We are thrilled to be a launch partner for Meta Llama 3. Experience Llama 3 now at up to 350 tokens per second for Llama 3 8B and up to 150 tokens per second for Llama 3 70B, running in full FP16 precision on the Together API! 🤯
0:10

We are thrilled to be a launch partner for Meta Llama 3. Experience Llama 3 now at up to 350 tokens per second for Llama 3 8B and up to 150 tokens per second for Llama 3 70B, running in full FP16 precision on the Together API! 🤯

Together AI

88,229 просмотров • 2 лет назад

Artificial Analysis just dropped tokens per second as its headline speed metric Finally! Opus streams over 2x faster than Astra and finishes 7 minutes later. It's still tokens / tps, not a stopwatch, but it's a big improvement.
0:18

Artificial Analysis just dropped tokens per second as its headline speed metric Finally! Opus streams over 2x faster than Astra and finishes 7 minutes later. It's still tokens / tps, not a stopwatch, but it's a big improvement.

Adam Holter

25,397 просмотров • 4 дней назад

From an issue on you can now open the GitHub Copilot app to start working on a fix with one-click.
0:19

From an issue on you can now open the GitHub Copilot app to start working on a fix with one-click.

Pierce Boggan

37,982 просмотров • 4 месяцев назад

🔥Apple MLX first 6bit model is on Hugging Face!🔥 Qwen2.5-Coder-32B-Instruct-6bit! 3bit conversion and test in progress! Video 8x below on M4 Max 40GPU: - Prompt: 38 tokens, 61.731 tokens-per-sec - Generation: 1181 tokens, 16.939 tokens-per-sec - Peak memory: 25.122 GB
0:12

🔥Apple MLX first 6bit model is on Hugging Face!🔥 Qwen2.5-Coder-32B-Instruct-6bit! 3bit conversion and test in progress! Video 8x below on M4 Max 40GPU: - Prompt: 38 tokens, 61.731 tokens-per-sec - Generation: 1181 tokens, 16.939 tokens-per-sec - Peak memory: 25.122 GB

Ivan Fioravanti ᯅ

46,494 просмотров • 1 год назад

Video In, Retargeted Mocap Out, All Running Locally Free Windows app by toyxyz: pick one of five AI mocap models, clean up the contacts on a timeline and put the motion on your humanoid character. Highlights: • Several people per video • Two or more synced cameras via MAMMA • Foot locking to stop sliding • Mixamo, VRM and PMX characters supported • MIT app code, research-only models GitHub:
0:18

Video In, Retargeted Mocap Out, All Running Locally Free Windows app by toyxyz: pick one of five AI mocap models, clean up the contacts on a timeline and put the motion on your humanoid character. Highlights: • Several people per video • Two or more synced cameras via MAMMA • Foot locking to stop sliding • Mixamo, VRM and PMX characters supported • MIT app code, research-only models GitHub:

Stefan 3D AI

23,818 просмотров • 9 дней назад

Got a question? Just ask GitHub Copilot. 💡 Find it in your IDE, on GitHub Mobile, and right in GitHub. ✅ Check it out:
0:15

Got a question? Just ask GitHub Copilot. 💡 Find it in your IDE, on GitHub Mobile, and right in GitHub. ✅ Check it out:

GitHub

59,808 просмотров • 2 лет назад