Video wird geladen...

Video konnte nicht geladen werden

Zur Startseite

Qwen3-Coder 30B running locally in the @GitHub Copilot app (ollama) spitting ~85 tokens per second on 96GB VRAM. It's not Sol, but we're getting somewhere.

burkeholland's profile picture

Burke Holland

26,569 subscribers

24,257 Aufrufe • vor 2 Monaten •via X (Twitter)

Wissenschaft & Technologie
LIVE

Anya Rossi• Live Now

Private livecam show

0 Kommentare

Keine Kommentare verfügbar

Kommentare vom Original-Post werden hier angezeigt

Ähnliche Videos

Did I tell you that I vibe coded a Tamagotchi style TUI for my Moltbot running on a 1400 EUR beelink AMD Ryzen AI 9 HX 370 with 64GB LPDDR5X and Ollama serving a GLM-4.7-Flash 30B at 20 tokens per second
0:10

Did I tell you that I vibe coded a Tamagotchi style TUI for my Moltbot running on a 1400 EUR beelink AMD Ryzen AI 9 HX 370 with 64GB LPDDR5X and Ollama serving a GLM-4.7-Flash 30B at 20 tokens per second

Florian Roth ⚡️

88,501 Aufrufe • vor 9 Monaten

All new...go get the GitHub Copilot App. It's a delight.
0:11

All new...go get the GitHub Copilot App. It's a delight.

Scott Hanselman 🌮

85,896 Aufrufe • vor 5 Monaten

Introducing the GitHub Copilot app, the desktop home for agent-native software development on GitHub
0:18

Introducing the GitHub Copilot app, the desktop home for agent-native software development on GitHub

Pierce Boggan

31,335 Aufrufe • vor 5 Monaten

Qwen/Qwen3-30B-A3B is absolute game changer 🤯 ⬇️ Are you on a Mac? then use MLX weights - getting 100 tokens/sec here. It changes everything for real world use cases.
0:15

Qwen/Qwen3-30B-A3B is absolute game changer 🤯 ⬇️ Are you on a Mac? then use MLX weights - getting 100 tokens/sec here. It changes everything for real world use cases.

Victor M

142,543 Aufrufe • vor 1 Jahr

Beginner-friendly sessions, in multiple languages. Register now for Let's Learn GitHub Copilot app 👇
0:18

Beginner-friendly sessions, in multiple languages. Register now for Let's Learn GitHub Copilot app 👇

GitHub

47,155 Aufrufe • vor 3 Monaten

Have you opened the GitHub Copilot app today? A pumpkin-spicy game awaits. 🎃 🎮
0:19

Have you opened the GitHub Copilot app today? A pumpkin-spicy game awaits. 🎃 🎮

GitHub

91,636 Aufrufe • vor 3 Tagen

GEMMA 4 26B ON AN RTX 4060 WITH A 248K TOKEN CONTEXT WINDOW 20 tokens per second and a context window so large you can feed it entire codebases, books and research papers in a single prompt this is not a cloud api and not a server rack, this is a regular consumer gpu running locally with llama.cpp and q4_k_xl quantization 248k context on an 8gb vram card was not supposed to be possible and here it is just running on someone’s desk the article below covers exactly which tools and configs make this kind of setup work in 2026 ↓
0:19

GEMMA 4 26B ON AN RTX 4060 WITH A 248K TOKEN CONTEXT WINDOW 20 tokens per second and a context window so large you can feed it entire codebases, books and research papers in a single prompt this is not a cloud api and not a server rack, this is a regular consumer gpu running locally with llama.cpp and q4_k_xl quantization 248k context on an 8gb vram card was not supposed to be possible and here it is just running on someone’s desk the article below covers exactly which tools and configs make this kind of setup work in 2026 ↓

leopardracer

56,865 Aufrufe • vor 4 Monaten

It's over. OpenAI just crushed it. We have their o3-level open-source model running on GroqInc at 500 tokens per second. Watch it build an entire SaaS app in just a few seconds. This is the new standard. Why the hell would you use anything else??
0:16

It's over. OpenAI just crushed it. We have their o3-level open-source model running on GroqInc at 500 tokens per second. Watch it build an entire SaaS app in just a few seconds. This is the new standard. Why the hell would you use anything else??

Matt Shumer

498,828 Aufrufe • vor 1 Jahr

AI-generated descriptions in your pull requests? That's right, it's GitHub Copilot in your PRs. Enable your repository in the technical preview:
0:19

AI-generated descriptions in your pull requests? That's right, it's GitHub Copilot in your PRs. Enable your repository in the technical preview:

GitHub

190,994 Aufrufe • vor 3 Jahren

FPS in top left corner 40fps realtime with video & 4.6gb VRAM ✅ 50fps realtime with image & 1.7gb VRAM ✅ Running locally on a 4090 o3mini w/ Cursor go brrrrrrrrrrrrrrrrrrrrrrrrrrrrrr
0:16

FPS in top left corner 40fps realtime with video & 4.6gb VRAM ✅ 50fps realtime with image & 1.7gb VRAM ✅ Running locally on a 4090 o3mini w/ Cursor go brrrrrrrrrrrrrrrrrrrrrrrrrrrrrr

A.I.Warper

111,015 Aufrufe • vor 1 Jahr

Right now, you may not have access to models like GPT‑5.6 Sol, GPT‑4.6 Terra, GPT‑5.6 Luna, Claude Mythos 5, or Claude Fable 5. But you can run something surprisingly powerful today, locally, and completely free. in the next 10 mins on your 8 GB VRAM gaming laptop. Gemma 4 26B A4B QAT (MoE) delivers strong performance on a standard 8 GB VRAM GPU using Ollama, with no API, no usage limits, and no external dependencies. Out of the box, it reaches around 20 tokens per second without any optimizations. Only one command in your terminal: Ollama run gemma4:26b This means: Full offline capability (privacy by default) Zero recurring cost Competitive performance for many real world tasks Fast enough for interactive use on cheap consumer hardware If you're waiting for cutting edge cloud models, you're missing what is already practical today: a capable, local LLM that runs entirely on your own machine.
0:19

Right now, you may not have access to models like GPT‑5.6 Sol, GPT‑4.6 Terra, GPT‑5.6 Luna, Claude Mythos 5, or Claude Fable 5. But you can run something surprisingly powerful today, locally, and completely free. in the next 10 mins on your 8 GB VRAM gaming laptop. Gemma 4 26B A4B QAT (MoE) delivers strong performance on a standard 8 GB VRAM GPU using Ollama, with no API, no usage limits, and no external dependencies. Out of the box, it reaches around 20 tokens per second without any optimizations. Only one command in your terminal: Ollama run gemma4:26b This means: Full offline capability (privacy by default) Zero recurring cost Competitive performance for many real world tasks Fast enough for interactive use on cheap consumer hardware If you're waiting for cutting edge cloud models, you're missing what is already practical today: a capable, local LLM that runs entirely on your own machine.

Alok

65,387 Aufrufe • vor 4 Monaten

The newer iPad Pros run 8B models easily. Here’s Llama running on-device at 30 tokens per second. Impressive for an iPad.
0:17

The newer iPad Pros run 8B models easily. Here’s Llama running on-device at 30 tokens per second. Impressive for an iPad.

Aaron Ng

18,617 Aufrufe • vor 1 Jahr

We are thrilled to be a launch partner for Meta Llama 3. Experience Llama 3 now at up to 350 tokens per second for Llama 3 8B and up to 150 tokens per second for Llama 3 70B, running in full FP16 precision on the Together API! 🤯
0:10

We are thrilled to be a launch partner for Meta Llama 3. Experience Llama 3 now at up to 350 tokens per second for Llama 3 8B and up to 150 tokens per second for Llama 3 70B, running in full FP16 precision on the Together API! 🤯

Together AI

88,229 Aufrufe • vor 2 Jahren

From an issue on you can now open the GitHub Copilot app to start working on a fix with one-click.
0:19

From an issue on you can now open the GitHub Copilot app to start working on a fix with one-click.

Pierce Boggan

37,982 Aufrufe • vor 3 Monaten

🔥Apple MLX first 6bit model is on Hugging Face!🔥 Qwen2.5-Coder-32B-Instruct-6bit! 3bit conversion and test in progress! Video 8x below on M4 Max 40GPU: - Prompt: 38 tokens, 61.731 tokens-per-sec - Generation: 1181 tokens, 16.939 tokens-per-sec - Peak memory: 25.122 GB
0:12

🔥Apple MLX first 6bit model is on Hugging Face!🔥 Qwen2.5-Coder-32B-Instruct-6bit! 3bit conversion and test in progress! Video 8x below on M4 Max 40GPU: - Prompt: 38 tokens, 61.731 tokens-per-sec - Generation: 1181 tokens, 16.939 tokens-per-sec - Peak memory: 25.122 GB

Ivan Fioravanti ᯅ

46,494 Aufrufe • vor 1 Jahr

Video In, Retargeted Mocap Out, All Running Locally Free Windows app by toyxyz: pick one of five AI mocap models, clean up the contacts on a timeline and put the motion on your humanoid character. Highlights: • Several people per video • Two or more synced cameras via MAMMA • Foot locking to stop sliding • Mixamo, VRM and PMX characters supported • MIT app code, research-only models GitHub:
0:18

Video In, Retargeted Mocap Out, All Running Locally Free Windows app by toyxyz: pick one of five AI mocap models, clean up the contacts on a timeline and put the motion on your humanoid character. Highlights: • Several people per video • Two or more synced cameras via MAMMA • Foot locking to stop sliding • Mixamo, VRM and PMX characters supported • MIT app code, research-only models GitHub:

Stefan 3D AI

23,136 Aufrufe • vor 4 Tagen

Got a question? Just ask GitHub Copilot. 💡 Find it in your IDE, on GitHub Mobile, and right in GitHub. ✅ Check it out:
0:15

Got a question? Just ask GitHub Copilot. 💡 Find it in your IDE, on GitHub Mobile, and right in GitHub. ✅ Check it out:

GitHub

59,808 Aufrufe • vor 2 Jahren

It's fast!! Ollama now supports AMD graphics cards! All the features of Ollama can now be accelerated by AMD graphics cards in preview on Ollama for Linux and Windows. Try it 👇👇 *video is not edited.
0:18

It's fast!! Ollama now supports AMD graphics cards! All the features of Ollama can now be accelerated by AMD graphics cards in preview on Ollama for Linux and Windows. Try it 👇👇 *video is not edited.

ollama

108,164 Aufrufe • vor 2 Jahren