Video wird geladen...

Video konnte nicht geladen werden

Zur Startseite

Kimi-K2.6 running locally 110+ tok/s

0xSero's profile picture

0xSero

57,041 subscribers

24,640 Aufrufe • vor 1 Monat •via X (Twitter)

LIVE

Anya Rossi• Live Now

Private livecam show

0 Kommentare

Keine Kommentare verfügbar

Kommentare vom Original-Post werden hier angezeigt

Ähnliche Videos

MiniMax-M3 running locally 100+ tok/s Good questions not often that models ask good questions.
1:23

MiniMax-M3 running locally 100+ tok/s Good questions not often that models ask good questions.

0xSero

32,693 Aufrufe • vor 1 Monat

Qwen 3.6. 35B. Running locally. 0.25s TTFT. 70 tok/s.
0:45

Qwen 3.6. 35B. Running locally. 0.25s TTFT. 70 tok/s.

Osaurus

101,528 Aufrufe • vor 3 Monaten

Curious about ollama kimi-k2.6:cloud speed? 3 test runs: > 77.9 tok/s, TTFT 979ms > 114.3 tok/s, TTFT 788ms > 86.3 tok/s, TTFT 1117ms For comparison, OpenRouter stats: > Parasail: 14 tok/s > Moonshot AI: 27 tok/s > NovitaAI: 27 tok/s > Cloudflare: 71 tok/s Obvious caveat: cloud speeds fluctuate with load. Just sharing numbers for the curious.
0:58

Curious about ollama kimi-k2.6:cloud speed? 3 test runs: > 77.9 tok/s, TTFT 979ms > 114.3 tok/s, TTFT 788ms > 86.3 tok/s, TTFT 1117ms For comparison, OpenRouter stats: > Parasail: 14 tok/s > Moonshot AI: 27 tok/s > NovitaAI: 27 tok/s > Cloudflare: 71 tok/s Obvious caveat: cloud speeds fluctuate with load. Just sharing numbers for the curious.

stevibe

35,129 Aufrufe • vor 3 Monaten

Nemotron-3-Ultra running on 4x 6000s edits my latest demo video.. - 75 tok/s decode - 8x concurrency - 256k context - 899 tok/s prefill - 20k tok/s prefill cache - NVFP4 Setting it up to be my Hermes driver. It's good enough at most things and doesn't talk like a moron.
1:26

Nemotron-3-Ultra running on 4x 6000s edits my latest demo video.. - 75 tok/s decode - 8x concurrency - 256k context - 899 tok/s prefill - 20k tok/s prefill cache - NVFP4 Setting it up to be my Hermes driver. It's good enough at most things and doesn't talk like a moron.

0xSero

15,674 Aufrufe • vor 1 Monat

GLM-5.1-478B-NVFP4 Running on: - 4x RTX Pro 6000 - Sglang - 370,000 max tokens (1.75x full context) - p10 27.7 | p90 45.6 tok/s decode (gen) - 1340 tok/s prefill I could get 2x decode if I limit to 64k context (100 tok/s) In this video it operates Figma (:
1:00

GLM-5.1-478B-NVFP4 Running on: - 4x RTX Pro 6000 - Sglang - 370,000 max tokens (1.75x full context) - p10 27.7 | p90 45.6 tok/s decode (gen) - 1340 tok/s prefill I could get 2x decode if I limit to 64k context (100 tok/s) In this video it operates Figma (:

0xSero

74,772 Aufrufe • vor 3 Monaten

GLM-5.2 Nvidia NVFP4 No pruning, no quantising, exact same model card. 110 tok/s single stream. My friend is a genius, holy fudge. Here's the repo, he got full DS4-Flash on a 5090 + DDR5 at 38.5 tok/s This is a breakthrough.
0:28

GLM-5.2 Nvidia NVFP4 No pruning, no quantising, exact same model card. 110 tok/s single stream. My friend is a genius, holy fudge. Here's the repo, he got full DS4-Flash on a 5090 + DDR5 at 38.5 tok/s This is a breakthrough.

0xSero

156,247 Aufrufe • vor 18 Tagen

GLM-4.7-Reap running locally fixes my Claude Code setup, 61 tps
0:33

GLM-4.7-Reap running locally fixes my Claude Code setup, 61 tps

0xSero

22,623 Aufrufe • vor 6 Monaten

Minimax-M3 running on 4x RTX Pro 6000s - 800k context - 4x concurrency at 250k - 70-120 tok/s - 2000 tok/s prefill no cache - 376gb vram - mxfp4 It's working on improving the audio on one of my videos, it's actually doing a good job in researching solutions. Good model
0:33

Minimax-M3 running on 4x RTX Pro 6000s - 800k context - 4x concurrency at 250k - 70-120 tok/s - 2000 tok/s prefill no cache - 376gb vram - mxfp4 It's working on improving the audio on one of my videos, it's actually doing a good job in researching solutions. Good model

0xSero

24,634 Aufrufe • vor 1 Monat

Hello, Kimi K2.6.
0:21

Hello, Kimi K2.6.

stevibe

52,761 Aufrufe • vor 3 Monaten

One-shotted WebGL website by Kimi K2.6 😭
0:28

One-shotted WebGL website by Kimi K2.6 😭

Crystal

43,839 Aufrufe • vor 3 Monaten

Thanks for the mention TBPN! We're working on making this run at >40 tok/sec on 2 Mac Studios (the full, unquantized Kimi K2.5). I'm already running Kimi K2.5 myself locally with Claude Code and it's impressive - very close to Opus level.
0:21

Thanks for the mention TBPN! We're working on making this run at >40 tok/sec on 2 Mac Studios (the full, unquantized Kimi K2.5). I'm already running Kimi K2.5 myself locally with Claude Code and it's impressive - very close to Opus level.

Alex Cheema

40,471 Aufrufe • vor 5 Monaten

Kimi K2.6 is a beast for design. ❤️‍🔥 Just recorded a tutorial on how to use Kimi K2.6 to build award-winning $10k websites (step-by-step).
14:44

Kimi K2.6 is a beast for design. ❤️‍🔥 Just recorded a tutorial on how to use Kimi K2.6 to build award-winning $10k websites (step-by-step).

Viktor Oddy

107,280 Aufrufe • vor 3 Monaten

Kimi K2.6 is actually a beast for design. ❤️‍🔥 Just recorded a tutorial on how to use Kimi K2.6 + to build award-winning $10k websites (step-by-step).
11:15

Kimi K2.6 is actually a beast for design. ❤️‍🔥 Just recorded a tutorial on how to use Kimi K2.6 + to build award-winning $10k websites (step-by-step).

Viktor Oddy

421,858 Aufrufe • vor 2 Monaten

I am blown away by MiMo-V2.5 It's so steerable, I didn't like MiMo-V2 This is self hosted btw, 125 tok/s across 2 sessions 4k prefill tok/s It's updating my website + editing a longer video I will be posting in a few minutes.
0:25

I am blown away by MiMo-V2.5 It's so steerable, I didn't like MiMo-V2 This is self hosted btw, 125 tok/s across 2 sessions 4k prefill tok/s It's updating my website + editing a longer video I will be posting in a few minutes.

0xSero

34,494 Aufrufe • vor 2 Monaten

Finally, full precision MiniMax-M2.7 running at home. 100 tokens/s decode 5050 tokens/s prefill
0:36

Finally, full precision MiniMax-M2.7 running at home. 100 tokens/s decode 5050 tokens/s prefill

0xSero

72,465 Aufrufe • vor 3 Monaten

Kimi K2.6 was released 1h ago, and it looks amazing! Here it's running with MLX (mlx-vlm) on two M3 Ultras (full 1T param VLM) 🔥
0:23

Kimi K2.6 was released 1h ago, and it looks amazing! Here it's running with MLX (mlx-vlm) on two M3 Ultras (full 1T param VLM) 🔥

Pedro Cuenca

65,768 Aufrufe • vor 3 Monaten

While we eagerly await Fable 5's return, our agentic WebGPU kernel optimization framework kept running. Opus 4.8 picked up where Fable left off, pushing Liquid AI's new LFM2.5 230M to an unbelievable 1,400 tok/s... running locally in your browser. Don't blink or you'll miss it.
0:57

While we eagerly await Fable 5's return, our agentic WebGPU kernel optimization framework kept running. Opus 4.8 picked up where Fable left off, pushing Liquid AI's new LFM2.5 230M to an unbelievable 1,400 tok/s... running locally in your browser. Don't blink or you'll miss it.

Xenova

174,271 Aufrufe • vor 1 Monat

gpt-oss 120b running at 50 tokens/s locally on my macbook
0:33

gpt-oss 120b running at 50 tokens/s locally on my macbook

ADAM

81,339 Aufrufe • vor 11 Monaten

This is the FASTER MODEL I've EVER Ran LOCALLY 🚀 laguna on Laguna S 2.1 · 3090 Quad INT4 • 1 parallel coding agents • Total: 3,405 tokens in 14s • Aggregate: 256.0 tok/s peak · 249.9 tok/s sustained • Per-stream: 256.0 high / 256.0 low / 256.0 avg tok/s • TTFT 0.12s avg
1:58

This is the FASTER MODEL I've EVER Ran LOCALLY 🚀 laguna on Laguna S 2.1 · 3090 Quad INT4 • 1 parallel coding agents • Total: 3,405 tokens in 14s • Aggregate: 256.0 tok/s peak · 249.9 tok/s sustained • Per-stream: 256.0 high / 256.0 low / 256.0 avg tok/s • TTFT 0.12s avg

Tech2Wild

16,404 Aufrufe • vor 6 Tagen

Kimi Code is good at video reasoning with Kimi K2.6.🎬 Drag in reference videos, ask about colors, shots, or visual style, and Kimi Code can generate a ready-to-use .cube LUT file.🎞️
0:37

Kimi Code is good at video reasoning with Kimi K2.6.🎬 Drag in reference videos, ask about colors, shots, or visual style, and Kimi Code can generate a ready-to-use .cube LUT file.🎞️

Kimi Developers

13,574 Aufrufe • vor 1 Monat