正在加载视频...

视频加载失败

加载此视频时出现问题。这可能是由于临时网络问题，或视频可能不可用。

Kimi-K2.6 running locally 110+ tok/s

0xSero

57,041 subscribers

24,640 次观看 • 3 个月前 •via X (Twitter)

Anya Rossi• Live Now

Private livecam show

0 条评论

暂无评论

原始帖子的评论将显示在这里

相关视频

MiniMax-M3 running locally 100+ tok/s Good questions not often that models ask good questions.

MiniMax-M3 running locally 100+ tok/s Good questions not often that models ask good questions.

0xSero

32,728 次观看 • 3 个月前

Qwen 3.6. 35B. Running locally. 0.25s TTFT. 70 tok/s.

Qwen 3.6. 35B. Running locally. 0.25s TTFT. 70 tok/s.

Osaurus

101,931 次观看 • 5 个月前

GLM-5.3-Flash running at up to 300 tok/s single stream, and 1000 tok/s with 8 concurrent sessions. On average it's working at 150 tok/s per stream. Phenomenal model, really something special. On 2x Sparks we get 60 tok/s and 4x 100 tok/s 300B params is the sweet spot.

GLM-5.3-Flash running at up to 300 tok/s single stream, and 1000 tok/s with 8 concurrent sessions. On average it's working at 150 tok/s per stream. Phenomenal model, really something special. On 2x Sparks we get 60 tok/s and 4x 100 tok/s 300B params is the sweet spot.

0xSero

30,601 次观看 • 22 天前

Curious about ollama kimi-k2.6:cloud speed? 3 test runs: > 77.9 tok/s, TTFT 979ms > 114.3 tok/s, TTFT 788ms > 86.3 tok/s, TTFT 1117ms For comparison, OpenRouter stats: > Parasail: 14 tok/s > Moonshot AI: 27 tok/s > NovitaAI: 27 tok/s > Cloudflare: 71 tok/s Obvious caveat: cloud speeds fluctuate with load. Just sharing numbers for the curious.

Curious about ollama kimi-k2.6:cloud speed? 3 test runs: > 77.9 tok/s, TTFT 979ms > 114.3 tok/s, TTFT 788ms > 86.3 tok/s, TTFT 1117ms For comparison, OpenRouter stats: > Parasail: 14 tok/s > Moonshot AI: 27 tok/s > NovitaAI: 27 tok/s > Cloudflare: 71 tok/s Obvious caveat: cloud speeds fluctuate with load. Just sharing numbers for the curious.

stevibe

35,129 次观看 • 5 个月前

Nemotron-3-Ultra running on 4x 6000s edits my latest demo video.. - 75 tok/s decode - 8x concurrency - 256k context - 899 tok/s prefill - 20k tok/s prefill cache - NVFP4 Setting it up to be my Hermes driver. It's good enough at most things and doesn't talk like a moron.

Nemotron-3-Ultra running on 4x 6000s edits my latest demo video.. - 75 tok/s decode - 8x concurrency - 256k context - 899 tok/s prefill - 20k tok/s prefill cache - NVFP4 Setting it up to be my Hermes driver. It's good enough at most things and doesn't talk like a moron.

0xSero

15,674 次观看 • 3 个月前

GLM-5.2 Nvidia NVFP4 No pruning, no quantising, exact same model card. 110 tok/s single stream. My friend is a genius, holy fudge. Here's the repo, he got full DS4-Flash on a 5090 + DDR5 at 38.5 tok/s This is a breakthrough.

GLM-5.2 Nvidia NVFP4 No pruning, no quantising, exact same model card. 110 tok/s single stream. My friend is a genius, holy fudge. Here's the repo, he got full DS4-Flash on a 5090 + DDR5 at 38.5 tok/s This is a breakthrough.

0xSero

157,562 次观看 • 2 个月前

GLM-5.1-478B-NVFP4 Running on: - 4x RTX Pro 6000 - Sglang - 370,000 max tokens (1.75x full context) - p10 27.7 | p90 45.6 tok/s decode (gen) - 1340 tok/s prefill I could get 2x decode if I limit to 64k context (100 tok/s) In this video it operates Figma (:

GLM-5.1-478B-NVFP4 Running on: - 4x RTX Pro 6000 - Sglang - 370,000 max tokens (1.75x full context) - p10 27.7 | p90 45.6 tok/s decode (gen) - 1340 tok/s prefill I could get 2x decode if I limit to 64k context (100 tok/s) In this video it operates Figma (:

0xSero

74,772 次观看 • 5 个月前

GLM-4.7-Reap running locally fixes my Claude Code setup, 61 tps

GLM-4.7-Reap running locally fixes my Claude Code setup, 61 tps

0xSero

22,623 次观看 • 7 个月前

Guess the tok/s

Guess the tok/s

0xSero

17,255 次观看 • 3 天前

Minimax-M3 running on 4x RTX Pro 6000s - 800k context - 4x concurrency at 250k - 70-120 tok/s - 2000 tok/s prefill no cache - 376gb vram - mxfp4 It's working on improving the audio on one of my videos, it's actually doing a good job in researching solutions. Good model

Minimax-M3 running on 4x RTX Pro 6000s - 800k context - 4x concurrency at 250k - 70-120 tok/s - 2000 tok/s prefill no cache - 376gb vram - mxfp4 It's working on improving the audio on one of my videos, it's actually doing a good job in researching solutions. Good model

0xSero

24,634 次观看 • 3 个月前

Hello, Kimi K2.6.

Hello, Kimi K2.6.

stevibe

52,761 次观看 • 5 个月前

Opus at home, at 200+ tok/s I love ZAI

Opus at home, at 200+ tok/s I love ZAI

0xSero

201,224 次观看 • 23 天前

Kimi K3 (2.8T params) running locally on two Mac Studios, pi agent + mlx-lm

Kimi K3 (2.8T params) running locally on two Mac Studios, pi agent + mlx-lm

Tarjei Mandt

60,563 次观看 • 1 个月前

One-shotted WebGL website by Kimi K2.6 😭

One-shotted WebGL website by Kimi K2.6 😭

Crystal

43,839 次观看 • 5 个月前

Thanks for the mention TBPN! We're working on making this run at >40 tok/sec on 2 Mac Studios (the full, unquantized Kimi K2.5). I'm already running Kimi K2.5 myself locally with Claude Code and it's impressive - very close to Opus level.

Thanks for the mention TBPN! We're working on making this run at >40 tok/sec on 2 Mac Studios (the full, unquantized Kimi K2.5). I'm already running Kimi K2.5 myself locally with Claude Code and it's impressive - very close to Opus level.

Alex Cheema

40,471 次观看 • 7 个月前

Kimi K2.6 is a beast for design. ❤️‍🔥 Just recorded a tutorial on how to use Kimi K2.6 to build award-winning $10k websites (step-by-step).

Kimi K2.6 is a beast for design. ❤️‍🔥 Just recorded a tutorial on how to use Kimi K2.6 to build award-winning $10k websites (step-by-step).

Viktor Oddy

108,014 次观看 • 4 个月前

Kimi K2.6 is actually a beast for design. ❤️‍🔥 Just recorded a tutorial on how to use Kimi K2.6 + to build award-winning $10k websites (step-by-step).

Kimi K2.6 is actually a beast for design. ❤️‍🔥 Just recorded a tutorial on how to use Kimi K2.6 + to build award-winning $10k websites (step-by-step).

Viktor Oddy

424,860 次观看 • 4 个月前

Kimi K2.6 was released 1h ago, and it looks amazing! Here it's running with MLX (mlx-vlm) on two M3 Ultras (full 1T param VLM) 🔥

Kimi K2.6 was released 1h ago, and it looks amazing! Here it's running with MLX (mlx-vlm) on two M3 Ultras (full 1T param VLM) 🔥

Pedro Cuenca

65,768 次观看 • 5 个月前

I am blown away by MiMo-V2.5 It's so steerable, I didn't like MiMo-V2 This is self hosted btw, 125 tok/s across 2 sessions 4k prefill tok/s It's updating my website + editing a longer video I will be posting in a few minutes.

I am blown away by MiMo-V2.5 It's so steerable, I didn't like MiMo-V2 This is self hosted btw, 125 tok/s across 2 sessions 4k prefill tok/s It's updating my website + editing a longer video I will be posting in a few minutes.

0xSero

34,494 次观看 • 4 个月前

Finally, full precision MiniMax-M2.7 running at home. 100 tokens/s decode 5050 tokens/s prefill

Finally, full precision MiniMax-M2.7 running at home. 100 tokens/s decode 5050 tokens/s prefill

0xSero

72,465 次观看 • 5 个月前