Video yükleniyor...

Video Yüklenemedi

Bu video yüklenirken bir sorun oluştu. Bu geçici bir ağ sorunundan kaynaklanıyor olabilir veya video kullanılamıyor olabilir.

Ana Sayfaya Dön

Completed a first hour side-by-side comparison between Qwen3.5 27b and Qwen3.6 27b on the same 4 canvas coding tests. Running the Qwen3.6 27b FP8, vLLM. What do you think?

stevibe

27,082 subscribers

114,191 görüntüleme • 3 ay önce •via X (Twitter)

Eğitim Bilim & Teknoloji

Anya Rossi• Live Now

Private livecam show

0 Yorum

Yorum bulunmuyor

Orijinal gönderinin yorumları burada görünecek

Benzer Videolar

Yesterday we found out Qwen3.5-27B (dense) beats both the 35B and 122B MoE variants at UI replication from screenshots. Today's question: what about Jackrong's Qwen3.5-27B-Claude-Opus-4.6-Reasoning-Distilled? A distilled 27B with Claude Opus 4.6 reasoning baked in. So I put all 3 in the ring: - Qwen3.5-27B - Qwen3.5-27B-Claude-Opus-Distilled - Claude Opus 4.6 Since the distilled model isn't multimodal, I gave all three the same detailed text prompts describing the UI components from yesterday's test.

Yesterday we found out Qwen3.5-27B (dense) beats both the 35B and 122B MoE variants at UI replication from screenshots. Today's question: what about Jackrong's Qwen3.5-27B-Claude-Opus-4.6-Reasoning-Distilled? A distilled 27B with Claude Opus 4.6 reasoning baked in. So I put all 3 in the ring: - Qwen3.5-27B - Qwen3.5-27B-Claude-Opus-Distilled - Claude Opus 4.6 Since the distilled model isn't multimodal, I gave all three the same detailed text prompts describing the UI components from yesterday's test.

stevibe

125,913 görüntüleme • 4 ay önce

"122B has to be smarter than 27B" I showed 4 UI components to three Qwen3.5 models and asked them to recreate them from a screenshot alone: - 27B (dense) - 35B-A3B (MoE) - 122B-A10B (MoE) Same screenshot. Same prompt. Same task. Which one do you think nailed it?

"122B has to be smarter than 27B" I showed 4 UI components to three Qwen3.5 models and asked them to recreate them from a screenshot alone: - 27B (dense) - 35B-A3B (MoE) - 122B-A10B (MoE) Same screenshot. Same prompt. Same task. Which one do you think nailed it?

stevibe

101,050 görüntüleme • 4 ay önce

2.3x faster. Ran Unsloth AI Qwen3.6 MTP variants on a DGX Spark (UD-Q6_K_XL): > 27B → 27B MTP: 8.1 → 18.65 t/s (2.3x faster) > 35B A3B → 35B A3B MTP: 56.91 → 66.52 t/s (+17%) The 27B dense model more than doubled throughput from MTP alone. Free speed is free speed.

2.3x faster. Ran Unsloth AI Qwen3.6 MTP variants on a DGX Spark (UD-Q6_K_XL): > 27B → 27B MTP: 8.1 → 18.65 t/s (2.3x faster) > 35B A3B → 35B A3B MTP: 56.91 → 66.52 t/s (+17%) The 27B dense model more than doubled throughput from MTP alone. Free speed is free speed.

stevibe

24,315 görüntüleme • 2 ay önce

"Why should you run your models locally?" Asked Qwen3.6 27B. Running locally. Thinking mode on. It made the case itself.

"Why should you run your models locally?" Asked Qwen3.6 27B. Running locally. Thinking mode on. It made the case itself.

Osaurus

42,770 görüntüleme • 3 ay önce

I gave two MoE models the same vibe coding challenge Qwen3.6 35B A3B (31.8GB) vs Gemma4 26B A4B (23.3GB) Stack: > Unsloth Q6_K_XL > llama.cpp > Model-card recommended sampling for each 4 prompts, side-by-side. Which one do you think wins?

I gave two MoE models the same vibe coding challenge Qwen3.6 35B A3B (31.8GB) vs Gemma4 26B A4B (23.3GB) Stack: > Unsloth Q6_K_XL > llama.cpp > Model-card recommended sampling for each 4 prompts, side-by-side. Which one do you think wins?

stevibe

262,039 görüntüleme • 3 ay önce

Got a 24GB Graphics Card? These 6 coding models all fit on it (Q4): - qwen3.5:27b (17GB) - qwen3.5:35b (24GB) - glm-4.7-flash (19GB) - nemotron-3-nano:30b (24GB) - nemotron-cascade-2:30b (24GB) - gpt-oss:20b (14GB) I gave them the same challenge: draw a campfire with HTML Canvas. Why Canvas? HTML/CSS forgives bad syntax — things still render. JavaScript + Canvas doesn't — one mistake and the screen goes black.

Got a 24GB Graphics Card? These 6 coding models all fit on it (Q4): - qwen3.5:27b (17GB) - qwen3.5:35b (24GB) - glm-4.7-flash (19GB) - nemotron-3-nano:30b (24GB) - nemotron-cascade-2:30b (24GB) - gpt-oss:20b (14GB) I gave them the same challenge: draw a campfire with HTML Canvas. Why Canvas? HTML/CSS forgives bad syntax — things still render. JavaScript + Canvas doesn't — one mistake and the screen goes black.

stevibe

75,939 görüntüleme • 4 ay önce

You can now run Qwen 3.6 27B on <10GB of memory and retain 90% of the intelligence. Today, PrismML dropped Bonsai 27B - which takes their unique compression approach they have already successfully applied to Qwen3.6 8B and Flux2-Klein and applied it to a properly smart model. Here is it using an entire computer for deep research. Long horizon agentic calls already are strong with Qwen3.6 27B and they still are here - just on 10x less memory.

You can now run Qwen 3.6 27B on <10GB of memory and retain 90% of the intelligence. Today, PrismML dropped Bonsai 27B - which takes their unique compression approach they have already successfully applied to Qwen3.6 8B and Flux2-Klein and applied it to a properly smart model. Here is it using an entire computer for deep research. Long horizon agentic calls already are strong with Qwen3.6 27B and they still are here - just on 10x less memory.

Tim Carambat

62,857 görüntüleme • 20 gün önce

The RTX 3090 is a 5-year-old GPU and it still runs a 27B model at 20 tok/s I tested Qwen3.5:27b across 3 generations of NVIDIA: 5090 → ~60 tok/s 4090 → ~40 tok/s 3090 → ~20 tok/s Perfectly linear scaling. Double the generation, double the speed.

The RTX 3090 is a 5-year-old GPU and it still runs a 27B model at 20 tok/s I tested Qwen3.5:27b across 3 generations of NVIDIA: 5090 → ~60 tok/s 4090 → ~40 tok/s 3090 → ~20 tok/s Perfectly linear scaling. Double the generation, double the speed.

stevibe

142,493 görüntüleme • 4 ay önce

"Why are you benchmarking DGX Spark? It's a training box." Yeah. Low bandwidth, but 128GB of unified memory is just sitting there. Plenty of room to optimize. DGX Spark + Qwen3.6 27B. Four backend/quant combos: 🔴 llama.cpp + UD_Q4_K_XL > 11.0 tok/s (baseline), TTFT 297ms 🟢 llama.cpp + DFlash > 20.4 tok/s (peaks at 97 tok/s), TTFT 320ms 🟡 vLLM FP8 + MTP > 13.1 tok/s, TTFT 540ms 🟣 vLLM NVFP4 + MTP > 24.2 tok/s, TTFT 376ms NVFP4+MTP is the winner for me, rock stable around 24 tok/s, no wild swings. DFlash is the wildcard: massive peaks, but fluctuates a lot. FP8+MTP barely beats baseline, and it's FP8. Love my Spark.

"Why are you benchmarking DGX Spark? It's a training box." Yeah. Low bandwidth, but 128GB of unified memory is just sitting there. Plenty of room to optimize. DGX Spark + Qwen3.6 27B. Four backend/quant combos: 🔴 llama.cpp + UD_Q4_K_XL > 11.0 tok/s (baseline), TTFT 297ms 🟢 llama.cpp + DFlash > 20.4 tok/s (peaks at 97 tok/s), TTFT 320ms 🟡 vLLM FP8 + MTP > 13.1 tok/s, TTFT 540ms 🟣 vLLM NVFP4 + MTP > 24.2 tok/s, TTFT 376ms NVFP4+MTP is the winner for me, rock stable around 24 tok/s, no wild swings. DFlash is the wildcard: massive peaks, but fluctuates a lot. FP8+MTP barely beats baseline, and it's FP8. Love my Spark.

stevibe

40,118 görüntüleme • 3 ay önce

Laguna S-2.1 vs Qwen3.6 35b and 27b on my visual bench.. 93 prompts, thinking on, every demo has to actually run and be error free in the browser to count. The stats across the run 27B 85/93 (91%) 35B Q8 76/93 (82%) Laguna 73/93 (78%) Love having a new model to test!

Laguna S-2.1 vs Qwen3.6 35b and 27b on my visual bench.. 93 prompts, thinking on, every demo has to actually run and be error free in the browser to count. The stats across the run 27B 85/93 (91%) 35B Q8 76/93 (82%) Laguna 73/93 (78%) Love having a new model to test!

Loktar 🇺🇸

20,173 görüntüleme • 12 gün önce

🥊 Time for a new fight Qwen3.5 397B A17B vs Qwen3.6 27B 🌸 "Cherry Blossom" (↓ prompt below) Using OpenRouter for 397B Running 27B locally on a single RTX 5080 Wow! 🤯 I'm sure this one is going to divide opinions. 397B feels cinematic with the flare and shadows it added, while 27B is just beautiful; it has a completely different color palette and the leaves are falling from the branches as asked. It's really tough to decide which model is the best. I was about to call it a tie, but then I remembered that 397B needs 180GB VRAM to run locally 😅 Don't get me wrong the model is amazing, but right now the VRAM it requires doesn't feel justified. It's simply not 10× better than 27B. We'll have to dig deeper with more prompts to be sure, let's see what each one has in store for us. What do you think?

🥊 Time for a new fight Qwen3.5 397B A17B vs Qwen3.6 27B 🌸 "Cherry Blossom" (↓ prompt below) Using OpenRouter for 397B Running 27B locally on a single RTX 5080 Wow! 🤯 I'm sure this one is going to divide opinions. 397B feels cinematic with the flare and shadows it added, while 27B is just beautiful; it has a completely different color palette and the leaves are falling from the branches as asked. It's really tough to decide which model is the best. I was about to call it a tie, but then I remembered that 397B needs 180GB VRAM to run locally 😅 Don't get me wrong the model is amazing, but right now the VRAM it requires doesn't feel justified. It's simply not 10× better than 27B. We'll have to dig deeper with more prompts to be sure, let's see what each one has in store for us. What do you think?

left curve dev

21,224 görüntüleme • 3 ay önce

Which LLMs actually love to think? Tested 7 models on 5 math problems, measured reasoning length. The think winners: both Qwen3.5 models (27B and 35B A3B) — massive overthinkers, up to 10k+ tokens on a single question. Plot twists: > Kimi K2.6 feels verbose, actually one of the leanest > Gemma4 26B A4B solved 2 with ZERO thinking

Which LLMs actually love to think? Tested 7 models on 5 math problems, measured reasoning length. The think winners: both Qwen3.5 models (27B and 35B A3B) — massive overthinkers, up to 10k+ tokens on a single question. Plot twists: > Kimi K2.6 feels verbose, actually one of the leanest > Gemma4 26B A4B solved 2 with ZERO thinking

stevibe

97,403 görüntüleme • 3 ay önce

Qwen3.6 27B landed yesterday, so I ran it on 4 setups side-by-side to see how they stack up: 🔴 RTX 4090 — 45.59 tok/s, TTFT 525ms 🟢 RTX 5090 — 51.83 tok/s, TTFT 752ms ⚫️ M2 Ultra — 22.30 tok/s, TTFT 216ms 🟣 DGX Spark — 11.08 tok/s, TTFT 319ms This is a standard test: no tuning, just the out-of-the-box experience. For the NVIDIA cards I used llama.cpp with Unsloth's UD-Q4_K_XL quant. For the M2 Ultra I used MLX with Unsloth's UD-MLX-4bit quant, since MLX is the native path on Apple Silicon. Please consider this as the baseline, you can definitely squeeze more out of every one of these with fine-tuned settings.

Qwen3.6 27B landed yesterday, so I ran it on 4 setups side-by-side to see how they stack up: 🔴 RTX 4090 — 45.59 tok/s, TTFT 525ms 🟢 RTX 5090 — 51.83 tok/s, TTFT 752ms ⚫️ M2 Ultra — 22.30 tok/s, TTFT 216ms 🟣 DGX Spark — 11.08 tok/s, TTFT 319ms This is a standard test: no tuning, just the out-of-the-box experience. For the NVIDIA cards I used llama.cpp with Unsloth's UD-Q4_K_XL quant. For the M2 Ultra I used MLX with Unsloth's UD-MLX-4bit quant, since MLX is the native path on Apple Silicon. Please consider this as the baseline, you can definitely squeeze more out of every one of these with fine-tuned settings.

stevibe

104,479 görüntüleme • 3 ay önce

I put together a side by side comparison between both mine and Frank Welker’s Megatron! What do you guys think?

I put together a side by side comparison between both mine and Frank Welker’s Megatron! What do you guys think?

ENEMY SCROTUM

55,825 görüntüleme • 2 ay önce

Round 2: Dense edition Qwen3.5 27B vs Gemma4 31B Same 4 HTML canvas challenges, this time no MoE. Setup: > Quant: Unsloth Q6_K_XL (both) > Each running on an RTX 5090 > Single HTML file, no libraries, real-time animation My read per prompt: 🌳 Tree — Gemma, branches are beautifully structured ✨ Night sky — close, but Qwen's stars blink better 🐟 Fish boids — Qwen, detailed fish and look at that motion, so realistic 🏠 House build — neither really nailed it Agree? Does dense actually beat MoE here?

Round 2: Dense edition Qwen3.5 27B vs Gemma4 31B Same 4 HTML canvas challenges, this time no MoE. Setup: > Quant: Unsloth Q6_K_XL (both) > Each running on an RTX 5090 > Single HTML file, no libraries, real-time animation My read per prompt: 🌳 Tree — Gemma, branches are beautifully structured ✨ Night sky — close, but Qwen's stars blink better 🐟 Fish boids — Qwen, detailed fish and look at that motion, so realistic 🏠 House build — neither really nailed it Agree? Does dense actually beat MoE here?

stevibe

33,304 görüntüleme • 3 ay önce

Qwen3.6-27B on RTX 5090, 4 power limits tested: 🔴 400W → 66.58 t/s · baseline (but fluctuates a lot — frequent dips) 🟢 450W → 69.79 t/s · +4.8% speed for +12.5% power (much more stable) 🟡 500W → 71.48 t/s · +2.4% speed for +11.1% power 🟣 575W → 72.64 t/s · +1.6% speed for +15.0% power ➡️ 400W → 575W: +44% power, +9% speed. Conclusion: 450W is the real sweet spot. 400W looks great on the average but the t/s curve is jittery; 450W trades 50W for consistent throughput. Above that, you're just heating your room.

Qwen3.6-27B on RTX 5090, 4 power limits tested: 🔴 400W → 66.58 t/s · baseline (but fluctuates a lot — frequent dips) 🟢 450W → 69.79 t/s · +4.8% speed for +12.5% power (much more stable) 🟡 500W → 71.48 t/s · +2.4% speed for +11.1% power 🟣 575W → 72.64 t/s · +1.6% speed for +15.0% power ➡️ 400W → 575W: +44% power, +9% speed. Conclusion: 450W is the real sweet spot. 400W looks great on the average but the t/s curve is jittery; 450W trades 50W for consistent throughput. Above that, you're just heating your room.

stevibe

55,052 görüntüleme • 3 ay önce

Everyone's comparing the DGX Spark to a 5090 and calling it slow. I think that's the wrong comparison. I ran Qwen3.6 35B-A3B FP8 with the full 262K context window enabled (~96GB RAM) — something gaming GPUs can't really do. Results: 🟢No context: 51.3 tok/s, TTFT 110ms 🟣200K prefill: 34.6 tok/s, TTFT 85s (~2,341 tok/s prefill) Prefill is way faster than a Mac. And 35 tok/s deep into 200K context, on a model this strong, is genuinely usable. The Spark plays a different game.

Everyone's comparing the DGX Spark to a 5090 and calling it slow. I think that's the wrong comparison. I ran Qwen3.6 35B-A3B FP8 with the full 262K context window enabled (~96GB RAM) — something gaming GPUs can't really do. Results: 🟢No context: 51.3 tok/s, TTFT 110ms 🟣200K prefill: 34.6 tok/s, TTFT 85s (~2,341 tok/s prefill) Prefill is way faster than a Mac. And 35 tok/s deep into 200K context, on a model this strong, is genuinely usable. The Spark plays a different game.

stevibe

34,109 görüntüleme • 3 ay önce

ICYMI: Here's a side-by-side comparison of Chapter 1 on Meta Quest 2 vs. Meta Quest 3. What do you think?

ICYMI: Here's a side-by-side comparison of Chapter 1 on Meta Quest 2 vs. Meta Quest 3. What do you think?

TWD Saints & Sinners

20,599 görüntüleme • 2 yıl önce

Introducing HermesAgent-20, a new Bench Pack for BenchLocal. 20 scenarios extracted straight from the Hermes Agent source code, run against a REAL Hermes instance. The actual workload you'd put your model through. Why I built BenchLocal in the first place: most benchmarks are too abstract. We use local LLMs for practical work, and finding the right model for YOUR task efficiently is the single most important thing, especially when you're constrained to what fits on your machine. BenchLocal is a framework: providers, models, side-by-side comparison, all in one UI. Bench Packs are the unit of testing: ToolCall-15 and BugFind-15 shipped first, and when I launched the BenchLocal 0.1.0, added StructOutput, ReasonMath, InstructFollow, DataExtract. Now, HermesAgent-20 is the newest. Bench Packs install like VS Code extensions. The SDK is open, write your own, share it, grow the ecosystem. Here's the goal: a community-built, practical evaluation layer for the local LLM space. Early numbers on HermesAgent-20: > GLM 5.1 — 85 > Gemma4 31B — 83 > Qwen3.5 27B — 79 > MiniMax M2.7 — 76 Upgrade to the latest BenchLocal to install HermesAgent-20 (SDK update required).

Introducing HermesAgent-20, a new Bench Pack for BenchLocal. 20 scenarios extracted straight from the Hermes Agent source code, run against a REAL Hermes instance. The actual workload you'd put your model through. Why I built BenchLocal in the first place: most benchmarks are too abstract. We use local LLMs for practical work, and finding the right model for YOUR task efficiently is the single most important thing, especially when you're constrained to what fits on your machine. BenchLocal is a framework: providers, models, side-by-side comparison, all in one UI. Bench Packs are the unit of testing: ToolCall-15 and BugFind-15 shipped first, and when I launched the BenchLocal 0.1.0, added StructOutput, ReasonMath, InstructFollow, DataExtract. Now, HermesAgent-20 is the newest. Bench Packs install like VS Code extensions. The SDK is open, write your own, share it, grow the ecosystem. Here's the goal: a community-built, practical evaluation layer for the local LLM space. Early numbers on HermesAgent-20: > GLM 5.1 — 85 > Gemma4 31B — 83 > Qwen3.5 27B — 79 > MiniMax M2.7 — 76 Upgrade to the latest BenchLocal to install HermesAgent-20 (SDK update required).

stevibe

38,631 görüntüleme • 3 ay önce

So cool!! I'm running NVIDIA's NemoClaw with Qwen3.5-27B entirely locally via Telegram. No API costs, no data being sent to anyone NemoClaw is a security sandbox built on top of OpenClaw🦞 that lets you restrict the files and networks your lobster can access. I'm running the 4-bit GGUF via llama cpp on a DGX Spark. It's running pretty smoothly at 9 tokens per second! The future might be local :)

So cool!! I'm running NVIDIA's NemoClaw with Qwen3.5-27B entirely locally via Telegram. No API costs, no data being sent to anyone NemoClaw is a security sandbox built on top of OpenClaw🦞 that lets you restrict the files and networks your lobster can access. I'm running the 4-bit GGUF via llama cpp on a DGX Spark. It's running pretty smoothly at 9 tokens per second! The future might be local :)

Niels Rogge

209,157 görüntüleme • 4 ay önce