Video wird geladen...

Video konnte nicht geladen werden

Beim Laden dieses Videos ist ein Problem aufgetreten. Dies könnte an einem vorübergehenden Netzwerkproblem liegen oder das Video ist möglicherweise nicht verfügbar.

First impression of how fast the new Qwen3.8-Flash-Next runs on a single DGX Spark. 180B params, 262k context, all local.

0xBakeer

1,280 subscribers

21,993 Aufrufe • vor 15 Tagen •via X (Twitter)

Anya Rossi• Live Now

Private livecam show

0 Kommentare

Keine Kommentare verfügbar

Kommentare vom Original-Post werden hier angezeigt

Ähnliche Videos

Qwen3.8 Flash on a single DGX Spark. Smooth experience!

Qwen3.8 Flash on a single DGX Spark. Smooth experience!

Mia

18,248 Aufrufe • vor 7 Tagen

DeepSeek-V4-Flash-Spark and Spark-Mini were born today. 1 command setup to Pi / vllm-studio / docker deployment. All this is running local on a single DGX Spark.

DeepSeek-V4-Flash-Spark and Spark-Mini were born today. 1 command setup to Pi / vllm-studio / docker deployment. All this is running local on a single DGX Spark.

0xSero

20,019 Aufrufe • vor 3 Monaten

I DID IT. Qwen3.8 Flash Next, the 125B MoE with the 51B n-gram table, running on 4 x RTX 3090 with 32GB of system RAM, in vLLM, at the FULL 262K context.

I DID IT. Qwen3.8 Flash Next, the 125B MoE with the 51B n-gram table, running on 4 x RTX 3090 with 32GB of system RAM, in vLLM, at the FULL 262K context.

Tech2Wild

11,714 Aufrufe • vor 4 Tagen

Qwen3.8-Flash-Next (176B, NVFP4, 2× DGX Spark): 40,265 thinking tokens, 21,091 answer. Qwen3.8-27B on the same prompt: 42,988 thinking, 6,040 answer. Same question, same deliberation, 3.5× the output. 55 min vs 37 min. The 176B shipped a genuine leapfrog wave equation on a 512² lattice with reflections and interference. The 27B shipped a solid ripple tank. Both run 60fps in a single HTML file Generated on DGX Sparks on my desk.

Qwen3.8-Flash-Next (176B, NVFP4, 2× DGX Spark): 40,265 thinking tokens, 21,091 answer. Qwen3.8-27B on the same prompt: 42,988 thinking, 6,040 answer. Same question, same deliberation, 3.5× the output. 55 min vs 37 min. The 176B shipped a genuine leapfrog wave equation on a 512² lattice with reflections and interference. The 27B shipped a solid ripple tank. Both run 60fps in a single HTML file Generated on DGX Sparks on my desk.

Wësche

23,168 Aufrufe • vor 15 Tagen

Qwen3.8-27B is insane at browser use. Running on a DGX Spark, sped up 3x. The Qwen bros were right....!

Qwen3.8-27B is insane at browser use. Running on a DGX Spark, sped up 3x. The Qwen bros were right....!

0xSero

28,702 Aufrufe • vor 10 Tagen

Jensen Huang hand-delivers the new NVIDIA DGX Spark to Elon Musk at Starbase 2016: Jensen hand-delivered the first DGX-1 to Elon at OpenAI Now: Nearly a decade later, he’s delivering the next generation at Starbase • DGX-1 (2016): 3,000 Watts • DGX Spark (2025): 40 Watts

Jensen Huang hand-delivers the new NVIDIA DGX Spark to Elon Musk at Starbase 2016: Jensen hand-delivered the first DGX-1 to Elon at OpenAI Now: Nearly a decade later, he’s delivering the next generation at Starbase • DGX-1 (2016): 3,000 Watts • DGX Spark (2025): 40 Watts

X Freeze

20,547 Aufrufe • vor 7 Monaten

Videos of Hermes Desktop using 2 x DGX Spark with: - GLM 5.3 Flash EXL3 - Qwen 3.8 Flash Next - DeepSeek V4 0731 Flash All powered by Mia recipes and her sparkDash!

Videos of Hermes Desktop using 2 x DGX Spark with: - GLM 5.3 Flash EXL3 - Qwen 3.8 Flash Next - DeepSeek V4 0731 Flash All powered by Mia recipes and her sparkDash!

Ivan Fioravanti ᯅ

45,257 Aufrufe • vor 12 Tagen

When NVIDIA CEO Jensen Huang presented the DGX Spark, then he recalled how, back in 2016, he unveiled the world’s first AI supercomputer, the DGX-1, and how Elon Musk, then at OpenAI, became its first customer. The DGX Spark is far more advanced, delivering five times the computational power of the DGX-1.

When NVIDIA CEO Jensen Huang presented the DGX Spark, then he recalled how, back in 2016, he unveiled the world’s first AI supercomputer, the DGX-1, and how Elon Musk, then at OpenAI, became its first customer. The DGX Spark is far more advanced, delivering five times the computational power of the DGX-1.

SMX 🇺🇸

13,315,787 Aufrufe • vor 10 Monaten

The holy grail of Local AI: 🔓Open Source 🏃‍♀️Runs Fast 💻Runs on your machine 🌐Runs on all machines Mozilla is leading the charge on the new local AI ecosystem: ’s work on llamafile and Stephen Hood announced sqlite-vec & $100k in non-dilutive funding for all local AI projects! Full talk in next post!

The holy grail of Local AI: 🔓Open Source 🏃‍♀️Runs Fast 💻Runs on your machine 🌐Runs on all machines Mozilla is leading the charge on the new local AI ecosystem: ’s work on llamafile and Stephen Hood announced sqlite-vec & $100k in non-dilutive funding for all local AI projects! Full talk in next post!

AI Engineer

23,092 Aufrufe • vor 2 Jahren

Loading DeepSeek v4 Flash just reminded me how good and fast this model is and how well it runs on DGX Sparks. GLM-5.2 is really awesome, but if you want fast and concurrent inference, DS4F is still a top choice IMO. Created by DS4F in single shot The coffee guy

Loading DeepSeek v4 Flash just reminded me how good and fast this model is and how well it runs on DGX Sparks. GLM-5.2 is really awesome, but if you want fast and concurrent inference, DS4F is still a top choice IMO. Created by DS4F in single shot The coffee guy

Mia

39,686 Aufrufe • vor 1 Monat

Receipts in video, see it float at ~100-150 while coding the fluctuations were for task and context switching of the model. This thing rips through code! A Single NVIDIA AI DGX Spark ⚡️

Receipts in video, see it float at ~100-150 while coding the fluctuations were for task and context switching of the model. This thing rips through code! A Single NVIDIA AI DGX Spark ⚡️

ÆON FORGE ✨

10,822 Aufrufe • vor 3 Monaten

Spent the last few days vibe coding on my NVIDIA DGX Spark. Here's what I learned. Qwen 3.5 122B took one minute and nine seconds to respond "Hi how are you doing". Unusable for vibe coding. Gemma 4 was fast but built a dot instead of a first person shooter game. GPT-OSS 120B was the sweet spot. Fast, capable, and actually produced working HTML. Open source models running locally are not replacing Claude Opus 4.6 or Codex with GPT 5.4. Not even close. But they're getting better every month. The new DGX Spark Bench is live on Real-world benchmarks for local models on local hardware. This is just the start. Full video below.

Spent the last few days vibe coding on my NVIDIA DGX Spark. Here's what I learned. Qwen 3.5 122B took one minute and nine seconds to respond "Hi how are you doing". Unusable for vibe coding. Gemma 4 was fast but built a dot instead of a first person shooter game. GPT-OSS 120B was the sweet spot. Fast, capable, and actually produced working HTML. Open source models running locally are not replacing Claude Opus 4.6 or Codex with GPT 5.4. Not even close. But they're getting better every month. The new DGX Spark Bench is live on Real-world benchmarks for local models on local hardware. This is just the start. Full video below.

BridgeMind

57,304 Aufrufe • vor 5 Monaten

Today we’re launching Portable Computer on NVIDIA DGX Spark. Portable Computer is a fully local version of Perplexity Computer, where the entire runtime: orchestrator LLM, subagent LLM, agent harness all run on your local hardware. No cloud dependency.

Today we’re launching Portable Computer on NVIDIA DGX Spark. Portable Computer is a fully local version of Perplexity Computer, where the entire runtime: orchestrator LLM, subagent LLM, agent harness all run on your local hardware. No cloud dependency.

Perplexity

1,217,188 Aufrufe • vor 17 Tagen

From the Hamster Labs lab: Introducing Qwen3.8-Flash-Next-REAP-288-MLX-4bit, a 180B-class model running on just 39gb of memory - MLX-native 4-bit 60% smaller than stock q4 - Pruned 512→288 experts via REAP - 91.5% HumanEval (vs 93.9% stock) Hugging Face links below ↓

From the Hamster Labs lab: Introducing Qwen3.8-Flash-Next-REAP-288-MLX-4bit, a 180B-class model running on just 39gb of memory - MLX-native 4-bit 60% smaller than stock q4 - Pruned 512→288 experts via REAP - 91.5% HumanEval (vs 93.9% stock) Hugging Face links below ↓

Eyal Toledano

45,601 Aufrufe • vor 14 Tagen

It's been an amazing week for open models running on NVIDIA Local AI systems! 👀 Here's a few you’ll want to know about, all ready to run locally on NVIDIA RTX, DGX Spark, DGX Station, and Jetson.

It's been an amazing week for open models running on NVIDIA Local AI systems! 👀 Here's a few you’ll want to know about, all ready to run locally on NVIDIA RTX, DGX Spark, DGX Station, and Jetson.

NVIDIA RTX Spark

60,516 Aufrufe • vor 27 Tagen

From rockets to AI. Nine years after the original NVIDIA DGX-1 handoff, Jensen Huang delivered a brand-new DGX Spark to Elon Musk at Starbase. 🚀✨ The DGX Spark is a petaflop powerhouse built for creators, researchers, and developers — a desktop-sized supercomputer with five times the performance of the first DGX-1. Filmed at SpaceX’s rocket factory in Texas, this moment captures a conversation between the two visionariesI. ➡️ 📹 #SparkSomethingBig

NVIDIA

3,159,905 Aufrufe • vor 10 Monaten

Nemotron-3-Nano-Omni-30B-A3B smashing 80 concurrent sessions on a single NVIDIA AI DGX Spark! 🔥 256k context. MTP enabled. All sessions running completely different prompts. ~800 tokens/s cumulative 🤯 Video starts slow but goes hard — watch till the end!

Nemotron-3-Nano-Omni-30B-A3B smashing 80 concurrent sessions on a single NVIDIA AI DGX Spark! 🔥 256k context. MTP enabled. All sessions running completely different prompts. ~800 tokens/s cumulative 🤯 Video starts slow but goes hard — watch till the end!

Mia

22,853 Aufrufe • vor 2 Monaten

Everyone's comparing the DGX Spark to a 5090 and calling it slow. I think that's the wrong comparison. I ran Qwen3.6 35B-A3B FP8 with the full 262K context window enabled (~96GB RAM) — something gaming GPUs can't really do. Results: 🟢No context: 51.3 tok/s, TTFT 110ms 🟣200K prefill: 34.6 tok/s, TTFT 85s (~2,341 tok/s prefill) Prefill is way faster than a Mac. And 35 tok/s deep into 200K context, on a model this strong, is genuinely usable. The Spark plays a different game.

Everyone's comparing the DGX Spark to a 5090 and calling it slow. I think that's the wrong comparison. I ran Qwen3.6 35B-A3B FP8 with the full 262K context window enabled (~96GB RAM) — something gaming GPUs can't really do. Results: 🟢No context: 51.3 tok/s, TTFT 110ms 🟣200K prefill: 34.6 tok/s, TTFT 85s (~2,341 tok/s prefill) Prefill is way faster than a Mac. And 35 tok/s deep into 200K context, on a model this strong, is genuinely usable. The Spark plays a different game.

stevibe

34,141 Aufrufe • vor 4 Monaten

Step-3.7-Flash Q4_K_S on DGX Spark (GB10, 128GB): > ~27 tok/s generation > 198B sparse MoE, ~11B active > 256K context, native vision > Agentic / tool-calling / reasoning > Apache 2.0 I added a mobile chat screen on the right showing what 27 tok/s actually feels like streaming on a phone.

Step-3.7-Flash Q4_K_S on DGX Spark (GB10, 128GB): > ~27 tok/s generation > 198B sparse MoE, ~11B active > 256K context, native vision > Agentic / tool-calling / reasoning > Apache 2.0 I added a mobile chat screen on the right showing what 27 tok/s actually feels like streaming on a phone.

stevibe

19,658 Aufrufe • vor 3 Monaten

This afternoon I picked up a new Nvidia DGX Spark computer with the goal of trying to run Gemma 4 31b (4bit) on it locally as a server. Just 1.5 hours later, it’s working! Using Open WebUI on my MacBook as the interface and it’s connecting to my DGX Spark running as a Gemma 4 server.

This afternoon I picked up a new Nvidia DGX Spark computer with the goal of trying to run Gemma 4 31b (4bit) on it locally as a server. Just 1.5 hours later, it’s working! Using Open WebUI on my MacBook as the interface and it’s connecting to my DGX Spark running as a Gemma 4 server.

Dave Lee

140,876 Aufrufe • vor 5 Monaten