Loading video...

Video Failed to Load

Go Home

DeepSeek V4.1 Flash 1017 on TensorFold ⚡️ - 16 concurrent session - Each with full native 1M context - Non-greedy, thinking on. OFFICIAL WEIGHTS. Recipe dropping very soon!

21,711 views • 4 days ago •via X (Twitter)

43 Comments

Mia's profile picture
Mia4 days ago

@volatilemarkts 4x DGX Sparks SUPPORTS SWITCHLESS

Mia's profile picture
Mia4 days ago

@volatilemarkts Out now

Stary Libra's profile picture
Stary Libra4 days ago

@ashxhart @volatilemarkts Can I change the setting to TP3 and use it on 3 Spark?

Mia's profile picture
Mia4 days ago

@ashxhart @volatilemarkts Initial release supports only 4

Stary Libra's profile picture
Stary Libra4 days ago

@ashxhart @volatilemarkts Okay. I'll wait. Thanks as always for sharing your awesome work!

Kevin Theo's profile picture
Kevin Theo4 days ago

@ashxhart @volatilemarkts running your SGLang recipe on 4 Sparks in a switchless ring. stock DeepSeek V4.1 Flash here: 70.0 tok/s on code single stream, 72.9 total at 4 streams (26.2 each). 16 sessions at full 1M is a different league. will rerun my prompts on TensorFold when the recipe drops

HealthRanger's profile picture
HealthRanger4 days ago

@ashxhart @volatilemarkts Oh man, this is most definitely worth trying out. Can't wait for the recipe!

vr8vr8's profile picture
vr8vr84 days ago

@ashxhart @volatilemarkts Nice achievement 👍

TechMD's profile picture
TechMD4 days ago

@ashxhart @volatilemarkts Did you get the 4 spark @MiaAI_lab

Mia's profile picture
Mia4 days ago

@ashxhart @volatilemarkts Yes a while ago :)

TechMD's profile picture
TechMD4 days ago

@ashxhart @volatilemarkts nice Im happy, Hope it made a difference to your workflow

GP3611 Phoenix's profile picture
GP3611 Phoenix4 days ago

@ashxhart @volatilemarkts how about single stream peak?

Simo's profile picture
Simo4 days ago

@ashxhart @volatilemarkts Publish sustained throughput latency and memory under full load

Twon | 00.sol | 1TB VRAM's profile picture
Twon | 00.sol | 1TB VRAM4 days ago

@ashxhart @volatilemarkts Ablit recipe too please 🙏

Mr. Galt's profile picture
Mr. Galt4 days ago

@ashxhart @volatilemarkts Nice, now I want two extra Sparks. :(

BullBear.News's profile picture
BullBear.News4 days ago

@ashxhart @volatilemarkts running 1M context natively on a 16gb mac mini via ollama sounds wild, how does tensorfold handle KV cache paging for those concurrent sessions?

lostinazeroy's profile picture
lostinazeroy4 days ago

@ashxhart @volatilemarkts 16 sessions each at full 1m context on one box is wild

Mike Hutu's profile picture
Mike Hutu4 days ago

@ashxhart @volatilemarkts Sayy whaa 2x DGX?

Mia's profile picture
Mia4 days ago

@ashxhart @volatilemarkts Nah... this is 4

Chris Frisby's profile picture
Chris Frisby4 days ago

@ashxhart @volatilemarkts Dang, what's the best quant on TP=3? 4bit?

Mia's profile picture
Mia4 days ago

@ashxhart @volatilemarkts OFFICIAL WEIGHTS !!!!

Chris Frisby's profile picture
Chris Frisby4 days ago

@ashxhart @volatilemarkts Dang, looking forward to it! 🤞🏼🙌🏼

Surrender ⚡️'s profile picture
Surrender ⚡️4 days ago

@ashxhart @volatilemarkts have you tried minimax yet?

Mia's profile picture
Mia4 days ago

@ashxhart @volatilemarkts Yes. I skipped it.

Ponzi's profile picture
Ponzi4 days ago

@ashxhart @volatilemarkts

Pragnyan Ramtha's profile picture
Pragnyan Ramtha4 days ago

@ashxhart @volatilemarkts ok where is the kv cache even living

Sage Byte's profile picture
Sage Byte3 days ago

@ashxhart @volatilemarkts Offical weights and 16 concurrent sessions is crazy 🔥

Mia's profile picture
Mia3 days ago

@ashxhart @volatilemarkts The only way to do it is crazy.

Whispers of Wisdom's profile picture
Whispers of Wisdom4 days ago

@ashxhart @volatilemarkts If you have time, can you please update the 2x DGX Spark version too please ♥️

FrontierMind's profile picture
FrontierMind4 days ago

@ashxhart @volatilemarkts running 16 concurrent sessions at 1m context on flash weights sounds wild for local infra

steddy's profile picture
steddy4 days ago

@ashxhart @volatilemarkts I don’t see a graphical front end for TensorFold on Spark. Only Mac

Peter Morris's profile picture
Peter Morris4 days ago

@ashxhart @volatilemarkts I assume you need 4×GB10 for 16 concurrent?

Mia's profile picture
Mia4 days ago

@ashxhart @volatilemarkts With official weights, yes, but it will support 3 sparks later on too

Steven Cheng's profile picture
Steven Cheng4 days ago

@ashxhart @volatilemarkts 16 sessions with full 1M context running simultaneously? That memory bandwidth must be absolutely insane.

Novaris's profile picture
Novaris4 days ago

@ashxhart @volatilemarkts 16 concurrent sessions, each with full 1M context — that's the kind of spec that makes 'just run it locally' sound almost reasonable.

The SI Maximalist's profile picture
The SI Maximalist4 days ago

@ashxhart @volatilemarkts the number I’m watching for in the recipe: tokens/sec per session with all 16 contexts filled. A 1M window tells us capacity; sustained decoding tells us how responsive those sessions are

Random Libertarian Tech Lead's profile picture
Random Libertarian Tech Lead4 days ago

@ashxhart @volatilemarkts Should be interesting to see how this compares single-stream compared to my ground-up Rust stack.

汉卿 | hanqing's profile picture
汉卿 | hanqing4 days ago

@ashxhart @volatilemarkts 1M上下文+16并发+非贪心,这配方一出直接封神。

Ryan Feng's profile picture
Ryan Feng4 days ago

@ashxhart @volatilemarkts prefil? sglang can do 5k+/s on TP4

Mia's profile picture
Mia4 days ago

@ashxhart @volatilemarkts I can only test switchless for now, don't have a switch. Switchless gets 4k prefill on 256k

Dave's profile picture
Dave4 days ago

@ashxhart @volatilemarkts I'm on TF 1.0.12 with DS 4 spark and I have images. But sad face TF does not cache images so reads are expeeeeensive.

AI Doc's profile picture
AI Doc3 days ago

@ashxhart @volatilemarkts But is it better than glm 5.3 flash? @MiaAI_lab

Dr.-Ing. Manuel Ramsaier's profile picture
Dr.-Ing. Manuel Ramsaier4 days ago

@ashxhart @volatilemarkts ❤️❤️❤️ will this be significantly better than the exl3 on 2 sparks ?!

Related Videos