正在加载视频...

视频加载失败

DeepSeek V4.1 Flash 1017 on TensorFold ⚡️ - 16 concurrent session - Each with full native 1M context - Non-greedy, thinking on. OFFICIAL WEIGHTS. Recipe dropping very soon!

21,875 次观看 • 13 天前 •via X (Twitter)

43 条评论

Mia 的头像
Mia13 天前

@volatilemarkts 4x DGX Sparks SUPPORTS SWITCHLESS

Mia 的头像
Mia13 天前

@volatilemarkts Out now

Stary Libra 的头像
Stary Libra13 天前

@ashxhart @volatilemarkts Can I change the setting to TP3 and use it on 3 Spark?

Mia 的头像
Mia13 天前

@ashxhart @volatilemarkts Initial release supports only 4

Stary Libra 的头像
Stary Libra13 天前

@ashxhart @volatilemarkts Okay. I'll wait. Thanks as always for sharing your awesome work!

Kevin Theo 的头像
Kevin Theo13 天前

@ashxhart @volatilemarkts running your SGLang recipe on 4 Sparks in a switchless ring. stock DeepSeek V4.1 Flash here: 70.0 tok/s on code single stream, 72.9 total at 4 streams (26.2 each). 16 sessions at full 1M is a different league. will rerun my prompts on TensorFold when the recipe drops

HealthRanger 的头像
HealthRanger13 天前

@ashxhart @volatilemarkts Oh man, this is most definitely worth trying out. Can't wait for the recipe!

vr8vr8 的头像
vr8vr813 天前

@ashxhart @volatilemarkts Nice achievement 👍

TechMD 的头像
TechMD13 天前

@ashxhart @volatilemarkts Did you get the 4 spark @MiaAI_lab

Mia 的头像
Mia13 天前

@ashxhart @volatilemarkts Yes a while ago :)

TechMD 的头像
TechMD13 天前

@ashxhart @volatilemarkts nice Im happy, Hope it made a difference to your workflow

GP3611 Phoenix 的头像
GP3611 Phoenix13 天前

@ashxhart @volatilemarkts how about single stream peak?

Simo 的头像
Simo13 天前

@ashxhart @volatilemarkts Publish sustained throughput latency and memory under full load

Twon | 00.sol | 1TB VRAM 的头像
Twon | 00.sol | 1TB VRAM13 天前

@ashxhart @volatilemarkts Ablit recipe too please 🙏

Mr. Galt 的头像
Mr. Galt13 天前

@ashxhart @volatilemarkts Nice, now I want two extra Sparks. :(

BullBear.News 的头像
BullBear.News13 天前

@ashxhart @volatilemarkts running 1M context natively on a 16gb mac mini via ollama sounds wild, how does tensorfold handle KV cache paging for those concurrent sessions?

lostinazeroy 的头像
lostinazeroy13 天前

@ashxhart @volatilemarkts 16 sessions each at full 1m context on one box is wild

Mike Hutu 的头像
Mike Hutu13 天前

@ashxhart @volatilemarkts Sayy whaa 2x DGX?

Mia 的头像
Mia13 天前

@ashxhart @volatilemarkts Nah... this is 4

Chris Frisby 的头像
Chris Frisby13 天前

@ashxhart @volatilemarkts Dang, what's the best quant on TP=3? 4bit?

Mia 的头像
Mia13 天前

@ashxhart @volatilemarkts OFFICIAL WEIGHTS !!!!

Chris Frisby 的头像
Chris Frisby13 天前

@ashxhart @volatilemarkts Dang, looking forward to it! 🤞🏼🙌🏼

Surrender ⚡️ 的头像
Surrender ⚡️13 天前

@ashxhart @volatilemarkts have you tried minimax yet?

Mia 的头像
Mia13 天前

@ashxhart @volatilemarkts Yes. I skipped it.

Ponzi 的头像
Ponzi13 天前

@ashxhart @volatilemarkts

Pragnyan Ramtha 的头像
Pragnyan Ramtha13 天前

@ashxhart @volatilemarkts ok where is the kv cache even living

Sage Byte 的头像
Sage Byte12 天前

@ashxhart @volatilemarkts Offical weights and 16 concurrent sessions is crazy 🔥

Mia 的头像
Mia12 天前

@ashxhart @volatilemarkts The only way to do it is crazy.

Whispers of Wisdom 的头像
Whispers of Wisdom13 天前

@ashxhart @volatilemarkts If you have time, can you please update the 2x DGX Spark version too please ♥️

FrontierMind 的头像
FrontierMind13 天前

@ashxhart @volatilemarkts running 16 concurrent sessions at 1m context on flash weights sounds wild for local infra

steddy 的头像
steddy13 天前

@ashxhart @volatilemarkts I don’t see a graphical front end for TensorFold on Spark. Only Mac

Peter Morris 的头像
Peter Morris13 天前

@ashxhart @volatilemarkts I assume you need 4×GB10 for 16 concurrent?

Mia 的头像
Mia13 天前

@ashxhart @volatilemarkts With official weights, yes, but it will support 3 sparks later on too

Steven Cheng 的头像
Steven Cheng13 天前

@ashxhart @volatilemarkts 16 sessions with full 1M context running simultaneously? That memory bandwidth must be absolutely insane.

Novaris 的头像
Novaris13 天前

@ashxhart @volatilemarkts 16 concurrent sessions, each with full 1M context — that's the kind of spec that makes 'just run it locally' sound almost reasonable.

The SI Maximalist 的头像
The SI Maximalist13 天前

@ashxhart @volatilemarkts the number I’m watching for in the recipe: tokens/sec per session with all 16 contexts filled. A 1M window tells us capacity; sustained decoding tells us how responsive those sessions are

Random Libertarian Tech Lead 的头像
Random Libertarian Tech Lead13 天前

@ashxhart @volatilemarkts Should be interesting to see how this compares single-stream compared to my ground-up Rust stack.

汉卿 | hanqing 的头像
汉卿 | hanqing13 天前

@ashxhart @volatilemarkts 1M上下文+16并发+非贪心,这配方一出直接封神。

Ryan Feng 的头像
Ryan Feng13 天前

@ashxhart @volatilemarkts prefil? sglang can do 5k+/s on TP4

Mia 的头像
Mia13 天前

@ashxhart @volatilemarkts I can only test switchless for now, don't have a switch. Switchless gets 4k prefill on 256k

Dave 的头像
Dave13 天前

@ashxhart @volatilemarkts I'm on TF 1.0.12 with DS 4 spark and I have images. But sad face TF does not cache images so reads are expeeeeensive.

AI Doc 的头像
AI Doc12 天前

@ashxhart @volatilemarkts But is it better than glm 5.3 flash? @MiaAI_lab

Dr.-Ing. Manuel Ramsaier 的头像
Dr.-Ing. Manuel Ramsaier13 天前

@ashxhart @volatilemarkts ❤️❤️❤️ will this be significantly better than the exl3 on 2 sparks ?!

相关视频