正在加载视频...

视频加载失败

Today we’re announcing our “ThinkingCap” efficient model series with a 2× thinking token reduction on average in Qwen 3.6 27B, with up to 10x faster generation on individual examples.

51,640 次观看 • 3 个月前 •via X (Twitter)

26 条评论

Jaroslav Beck 的头像
Jaroslav Beck3 个月前

The results across seven out-of-domain benchmarks: 🏆 Up to 10x faster in specific responses 📉 ~46% fewer reasoning tokens on average 🎯 −0.7pp accuracy difference (comparable accuracy) 🔄 Fewer reasoning loops & dead-ends ⚡ Lower latency, lower inference cost, better real-world throughput

Jaroslav Beck 的头像
Jaroslav Beck3 个月前

I am using this improved model in my local cluster “Bob” for some time now. I’s fast and also shortening the answers without degrading the output.

Jaroslav Beck 的头像
Jaroslav Beck3 个月前

Our goal was to get to same answer sooner with fewer tokens burned and without loosing accuracy.

Jaroslav Beck 的头像
Jaroslav Beck3 个月前

🔗 Full technical write-up with methodology & numbers in our blog post: 🔗 HuggingFace LINK:

Jaroslav Beck 的头像
Jaroslav Beck3 个月前

PS: Efficiency not just in open models is our core thesis since we started year ago. If you want to work on frontier of efficiency, join us!

Martin Havel 的头像
Martin Havel3 个月前

Replicated on Czech-language RAG (tender docs, 3090, same quants): −29–55 % thinking, 0 quality loss, and 3× lower variance in thinking length across seeds — more predictable latency in production. Fits 24GB. Well done 👏

Jaroslav Beck 的头像
Jaroslav Beck3 个月前

🔥

Tom Krcha 的头像
Tom Krcha3 个月前

🏎️ love it!

Jaroslav Beck 的头像
Jaroslav Beck3 个月前

🙌🔥

Jaroslav Beck 的头像
Jaroslav Beck3 个月前

;)

Chetin 的头像
Chetin3 个月前

Interesting.

Jaroslav Beck 的头像
Jaroslav Beck3 个月前

your 🤖 Henry would love this model!

Ondřej Súkup 的头像
Ondřej Súkup3 个月前

Any plan for official mlx ?

Ddddddd 的头像
Ddddddd3 个月前

Qwen 3.6 36b-A3 will work also?

Jaroslav Beck 的头像
Jaroslav Beck3 个月前

Our training algorithm will work for most open models.

Jan Kozák 🇨🇿🇪🇺🇺🇦🇵🇱 的头像
Jan Kozák 🇨🇿🇪🇺🇺🇦🇵🇱3 个月前

i will wait for mtp, this is currently slower

Gedeon 的头像
Gedeon3 个月前

Good stuff

Latent Node 的头像
Latent Node3 个月前

Great idea, similar to autothink - ?

Adel Bucetta 的头像
Adel Bucetta3 个月前

what makes the 2x token reduction so remarkable is it's a direct result of rethinking compute and dataflow from scratch

Pavol Zajicek 的头像
Pavol Zajicek3 个月前

Interesting 👍 Does it support MTP?

Jaroslav Beck 的头像
Jaroslav Beck3 个月前

Yep

Pavol Zajicek 的头像
Pavol Zajicek3 个月前

Can I make Beat Saber 2 with it? 🙃✌️

Jaroslav Beck 的头像
Jaroslav Beck3 个月前

Go ahead! ;)

Johnny Hu 的头像
Johnny Hu3 个月前

Pitty it's at the beginning of summer holidays, tried to promote it to a community neewsfeed but everyone is gone for weeks :(. But thanks for making europe great again 😁 keep rocking

smeekky 的头像
smeekky3 个月前

Great job, @JaroslavBeck ! Keep up the excellent work. You are truly inspiring, and the Czech Republic appreciates what you do more than it may seem at first glance. Thank you to your entire team.

Václav Knapp 的头像
Václav Knapp3 个月前

Really cool guys!! 🇨🇿🇨🇿🔥 I have 4 questions below👇

相关视频