Загрузка видео...

Не удалось загрузить видео

На главную

Today we’re announcing our “ThinkingCap” efficient model series with a 2× thinking token reduction on average in Qwen 3.6 27B, with up to 10x faster generation on individual examples.

51,612 просмотров • 3 месяцев назад •via X (Twitter)

Комментарии: 26

Фото профиля Jaroslav Beck
Jaroslav Beck3 месяцев назад

The results across seven out-of-domain benchmarks: 🏆 Up to 10x faster in specific responses 📉 ~46% fewer reasoning tokens on average 🎯 −0.7pp accuracy difference (comparable accuracy) 🔄 Fewer reasoning loops & dead-ends ⚡ Lower latency, lower inference cost, better real-world throughput

Фото профиля Jaroslav Beck
Jaroslav Beck3 месяцев назад

I am using this improved model in my local cluster “Bob” for some time now. I’s fast and also shortening the answers without degrading the output.

Фото профиля Jaroslav Beck
Jaroslav Beck3 месяцев назад

Our goal was to get to same answer sooner with fewer tokens burned and without loosing accuracy.

Фото профиля Jaroslav Beck
Jaroslav Beck3 месяцев назад

🔗 Full technical write-up with methodology & numbers in our blog post: 🔗 HuggingFace LINK:

Фото профиля Jaroslav Beck
Jaroslav Beck3 месяцев назад

PS: Efficiency not just in open models is our core thesis since we started year ago. If you want to work on frontier of efficiency, join us!

Фото профиля Martin Havel
Martin Havel3 месяцев назад

Replicated on Czech-language RAG (tender docs, 3090, same quants): −29–55 % thinking, 0 quality loss, and 3× lower variance in thinking length across seeds — more predictable latency in production. Fits 24GB. Well done 👏

Фото профиля Jaroslav Beck
Jaroslav Beck3 месяцев назад

🔥

Фото профиля Tom Krcha
Tom Krcha3 месяцев назад

🏎️ love it!

Фото профиля Jaroslav Beck
Jaroslav Beck3 месяцев назад

🙌🔥

Фото профиля Jaroslav Beck
Jaroslav Beck3 месяцев назад

;)

Фото профиля Chetin
Chetin3 месяцев назад

Interesting.

Фото профиля Jaroslav Beck
Jaroslav Beck3 месяцев назад

your 🤖 Henry would love this model!

Фото профиля Ondřej Súkup
Ondřej Súkup3 месяцев назад

Any plan for official mlx ?

Фото профиля Ddddddd
Ddddddd3 месяцев назад

Qwen 3.6 36b-A3 will work also?

Фото профиля Jaroslav Beck
Jaroslav Beck3 месяцев назад

Our training algorithm will work for most open models.

Фото профиля Jan Kozák 🇨🇿🇪🇺🇺🇦🇵🇱
Jan Kozák 🇨🇿🇪🇺🇺🇦🇵🇱3 месяцев назад

i will wait for mtp, this is currently slower

Фото профиля Gedeon
Gedeon3 месяцев назад

Good stuff

Фото профиля Latent Node
Latent Node3 месяцев назад

Great idea, similar to autothink - ?

Фото профиля Adel Bucetta
Adel Bucetta3 месяцев назад

what makes the 2x token reduction so remarkable is it's a direct result of rethinking compute and dataflow from scratch

Фото профиля Pavol Zajicek
Pavol Zajicek3 месяцев назад

Interesting 👍 Does it support MTP?

Фото профиля Jaroslav Beck
Jaroslav Beck3 месяцев назад

Yep

Фото профиля Pavol Zajicek
Pavol Zajicek3 месяцев назад

Can I make Beat Saber 2 with it? 🙃✌️

Фото профиля Jaroslav Beck
Jaroslav Beck3 месяцев назад

Go ahead! ;)

Фото профиля Johnny Hu
Johnny Hu3 месяцев назад

Pitty it's at the beginning of summer holidays, tried to promote it to a community neewsfeed but everyone is gone for weeks :(. But thanks for making europe great again 😁 keep rocking

Фото профиля smeekky
smeekky3 месяцев назад

Great job, @JaroslavBeck ! Keep up the excellent work. You are truly inspiring, and the Czech Republic appreciates what you do more than it may seem at first glance. Thank you to your entire team.

Фото профиля Václav Knapp
Václav Knapp3 месяцев назад

Really cool guys!! 🇨🇿🇨🇿🔥 I have 4 questions below👇

Похожие видео