Loading video...

Video Failed to Load

Go Home

Introducing Decision 2.0: our newest state-of-the-art decision models, open in every size from 0.6B to 27B ⚡ HF collection 🤗: #OpenSource #Decision #Jev #LLM

147,258 views • 1 month ago •via X (Twitter)

45 Comments

Crio Songo's profile picture
Crio Songo1 month ago

Wow, covering 0.6B to 27B sizes, all open sourced. This is really solid work.

Xunzhuo's profile picture
Xunzhuo1 month ago

Thank you!

pablito's profile picture
pablito1 month ago

@airesearch12 to add in the jev bench please

Xunzhuo's profile picture
Xunzhuo1 month ago

@airesearch12 Let’s do it!

ShadowAguy's profile picture
ShadowAguy1 month ago

0.6B to 27B. the dropdown is where model choice happens.

Xunzhuo's profile picture
Xunzhuo1 month ago

Exactly!

Donald Lee's profile picture
Donald Lee1 month ago

I like that you included 0.6B. That's the size I'd try first for a local setup.

Xunzhuo's profile picture
Xunzhuo1 month ago

Exactly! 💯

Nichy's profile picture
Nichy1 month ago

Is there a Vision model planned?

Xunzhuo's profile picture
Xunzhuo1 month ago

Yes for sure : )

Nichy's profile picture
Nichy1 month ago

I can't wait to try it!

Solomon's profile picture
Solomon1 month ago

The per-option probabilities are a useful touch. Have you measured calibration after rephrasing or reordering the choices? I'd use that to set a fallback threshold; a harmless label edit shouldn't quietly change which cases reach the larger model.

Xunzhuo's profile picture
Xunzhuo1 month ago

Good point. Cascade for decision model will be added into to have realtime upgrades

Jan Henrik's profile picture
Jan Henrik1 month ago

Have you benchmarked it on predictive benchmarks like BeyondArena?

Cristian Leo's profile picture
Cristian Leo1 month ago

Kai is particularly interesting as it can be used on an edge device

Xunzhuo's profile picture
Xunzhuo1 month ago

Yes, it is very cheap and capable for most of works, and we can cascade to larger one when uncertain

Xunzhuo's profile picture
Xunzhuo1 month ago

@cristian_le0 more interesting decisions will come not just vary from the model size 🤗

Jacob Lin's profile picture
Jacob Lin1 month ago

We benchmarked all six vLLM Decision 2.0 models on StreamDecisionBench, across presenter control, live debugging, assembly coaching, and call assist. Lux-9B came out strongest on the in-force score, while Vega-27B showed strong untimed accuracy but dropped much more once latency was counted. Code and full results are here

Vito Botta's profile picture
Vito Botta1 month ago

Curious what the licence looks like on the big one.

shiv k.'s profile picture
shiv k.29 days ago

This is a great will for sure will be intergerating this into our own software decision making is the biggest problem these frontier models still lack in great work!!

Othmane Kinane's profile picture
Othmane Kinane1 month ago

I see this is based on Qwen. Is it possible to have the model loaded in memory serve decision jev and generation requests?

Agentic Intelligence Lab's profile picture
Agentic Intelligence Lab1 month ago

hey @UnslothAI @ollama can we add decision 2.0 into the stack?

AI 码人士's profile picture
AI 码人士1 month ago

Fully open-weight from 0.6B to 27B is what makes this category actually buildable — teams can run decisions locally, fine-tune on their own judgment patterns, and keep data in-house. The spread across sizes means you can pay for scale only where decisions are hard. What does Decision 2.0 do differently on calibration vs Kev and the other open decision models?

Hova's profile picture
Hova1 month ago

Hey @grok bu nədi belə hər kəs model çıxardır bu neçənci dəfədir görürəm bu gün axı çətin idi hesablama gücü və S. Staratplar şirkətlər ən böyüklərə dirənən bilmirdi

Mostafa's profile picture
Mostafa28 days ago

I can't wait to try these!

Spartak's profile picture
Spartak1 month ago

In this world we course need more decision models

Artale's profile picture
Artale29 days ago

great job 😍

奇韬者's profile picture
奇韬者1 month ago

Cool, I like open source

Contract Tea's profile picture
Contract Tea1 month ago

0.6B to 27B, every size. the small end matters more than the headline 27B for on-chain stuff where you just need a fast flag, low latency beats raw accuracy when you're scanning thousands of contracts.

Xunzhuo's profile picture
Xunzhuo1 month ago

Thanks 🍻

Feed Latency's profile picture
Feed Latency28 days ago

0.6B to 27B open. running the 0.6B locally to grade orderbook snapshots - 3.46B active on Kolibri is still my classifier, but a decision model that fits on one card is worth the swap test. what's p99 on the small one?

Mushaf S.'s profile picture
Mushaf S.1 month ago

Is this vision ? By the way is there any decision model that supports vision right now?

Alex Yarosh · AI expert · CEO of AI Studio's profile picture
Alex Yarosh · AI expert · CEO of AI Studio1 month ago

The 0.6B end is the one I'd grab first - big enough range to test on a laptop before committing.

Ashish Ranjan's profile picture
Ashish Ranjan1 month ago

decision-specific training beats general purpose models every time for this use case

Hook & Queue's profile picture
Hook & Queue1 month ago

0.6B to 27B all open is the useful part. small one fits a router hook, no endpoint to babysit. did they ship the router config too or just weights?

Shorya Mishra's profile picture
Shorya Mishra29 days ago

64 decisions in one 63ms forward pass is the bit i'd benchmark against “just ask the main LLM”. this feels less like a tiny chatbot and more like a vectorized policy primitive for routers/agents

aleks's profile picture
aleks1 month ago

love this

Xunzhuo's profile picture
Xunzhuo1 month ago

Thanks!

Ork9163's profile picture
Ork916329 days ago

@XunzhuoLiu is that better than laya 421M? Can you compare, im curios about that 0.6 , 0.8 reasoining which one equal to vanilla laya 421M?

NickE's profile picture
NickE1 month ago

Does it has some arch improvements over other decision models to run faster over vllm, or does vllm has also improved the infra to run decision models faster?

Xunzhuo's profile picture
Xunzhuo1 month ago

We have some runtime specific optimizations

Vera Ai | Tools & Updates's profile picture
Vera Ai | Tools & Updates1 month ago

Open decision models across that size range is a useful drop here

Xunzhuo's profile picture
Xunzhuo1 month ago

Thank you !

dreambeam's profile picture
dreambeam1 month ago

I ll try to make one play world warcraft by itself .

Xunzhuo's profile picture
Xunzhuo1 month ago

Cheers 🍻

Related Videos