Loading video...
Video Failed to Load
Ollama now supports Jev-like decision models all locally. Use decision models like Nimble for tasks like ticket triaging, model routing, and content moderation. ollama pull nimble Here’s Nimble playing Ollama racer through the new local /v1/systemone API by making decisions in real-time. 🏎️
663,502 views • 14 days ago •via X (Twitter)
17 Comments

3 models are now available on Ollama for use with /v1/systemone: • Nimble: • Tev1 4b: • Tev1 0.8b:

Blog: Decision capability docs: API Docs:

@madiator

@bespokelabsai @madiator Dammnnn this is so cool

@bespokelabsai @madiator ❤️

@bespokelabsai @madiator Please give us jev for Cloud Subscription users ❤️

@bespokelabsai @madiator Local decision models for routing and triage feel like the missing piece next to chat-only setups.

@bespokelabsai @madiator nyooooooooom

@bespokelabsai @madiator Cool 😎

@bespokelabsai @madiator Fun racer. We built the opposite: in mlx-optiq (ours) `optiq game` runs a 131M world model on a Mac that generates every frame of a kart race from your key presses. No engine underneath, you drive the model.

@bespokelabsai @madiator Model routing is the weakest case here. Local models each run separate KV cache processes, so you still pay cold-start cost on every routed call. Ticket triaging and content moderation are the real wins.

@bespokelabsai @madiator Seeing Nimble run locally with Ollama could cut latency for real-time routing and moderation. How does the /v1/systemone API handle updates and rollback during live decision sessions?

@bespokelabsai @madiator can someone ELI5? should i be running a tiny model locally to make routing decisions and pass them off to claude code/codex?

@bespokelabsai @madiator What do you mean—has JEV released its weights?

@bespokelabsai @madiator the routing layer just became something you pull instead of something you rent. local triage with no per-row api bill changes what people will bother automating

@bespokelabsai @madiator Can you please add in cloud also, will be very thankful, as it will save RAM

@bespokelabsai @madiator Nimble 这类决策走本地 /v1/systemone 时,路由日志和审核结果是只落本机,还是还会回你们云端?有没有单独鉴权
