正在加载视频...

视频加载失败

I hooked Doom to a basic 187M param zero shot sequence classification model to do similar 10x+ faster by classifying in a single forward pass plays doom, but also works w other biz tasks too: - intent detection - prioritizing tasks - customer support routing - scoring - etc

41,281 次观看 • 1 个月前 •via X (Twitter)

23 条评论

Nathan Wilbanks 的头像
Nathan Wilbanks1 个月前

demo built by @agnt_gg try AGNT today 👇

Nicholas Bardy 的头像
Nicholas Bardy1 个月前

Nice, I was considering speed running "OpenJev". I feel like parallel sampling just got a good marketing run and this stuff has been possible the last 10 years

Nathan Wilbanks 的头像
Nathan Wilbanks1 个月前

100%, still so handy tho if you know the solutions before hand and are trying to optimize for speed and compute the "LLM shaped hammer" wastes a lot of resources for tasks better suited for classifiers and such

Nicholas Bardy 的头像
Nicholas Bardy1 个月前

I think it's smart to make a company around this and market it tbh. 99% of company building is about about spoonfeeding technology to people and teching them how to use it. I deployed something like this at a startup 3 years ago and considered building a product around it, but it just doesn't excited me much

Justus 的头像
Justus1 个月前

Would this not also work for a lot of robotics policies? Fun to think about.

Nathan Wilbanks 的头像
Nathan Wilbanks1 个月前

oh yes!! the inference speed is ~30ms to first token so it's incredibly fast and cheap to run

tokenbender 的头像
tokenbender1 个月前

much needed sane post.

IMRΛN 的头像
IMRΛN1 个月前

But does it have a cool name like Jev

Wes Winder 的头像
Wes Winder1 个月前

so you're saying it's better than jev?

Nathan Wilbanks 的头像
Nathan Wilbanks1 个月前

give me a benchmark and i'll show you an outcome - Charlie Munger, probably

Utkarsh Agrawal 的头像
Utkarsh Agrawal1 个月前

and I gave it access to a whole falcon-9 class rocket and it was able to launch and land itself as well

Ritwik 的头像
Ritwik1 个月前

The single-forward-pass framing is the key: it turns policy decisions into a cheap classifier call instead of a long generative loop. I would watch calibration drift as the task mix changes, since routing errors are harder to spot than missed Doom shots.

Mark James Francis 的头像
Mark James Francis1 个月前

This is so beyond my understanding, but it looks amazing, keep it up

Tech Friend AJ 的头像
Tech Friend AJ1 个月前

@NathanWilbanks_ @grok does this use vision , if so how?

paul 的头像
paul1 个月前

how do i even get started to try to make something like this?

Nathan Wilbanks 的头像
Nathan Wilbanks1 个月前

like a sandwich: small bites, one after the other - learn about perceptrons - start thinking about how to codify the states of things - once you have turned some state into a numerical representation, think about how you can loop through, reason over, and change that state

Sahibzada Allahyar 的头像
Sahibzada Allahyar1 个月前

GLiNER can do the same agentic decision making tasks to play video games like Jev while being local, free and open weights. it's so lightweight it'll run on a laptop.

Jerry Howell 的头像
Jerry Howell1 个月前

bart-mnli?

Nathan Wilbanks 的头像
Nathan Wilbanks1 个月前

it uses deBerta v3 as the encoder, with GLiClass's label scoring architecture and training on top:

lunarcavyheavyindustries 的头像
lunarcavyheavyindustries1 个月前

i found if you offer a few different move options (slight nudge left, veer left, etc.) the model will use them for more precise aim

Nathan Wilbanks 的头像
Nathan Wilbanks1 个月前

you could also stack instances of this model for different tasks one for aiming/shooting one for movement/dodge one for pathfinding etc

Althayr Santos 的头像
Althayr Santos1 个月前

That's what I was questioning myself. We do have GliNER as the mid point between high eng effort, small models and low eng effort, big models. Is the inference speed around the same?

Nathan Wilbanks 的头像
Nathan Wilbanks1 个月前

since its output is a decision matrix, not text like a llm, its inference speed is VERY fast. ~30ms to first token vs seconds for most LLMs to first token

相关视频