Video yükleniyor...

Video Yüklenemedi

Ana Sayfaya Dön

I hooked Doom to a basic 187M param zero shot sequence classification model to do similar 10x+ faster by classifying in a single forward pass plays doom, but also works w other biz tasks too: - intent detection - prioritizing tasks - customer support routing - scoring - etc

41,281 görüntüleme • 1 ay önce •via X (Twitter)

23 Yorum

Nathan Wilbanks profil fotoğrafı
Nathan Wilbanks1 ay önce

demo built by @agnt_gg try AGNT today 👇

Nicholas Bardy profil fotoğrafı
Nicholas Bardy1 ay önce

Nice, I was considering speed running "OpenJev". I feel like parallel sampling just got a good marketing run and this stuff has been possible the last 10 years

Nathan Wilbanks profil fotoğrafı
Nathan Wilbanks1 ay önce

100%, still so handy tho if you know the solutions before hand and are trying to optimize for speed and compute the "LLM shaped hammer" wastes a lot of resources for tasks better suited for classifiers and such

Nicholas Bardy profil fotoğrafı
Nicholas Bardy1 ay önce

I think it's smart to make a company around this and market it tbh. 99% of company building is about about spoonfeeding technology to people and teching them how to use it. I deployed something like this at a startup 3 years ago and considered building a product around it, but it just doesn't excited me much

Justus profil fotoğrafı
Justus1 ay önce

Would this not also work for a lot of robotics policies? Fun to think about.

Nathan Wilbanks profil fotoğrafı
Nathan Wilbanks1 ay önce

oh yes!! the inference speed is ~30ms to first token so it's incredibly fast and cheap to run

tokenbender profil fotoğrafı
tokenbender1 ay önce

much needed sane post.

IMRΛN profil fotoğrafı
IMRΛN1 ay önce

But does it have a cool name like Jev

Wes Winder profil fotoğrafı
Wes Winder1 ay önce

so you're saying it's better than jev?

Nathan Wilbanks profil fotoğrafı
Nathan Wilbanks1 ay önce

give me a benchmark and i'll show you an outcome - Charlie Munger, probably

Utkarsh Agrawal profil fotoğrafı
Utkarsh Agrawal1 ay önce

and I gave it access to a whole falcon-9 class rocket and it was able to launch and land itself as well

Ritwik profil fotoğrafı
Ritwik1 ay önce

The single-forward-pass framing is the key: it turns policy decisions into a cheap classifier call instead of a long generative loop. I would watch calibration drift as the task mix changes, since routing errors are harder to spot than missed Doom shots.

Mark James Francis profil fotoğrafı
Mark James Francis1 ay önce

This is so beyond my understanding, but it looks amazing, keep it up

Tech Friend AJ profil fotoğrafı
Tech Friend AJ1 ay önce

@NathanWilbanks_ @grok does this use vision , if so how?

paul profil fotoğrafı
paul1 ay önce

how do i even get started to try to make something like this?

Nathan Wilbanks profil fotoğrafı
Nathan Wilbanks1 ay önce

like a sandwich: small bites, one after the other - learn about perceptrons - start thinking about how to codify the states of things - once you have turned some state into a numerical representation, think about how you can loop through, reason over, and change that state

Sahibzada Allahyar profil fotoğrafı
Sahibzada Allahyar1 ay önce

GLiNER can do the same agentic decision making tasks to play video games like Jev while being local, free and open weights. it's so lightweight it'll run on a laptop.

Jerry Howell profil fotoğrafı
Jerry Howell1 ay önce

bart-mnli?

Nathan Wilbanks profil fotoğrafı
Nathan Wilbanks1 ay önce

it uses deBerta v3 as the encoder, with GLiClass's label scoring architecture and training on top:

lunarcavyheavyindustries profil fotoğrafı
lunarcavyheavyindustries1 ay önce

i found if you offer a few different move options (slight nudge left, veer left, etc.) the model will use them for more precise aim

Nathan Wilbanks profil fotoğrafı
Nathan Wilbanks1 ay önce

you could also stack instances of this model for different tasks one for aiming/shooting one for movement/dodge one for pathfinding etc

Althayr Santos profil fotoğrafı
Althayr Santos1 ay önce

That's what I was questioning myself. We do have GliNER as the mid point between high eng effort, small models and low eng effort, big models. Is the inference speed around the same?

Nathan Wilbanks profil fotoğrafı
Nathan Wilbanks1 ay önce

since its output is a decision matrix, not text like a llm, its inference speed is VERY fast. ~30ms to first token vs seconds for most LLMs to first token

Benzer Videolar