Local Laya beat OpenAI's decision API 🕷 Four decision models raced down a web page ripping out links that name a spider and Laya running locally on an M5 Max took 34 ms a link so it checked 3x more than the cloud models Run decision models locally ->

@OpenAI The first spider for super excited to see its own name and smashed through it lol

@OpenAI Laya is actually good for its size

@OpenAI Local gutsy outperforms local laya, and is also free, open source, and just 500MB for CPU inference

@OpenAI

@OpenAI depends on the task

@OpenAI no network round trip per call, of course local takes it

@OpenAI kudo for the viz, wow

@OpenAI I‘m using laya for my Hermes Agent and it’s perfect

@OpenAI Decider-4B is better model than laya. Try using it.

@OpenAI small = fast

@OpenAI I wonder how DM-JEPA would do here

@OpenAI S-tier eval visualization 💎

@OpenAI Laya running locally is actually proving decision models can outpace cloud APIs on both speed and cost. We went deeper on this shift in how AI judgment is changing here:

@OpenAI i agree in my test laya also outperformed clef flash an CLM

@OpenAI You haven’t put lev to the test

@OpenAI I’ve achieved four hours of successful autonomous operation for Laya in my RimWorld colony without any input from me; all experiment logs are recorded in the repository, and I’m also planning to host a stream!

@OpenAI What about Mercury decide? Its the best!

@OpenAI Nightmare fuel

@OpenAI You've got me on my knees, Layla Begging darling please, Layla Darling, won't you ease my worried mind?

@OpenAI if local models can process links 3x faster, cloud solutions need to catch up

@OpenAI How did you do the animations?

@OpenAI But I tested yesterday and Laya didn't work so well 🫠

@OpenAI Nice marketing so cute

@OpenAI Did all four models pick the same links, or were there differences in what they missed?

@OpenAI I doubt it beats it on speed, Decisions API is pretty fast

@OpenAI how about something that scales as it fails. JEV fail-up across scales