Loading video...
Video Failed to Load
While we eagerly await Fable 5's return, our agentic WebGPU kernel optimization framework kept running. Opus 4.8 picked up where Fable left off, pushing Liquid AI's new LFM2.5 230M to an unbelievable 1,400 tok/s... running locally in your browser. Don't blink or you'll miss it.
175,295 views • 3 months ago •via X (Twitter)
35 Comments

How many tok/s do you get on your hardware? Try it out yourself! 👇

incredible to see you still cooking

Can’t stop, won’t stop. 🧑🍳

That is the dumbest model I've seen in my entire life. Every single test, no matter how trivial I gave it, it failed miserably. Basically a random text generator that loosely abides to English grammar rules. This is on a fully maxed out MacBook Pro M5... Am I doing something wrong? It said 1+2=2 and that a bagel is a type of raw pizza.

Fuck yeah! Right there with you. DM so we can share noted

so sick

Thanks Jared! 🤗

I got ~300 tok/s on my iPhone 16 Pro ⚡️ Really curious how the agentic WebGPU kernel optimization framework is pulling that off. What specific optimizations did Claude come up with? Did you use /goal or a different loop setup?

Have you tried with Gemini 3.5 pro too?

Gemini 3.5 Pro isn’t out yet (at least, for the public), but I’d love to try when it is!

Whoops my bad 😅 I know we announced it but i forgot when you all will get it. Yes do let me know how to fairs. PS are you doing continuous itteration here, or one session at a time, when you ask to optimise more each time? Do you give suggestions or completely open?

fantastic work boys

M2 Mac - 250tok/sec

1400 tok/s in browser? That's wild. Fable 5 who?

LOL! Awesome

Awesome! is this open source?

It's fast yes, but how the practical max context length compares to running the same model natively on CUDA/Metal. Is it mostly limited by available VRAM/KV cache like native inference, or do WebGPU/browser buffer allocation limits cap it earlier?

I’ve been playing with this! Nice work. 😎

my chrome is sweating just looking at this

I was able to download it in less than 30 seconds. It's fast, but it's only worth it for conversions.

1 400 tok/s in a browser is wild cant wait to try it

This is the part worth watching: eagerly, await and fable. The edge is less in spotting the trend once and more in turning it into a repeatable advantage.

trasnformers.js?

1,400 tok/s running locally in the browser is the kind of number that actually makes on device AI feel viable.

@ClementDelangue The interesting part isn’t Opus picking it up; it’s that kernel optimization is now a continual loop, not a one-off pass. That shifts perf ownership from a lone specialist to model + compiler + runtime.

Não parece certo

Wtf? Is a good work, I love this shit!

@xenovacom awesome stuff. How can a developer start embedding these models with the custom kernels in their web-apps? Is there some sample code to refer to?

waiting for Gemma 4 24B on WebGPU so we can max out our macbooks!

Are ya gonna check out that new Ornith model series?

Wooow I need to try this and all your other models

This is insane

so i run 30b dense models at 40-60tk/s and this runs at 20 :D

This is absolutely incredible.. 1,400 tok/s locally in the browser is mind-blowing. Amazing work!

Some devices are not powerful enough to run mobile animations; to make it more accessible, we would leave a normal chat as it is currently known.
