正在加载视频...
视频加载失败
Today, we're introducing GLM-5.2 Fast: our GLM-5.2 Model API designed for the most demanding real-time use cases. The Fast tier delivers 2-3x higher TPS than the standard GLM-5.2 MAPI.
115,626 次观看 • 3 个月前 •via X (Twitter)
25 条评论

More in our blog: Try it now:

This is insane 🔥

Not as fast as @sferenceai though 🙃

Is it the vision version?

this is awesome. Will you be supporting kimi k3 release this weekend?

Absolutely

what is in/out toks/sec?

so does "fast" mean faster tokens or faster latency

Does it have Zero Data Retention btw 👀

GLM-5.2 Fast API offers 2-3x higher transactions per second for real-time applications, enhancing performance for users. Congrats @baseten on #1 on Launch Archive today.

It's good, but... I hit this wall constantly... :(

총 3 x DGX Spark 로 실행하는거니? glm5.2 는 어떤 모델인가요

2-3x tps helps but p99 under bursty load decides real-time fit

Nice. Can you do the same with KimiK3?

🥳🥳🥳

Need

That's impressive, if it can maintain comparable performance //'GLM 5.2 Fast serves the same weights as standard GLM-5.2'

2-3x higher TPS is a big deal for anything running in real time.

amazing work

我需要“slow” api,只要不慢10倍就行,我可以用并行subagents来确保进度不被显著拖慢,只要成本能降下来就行

2-3x TPS improvement is significant, what tradeoffs did you make in accuracy or context retention?

Price ?

#glm fast is really helpful interns of speed

price?

Do that with k3 soon and you might just win
