Video wird geladen...

Video konnte nicht geladen werden

Beim Laden dieses Videos ist ein Problem aufgetreten. Dies könnte an einem vorübergehenden Netzwerkproblem liegen oder das Video ist möglicherweise nicht verfügbar.

We're proud to be the fastest inference provider on Artificial Analysis, OpenRouter, and Hugging Face for GLM-5.3-Flash, at 122+ TPS. All served from the US only, starting on day 0, with ZDR by default. Stay tuned for updates as our engineers continue to optimize GLM-5.3-Flash for even higher throughput... show more

Baseten

18,601 subscribers

21,391 Aufrufe • vor 2 Tagen •via X (Twitter)

Anya Rossi• Live Now

Private livecam show

0 Kommentare

Keine Kommentare verfügbar

Kommentare vom Original-Post werden hier angezeigt

Ähnliche Videos

Today, we're introducing GLM-5.2 Fast: our GLM-5.2 Model API designed for the most demanding real-time use cases. The Fast tier delivers 2-3x higher TPS than the standard GLM-5.2 MAPI.

Today, we're introducing GLM-5.2 Fast: our GLM-5.2 Model API designed for the most demanding real-time use cases. The Fast tier delivers 2-3x higher TPS than the standard GLM-5.2 MAPI.

Baseten

114,533 Aufrufe • vor 1 Monat

For even higher throughput and lower latency: batch generation + tensor parallel with mlx-lm + and mlx.distributed. Here it's generating at 63 tok/sec (throughput) with GLM 4.7 in 6-bit and batch size 4 on 4 M3 Ultras:

For even higher throughput and lower latency: batch generation + tensor parallel with mlx-lm + and mlx.distributed. Here it's generating at 63 tok/sec (throughput) with GLM 4.7 in 6-bit and batch size 4 on 4 M3 Ultras:

Awni Hannun

22,721 Aufrufe • vor 8 Monaten

GLM 4.6 fans! just soared to the top as the fastest provider in Artificial Analysis for the model. > a 114 TPS and <0.18s TTFT. > That's 2x faster than the next best option on both metrics. Available now in Cline.

GLM 4.6 fans! just soared to the top as the fastest provider in Artificial Analysis for the model. > a 114 TPS and <0.18s TTFT. > That's 2x faster than the next best option on both metrics. Available now in Cline.

Cline

31,584 Aufrufe • vor 10 Monaten

🚨 GLM 5.3 just dropped, and here’s how to access the GLM family completely FREE. no subscription. no API credit cost & no rate limit. step 1️⃣: download the OpenCode app on your PC. it’s available on both Mac and Windows. 🔗: step 2️⃣: go to NVIDIA’s website, sign up with your email, verify your account, and generate a unified API key for free. NVIDIA offers free model endpoints for developers, and GLM 5.2 is one of the top models currently available there. 🔗: step 3️⃣: launch OpenCode, open the model selection menu, search for NVIDIA, and paste the API key you generated. also, there’s no rate limit, but traffic to the model through NVIDIA can get busy at times, so responses may occasionally be slower or temporarily unavailable. the only catch: NVIDIA hasn’t listed GLM 5.3 yet, so for now you’ll be using GLM 5.2. once GLM 5.3 gets added to NVIDIA’s model catalog, you should be able to switch to it the same way.

🚨 GLM 5.3 just dropped, and here’s how to access the GLM family completely FREE. no subscription. no API credit cost & no rate limit. step 1️⃣: download the OpenCode app on your PC. it’s available on both Mac and Windows. 🔗: step 2️⃣: go to NVIDIA’s website, sign up with your email, verify your account, and generate a unified API key for free. NVIDIA offers free model endpoints for developers, and GLM 5.2 is one of the top models currently available there. 🔗: step 3️⃣: launch OpenCode, open the model selection menu, search for NVIDIA, and paste the API key you generated. also, there’s no rate limit, but traffic to the model through NVIDIA can get busy at times, so responses may occasionally be slower or temporarily unavailable. the only catch: NVIDIA hasn’t listed GLM 5.3 yet, so for now you’ll be using GLM 5.2. once GLM 5.3 gets added to NVIDIA’s model catalog, you should be able to switch to it the same way.

m0h

78,449 Aufrufe • vor 15 Tagen

🚀 Our "technical" marketer might not be looped in, but today is our biggest launch day yet. We're introducing two new products to serve the inference lifecycle: Model APIs and Training. Model APIs are frontier models running on the Baseten Inference Stack, purpose-built for production. Baseten Training (Beta) provides infra and tooling without limitations for AI models destined for production. Huge shoutout to the many partners and customers we've worked with as we built these two new products—more details below.

🚀 Our "technical" marketer might not be looped in, but today is our biggest launch day yet. We're introducing two new products to serve the inference lifecycle: Model APIs and Training. Model APIs are frontier models running on the Baseten Inference Stack, purpose-built for production. Baseten Training (Beta) provides infra and tooling without limitations for AI models destined for production. Huge shoutout to the many partners and customers we've worked with as we built these two new products—more details below.

Baseten

35,338 Aufrufe • vor 1 Jahr

I'm thrilled to announce the launch of ⚡️Flash Diffusion from Jasper! Earlier this year, with our acquisition of Clipdrop, we launched the Jasper AI Research Lab in Paris. Today, we are excited to release our first piece of groundbreaking research: the open-source distillation method, "Flash Diffusion". Flash Diffusion accelerates inference by 500%, reduces computing costs, and produces higher-quality image outputs. Dive into the details and discover how Flash Diffusion is set to revolutionize the field of AI and image synthesis. Read all about it here: Try a demo on Hugging Face:

I'm thrilled to announce the launch of ⚡️Flash Diffusion from Jasper! Earlier this year, with our acquisition of Clipdrop, we launched the Jasper AI Research Lab in Paris. Today, we are excited to release our first piece of groundbreaking research: the open-source distillation method, "Flash Diffusion". Flash Diffusion accelerates inference by 500%, reduces computing costs, and produces higher-quality image outputs. Dive into the details and discover how Flash Diffusion is set to revolutionize the field of AI and image synthesis. Read all about it here: Try a demo on Hugging Face:

Timothy Young

10,093 Aufrufe • vor 2 Jahren

ZAI is on fire. Z.ai Hot on the heels of GLM-4.6V, the team has dropped two more models on Hugging Face: - AutoGLM-Phone-9B: a 9-billion-parameter “foundation model for smartphones” that reads the screen and acts on your behalf. Small enough for on-device inference, big enough to feel like future. - GLM-ASR-Nano-2512: a pocket-sized (2B) speech-recognition powerhouse that beats Whisper v3 on English, Mandarin, and Cantonese - It even picks up your whisper. Grab them here: - AutoGLM-Phone-9B → - GLM-ASR-Nano-2512 →

ZAI is on fire. Z.ai Hot on the heels of GLM-4.6V, the team has dropped two more models on Hugging Face: - AutoGLM-Phone-9B: a 9-billion-parameter “foundation model for smartphones” that reads the screen and acts on your behalf. Small enough for on-device inference, big enough to feel like future. - GLM-ASR-Nano-2512: a pocket-sized (2B) speech-recognition powerhouse that beats Whisper v3 on English, Mandarin, and Cantonese - It even picks up your whisper. Grab them here: - AutoGLM-Phone-9B → - GLM-ASR-Nano-2512 →

Tiezhen WANG

45,514 Aufrufe • vor 8 Monaten

Serving GLM5.2 NVFP4 Agentic Workload with SGLang: How We Reached 500 TPS on 8xB300 at bs=1 In this deep dive, we explain how SGLang reaches 500+ tok/s/user at bs=1 on 8xB300, with 18 to 34% higher single-user interactivity within two weeks since day-0, and 6 to 11% better peak throughput at high concurrency, benchmarked on a real multi-turn agentic coding workload. Our new TopK-V2 kernel is 2.33x faster at 80K ISL, scaling to 10.17x at 1M ISL, keeping interactivity essentially flat out to 1M tokens. Part of the story is the architecture itself. GLM-5.2 applies IndexShare to its DSA layers and ships a stronger MTP head reusing IndexShare and KVShare. The rest comes from our serving optimizations. Special thanks to NVIDIA AI for the help in day-0 support of GLM-5.2 NVFP4, and to Z.ai for IndexShare in SGLang!

Serving GLM5.2 NVFP4 Agentic Workload with SGLang: How We Reached 500 TPS on 8xB300 at bs=1 In this deep dive, we explain how SGLang reaches 500+ tok/s/user at bs=1 on 8xB300, with 18 to 34% higher single-user interactivity within two weeks since day-0, and 6 to 11% better peak throughput at high concurrency, benchmarked on a real multi-turn agentic coding workload. Our new TopK-V2 kernel is 2.33x faster at 80K ISL, scaling to 10.17x at 1M ISL, keeping interactivity essentially flat out to 1M tokens. Part of the story is the architecture itself. GLM-5.2 applies IndexShare to its DSA layers and ships a stronger MTP head reusing IndexShare and KVShare. The rest comes from our serving optimizations. Special thanks to NVIDIA AI for the help in day-0 support of GLM-5.2 NVFP4, and to Z.ai for IndexShare in SGLang!

LMSYS Org

107,317 Aufrufe • vor 1 Monat

SITUATION EXPLAINED: A stealth model on OpenRouter is beating Fable and Sol on coding, and nobody knows who made it. • Ox Alpha has a 1M token context window, text, image, and video input, free for a week, with capacity for 100 trillion tokens a day • On a DeepSWE subset it hit 80%, against Fable's 65%, GLM-5.3's 62%, and Sol's 52% • The tokenizer is one-for-one identical to GLM's, and a live test asking whether Taiwan is part of China returned a nearly identical answer • This is the 5th anonymous drop in six months, and the previous four were all claimed by Chinese labs: Zhipu, Xiaomi, Ant, and Meituan Theo Jaffee: " There's no way it's a Flash model. If that's a Flash model, then holy shit, the entire United States is cooked. If that's a Flash model, we need to short the stock market now. Not financial advice."

SITUATION EXPLAINED: A stealth model on OpenRouter is beating Fable and Sol on coding, and nobody knows who made it. • Ox Alpha has a 1M token context window, text, image, and video input, free for a week, with capacity for 100 trillion tokens a day • On a DeepSWE subset it hit 80%, against Fable's 65%, GLM-5.3's 62%, and Sol's 52% • The tokenizer is one-for-one identical to GLM's, and a live test asking whether Taiwan is part of China returned a nearly identical answer • This is the 5th anonymous drop in six months, and the previous four were all claimed by Chinese labs: Zhipu, Xiaomi, Ant, and Meituan Theo Jaffee: " There's no way it's a Flash model. If that's a Flash model, then holy shit, the entire United States is cooked. If that's a Flash model, we need to short the stock market now. Not financial advice."

MTS

376,143 Aufrufe • vor 8 Tagen

I love using GLM 5.2 for web app iteration. My workflow: generate 6 variations, then pick the best one and continue iterating on it. I built Recast to make this even easier. Give it a prompt, get 6 variations, download the code for your favorite version, then continue iterating in your own coding agent. GLM 5.2 works really well for this use case since it's fast, cheap, and great at design. On average, you can make 3-6 landing pages with GLM 5.2 for every one you can generate with Opus 4.8. And the design variety of the GLM landing pages helps a lot with trying to think through what style you want to go with. Recast is launching soon (as a web app + skill).

I love using GLM 5.2 for web app iteration. My workflow: generate 6 variations, then pick the best one and continue iterating on it. I built Recast to make this even easier. Give it a prompt, get 6 variations, download the code for your favorite version, then continue iterating in your own coding agent. GLM 5.2 works really well for this use case since it's fast, cheap, and great at design. On average, you can make 3-6 landing pages with GLM 5.2 for every one you can generate with Opus 4.8. And the design variety of the GLM landing pages helps a lot with trying to think through what style you want to go with. Recast is launching soon (as a web app + skill).

Hassan

20,164 Aufrufe • vor 2 Monaten

Just launched #CES2026, the new open-source NVIDIA Nemotron Speech ASR model is here to solve latency drift and redundant compute. Its cache-aware streaming architecture eliminates the need for buffered inference, giving you stable, sub-100ms latency (24ms median T-T-F) and up to 3x more throughput on your GPU. 🤗 Read the technical blog with real-world results from Daily and Modal on Hugging Face:

Just launched #CES2026, the new open-source NVIDIA Nemotron Speech ASR model is here to solve latency drift and redundant compute. Its cache-aware streaming architecture eliminates the need for buffered inference, giving you stable, sub-100ms latency (24ms median T-T-F) and up to 3x more throughput on your GPU. 🤗 Read the technical blog with real-world results from Daily and Modal on Hugging Face:

NVIDIA AI Developer

138,518 Aufrufe • vor 7 Monaten

┣¨┣¨┣¨┣¨┣¨ We're thrilled to announce our collaboration with PROFILES! Together, we'll be co-creating exclusive new apparel items for the premium packs. Stay tuned for sneak peeks and updates! ⦿⦿⦿

┣¨┣¨┣¨┣¨┣¨ We're thrilled to announce our collaboration with PROFILES! Together, we'll be co-creating exclusive new apparel items for the premium packs. Stay tuned for sneak peeks and updates! ⦿⦿⦿

BŌSŌ TOKYO -暴走東京-

12,495 Aufrufe • vor 2 Jahren

GMI Cloud and Z.ai are bringing fast inference + frontier models around the globe. First stop: Singapore. Big congrats to all the builders at the GMI x Z.ai Agent Hackathon in 🇸🇬 100+ on-site, 16 teams shipped projects and battled it out for the top prizes with GLM 5.1, including $1500 for the grand winner. Proud to support all the builders with team! Keep building 💪

GMI Cloud and Z.ai are bringing fast inference + frontier models around the globe. First stop: Singapore. Big congrats to all the builders at the GMI x Z.ai Agent Hackathon in 🇸🇬 100+ on-site, 16 teams shipped projects and battled it out for the top prizes with GLM 5.1, including $1500 for the grand winner. Proud to support all the builders with team! Keep building 💪

GMI Cloud

13,726 Aufrufe • vor 4 Monaten

Kansas City is welcoming the world with heart, and a few familiar faces 😏 We're ready! Join us at KC Live! for the Final Draw watch party and stay tuned for updates on the road to 2026 ❤️⚽ #FIFAWorldCup #WeAreKansasCity #WeAre26

Kansas City is welcoming the world with heart, and a few familiar faces 😏 We're ready! Join us at KC Live! for the Final Draw watch party and stay tuned for updates on the road to 2026 ❤️⚽ #FIFAWorldCup #WeAreKansasCity #WeAre26

FIFA World Cup 26 Kansas City

10,976 Aufrufe • vor 8 Monaten

On our way to Turkey to join the Gaza Freedom Flotilla, sailing with desperately needed food and medicine. Stay tuned for updates as we try to break the siege of Gaza!

On our way to Turkey to join the Gaza Freedom Flotilla, sailing with desperately needed food and medicine. Stay tuned for updates as we try to break the siege of Gaza!

Medea Benjamin

296,181 Aufrufe • vor 2 Jahren

Timelapse #156 (36 hrs) - Worked with the tiny corp on getting GLM 5.2 running on 8xMI300X (sglang won here) - Launched KernelBench-Mega and updated Kernelbench-Hard with h100 and b200 sweeps - Took care of boring business stuff - Did some training sweeps for specialized technical vocab audio model - Some bugs with putting kernelbench-mega and hard on cloud instances so had to do some reruns. Learned a lot though - Setting up my own local rl infra and profiling concurrency 128 rollouts with vllm. Became clear to me that I need to serve in nvfp4, use MoE only for throughput, reap so training doesn’t OOM, dig into the vllm kernel graph itself to not underutilize my hardware from poor flashinfer/cutlass selections for my rtx pro 6000 sm120 architecture - Might do online distillation from glm 5.2 but for now taking it one step at a time - Slept for a bit then woke up and showered - Fixed an issue with SGLang tensor parallel deadlock on GLM 5.2 architecture with MTP enabled - GLM 5.2 inference is 2-3x faster than coding plans and running on amd boxes - Spent time with family - Hung out with some friends - Recorded some yoctogpt lectures with the revamped notebook (high taste btw) - Setting up dflash training for GLM 5.2

Timelapse #156 (36 hrs) - Worked with the tiny corp on getting GLM 5.2 running on 8xMI300X (sglang won here) - Launched KernelBench-Mega and updated Kernelbench-Hard with h100 and b200 sweeps - Took care of boring business stuff - Did some training sweeps for specialized technical vocab audio model - Some bugs with putting kernelbench-mega and hard on cloud instances so had to do some reruns. Learned a lot though - Setting up my own local rl infra and profiling concurrency 128 rollouts with vllm. Became clear to me that I need to serve in nvfp4, use MoE only for throughput, reap so training doesn’t OOM, dig into the vllm kernel graph itself to not underutilize my hardware from poor flashinfer/cutlass selections for my rtx pro 6000 sm120 architecture - Might do online distillation from glm 5.2 but for now taking it one step at a time - Slept for a bit then woke up and showered - Fixed an issue with SGLang tensor parallel deadlock on GLM 5.2 architecture with MTP enabled - GLM 5.2 inference is 2-3x faster than coding plans and running on amd boxes - Spent time with family - Hung out with some friends - Recorded some yoctogpt lectures with the revamped notebook (high taste btw) - Setting up dflash training for GLM 5.2

Elliot Arledge

45,447 Aufrufe • vor 2 Monaten

Gemini 3.5 Flash is a step forward for Google on speed and agentic capabilities but comes at a trade-off of being higher cost than prior models We have measured up to ~280 output tokens/sec, placing it on the speed/intelligence Pareto frontier and well ahead of Gemini 3 Flash. It also shows a major uplift on agentic tasks, reaching ~1650 ELO on GDPVal-AA. The trade-off: cost is up ~5x versus Gemini 3 Flash, driven by higher token prices (3x higher than Gemini 3 Flash) and higher token usage. In this video, Declan Jackson, Member of Technical Staff at Artificial Analysis, breaks it down.

Gemini 3.5 Flash is a step forward for Google on speed and agentic capabilities but comes at a trade-off of being higher cost than prior models We have measured up to ~280 output tokens/sec, placing it on the speed/intelligence Pareto frontier and well ahead of Gemini 3 Flash. It also shows a major uplift on agentic tasks, reaching ~1650 ELO on GDPVal-AA. The trade-off: cost is up ~5x versus Gemini 3 Flash, driven by higher token prices (3x higher than Gemini 3 Flash) and higher token usage. In this video, Declan Jackson, Member of Technical Staff at Artificial Analysis, breaks it down.

Artificial Analysis

16,055 Aufrufe • vor 3 Monaten

Today and every day, we're grateful for the bravery, sacrifice, and resilience of our veterans. On Veterans Day, we honor and support those who have served and continue to stand strong for our freedoms. Thank you to our veterans and their families for your service and dedication to our great nation.

Today and every day, we're grateful for the bravery, sacrifice, and resilience of our veterans. On Veterans Day, we honor and support those who have served and continue to stand strong for our freedoms. Thank you to our veterans and their families for your service and dedication to our great nation.

Governor Gavin Newsom

114,357 Aufrufe • vor 2 Jahren

Today, we honor the brave men and women who have served our country and continue to fight for our freedom. I’m proud to share Travelin’ Soldier (From The Stage), out now on YouTube.

Today, we honor the brave men and women who have served our country and continue to fight for our freedom. I’m proud to share Travelin’ Soldier (From The Stage), out now on YouTube.

Cody Johnson

20,439 Aufrufe • vor 9 Monaten