Loading video...

Video Failed to Load

Go Home

Introducing GLM-5V-Turbo: Vision Coding Model - Native Multimodal Coding: Natively understands multimodal inputs including images, videos, design drafts, and document layouts. - Balanced Visual and Programming Capabilities: Achieves leading performance across core benchmarks for multimodal coding, tool use, and GUI Agents. - Deep Adaptation for Claude Code and Claw...

1,970,275 views • 6 months ago •via X (Twitter)

39 Comments

Z.ai's profile picture
Z.ai6 months ago

The model can understand design drafts, screenshots, and web interfaces to generate complete, runnable code, truly achieving the goal of "seeing the screen and writing the code."

Z.ai's profile picture
Z.ai6 months ago

GLM-5V-Turbo leads in benchmarks for design draft reconstruction, visual code generation, multimodal retrieval and QA, and visual exploration. It also performs exceptionally well on AndroidWorld and WebVoyager, which measure control capabilities in real GUI environments.

Z.ai's profile picture
Z.ai6 months ago

Regarding pure-text coding, GLM-5V-Turbo maintains stable performance across three core benchmarks of CC-Bench-V2 (Backend, Frontend, and Repo Exploration), proving that the introduction of visual capabilities does not degrade text-based reasoning.

Z.ai's profile picture
Z.ai6 months ago

The leading performance of GLM-5V-Turbo stems from systematic upgrades across four levels: Native Multimodal Fusion: Deep fusion of text and vision begins at pre-training, with multimodal collaborative optimization during post-training. We developed the next-generation CogViT visual encoder, reaching SOTA in general object recognition, fine-grained understanding, and geometric/spatial perception. We also designed an inference-friendly MTP structure to ensure high efficiency. 30+ Task Collaborative RL: The RL stage optimizes over 30 task types simultaneously, covering STEM, grounding, video, and GUI Agents. This improves perception and reasoning while mitigating the instability often found in single-domain training. Agentic Data and Task Construction: To solve the challenge of scarce Agent data, we built a multi-level system ranging from element perception to sequence-level action prediction. We use synthetic environments to generate verifiable training data and inject "Agentic Meta-capabilities" during pre-training (e.g., adding GUI Agent PRM data to reduce hallucinations). Multimodal Toolchain Extension: Beyond text tools, the model supports multimodal search, drawing, and web reading. This expands the perception-action loop into visual interaction. Synergies with Claude Code and OpenClaw are enhanced to support full-loop task execution.

EdDiboi's profile picture
EdDiboi6 months ago

Will it be open sourced?

Ahmad's profile picture
Ahmad6 months ago

Weights wen?

Calimanu Loredan's profile picture
Calimanu Loredan6 months ago

Guys, I agree it’s nice but where is the finesse on the design ? Does this page on an iPhone 13Pro max look good to you? :(

Sheeki's profile picture
Sheeki6 months ago

sus

AVB's profile picture
AVB6 months ago

My Claude code sub about to end… and I don’t think I’ll be resubscribing to ask my 2 questions/day. Not after THIS exists

Metabolic Uncle's profile picture
Metabolic Uncle6 months ago

GLM 5.1 in my own agent harness runs circles around Opus 4.6 in Antigravity. I literally also built my own coding cli the day Anthropic reduced the quota in Antigravity to hilarious 4 complex coding tasks… for Ultra users that is. The Zai Max Plan is currently by far the best offer for everything coding or agent related. The new models are incredible!

tonbi's profile picture
tonbi6 months ago

I tested some of the multimodel functions in hermes agent! I was really impressed at how well it read from screenshots, handwriting, and messy charts. Fast too! Check out the results in this quick video:

Chris's profile picture
Chris6 months ago

Can’t wait to try it 💥

mrkelly's profile picture
mrkelly6 months ago

I learned the hard way that generating code from a mockup is never the actual bottleneck.

Farhanism's profile picture
Farhanism6 months ago

seems like knowledge cut off 2019🤣🤣🤣

alkimiadev's profile picture
alkimiadev6 months ago

Its sad to see Zai go so far down hill so fast. Its like after you went public you decided to join the Dr Evil AI lab crowd like Anthropic and OAI. First you served a broken model to your users for WEEKS and then you went back on your oss mission and aren't releasing that model

Sergei Vecherenko's profile picture
Sergei Vecherenko6 months ago

@grok GLM-5.1 vs GLM-5V-turbo for real coding, who is better and faster?

Zaid's profile picture
Zaid6 months ago

really cool!

Dennis Rongo's profile picture
Dennis Rongo6 months ago

Except that it's not available on pro accounts 😞.

Z.ai's profile picture
Z.ai6 months ago

It is now available! Give it a try❤️

Dennis Rongo's profile picture
Dennis Rongo6 months ago

this is what I see inside OpenCode.

Julien Blanchon 🇺🇦's profile picture
Julien Blanchon 🇺🇦6 months ago

Please open source it !

robotshelp's profile picture
robotshelp6 months ago

The multimodal coding approach is huge - being able to parse UI mockups and generate code directly from visual inputs cuts development time dramatically. This is where vision models really shine.

Anand C. Patel, MD MS's profile picture
Anand C. Patel, MD MS6 months ago

Source? Weights? 🙏🏽

Melvin Vivas's profile picture
Melvin Vivas6 months ago

so does this mean we dont need MCP for image anymore?

RealAIzation's profile picture
RealAIzation6 months ago

Hopefully! This model is good at SVG

Nour Eddine Hamaidi's profile picture
Nour Eddine Hamaidi6 months ago

This will rock with Hermes @Teknium

testtm's profile picture
testtm6 months ago

i hope its not april fools joke >.<

David Zhang's profile picture
David Zhang6 months ago

Can't wait to use this as my project manager in CAR

Codve.ai's profile picture
Codve.ai6 months ago

finally someone tackling multimodal coding properly. the visual understanding piece has been the missing link for agentic dev

Theo Borges's profile picture
Theo Borges6 months ago

How much better is 5.1 for non-visual tasks?

kiyoshi ?¿'s profile picture
kiyoshi ?¿6 months ago

fuck im hard

Tugser Okur's profile picture
Tugser Okur6 months ago

Wow

黄月英's profile picture
黄月英6 months ago

@grok Should I replace GLM-5.1 with GLM-5V-Turbo?

Onions in Taiwan 🧅 (Formerly Condemner) 𓅃𓅊's profile picture
Onions in Taiwan 🧅 (Formerly Condemner) 𓅃𓅊6 months ago

@SookieWinehouse

Abu Bakar Siddik's profile picture
Abu Bakar Siddik6 months ago

Fix the GLM-5.1 inference server, first guys!

Will Faust's profile picture
Will Faust6 months ago

@n1d_all open weight wen

Abhishek Ekaanth's profile picture
Abhishek Ekaanth6 months ago

Buying 1 year subscription with new year discount was a beast deal.

Daniel Mulec's profile picture
Daniel Mulec6 months ago

"Deep Adaptation for Claude Code and Claw Scenarios: Works in deep synergy with Agents like Claude Code and OpenClaw." What are the precise OpenClaw examples? All I want is for Chinese LLMs to be on par with GPT 5.2 and Opus 4.5 as personal assistants, yet they still come short

T.Rex-Baby's profile picture
T.Rex-Baby6 months ago

Would you use Chinese models, now that they have all switched to closed source?

Related Videos

Claude Code is a major (and accidental!) hit for Anthropic that surprised even its creator, Boris Cherny. Claude Code, an Agentic AI coding product that lives in the terminal. Most of the new code at Anthropic is created through it today. And in the last 5 months since it was launched publicly, Claude Code went from $0 to $400M in revenue run rate (as per The Information). 00:00 – Intro 01:15 – Did You Expect Claude Code’s Success? 04:22 – How Claude Code Works and Origins 08:05 – Command Line vs IDE: Why Start Claude Code in the Terminal? 11:31 – The Evolution of Programming: From Punch Cards to Agents 13:20 – Product Follows Model: Simple Interfaces and Fast Evolution 15:17 – Who Is Claude Code For? (Engineers, Designers, PMs & More) 17:46 – What Can Claude Code Actually Do? (Actions & Capabilities) 21:14 – Agentic Actions, Subagents, and Workflows 25:30 – Claude Code’s Awareness, Memory, and Knowledge Sharing 33:28 – Model Context Protocol (MCP) and Customization 35:30 – Safety, Human Oversight, and Enterprise Considerations 38:10 – UX/UI: Making Claude Code Useful and Enjoyable 40:44 – Pricing for Power Users and Subscription Models 43:36 – Real-World Use Cases: Debugging, Testing, and More 46:44 – How Does Claude Code Transform Onboarding? 49:36 – The Future of Coding: Agents, Teams, and Collaboration 54:11 – The AI Coding Wars: Competition & Ecosystem 57:27 – The Future of Coding as a Profession 58:41 – What’s Next for Claude Code

Matt Turck

82,372 views • 1 year ago