正在加载视频...

视频加载失败

Introducing GLM-5V-Turbo: Vision Coding Model - Native Multimodal Coding: Natively understands multimodal inputs including images, videos, design drafts, and document layouts. - Balanced Visual and Programming Capabilities: Achieves leading performance across core benchmarks for multimodal coding, tool use, and GUI Agents. - Deep Adaptation for Claude Code and Claw...

1,970,275 次观看 • 6 个月前 •via X (Twitter)

39 条评论

Z.ai 的头像
Z.ai6 个月前

The model can understand design drafts, screenshots, and web interfaces to generate complete, runnable code, truly achieving the goal of "seeing the screen and writing the code."

Z.ai 的头像
Z.ai6 个月前

GLM-5V-Turbo leads in benchmarks for design draft reconstruction, visual code generation, multimodal retrieval and QA, and visual exploration. It also performs exceptionally well on AndroidWorld and WebVoyager, which measure control capabilities in real GUI environments.

Z.ai 的头像
Z.ai6 个月前

Regarding pure-text coding, GLM-5V-Turbo maintains stable performance across three core benchmarks of CC-Bench-V2 (Backend, Frontend, and Repo Exploration), proving that the introduction of visual capabilities does not degrade text-based reasoning.

Z.ai 的头像
Z.ai6 个月前

The leading performance of GLM-5V-Turbo stems from systematic upgrades across four levels: Native Multimodal Fusion: Deep fusion of text and vision begins at pre-training, with multimodal collaborative optimization during post-training. We developed the next-generation CogViT visual encoder, reaching SOTA in general object recognition, fine-grained understanding, and geometric/spatial perception. We also designed an inference-friendly MTP structure to ensure high efficiency. 30+ Task Collaborative RL: The RL stage optimizes over 30 task types simultaneously, covering STEM, grounding, video, and GUI Agents. This improves perception and reasoning while mitigating the instability often found in single-domain training. Agentic Data and Task Construction: To solve the challenge of scarce Agent data, we built a multi-level system ranging from element perception to sequence-level action prediction. We use synthetic environments to generate verifiable training data and inject "Agentic Meta-capabilities" during pre-training (e.g., adding GUI Agent PRM data to reduce hallucinations). Multimodal Toolchain Extension: Beyond text tools, the model supports multimodal search, drawing, and web reading. This expands the perception-action loop into visual interaction. Synergies with Claude Code and OpenClaw are enhanced to support full-loop task execution.

EdDiboi 的头像
EdDiboi6 个月前

Will it be open sourced?

Ahmad 的头像
Ahmad6 个月前

Weights wen?

Calimanu Loredan 的头像
Calimanu Loredan6 个月前

Guys, I agree it’s nice but where is the finesse on the design ? Does this page on an iPhone 13Pro max look good to you? :(

Sheeki 的头像
Sheeki6 个月前

sus

AVB 的头像
AVB6 个月前

My Claude code sub about to end… and I don’t think I’ll be resubscribing to ask my 2 questions/day. Not after THIS exists

Metabolic Uncle 的头像
Metabolic Uncle6 个月前

GLM 5.1 in my own agent harness runs circles around Opus 4.6 in Antigravity. I literally also built my own coding cli the day Anthropic reduced the quota in Antigravity to hilarious 4 complex coding tasks… for Ultra users that is. The Zai Max Plan is currently by far the best offer for everything coding or agent related. The new models are incredible!

tonbi 的头像
tonbi6 个月前

I tested some of the multimodel functions in hermes agent! I was really impressed at how well it read from screenshots, handwriting, and messy charts. Fast too! Check out the results in this quick video:

Chris 的头像
Chris6 个月前

Can’t wait to try it 💥

mrkelly 的头像
mrkelly6 个月前

I learned the hard way that generating code from a mockup is never the actual bottleneck.

Farhanism 的头像
Farhanism6 个月前

seems like knowledge cut off 2019🤣🤣🤣

alkimiadev 的头像
alkimiadev6 个月前

Its sad to see Zai go so far down hill so fast. Its like after you went public you decided to join the Dr Evil AI lab crowd like Anthropic and OAI. First you served a broken model to your users for WEEKS and then you went back on your oss mission and aren't releasing that model

Sergei Vecherenko 的头像
Sergei Vecherenko6 个月前

@grok GLM-5.1 vs GLM-5V-turbo for real coding, who is better and faster?

Zaid 的头像
Zaid6 个月前

really cool!

Dennis Rongo 的头像
Dennis Rongo6 个月前

Except that it's not available on pro accounts 😞.

Z.ai 的头像
Z.ai6 个月前

It is now available! Give it a try❤️

Dennis Rongo 的头像
Dennis Rongo6 个月前

this is what I see inside OpenCode.

Julien Blanchon 🇺🇦 的头像
Julien Blanchon 🇺🇦6 个月前

Please open source it !

robotshelp 的头像
robotshelp6 个月前

The multimodal coding approach is huge - being able to parse UI mockups and generate code directly from visual inputs cuts development time dramatically. This is where vision models really shine.

Anand C. Patel, MD MS 的头像
Anand C. Patel, MD MS6 个月前

Source? Weights? 🙏🏽

Melvin Vivas 的头像
Melvin Vivas6 个月前

so does this mean we dont need MCP for image anymore?

RealAIzation 的头像
RealAIzation6 个月前

Hopefully! This model is good at SVG

Nour Eddine Hamaidi 的头像
Nour Eddine Hamaidi6 个月前

This will rock with Hermes @Teknium

testtm 的头像
testtm6 个月前

i hope its not april fools joke >.<

David Zhang 的头像
David Zhang6 个月前

Can't wait to use this as my project manager in CAR

Codve.ai 的头像
Codve.ai6 个月前

finally someone tackling multimodal coding properly. the visual understanding piece has been the missing link for agentic dev

Theo Borges 的头像
Theo Borges6 个月前

How much better is 5.1 for non-visual tasks?

kiyoshi ?¿ 的头像
kiyoshi ?¿6 个月前

fuck im hard

Tugser Okur 的头像
Tugser Okur6 个月前

Wow

黄月英 的头像
黄月英6 个月前

@grok Should I replace GLM-5.1 with GLM-5V-Turbo?

Onions in Taiwan 🧅 (Formerly Condemner) 𓅃𓅊 的头像
Onions in Taiwan 🧅 (Formerly Condemner) 𓅃𓅊6 个月前

@SookieWinehouse

Abu Bakar Siddik 的头像
Abu Bakar Siddik6 个月前

Fix the GLM-5.1 inference server, first guys!

Will Faust 的头像
Will Faust6 个月前

@n1d_all open weight wen

Abhishek Ekaanth 的头像
Abhishek Ekaanth6 个月前

Buying 1 year subscription with new year discount was a beast deal.

Daniel Mulec 的头像
Daniel Mulec6 个月前

"Deep Adaptation for Claude Code and Claw Scenarios: Works in deep synergy with Agents like Claude Code and OpenClaw." What are the precise OpenClaw examples? All I want is for Chinese LLMs to be on par with GPT 5.2 and Opus 4.5 as personal assistants, yet they still come short

T.Rex-Baby 的头像
T.Rex-Baby6 个月前

Would you use Chinese models, now that they have all switched to closed source?

相关视频

Claude Code is a major (and accidental!) hit for Anthropic that surprised even its creator, Boris Cherny. Claude Code, an Agentic AI coding product that lives in the terminal. Most of the new code at Anthropic is created through it today. And in the last 5 months since it was launched publicly, Claude Code went from $0 to $400M in revenue run rate (as per The Information). 00:00 – Intro 01:15 – Did You Expect Claude Code’s Success? 04:22 – How Claude Code Works and Origins 08:05 – Command Line vs IDE: Why Start Claude Code in the Terminal? 11:31 – The Evolution of Programming: From Punch Cards to Agents 13:20 – Product Follows Model: Simple Interfaces and Fast Evolution 15:17 – Who Is Claude Code For? (Engineers, Designers, PMs & More) 17:46 – What Can Claude Code Actually Do? (Actions & Capabilities) 21:14 – Agentic Actions, Subagents, and Workflows 25:30 – Claude Code’s Awareness, Memory, and Knowledge Sharing 33:28 – Model Context Protocol (MCP) and Customization 35:30 – Safety, Human Oversight, and Enterprise Considerations 38:10 – UX/UI: Making Claude Code Useful and Enjoyable 40:44 – Pricing for Power Users and Subscription Models 43:36 – Real-World Use Cases: Debugging, Testing, and More 46:44 – How Does Claude Code Transform Onboarding? 49:36 – The Future of Coding: Agents, Teams, and Collaboration 54:11 – The AI Coding Wars: Competition & Ecosystem 57:27 – The Future of Coding as a Profession 58:41 – What’s Next for Claude Code

Matt Turck

82,372 次观看 • 1 年前