Загрузка видео...

Не удалось загрузить видео

На главную

Introducing GLM-5V-Turbo: Vision Coding Model - Native Multimodal Coding: Natively understands multimodal inputs including images, videos, design drafts, and document layouts. - Balanced Visual and Programming Capabilities: Achieves leading performance across core benchmarks for multimodal coding, tool use, and GUI Agents. - Deep Adaptation for Claude Code and Claw...

1,970,275 просмотров • 6 месяцев назад •via X (Twitter)

Комментарии: 39

Фото профиля Z.ai
Z.ai6 месяцев назад

The model can understand design drafts, screenshots, and web interfaces to generate complete, runnable code, truly achieving the goal of "seeing the screen and writing the code."

Фото профиля Z.ai
Z.ai6 месяцев назад

GLM-5V-Turbo leads in benchmarks for design draft reconstruction, visual code generation, multimodal retrieval and QA, and visual exploration. It also performs exceptionally well on AndroidWorld and WebVoyager, which measure control capabilities in real GUI environments.

Фото профиля Z.ai
Z.ai6 месяцев назад

Regarding pure-text coding, GLM-5V-Turbo maintains stable performance across three core benchmarks of CC-Bench-V2 (Backend, Frontend, and Repo Exploration), proving that the introduction of visual capabilities does not degrade text-based reasoning.

Фото профиля Z.ai
Z.ai6 месяцев назад

The leading performance of GLM-5V-Turbo stems from systematic upgrades across four levels: Native Multimodal Fusion: Deep fusion of text and vision begins at pre-training, with multimodal collaborative optimization during post-training. We developed the next-generation CogViT visual encoder, reaching SOTA in general object recognition, fine-grained understanding, and geometric/spatial perception. We also designed an inference-friendly MTP structure to ensure high efficiency. 30+ Task Collaborative RL: The RL stage optimizes over 30 task types simultaneously, covering STEM, grounding, video, and GUI Agents. This improves perception and reasoning while mitigating the instability often found in single-domain training. Agentic Data and Task Construction: To solve the challenge of scarce Agent data, we built a multi-level system ranging from element perception to sequence-level action prediction. We use synthetic environments to generate verifiable training data and inject "Agentic Meta-capabilities" during pre-training (e.g., adding GUI Agent PRM data to reduce hallucinations). Multimodal Toolchain Extension: Beyond text tools, the model supports multimodal search, drawing, and web reading. This expands the perception-action loop into visual interaction. Synergies with Claude Code and OpenClaw are enhanced to support full-loop task execution.

Фото профиля EdDiboi
EdDiboi6 месяцев назад

Will it be open sourced?

Фото профиля Ahmad
Ahmad6 месяцев назад

Weights wen?

Фото профиля Calimanu Loredan
Calimanu Loredan6 месяцев назад

Guys, I agree it’s nice but where is the finesse on the design ? Does this page on an iPhone 13Pro max look good to you? :(

Фото профиля Sheeki
Sheeki6 месяцев назад

sus

Фото профиля AVB
AVB6 месяцев назад

My Claude code sub about to end… and I don’t think I’ll be resubscribing to ask my 2 questions/day. Not after THIS exists

Фото профиля Metabolic Uncle
Metabolic Uncle6 месяцев назад

GLM 5.1 in my own agent harness runs circles around Opus 4.6 in Antigravity. I literally also built my own coding cli the day Anthropic reduced the quota in Antigravity to hilarious 4 complex coding tasks… for Ultra users that is. The Zai Max Plan is currently by far the best offer for everything coding or agent related. The new models are incredible!

Фото профиля tonbi
tonbi6 месяцев назад

I tested some of the multimodel functions in hermes agent! I was really impressed at how well it read from screenshots, handwriting, and messy charts. Fast too! Check out the results in this quick video:

Фото профиля Chris
Chris6 месяцев назад

Can’t wait to try it 💥

Фото профиля mrkelly
mrkelly6 месяцев назад

I learned the hard way that generating code from a mockup is never the actual bottleneck.

Фото профиля Farhanism
Farhanism6 месяцев назад

seems like knowledge cut off 2019🤣🤣🤣

Фото профиля alkimiadev
alkimiadev6 месяцев назад

Its sad to see Zai go so far down hill so fast. Its like after you went public you decided to join the Dr Evil AI lab crowd like Anthropic and OAI. First you served a broken model to your users for WEEKS and then you went back on your oss mission and aren't releasing that model

Фото профиля Sergei Vecherenko
Sergei Vecherenko6 месяцев назад

@grok GLM-5.1 vs GLM-5V-turbo for real coding, who is better and faster?

Фото профиля Zaid
Zaid6 месяцев назад

really cool!

Фото профиля Dennis Rongo
Dennis Rongo6 месяцев назад

Except that it's not available on pro accounts 😞.

Фото профиля Z.ai
Z.ai6 месяцев назад

It is now available! Give it a try❤️

Фото профиля Dennis Rongo
Dennis Rongo6 месяцев назад

this is what I see inside OpenCode.

Фото профиля Julien Blanchon 🇺🇦
Julien Blanchon 🇺🇦6 месяцев назад

Please open source it !

Фото профиля robotshelp
robotshelp6 месяцев назад

The multimodal coding approach is huge - being able to parse UI mockups and generate code directly from visual inputs cuts development time dramatically. This is where vision models really shine.

Фото профиля Anand C. Patel, MD MS
Anand C. Patel, MD MS6 месяцев назад

Source? Weights? 🙏🏽

Фото профиля Melvin Vivas
Melvin Vivas6 месяцев назад

so does this mean we dont need MCP for image anymore?

Фото профиля RealAIzation
RealAIzation6 месяцев назад

Hopefully! This model is good at SVG

Фото профиля Nour Eddine Hamaidi
Nour Eddine Hamaidi6 месяцев назад

This will rock with Hermes @Teknium

Фото профиля testtm
testtm6 месяцев назад

i hope its not april fools joke >.<

Фото профиля David Zhang
David Zhang6 месяцев назад

Can't wait to use this as my project manager in CAR

Фото профиля Codve.ai
Codve.ai6 месяцев назад

finally someone tackling multimodal coding properly. the visual understanding piece has been the missing link for agentic dev

Фото профиля Theo Borges
Theo Borges6 месяцев назад

How much better is 5.1 for non-visual tasks?

Фото профиля kiyoshi ?¿
kiyoshi ?¿6 месяцев назад

fuck im hard

Фото профиля Tugser Okur
Tugser Okur6 месяцев назад

Wow

Фото профиля 黄月英
黄月英6 месяцев назад

@grok Should I replace GLM-5.1 with GLM-5V-Turbo?

Фото профиля Onions in Taiwan 🧅 (Formerly Condemner) 𓅃𓅊
Onions in Taiwan 🧅 (Formerly Condemner) 𓅃𓅊6 месяцев назад

@SookieWinehouse

Фото профиля Abu Bakar Siddik
Abu Bakar Siddik6 месяцев назад

Fix the GLM-5.1 inference server, first guys!

Фото профиля Will Faust
Will Faust6 месяцев назад

@n1d_all open weight wen

Фото профиля Abhishek Ekaanth
Abhishek Ekaanth6 месяцев назад

Buying 1 year subscription with new year discount was a beast deal.

Фото профиля Daniel Mulec
Daniel Mulec6 месяцев назад

"Deep Adaptation for Claude Code and Claw Scenarios: Works in deep synergy with Agents like Claude Code and OpenClaw." What are the precise OpenClaw examples? All I want is for Chinese LLMs to be on par with GPT 5.2 and Opus 4.5 as personal assistants, yet they still come short

Фото профиля T.Rex-Baby
T.Rex-Baby6 месяцев назад

Would you use Chinese models, now that they have all switched to closed source?

Похожие видео

Claude Code is a major (and accidental!) hit for Anthropic that surprised even its creator, Boris Cherny. Claude Code, an Agentic AI coding product that lives in the terminal. Most of the new code at Anthropic is created through it today. And in the last 5 months since it was launched publicly, Claude Code went from $0 to $400M in revenue run rate (as per The Information). 00:00 – Intro 01:15 – Did You Expect Claude Code’s Success? 04:22 – How Claude Code Works and Origins 08:05 – Command Line vs IDE: Why Start Claude Code in the Terminal? 11:31 – The Evolution of Programming: From Punch Cards to Agents 13:20 – Product Follows Model: Simple Interfaces and Fast Evolution 15:17 – Who Is Claude Code For? (Engineers, Designers, PMs & More) 17:46 – What Can Claude Code Actually Do? (Actions & Capabilities) 21:14 – Agentic Actions, Subagents, and Workflows 25:30 – Claude Code’s Awareness, Memory, and Knowledge Sharing 33:28 – Model Context Protocol (MCP) and Customization 35:30 – Safety, Human Oversight, and Enterprise Considerations 38:10 – UX/UI: Making Claude Code Useful and Enjoyable 40:44 – Pricing for Power Users and Subscription Models 43:36 – Real-World Use Cases: Debugging, Testing, and More 46:44 – How Does Claude Code Transform Onboarding? 49:36 – The Future of Coding: Agents, Teams, and Collaboration 54:11 – The AI Coding Wars: Competition & Ecosystem 57:27 – The Future of Coding as a Profession 58:41 – What’s Next for Claude Code

Matt Turck

82,372 просмотров • 1 год назад