Video wird geladen...

Video konnte nicht geladen werden

Zur Startseite

Overview of our recent launch of Coding Agent benchmarks on Artificial Analysis and our first Youtube Video! We walk through the performance, cost, token usage and speed differences across different coding agents. This includes looking at Opus 4.7 in Claude Code's leading performance and Composer 2.5's strong positioning on...

ArtificialAnlys's profile picture

Artificial Analysis

101,518 subscribers

10,533 Aufrufe • vor 24 Tagen •via X (Twitter)

LIVE

Anya Rossi• Live Now

Private livecam show

0 Kommentare

Keine Kommentare verfügbar

Kommentare vom Original-Post werden hier angezeigt

Ähnliche Videos

Our new Gemini 3.5 Flash is our strongest agentic and coding model yet, delivering frontier-level performance at 4x the speed of comparable frontier models at less than half the cost. We had @TulseeDoshi break down what you need to know about it.
1:24

Our new Gemini 3.5 Flash is our strongest agentic and coding model yet, delivering frontier-level performance at 4x the speed of comparable frontier models at less than half the cost. We had @TulseeDoshi break down what you need to know about it.

Google

77,091 Aufrufe • vor 1 Monat

Meet Agent Bake-Off: blind side by side tests for coding agents like Claude Code, Cursor , Amp , Factory , Codex, & more. We've been building the largest real world benchmarks for coding agents, and we're excited share an early preview of our open community tooling.
1:37

Meet Agent Bake-Off: blind side by side tests for coding agents like Claude Code, Cursor , Amp , Factory , Codex, & more. We've been building the largest real world benchmarks for coding agents, and we're excited share an early preview of our open community tooling.

brexton

18,160 Aufrufe • vor 7 Monaten

Announcing Opcode Everyone's favorite Claude Code GUI Claudia is now Opcode... with a complete revamp. And we just hit 15K+ stars on GitHub! The support from the community has been immense! ❤️ What's new: - Feature parity with all new Claude Code features in the CLI. - A complete UI revamp, faster and cleaner. What's coming: - Opcode's own coding agent that exclusively uses open models while achieving SOTA performance on coding benchmarks. We're currently piloting this at companies requiring fully local on-prem coding agents. If you're one of them, reach out to us and we'll set this up for you! Try Opcode at opcode [dot] sh Like/retweet and reply to this tweet with "join" to get an invite to the Discord server and beta test our coding agent for free.
2:58

Announcing Opcode Everyone's favorite Claude Code GUI Claudia is now Opcode... with a complete revamp. And we just hit 15K+ stars on GitHub! The support from the community has been immense! ❤️ What's new: - Feature parity with all new Claude Code features in the CLI. - A complete UI revamp, faster and cleaner. What's coming: - Opcode's own coding agent that exclusively uses open models while achieving SOTA performance on coding benchmarks. We're currently piloting this at companies requiring fully local on-prem coding agents. If you're one of them, reach out to us and we'll set this up for you! Try Opcode at opcode [dot] sh Like/retweet and reply to this tweet with "join" to get an invite to the Discord server and beta test our coding agent for free.

winfunc

38,639 Aufrufe • vor 9 Monaten

Introducing GLM-5V-Turbo: Vision Coding Model - Native Multimodal Coding: Natively understands multimodal inputs including images, videos, design drafts, and document layouts. - Balanced Visual and Programming Capabilities: Achieves leading performance across core benchmarks for multimodal coding, tool use, and GUI Agents. - Deep Adaptation for Claude Code and Claw Scenarios: Works in deep synergy with Agents like Claude Code and OpenClaw. Try it now: API: Coding Plan trial applications:
1:17

Introducing GLM-5V-Turbo: Vision Coding Model - Native Multimodal Coding: Natively understands multimodal inputs including images, videos, design drafts, and document layouts. - Balanced Visual and Programming Capabilities: Achieves leading performance across core benchmarks for multimodal coding, tool use, and GUI Agents. - Deep Adaptation for Claude Code and Claw Scenarios: Works in deep synergy with Agents like Claude Code and OpenClaw. Try it now: API: Coding Plan trial applications:

Z.ai

1,961,690 Aufrufe • vor 2 Monaten

GLM 5.2 BEATS GPT-5.5 ON CODING PERFORMANCE The model is reported to outperform GPT-5.5 on multiple coding benchmarks while remaining available on a free tier for developers to test and use Benchmark results show higher scores on SWE-bench Pro at 62.1 compared to 58.6, terminal benchmarks at 81 compared to 74.4, and Frontier-SWE at 74.4, alongside a 1M token context window, open weights, and lower operational cost Users can access it through free setup routes using API-based tools or run it in production through platforms that allow model selection and long context coding workflows The main implication is that high performance coding models are becoming more accessible, reducing dependency on paid frontier models for many development tasks
0:30

GLM 5.2 BEATS GPT-5.5 ON CODING PERFORMANCE The model is reported to outperform GPT-5.5 on multiple coding benchmarks while remaining available on a free tier for developers to test and use Benchmark results show higher scores on SWE-bench Pro at 62.1 compared to 58.6, terminal benchmarks at 81 compared to 74.4, and Frontier-SWE at 74.4, alongside a 1M token context window, open weights, and lower operational cost Users can access it through free setup routes using API-based tools or run it in production through platforms that allow model selection and long context coding workflows The main implication is that high performance coding models are becoming more accessible, reducing dependency on paid frontier models for many development tasks

0xMarioNawfal

46,344 Aufrufe • vor 8 Stunden

GLM-4.7 from Z.ai is live on Cerebras! - Frontier intelligence for coding, tool-driven agents, and multi-turn reasoning - Record coding speed: ~1,000 tokens per second (up to 1,700 TPS for other uses) - Strong price-performance: ~10x higher than Sonnet 4.5
0:39

GLM-4.7 from Z.ai is live on Cerebras! - Frontier intelligence for coding, tool-driven agents, and multi-turn reasoning - Record coding speed: ~1,000 tokens per second (up to 1,700 TPS for other uses) - Strong price-performance: ~10x higher than Sonnet 4.5

Cerebras

134,724 Aufrufe • vor 5 Monaten

ICYMI, GitHub Copilot coding agent now works with Claude Sonnet 4.5 - which you can leverage through Visual Studio Code's deep coding agent integration.
0:36

ICYMI, GitHub Copilot coding agent now works with Claude Sonnet 4.5 - which you can leverage through Visual Studio Code's deep coding agent integration.

Visual Studio Code

33,996 Aufrufe • vor 8 Monaten

A conversation with Claude Code's creator Boris Cherny on the future of agentic coding, the evolution of coding models, and how he uses Claude Code to build Claude Code.
20:20

A conversation with Claude Code's creator Boris Cherny on the future of agentic coding, the evolution of coding models, and how he uses Claude Code to build Claude Code.

Alex Albert

81,455 Aufrufe • vor 9 Monaten

Everyone's sleeping on MiniMax. Again. They just shipped M3. The first open-weights model to combine frontier coding, 1M context, and native multimodality in one drop. I plugged it into Claude Code this morning. Pasted a design from Dribbble. Watched M3 write production-ready React code in one session. At the agency, I just replaced Opus 4.8 with M3 for 80% of our coding tasks. The output is the same and we are running everything at a fraction of the cost. Open infrastructure is the future.
1:35

Everyone's sleeping on MiniMax. Again. They just shipped M3. The first open-weights model to combine frontier coding, 1M context, and native multimodality in one drop. I plugged it into Claude Code this morning. Pasted a design from Dribbble. Watched M3 write production-ready React code in one session. At the agency, I just replaced Opus 4.8 with M3 for 80% of our coding tasks. The output is the same and we are running everything at a fraction of the cost. Open infrastructure is the future.

Prajwal Tomar

12,834 Aufrufe • vor 16 Tagen

🔧 Let your coding agent identify and fix INP issues for you → With Chrome DevTools MCP, your coding agent can measure performance for specific user interactions to find and resolve slow UI responses - on its own with the help of the browser!
0:31

🔧 Let your coding agent identify and fix INP issues for you → With Chrome DevTools MCP, your coding agent can measure performance for specific user interactions to find and resolve slow UI responses - on its own with the help of the browser!

Chrome for Developers

16,694 Aufrufe • vor 7 Monaten

🐋 DeepSeek-R1 671B is on our Cloud! This BLACKBOX AI demo shows the advantages of coding significantly better w/ R1 671B & shows our speed against GPUs 😊. In CyberCoder, BlackBox uses R1 to improve the performance of coding agents, a primary use case for #DeepSeekR1 671B.
1:28

🐋 DeepSeek-R1 671B is on our Cloud! This BLACKBOX AI demo shows the advantages of coding significantly better w/ R1 671B & shows our speed against GPUs 😊. In CyberCoder, BlackBox uses R1 to improve the performance of coding agents, a primary use case for #DeepSeekR1 671B.

SambaNova

53,380 Aufrufe • vor 1 Jahr

Embedder is the world's first hardware-aware coding agent. By understanding and interacting directly with your hardware, it achieves state of the art performance in an embedded systems (C++/Rust) context. Our latest update (v0.3.0) features a stunning new terminal UI, and our fastest, most capable firmware agent yet: Embedder
1:26

Embedder is the world's first hardware-aware coding agent. By understanding and interacting directly with your hardware, it achieves state of the art performance in an embedded systems (C++/Rust) context. Our latest update (v0.3.0) features a stunning new terminal UI, and our fastest, most capable firmware agent yet: Embedder

Ethan Gibbs

435,173 Aufrufe • vor 4 Monaten

🔗 Announcing LangChain OSS Skills LangChain has the most popular frameworks for building AI agents — and now your coding agent can be an expert in it. We're excited to release the first iteration of LangChain OSS Skills, giving your agent expertise in our open source frameworks. The skills include guidance on how to use langchain, langgraph, and deepagents to effectively build agents. ➡️ Install our OSS skills for your coding agent here: ➡️ Read more:
0:43

🔗 Announcing LangChain OSS Skills LangChain has the most popular frameworks for building AI agents — and now your coding agent can be an expert in it. We're excited to release the first iteration of LangChain OSS Skills, giving your agent expertise in our open source frameworks. The skills include guidance on how to use langchain, langgraph, and deepagents to effectively build agents. ➡️ Install our OSS skills for your coding agent here: ➡️ Read more:

LangChain OSS

65,840 Aufrufe • vor 3 Monaten

The Claude Code SDK is now the Claude Agent SDK Why? Because we realized the Claude Code agent harness is useful for much more than coding. In fact, we're moving to using it to power most of our own agent loops at Anthropic.
0:25

The Claude Code SDK is now the Claude Agent SDK Why? Because we realized the Claude Code agent harness is useful for much more than coding. In fact, we're moving to using it to power most of our own agent loops at Anthropic.

Thariq

206,976 Aufrufe • vor 8 Monaten

This is Claude Sonnet 4.6: our most capable Sonnet model yet. It’s a full upgrade across coding, computer use, long-context reasoning, agent planning, knowledge work, and design. It also features a 1M token context window in beta.
1:29

This is Claude Sonnet 4.6: our most capable Sonnet model yet. It’s a full upgrade across coding, computer use, long-context reasoning, agent planning, knowledge work, and design. It also features a 1M token context window in beta.

Claude

7,589,297 Aufrufe • vor 4 Monaten

Walk through Kiro's haunted house at #AWSreInvent, full of developer nightmares and horrors. Explore how kiro brings structure to scary coding chaos through spec-driven development, vibe coding, and agent hooks. Survive the House of Kiro and share your images on social media using the hashtag #Houseofkiro.
0:36

Walk through Kiro's haunted house at #AWSreInvent, full of developer nightmares and horrors. Explore how kiro brings structure to scary coding chaos through spec-driven development, vibe coding, and agent hooks. Survive the House of Kiro and share your images on social media using the hashtag #Houseofkiro.

Kiro

19,465 Aufrufe • vor 6 Monaten

🚀New Amazon Q Developer agent for software development is available to customers: This agent is based on a new agent architecture that has exciting results coming from the SWE-bench scores (on the full and verified benchmarks) representing AI models’ ability to resolve real-world coding problems. Interesting aspect of Q Agent is that with these newest updates, Q drove nearly 50% more successful coding tasks completed. What makes Q Dev Agent remarkable? The agent architecture is not just about using the best LLMs (which we do), but also giving the agent the ability to constantly explore multiple paths to find the best way to resolve a particular problem (and back tracking when it has reached dead end like a developer would do). Needless to say, we are just getting started on the developer agent and we are constantly pushing to advance our AI capabilities while maintaining quality, security, privacy, and reliability to keep Amazon Q Developer an innovative and trusted option available to our customers using agents for software development. We highlighted the results of our first SWE-bench submission of Amazon Q Developer back in June blog post; with these updates, our new agent resolves 51% more coding tasks than its previous iteration on the SWE-bench verified dataset, and 43% more on the full dataset. That’s the difference a few months make, and I can’t wait to share what our teams will deliver at re:Invent this December. Here's a quick demo showcasing our new Agent in action:
1:28

🚀New Amazon Q Developer agent for software development is available to customers: This agent is based on a new agent architecture that has exciting results coming from the SWE-bench scores (on the full and verified benchmarks) representing AI models’ ability to resolve real-world coding problems. Interesting aspect of Q Agent is that with these newest updates, Q drove nearly 50% more successful coding tasks completed. What makes Q Dev Agent remarkable? The agent architecture is not just about using the best LLMs (which we do), but also giving the agent the ability to constantly explore multiple paths to find the best way to resolve a particular problem (and back tracking when it has reached dead end like a developer would do). Needless to say, we are just getting started on the developer agent and we are constantly pushing to advance our AI capabilities while maintaining quality, security, privacy, and reliability to keep Amazon Q Developer an innovative and trusted option available to our customers using agents for software development. We highlighted the results of our first SWE-bench submission of Amazon Q Developer back in June blog post; with these updates, our new agent resolves 51% more coding tasks than its previous iteration on the SWE-bench verified dataset, and 43% more on the full dataset. That’s the difference a few months make, and I can’t wait to share what our teams will deliver at re:Invent this December. Here's a quick demo showcasing our new Agent in action:

Swami Sivasubramanian

28,946 Aufrufe • vor 1 Jahr

Introducing OB-1: the new #1 coding agent on Terminal Bench. After a year of R&D, our agent now outperforms Codex and Claude Code. Early access is rolling out to waitlist users now.
0:23

Introducing OB-1: the new #1 coding agent on Terminal Bench. After a year of R&D, our agent now outperforms Codex and Claude Code. Early access is rolling out to waitlist users now.

OpenBlock

75,822 Aufrufe • vor 9 Monaten

2.5 models are thinking models, capable of reasoning through thoughts before responding. The result is enhanced performance and improved accuracy. This means Gemini 2.5 can handle more complex problems in coding, science and math, and support more context-aware agents.
0:29

2.5 models are thinking models, capable of reasoning through thoughts before responding. The result is enhanced performance and improved accuracy. This means Gemini 2.5 can handle more complex problems in coding, science and math, and support more context-aware agents.

Google

31,023 Aufrufe • vor 1 Jahr

Opus 4.6 and Codex 5.3 just launched, so I did a hexagon test on both of them Opus 4.6 - 1M context - great for research + enterprise work - agent teams + long-range reasoning - weaker on raw code benchmarks Codex 5.3 - wins coding benchmarks - faster + mid-task steering - smaller context window TLDR: Opus = depth + orchestration Codex = speed + code
0:20

Opus 4.6 and Codex 5.3 just launched, so I did a hexagon test on both of them Opus 4.6 - 1M context - great for research + enterprise work - agent teams + long-range reasoning - weaker on raw code benchmarks Codex 5.3 - wins coding benchmarks - faster + mid-task steering - smaller context window TLDR: Opus = depth + orchestration Codex = speed + code

Abhinav

447,814 Aufrufe • vor 4 Monaten