Загрузка видео...

Не удалось загрузить видео

На главную

Overview of our recent launch of Coding Agent benchmarks on Artificial Analysis and our first Youtube Video! We walk through the performance, cost, token usage and speed differences across different coding agents. This includes looking at Opus 4.7 in Claude Code's leading performance and Composer 2.5's strong positioning on...

ArtificialAnlys's profile picture

Artificial Analysis

106,825 subscribers

10,623 просмотров • 1 месяц назад •via X (Twitter)

LIVE

Anya Rossi• Live Now

Private livecam show

Комментарии: 0

Нет доступных комментариев

Здесь появятся комментарии из оригинального поста

Похожие видео

Our new Gemini 3.5 Flash is our strongest agentic and coding model yet, delivering frontier-level performance at 4x the speed of comparable frontier models at less than half the cost. We had @TulseeDoshi break down what you need to know about it.
1:24

Our new Gemini 3.5 Flash is our strongest agentic and coding model yet, delivering frontier-level performance at 4x the speed of comparable frontier models at less than half the cost. We had @TulseeDoshi break down what you need to know about it.

Google

77,414 просмотров • 1 месяц назад

Announcing Grok 4.5, our first model trained specifically for coding and agents. It was trained with Cursor and offers frontier intelligence at leading speeds and cost efficiency.
0:55

Announcing Grok 4.5, our first model trained specifically for coding and agents. It was trained with Cursor and offers frontier intelligence at leading speeds and cost efficiency.

SpaceXAI

68,179,451 просмотров • 3 дней назад

Meet Agent Bake-Off: blind side by side tests for coding agents like Claude Code, Cursor , Amp , Factory , Codex, & more. We've been building the largest real world benchmarks for coding agents, and we're excited share an early preview of our open community tooling.
1:37

Meet Agent Bake-Off: blind side by side tests for coding agents like Claude Code, Cursor , Amp , Factory , Codex, & more. We've been building the largest real world benchmarks for coding agents, and we're excited share an early preview of our open community tooling.

brexton

18,186 просмотров • 8 месяцев назад

Announcing Opcode Everyone's favorite Claude Code GUI Claudia is now Opcode... with a complete revamp. And we just hit 15K+ stars on GitHub! The support from the community has been immense! ❤️ What's new: - Feature parity with all new Claude Code features in the CLI. - A complete UI revamp, faster and cleaner. What's coming: - Opcode's own coding agent that exclusively uses open models while achieving SOTA performance on coding benchmarks. We're currently piloting this at companies requiring fully local on-prem coding agents. If you're one of them, reach out to us and we'll set this up for you! Try Opcode at opcode [dot] sh Like/retweet and reply to this tweet with "join" to get an invite to the Discord server and beta test our coding agent for free.
2:58

Announcing Opcode Everyone's favorite Claude Code GUI Claudia is now Opcode... with a complete revamp. And we just hit 15K+ stars on GitHub! The support from the community has been immense! ❤️ What's new: - Feature parity with all new Claude Code features in the CLI. - A complete UI revamp, faster and cleaner. What's coming: - Opcode's own coding agent that exclusively uses open models while achieving SOTA performance on coding benchmarks. We're currently piloting this at companies requiring fully local on-prem coding agents. If you're one of them, reach out to us and we'll set this up for you! Try Opcode at opcode [dot] sh Like/retweet and reply to this tweet with "join" to get an invite to the Discord server and beta test our coding agent for free.

winfunc

38,639 просмотров • 10 месяцев назад

Introducing GLM-5V-Turbo: Vision Coding Model - Native Multimodal Coding: Natively understands multimodal inputs including images, videos, design drafts, and document layouts. - Balanced Visual and Programming Capabilities: Achieves leading performance across core benchmarks for multimodal coding, tool use, and GUI Agents. - Deep Adaptation for Claude Code and Claw Scenarios: Works in deep synergy with Agents like Claude Code and OpenClaw. Try it now: API: Coding Plan trial applications:
1:17

Introducing GLM-5V-Turbo: Vision Coding Model - Native Multimodal Coding: Natively understands multimodal inputs including images, videos, design drafts, and document layouts. - Balanced Visual and Programming Capabilities: Achieves leading performance across core benchmarks for multimodal coding, tool use, and GUI Agents. - Deep Adaptation for Claude Code and Claw Scenarios: Works in deep synergy with Agents like Claude Code and OpenClaw. Try it now: API: Coding Plan trial applications:

Z.ai

1,963,752 просмотров • 3 месяцев назад

GLM-4.7 from Z.ai is live on Cerebras! - Frontier intelligence for coding, tool-driven agents, and multi-turn reasoning - Record coding speed: ~1,000 tokens per second (up to 1,700 TPS for other uses) - Strong price-performance: ~10x higher than Sonnet 4.5
0:39

GLM-4.7 from Z.ai is live on Cerebras! - Frontier intelligence for coding, tool-driven agents, and multi-turn reasoning - Record coding speed: ~1,000 tokens per second (up to 1,700 TPS for other uses) - Strong price-performance: ~10x higher than Sonnet 4.5

Cerebras

134,887 просмотров • 6 месяцев назад

ICYMI, GitHub Copilot coding agent now works with Claude Sonnet 4.5 - which you can leverage through Visual Studio Code's deep coding agent integration.
0:36

ICYMI, GitHub Copilot coding agent now works with Claude Sonnet 4.5 - which you can leverage through Visual Studio Code's deep coding agent integration.

Visual Studio Code

33,996 просмотров • 9 месяцев назад

Everyone's sleeping on MiniMax. Again. They just shipped M3. The first open-weights model to combine frontier coding, 1M context, and native multimodality in one drop. I plugged it into Claude Code this morning. Pasted a design from Dribbble. Watched M3 write production-ready React code in one session. At the agency, I just replaced Opus 4.8 with M3 for 80% of our coding tasks. The output is the same and we are running everything at a fraction of the cost. Open infrastructure is the future.
1:35

Everyone's sleeping on MiniMax. Again. They just shipped M3. The first open-weights model to combine frontier coding, 1M context, and native multimodality in one drop. I plugged it into Claude Code this morning. Pasted a design from Dribbble. Watched M3 write production-ready React code in one session. At the agency, I just replaced Opus 4.8 with M3 for 80% of our coding tasks. The output is the same and we are running everything at a fraction of the cost. Open infrastructure is the future.

Prajwal Tomar

12,904 просмотров • 1 месяц назад

A conversation with Claude Code's creator Boris Cherny on the future of agentic coding, the evolution of coding models, and how he uses Claude Code to build Claude Code.
20:20

A conversation with Claude Code's creator Boris Cherny on the future of agentic coding, the evolution of coding models, and how he uses Claude Code to build Claude Code.

Alex Albert

81,455 просмотров • 10 месяцев назад

🔧 Let your coding agent identify and fix INP issues for you → With Chrome DevTools MCP, your coding agent can measure performance for specific user interactions to find and resolve slow UI responses - on its own with the help of the browser!
0:31

🔧 Let your coding agent identify and fix INP issues for you → With Chrome DevTools MCP, your coding agent can measure performance for specific user interactions to find and resolve slow UI responses - on its own with the help of the browser!

Chrome for Developers

16,696 просмотров • 8 месяцев назад

🐋 DeepSeek-R1 671B is on our Cloud! This BLACKBOX AI demo shows the advantages of coding significantly better w/ R1 671B & shows our speed against GPUs 😊. In CyberCoder, BlackBox uses R1 to improve the performance of coding agents, a primary use case for #DeepSeekR1 671B.
1:28

🐋 DeepSeek-R1 671B is on our Cloud! This BLACKBOX AI demo shows the advantages of coding significantly better w/ R1 671B & shows our speed against GPUs 😊. In CyberCoder, BlackBox uses R1 to improve the performance of coding agents, a primary use case for #DeepSeekR1 671B.

SambaNova

53,380 просмотров • 1 год назад

Following up on our Intelligence Index v4.1 release yesterday, in the video below, Daniel from our team shares a short overview of what's changed: 1. Three upgraded evaluations: Terminal-Bench 2.1, τ³-Bench Banking and GDPval-AA v2 2. Cost, time, and tokens per task: Understand the cost, time, and tokens of tasks across our Index and for individual evals, and how these trade off against Intelligence 3. Cached input token reporting: We now report the amount of cached tokens a particular model uses and how this influences cost
2:40

Following up on our Intelligence Index v4.1 release yesterday, in the video below, Daniel from our team shares a short overview of what's changed: 1. Three upgraded evaluations: Terminal-Bench 2.1, τ³-Bench Banking and GDPval-AA v2 2. Cost, time, and tokens per task: Understand the cost, time, and tokens of tasks across our Index and for individual evals, and how these trade off against Intelligence 3. Cached input token reporting: We now report the amount of cached tokens a particular model uses and how this influences cost

Artificial Analysis

12,491 просмотров • 24 дней назад

Embedder is the world's first hardware-aware coding agent. By understanding and interacting directly with your hardware, it achieves state of the art performance in an embedded systems (C++/Rust) context. Our latest update (v0.3.0) features a stunning new terminal UI, and our fastest, most capable firmware agent yet: Embedder
1:26

Embedder is the world's first hardware-aware coding agent. By understanding and interacting directly with your hardware, it achieves state of the art performance in an embedded systems (C++/Rust) context. Our latest update (v0.3.0) features a stunning new terminal UI, and our fastest, most capable firmware agent yet: Embedder

Ethan Gibbs

435,204 просмотров • 5 месяцев назад

The Claude Code SDK is now the Claude Agent SDK Why? Because we realized the Claude Code agent harness is useful for much more than coding. In fact, we're moving to using it to power most of our own agent loops at Anthropic.
0:25

The Claude Code SDK is now the Claude Agent SDK Why? Because we realized the Claude Code agent harness is useful for much more than coding. In fact, we're moving to using it to power most of our own agent loops at Anthropic.

Thariq

206,976 просмотров • 9 месяцев назад

🔗 Announcing LangChain OSS Skills LangChain has the most popular frameworks for building AI agents — and now your coding agent can be an expert in it. We're excited to release the first iteration of LangChain OSS Skills, giving your agent expertise in our open source frameworks. The skills include guidance on how to use langchain, langgraph, and deepagents to effectively build agents. ➡️ Install our OSS skills for your coding agent here: ➡️ Read more:
0:43

🔗 Announcing LangChain OSS Skills LangChain has the most popular frameworks for building AI agents — and now your coding agent can be an expert in it. We're excited to release the first iteration of LangChain OSS Skills, giving your agent expertise in our open source frameworks. The skills include guidance on how to use langchain, langgraph, and deepagents to effectively build agents. ➡️ Install our OSS skills for your coding agent here: ➡️ Read more:

LangChain OSS

65,840 просмотров • 4 месяцев назад

Gemini 3.5 Flash is a step forward for Google on speed and agentic capabilities but comes at a trade-off of being higher cost than prior models We have measured up to ~280 output tokens/sec, placing it on the speed/intelligence Pareto frontier and well ahead of Gemini 3 Flash. It also shows a major uplift on agentic tasks, reaching ~1650 ELO on GDPVal-AA. The trade-off: cost is up ~5x versus Gemini 3 Flash, driven by higher token prices (3x higher than Gemini 3 Flash) and higher token usage. In this video, Declan Jackson, Member of Technical Staff at Artificial Analysis, breaks it down.
1:57

Gemini 3.5 Flash is a step forward for Google on speed and agentic capabilities but comes at a trade-off of being higher cost than prior models We have measured up to ~280 output tokens/sec, placing it on the speed/intelligence Pareto frontier and well ahead of Gemini 3 Flash. It also shows a major uplift on agentic tasks, reaching ~1650 ELO on GDPVal-AA. The trade-off: cost is up ~5x versus Gemini 3 Flash, driven by higher token prices (3x higher than Gemini 3 Flash) and higher token usage. In this video, Declan Jackson, Member of Technical Staff at Artificial Analysis, breaks it down.

Artificial Analysis

16,055 просмотров • 1 месяц назад

GPT-5.6 is rolling out in the API. Sol is our flagship model, leading in coding, knowledge work, cybersecurity, and science. Terra delivers performance competitive with GPT-5.5 at lower cost. Luna is our fastest, most affordable model for high-volume tasks.
1:58

GPT-5.6 is rolling out in the API. Sol is our flagship model, leading in coding, knowledge work, cybersecurity, and science. Terra delivers performance competitive with GPT-5.5 at lower cost. Luna is our fastest, most affordable model for high-volume tasks.

OpenAI Developers

219,809 просмотров • 2 дней назад

This is Claude Sonnet 4.6: our most capable Sonnet model yet. It’s a full upgrade across coding, computer use, long-context reasoning, agent planning, knowledge work, and design. It also features a 1M token context window in beta.
1:29

This is Claude Sonnet 4.6: our most capable Sonnet model yet. It’s a full upgrade across coding, computer use, long-context reasoning, agent planning, knowledge work, and design. It also features a 1M token context window in beta.

Claude

7,593,858 просмотров • 4 месяцев назад

Walk through Kiro's haunted house at #AWSreInvent, full of developer nightmares and horrors. Explore how kiro brings structure to scary coding chaos through spec-driven development, vibe coding, and agent hooks. Survive the House of Kiro and share your images on social media using the hashtag #Houseofkiro.
0:36

Walk through Kiro's haunted house at #AWSreInvent, full of developer nightmares and horrors. Explore how kiro brings structure to scary coding chaos through spec-driven development, vibe coding, and agent hooks. Survive the House of Kiro and share your images on social media using the hashtag #Houseofkiro.

Kiro

19,465 просмотров • 7 месяцев назад

🚀New Amazon Q Developer agent for software development is available to customers: This agent is based on a new agent architecture that has exciting results coming from the SWE-bench scores (on the full and verified benchmarks) representing AI models’ ability to resolve real-world coding problems. Interesting aspect of Q Agent is that with these newest updates, Q drove nearly 50% more successful coding tasks completed. What makes Q Dev Agent remarkable? The agent architecture is not just about using the best LLMs (which we do), but also giving the agent the ability to constantly explore multiple paths to find the best way to resolve a particular problem (and back tracking when it has reached dead end like a developer would do). Needless to say, we are just getting started on the developer agent and we are constantly pushing to advance our AI capabilities while maintaining quality, security, privacy, and reliability to keep Amazon Q Developer an innovative and trusted option available to our customers using agents for software development. We highlighted the results of our first SWE-bench submission of Amazon Q Developer back in June blog post; with these updates, our new agent resolves 51% more coding tasks than its previous iteration on the SWE-bench verified dataset, and 43% more on the full dataset. That’s the difference a few months make, and I can’t wait to share what our teams will deliver at re:Invent this December. Here's a quick demo showcasing our new Agent in action:
1:28

🚀New Amazon Q Developer agent for software development is available to customers: This agent is based on a new agent architecture that has exciting results coming from the SWE-bench scores (on the full and verified benchmarks) representing AI models’ ability to resolve real-world coding problems. Interesting aspect of Q Agent is that with these newest updates, Q drove nearly 50% more successful coding tasks completed. What makes Q Dev Agent remarkable? The agent architecture is not just about using the best LLMs (which we do), but also giving the agent the ability to constantly explore multiple paths to find the best way to resolve a particular problem (and back tracking when it has reached dead end like a developer would do). Needless to say, we are just getting started on the developer agent and we are constantly pushing to advance our AI capabilities while maintaining quality, security, privacy, and reliability to keep Amazon Q Developer an innovative and trusted option available to our customers using agents for software development. We highlighted the results of our first SWE-bench submission of Amazon Q Developer back in June blog post; with these updates, our new agent resolves 51% more coding tasks than its previous iteration on the SWE-bench verified dataset, and 43% more on the full dataset. That’s the difference a few months make, and I can’t wait to share what our teams will deliver at re:Invent this December. Here's a quick demo showcasing our new Agent in action:

Swami Sivasubramanian

28,946 просмотров • 1 год назад