Loading video...

Video Failed to Load

There was a problem loading this video. This could be due to a temporary network issue or the video might be unavailable.

Llama 4 seems to actually be a poor model for coding. Scout (109B) and Maverick (402B) underperform 4o, Gemini Flash, Grok 3, DeepSeek V3 and Sonnet 3.5/7 on the Kscores benchmark which tests on coding tasks like this. ELO-maxxing on LMarena doesn’t create the best models.

Deedy

179,524 subscribers

252,791 views • 1 year ago •via X (Twitter)

Science & Technology

Anya Rossi• Live Now

Private livecam show

0 Comments

No comments available

Comments from the original post will appear here

Related Videos

Introducing Gemini 3, the best model in the world for multimodal understanding and our most powerful agentic and vibe-coding model yet. Gemini 3 Pro tops the LMArena Leaderboard at 1501 Elo! Available now in Gemini Enterprise & Vertex AI →

Introducing Gemini 3, the best model in the world for multimodal understanding and our most powerful agentic and vibe-coding model yet. Gemini 3 Pro tops the LMArena Leaderboard at 1501 Elo! Available now in Gemini Enterprise & Vertex AI →

Google Cloud Tech

57,813 views • 7 months ago

Llama 3.1 Nemotron 70B is the latest model from NVIDIA, released only a few hours ago. Initial testing shows the model outperforms GPT-4o and Sonnet 3.5 on several benchmarks. Try it on Akash Chat for free:

Llama 3.1 Nemotron 70B is the latest model from NVIDIA, released only a few hours ago. Initial testing shows the model outperforms GPT-4o and Sonnet 3.5 on several benchmarks. Try it on Akash Chat for free:

Akash Network

38,472 views • 1 year ago

This is not Grok-4. It's an Opensource AI Coding model soon to be coming out of China. And it works incredibly well with Cline and Claude Code. It's going to be a huge day for AI coding models.

This is not Grok-4. It's an Opensource AI Coding model soon to be coming out of China. And it works incredibly well with Cline and Claude Code. It's going to be a huge day for AI coding models.

Shubham Saboo

220,584 views • 1 year ago

🎯 One of our most requested features is here: Seamless Plan & Act mode switching. Use different models for different tasks: - Planning: Try Gemini Flash Thinking 2.0 or DeepSeek R1 - Execution: Use 3.5-Sonnet or DeepSeek V3 - Auto-saves your preferences plan-act-models No more manual switching between sessions. ⚡️

🎯 One of our most requested features is here: Seamless Plan & Act mode switching. Use different models for different tasks: - Planning: Try Gemini Flash Thinking 2.0 or DeepSeek R1 - Execution: Use 3.5-Sonnet or DeepSeek V3 - Auto-saves your preferences plan-act-models No more manual switching between sessions. ⚡️

Cline

34,412 views • 1 year ago

Previews are now available on the Poe iOS app! Generate custom interactive apps directly in chat using any of the leading LLMs, including Claude 3.5 Sonnet, GPT-4o, Gemini 1.5 Pro, and Llama 3.1 405b. (1/4)

Previews are now available on the Poe iOS app! Generate custom interactive apps directly in chat using any of the leading LLMs, including Claude 3.5 Sonnet, GPT-4o, Gemini 1.5 Pro, and Llama 3.1 405b. (1/4)

Poe

38,866 views • 1 year ago

Here’s Deepseek r1 1.5B thinking through a problem — it’s comparable to 4o and Claude 3.5 Sonnet in a number of domains like math. Except… it’s a 1.5B model… and can run on virtually any hardware. Truly a huge efficiency leap.

Here’s Deepseek r1 1.5B thinking through a problem — it’s comparable to 4o and Claude 3.5 Sonnet in a number of domains like math. Except… it’s a 1.5B model… and can run on virtually any hardware. Truly a huge efficiency leap.

Aaron Ng

564,677 views • 1 year ago

Just tried Baidu’s new ERNIE X1.1 and wow… this is actually impressive 🤯 I’ve been testing it on complex coding problems and math reasoning tasks, and the jump from earlier models is night and day. What stood out to me: ▪️ Much stronger at factual accuracy and instruction following ▪️ Handles agent-like tasks, tool use, and multi-step reasoning smoothly ▪️ Far fewer hallucinations compared to other reasoning-heavy models ▪️ Solid performance across creative writing, Q&A, coding, and math Benchmarks put ERNIE X1.1 ahead of DeepSeek R1-0528 and on par with GPT-5 & Gemini 2.5 Pro. If you’re into AI or reasoning models, it's definitely worth checking out: This doesn’t feel like just another release — it feels like a new standard for reasoning AI.

Just tried Baidu’s new ERNIE X1.1 and wow… this is actually impressive 🤯 I’ve been testing it on complex coding problems and math reasoning tasks, and the jump from earlier models is night and day. What stood out to me: ▪️ Much stronger at factual accuracy and instruction following ▪️ Handles agent-like tasks, tool use, and multi-step reasoning smoothly ▪️ Far fewer hallucinations compared to other reasoning-heavy models ▪️ Solid performance across creative writing, Q&A, coding, and math Benchmarks put ERNIE X1.1 ahead of DeepSeek R1-0528 and on par with GPT-5 & Gemini 2.5 Pro. If you’re into AI or reasoning models, it's definitely worth checking out: This doesn’t feel like just another release — it feels like a new standard for reasoning AI.

Parul Gautam

68,406 views • 10 months ago

LayerAI Works with DeepSeek to Supercharge the LayerAI Product Suite 🌐 LayerAI integrates DeepSeek by leveraging several of its features and capabilities, focusing on areas where DeepSeek's strengths align with LayerAI's objectives. 👉 Learn more about our work with DeepSeek: - Model Deployment: DeepSeek-V3 & Coder-V2 for superior code generation, debugging, and language tasks. - DeepSeek-Coder-V2: Coding in 338 languages with a 128K context for complex structures. - Efficient Inference: Enhanced performance with DeepSeek's MLA & MoE tech. - IDE Assist: Real-time coding help, error catch, and auto-complete. - GitHub Sync: Better collab with seamless version control and reviews. This integration elevates our AI tools, making coding, learning, and teamwork smarter. More:

LayerAI Works with DeepSeek to Supercharge the LayerAI Product Suite 🌐 LayerAI integrates DeepSeek by leveraging several of its features and capabilities, focusing on areas where DeepSeek's strengths align with LayerAI's objectives. 👉 Learn more about our work with DeepSeek: - Model Deployment: DeepSeek-V3 & Coder-V2 for superior code generation, debugging, and language tasks. - DeepSeek-Coder-V2: Coding in 338 languages with a 128K context for complex structures. - Efficient Inference: Enhanced performance with DeepSeek's MLA & MoE tech. - IDE Assist: Real-time coding help, error catch, and auto-complete. - GitHub Sync: Better collab with seamless version control and reviews. This integration elevates our AI tools, making coding, learning, and teamwork smarter. More:

LayerAI | AI2Earn

47,893 views • 1 year ago

Salute to the Qwen team 🫡 We tested Qwen 3.7-Max, Gemini 3.5 Flash, GPT-5.5, and Claude Opus 4.7. The biggest shock came from Qwen. In less than a month (3.6 Max dropped April 20), Qwen went from the worst multimodal output on our sakura tree test, barely keeping up with Gemini, GPT, and Claude , to matching Gemini 3.5 Flash frame for frame on this soccer test, and outperforming GPT-5.5 and Claude Opus 4.7. It rendered a perfectly proportioned soccer player and the most lifelike ball in the entire test. Remarkable spatial reasoning. Also: Gemini 3.5 Flash is now faster than GPT-5.5, which used to be the fastest in our past tests.

Salute to the Qwen team 🫡 We tested Qwen 3.7-Max, Gemini 3.5 Flash, GPT-5.5, and Claude Opus 4.7. The biggest shock came from Qwen. In less than a month (3.6 Max dropped April 20), Qwen went from the worst multimodal output on our sakura tree test, barely keeping up with Gemini, GPT, and Claude , to matching Gemini 3.5 Flash frame for frame on this soccer test, and outperforming GPT-5.5 and Claude Opus 4.7. It rendered a perfectly proportioned soccer player and the most lifelike ball in the entire test. Remarkable spatial reasoning. Also: Gemini 3.5 Flash is now faster than GPT-5.5, which used to be the fastest in our past tests.

GMI Cloud

75,785 views • 1 month ago

Sonnet-3.7 is available in Cursor! We've been very impressed by its coding ability, especially on real-world agentic tasks. It appears to be the new state of the art.

Sonnet-3.7 is available in Cursor! We've been very impressed by its coding ability, especially on real-world agentic tasks. It appears to be the new state of the art.

Cursor

1,115,349 views • 1 year ago

Gemini 3.0 pro and Opus 4.5 both models are far ahead in terms of coding specially frontend I am thinking about next sonnet 4.7 and gemini 3.0 pro GA

Gemini 3.0 pro and Opus 4.5 both models are far ahead in terms of coding specially frontend I am thinking about next sonnet 4.7 and gemini 3.0 pro GA

Chetaslua

70,198 views • 6 months ago

Alright guys, hear me out I was skeptical about Llama 4 coding skills... until I started comparing it to other models, including the earlier version of GPT-4o This thing is free, open source, and honestly pretty close to GPT-4o (pre-update), wild if you think about it

Alright guys, hear me out I was skeptical about Llama 4 coding skills... until I started comparing it to other models, including the earlier version of GPT-4o This thing is free, open source, and honestly pretty close to GPT-4o (pre-update), wild if you think about it

Flavio Adamo

378,266 views • 1 year ago

Claude Sonnet 4.5 is live on OpenRouter! Substantial gains on coding and math over Opus 4.1, but at normal Sonnet prices. More info and benchmarks 👇

Claude Sonnet 4.5 is live on OpenRouter! Substantial gains on coding and math over Opus 4.1, but at normal Sonnet prices. More info and benchmarks 👇

OpenRouter

38,062 views • 9 months ago

MiniMax M3: Opus-level coding at DeepSeek pricing. On Terminal-Bench 2.1, it scores 66.0, only 0.1 behind Opus 4.7. I gave it a quick try on a few frontend tasks, and the output quality genuinely feels close to Opus 4.7.

MiniMax M3: Opus-level coding at DeepSeek pricing. On Terminal-Bench 2.1, it scores 66.0, only 0.1 behind Opus 4.7. I gave it a quick try on a few frontend tasks, and the output quality genuinely feels close to Opus 4.7.

Kai

25,705 views • 1 month ago

Today we’re releasing Code Llama, a large language model built on top of Llama 2, fine-tuned for coding & state-of-the-art for publicly available coding tools. Keeping with our open approach, Code Llama is publicly-available now for both research & commercial use. More ⬇️

Today we’re releasing Code Llama, a large language model built on top of Llama 2, fine-tuned for coding & state-of-the-art for publicly available coding tools. Keeping with our open approach, Code Llama is publicly-available now for both research & commercial use. More ⬇️

AI at Meta

1,004,918 views • 2 years ago

1/ Gemini 2.5 is here, and it’s our most intelligent AI model ever. Our first 2.5 model, Gemini 2.5 Pro Experimental is a state-of-the-art thinking model, leading in a wide range of benchmarks – with impressive improvements in enhanced reasoning and coding and now #1 on Arena by a significant margin. With a model this intelligent, we wanted to get it to people as quickly as possible. Find it on Google AI Studio and in the Google Gemini for Gemini Advanced users now – and in Vertex in the coming weeks. This is the start of a new era of thinking models – and we can’t wait to see where things go from here.

1/ Gemini 2.5 is here, and it’s our most intelligent AI model ever. Our first 2.5 model, Gemini 2.5 Pro Experimental is a state-of-the-art thinking model, leading in a wide range of benchmarks – with impressive improvements in enhanced reasoning and coding and now #1 on Arena by a significant margin. With a model this intelligent, we wanted to get it to people as quickly as possible. Find it on Google AI Studio and in the Google Gemini for Gemini Advanced users now – and in Vertex in the coming weeks. This is the start of a new era of thinking models – and we can’t wait to see where things go from here.

Sundar Pichai

864,176 views • 1 year ago

New Hunyuan Hy3 hits Gemini 3.5 quality on physics for 35x cheaper! We gave 4 models the same prompt: build three self-contained HTML5 canvas scenes with real physics demos Prompts: - A bowling ball knocking down the pins - An air hockey rally that ends in a goal - A pool break scattering the rack Outputs: Hunyuan Hy3: 29,757 tokens, $0.006 Gemini 3.5: 23,300 tokens, $0.21 GLM-5.2: 25,454 tokens, $0.07 DeepSeek-V4: 50,600 tokens, $0.009 Tencent's Hy3 matched Gemini across all three: clean collisions, the puck bounced true, the pins scattered like a real strike, the rack broke with real momentum, nothing clipped or floated. GLM is genuinely strong on pure coding tasks, but the moment the job steps outside clean code it gives way. DeepSeek was the letdown, it burned the most tokens of anyone (50k, almost 2x Hy3) and still turned in the weakest scenes

New Hunyuan Hy3 hits Gemini 3.5 quality on physics for 35x cheaper! We gave 4 models the same prompt: build three self-contained HTML5 canvas scenes with real physics demos Prompts: - A bowling ball knocking down the pins - An air hockey rally that ends in a goal - A pool break scattering the rack Outputs: Hunyuan Hy3: 29,757 tokens, $0.006 Gemini 3.5: 23,300 tokens, $0.21 GLM-5.2: 25,454 tokens, $0.07 DeepSeek-V4: 50,600 tokens, $0.009 Tencent's Hy3 matched Gemini across all three: clean collisions, the puck bounced true, the pins scattered like a real strike, the rack broke with real momentum, nothing clipped or floated. GLM is genuinely strong on pure coding tasks, but the moment the job steps outside clean code it gives way. DeepSeek was the letdown, it burned the most tokens of anyone (50k, almost 2x Hy3) and still turned in the weakest scenes

atomic.chat

96,930 views • 3 days ago

There are so many models that it can get confusing so today we launched an auto-router - you get the best answers from any of the top models. At the same time, we have AI experts and model enthusiasts who will enjoy access to 10 new models we just added including: ✅ GPT-4.1 ✅ o3 & o4 Mini ✅ Grok 3 ✅ Llama 4 Maverick & Scout We're also sunsetting some older models that just can't keep up anymore.

There are so many models that it can get confusing so today we launched an auto-router - you get the best answers from any of the top models. At the same time, we have AI experts and model enthusiasts who will enjoy access to 10 new models we just added including: ✅ GPT-4.1 ✅ o3 & o4 Mini ✅ Grok 3 ✅ Llama 4 Maverick & Scout We're also sunsetting some older models that just can't keep up anymore.

Richard Socher

24,731 views • 1 year ago

💡 The Age of Foundational AI! In AI, the base layer matters most. Solidus Ai Tech AI Marketplace offers a curated lineup of foundational models designed to support reasoning, coding, multilingual tasks, and enhanced privacy features. From DeepSeek-R1 to SecretAI, these models provide the infrastructure for the next generation of AI agents and applications. Explore the models here →

💡 The Age of Foundational AI! In AI, the base layer matters most. Solidus Ai Tech AI Marketplace offers a curated lineup of foundational models designed to support reasoning, coding, multilingual tasks, and enhanced privacy features. From DeepSeek-R1 to SecretAI, these models provide the infrastructure for the next generation of AI agents and applications. Explore the models here →

AITECH CLOUD NETWORK

39,060 views • 9 months ago