Video wird geladen...

Video konnte nicht geladen werden

Zur Startseite

A recent Broadcom study of 1,800 IT professionals found an 8:1 cost gap between running an AI agent through a frontier model and running it on-prem. At VMware Explore 2026, Patrick Moorhead and Daniel Newman spoke with Broadcom's Paul Turner on how VMware's AI Factory is closing that gap. $AVGO

TheSixFiveMedia's profile picture

Six Five Media

4,519 subscribers

49,529 Aufrufe • vor 12 Tagen •via X (Twitter)

LIVE

Anya Rossi• Live Now

Private livecam show

1 Kommentare

Profilbild von why
whyvor 12 Tagen

@Broadcom @VMware @PatrickMoorhead @danielnewmanUV An 8:1 gap is substantial, though the real tradeoff probably depends on utilization, latency requirements, and the operational cost of running on-prem.

Ähnliche Videos

AI scaling is running into some hard limits. Primarily memory, bandwidth, and power. Samsung Semiconductor US President Paul Cho joined Patrick Moorhead and Daniel Newman to unpack how the industry is responding at The Six Five Summit: AI Unleashed 2026. Watch on demand:
2:22

AI scaling is running into some hard limits. Primarily memory, bandwidth, and power. Samsung Semiconductor US President Paul Cho joined Patrick Moorhead and Daniel Newman to unpack how the industry is responding at The Six Five Summit: AI Unleashed 2026. Watch on demand:

Six Five Media

27,771 Aufrufe • vor 17 Tagen

AI is reshaping the data center. Hear from Paul Turner, Chief Product Officer of the VMware Cloud Foundation Division at Broadcom, on how Broadcom and AMD are helping organizations build AI-ready infrastructure with VMware Cloud Foundation and AMD Instinct MI350P Series GPUs.
0:53

AI is reshaping the data center. Hear from Paul Turner, Chief Product Officer of the VMware Cloud Foundation Division at Broadcom, on how Broadcom and AMD are helping organizations build AI-ready infrastructure with VMware Cloud Foundation and AMD Instinct MI350P Series GPUs.

AMD

29,114 Aufrufe • vor 2 Monaten

CEO of Broadcom Hock Tan sat down w/ Daniel Newman at VMware Explore, where they discussed the strategy of VCF 9.0 and how it’s aimed to solve key enterprise friction points. Tune it to hear the how & why Hock believes it is the platform to bring unified, secure, and cost-effective workloads back on-prem.
17:45

CEO of Broadcom Hock Tan sat down w/ Daniel Newman at VMware Explore, where they discussed the strategy of VCF 9.0 and how it’s aimed to solve key enterprise friction points. Tune it to hear the how & why Hock believes it is the platform to bring unified, secure, and cost-effective workloads back on-prem.

Six Five Media

51,930 Aufrufe • vor 1 Jahr

Jeff Clarke on AI transformation: be willing to tear down what made you successful and rebuild it from scratch through the lens of AI. Patrick Moorhead and Daniel Newman get into what that actually means with Clarke and Bob Venero at Dell Technologies World 2026.
1:37

Jeff Clarke on AI transformation: be willing to tear down what made you successful and rebuild it from scratch through the lens of AI. Patrick Moorhead and Daniel Newman get into what that actually means with Clarke and Bob Venero at Dell Technologies World 2026.

Six Five Media

158,042 Aufrufe • vor 3 Monaten

Qwen 3.6 35B running at over 100 tokens per second on my $5,399 MacBook Pro M5 Max. This is the best local AI model I have ever run. 128GB of unified memory. No cloud. No API costs. No rate limits. Just raw local inference at speeds I didn't think were possible on a laptop. This model is more intelligent than GPT 5 on benchmarks. Running locally. On a MacBook. For free after the hardware cost. I said local AI would never compete with frontier. I'm starting to rethink that. The gap is closing faster than anyone expected.
1:04

Qwen 3.6 35B running at over 100 tokens per second on my $5,399 MacBook Pro M5 Max. This is the best local AI model I have ever run. 128GB of unified memory. No cloud. No API costs. No rate limits. Just raw local inference at speeds I didn't think were possible on a laptop. This model is more intelligent than GPT 5 on benchmarks. Running locally. On a MacBook. For free after the hardware cost. I said local AI would never compete with frontier. I'm starting to rethink that. The gap is closing faster than anyone expected.

BridgeMind

62,800 Aufrufe • vor 3 Monaten

"They're not spending $30 billion on an acquisition for charity." — Daniel Newman, CEO and Chief Analyst, Futurum Patrick Moorhead and Daniel Newman called it like it is at Google Cloud Next 2026. The Wiz acquisition is not a security product play. It's a strategic bet Google is making that agent-native security will become the most critical infrastructure layer for every large enterprise operating at a global scale. They're going for security that's built into the platform, not bolted on. That distinction matters more than most people realize right now.
1:39

"They're not spending $30 billion on an acquisition for charity." — Daniel Newman, CEO and Chief Analyst, Futurum Patrick Moorhead and Daniel Newman called it like it is at Google Cloud Next 2026. The Wiz acquisition is not a security product play. It's a strategic bet Google is making that agent-native security will become the most critical infrastructure layer for every large enterprise operating at a global scale. They're going for security that's built into the platform, not bolted on. That distinction matters more than most people realize right now.

Six Five Media

62,371 Aufrufe • vor 4 Monaten

“An ounce of prevention is as important as a pound of resilience.” Cohesity CEO Sanjay Poonen (Sanjay Poonen) joined Patrick Moorhead and Daniel Newman at The Six Five Summit to discuss prevention, resilience, and faster identity attacks in the AI era. Watch the full Cybersecurity spotlight conversation on demand:
2:08

“An ounce of prevention is as important as a pound of resilience.” Cohesity CEO Sanjay Poonen (Sanjay Poonen) joined Patrick Moorhead and Daniel Newman at The Six Five Summit to discuss prevention, resilience, and faster identity attacks in the AI era. Watch the full Cybersecurity spotlight conversation on demand:

Six Five Media

27,689 Aufrufe • vor 11 Tagen

Chamath is making one of the most important business arguments of 2026. Half of large US companies right now cannot generate returns that exceed their cost of capital, which has normalized back to its long run average of 8 to 11%. Another one in seven companies globally is stuck generating persistent returns between 1 and 5% and most businesses don't have room for error and in this environment walks every frontier AI lab saying the same thing, give us your data, your workflows, your processes and our model will make everything better. And companies by the millions said yes. What they didn't fully account for is what happens on the other side of that door. Every time an employee runs a query through a frontier model API, the prompt goes through external servers, workflows, customer data, pricing logic, internal processes, all of it transmitted through a third party. As Alex Karp said companies are spending on tokens while handing over the exact proprietary advantages that make their business worth owning. Microsoft blocked internal use of Anthropic's Claude Fable 5 but over its 30-day data retention policy and the largest software company in the world decided a frontier model's data handling was too risky for its own employees. A US government action revoked access to another frontier model for foreign nationals overnight. Now here's where the cost math becomes impossible to ignore. Deutsche Bank calculated a roughly 65x cost gap between frontier models like Claude Fable 5 at ~$3.25 per task and open-source alternatives at ~$0.05. For 90% of everyday enterprise tasks, performance is comparable. Open-weight models now match closed frontier systems on core agent tasks at roughly one-tenth the cost, a high-volume deployment that costs $250/day on Claude runs at $12/day on an open-source equivalent. Chamath Palihapitiya tested this directly by running a standard enterprise code migration task through an orchestration layer wrapping an open-source model came in 16.4x cheaper than using a frontier model directly.
5:24

Chamath is making one of the most important business arguments of 2026. Half of large US companies right now cannot generate returns that exceed their cost of capital, which has normalized back to its long run average of 8 to 11%. Another one in seven companies globally is stuck generating persistent returns between 1 and 5% and most businesses don't have room for error and in this environment walks every frontier AI lab saying the same thing, give us your data, your workflows, your processes and our model will make everything better. And companies by the millions said yes. What they didn't fully account for is what happens on the other side of that door. Every time an employee runs a query through a frontier model API, the prompt goes through external servers, workflows, customer data, pricing logic, internal processes, all of it transmitted through a third party. As Alex Karp said companies are spending on tokens while handing over the exact proprietary advantages that make their business worth owning. Microsoft blocked internal use of Anthropic's Claude Fable 5 but over its 30-day data retention policy and the largest software company in the world decided a frontier model's data handling was too risky for its own employees. A US government action revoked access to another frontier model for foreign nationals overnight. Now here's where the cost math becomes impossible to ignore. Deutsche Bank calculated a roughly 65x cost gap between frontier models like Claude Fable 5 at ~$3.25 per task and open-source alternatives at ~$0.05. For 90% of everyday enterprise tasks, performance is comparable. Open-weight models now match closed frontier systems on core agent tasks at roughly one-tenth the cost, a high-volume deployment that costs $250/day on Claude runs at $12/day on an open-source equivalent. Chamath Palihapitiya tested this directly by running a standard enterprise code migration task through an orchestration layer wrapping an open-source model came in 16.4x cheaper than using a frontier model directly.

Milk Road AI

281,771 Aufrufe • vor 2 Monaten

General AI is already a dated concept. ThinkingAI connects an entire business ecosystem through MCP, pulling data, tools, and workflows into a single execution layer. Not isolated AI tools working separately. Coordinated agent systems triggering real actions across the whole operation. The shift is from using AI to running on it. Every company becomes an AI-powered system built on custom agent teams through the ThinkingAI Agentic Engine.
5:06

General AI is already a dated concept. ThinkingAI connects an entire business ecosystem through MCP, pulling data, tools, and workflows into a single execution layer. Not isolated AI tools working separately. Coordinated agent systems triggering real actions across the whole operation. The shift is from using AI to running on it. Every company becomes an AI-powered system built on custom agent teams through the ThinkingAI Agentic Engine.

Future Stacked

52,003 Aufrufe • vor 4 Monaten

was featured today on NVIDIA AI Nemotron Labs livestream on open model routing via their X pages and YouTube channels. We're an official NVIDIA Inception project running it in production: agent workloads routed between local Nemotron and frontier APIs. Thank you to the NVIDIA AIDev NVIDIA AIInfra and Nemotron Labs team for featuring us. Great session. #NVIDIAInception
0:55

was featured today on NVIDIA AI Nemotron Labs livestream on open model routing via their X pages and YouTube channels. We're an official NVIDIA Inception project running it in production: agent workloads routed between local Nemotron and frontier APIs. Thank you to the NVIDIA AIDev NVIDIA AIInfra and Nemotron Labs team for featuring us. Great session. #NVIDIAInception

three.ws

19,545 Aufrufe • vor 21 Tagen

Sam Altman said on camera at Stripe Sessions that we are in an insane area, stuck with old devices and old operating systems. The OS and the browser are built for humans clicking. Both get rewritten around agents that do not click. Two years deep building agents. Sharpest framing I have heard a frontier lab CEO put on the next interface. ↓ Read it before the gap locks in The part nobody is sitting with: >the chat window is the old interface >the new one is an agent in a loop with your machine >the gap between people prompting and people running agents is forming right now >in six months it will be permanent Open Claude, type a question, copy the answer, paste it into VS Code. The average dev runs this loop every day. They think they are using AI. That is 5% of what these tools can do. The people pulling ahead do not prompt. They build harnesses. They run agents in loops. Same model. Different output. Full 2026 agent playbook in the article below here:
0:35

Sam Altman said on camera at Stripe Sessions that we are in an insane area, stuck with old devices and old operating systems. The OS and the browser are built for humans clicking. Both get rewritten around agents that do not click. Two years deep building agents. Sharpest framing I have heard a frontier lab CEO put on the next interface. ↓ Read it before the gap locks in The part nobody is sitting with: >the chat window is the old interface >the new one is an agent in a loop with your machine >the gap between people prompting and people running agents is forming right now >in six months it will be permanent Open Claude, type a question, copy the answer, paste it into VS Code. The average dev runs this loop every day. They think they are using AI. That is 5% of what these tools can do. The people pulling ahead do not prompt. They build harnesses. They run agents in loops. Same model. Different output. Full 2026 agent playbook in the article below here:

Rohit

120,600 Aufrufe • vor 3 Monaten

TSMC controls 90% of advanced AI silicon and moves markets when it skips a supplier's equipment. But ASML is a single point of failure for every advanced node on the planet, and Applied Materials and Lam control nearly every other fab process step. Patrick Moorhead and Daniel Newman make the case for both sides.
7:43

TSMC controls 90% of advanced AI silicon and moves markets when it skips a supplier's equipment. But ASML is a single point of failure for every advanced node on the planet, and Applied Materials and Lam control nearly every other fab process step. Patrick Moorhead and Daniel Newman make the case for both sides.

Six Five Media

108,634 Aufrufe • vor 4 Monaten

Most AI deployments break when they leave the data center. At GTC, Patrick Moorhead + Daniel Newman talk with Lenovo Data Center’s Vlad Rozanovich and Jon Alexander of Akamai Technologies on what it takes to actually run AI at the edge: Latency Consistency Security Where are you seeing friction? Central infrastructure or edge execution?
15:19

Most AI deployments break when they leave the data center. At GTC, Patrick Moorhead + Daniel Newman talk with Lenovo Data Center’s Vlad Rozanovich and Jon Alexander of Akamai Technologies on what it takes to actually run AI at the edge: Latency Consistency Security Where are you seeing friction? Central infrastructure or edge execution?

Six Five Media

65,038 Aufrufe • vor 5 Monaten

The teams shipping AI agents right now are bleeding money on the dumbest possible expense: teaching a 400B-parameter model to read a file name. Every time an AI agent needs to "see" something today, it routes an image through a frontier model. OCR, object detection, checking if a button exists on screen. You're paying GPT-4o or Claude pricing for tasks that require perception, not reasoning. One agent workflow processing a few thousand screenshots per day can burn through more on vision calls than on the actual thinking. Perceptron's Isaac is 2B parameters. Built by the team that created Meta's Chameleon multimodal models. On perceptive benchmarks, it matches or beats models 50x its size. The VQA, OCR, and object detection scores are competitive with models running on infrastructure that costs orders of magnitude more. The MCP wrapper is the distribution play. One install command and every Claude Code agent can offload vision tasks to a model that runs on a single consumer GPU. The agent keeps its reasoning in the frontier model and routes perception to a specialist. That split is how you get vision-heavy agent workflows from "technically possible but expensive" to "cheap enough to run on everything." This is the same pattern that won in every other compute-intensive stack. General-purpose handles orchestration. Specialists handle the heavy lifting. Graphics went through it. Audio went through it. Video encoding went through it. Vision in AI agents is next. The teams building agents that see 10,000 images a day will care about this before anyone else does.
0:38

The teams shipping AI agents right now are bleeding money on the dumbest possible expense: teaching a 400B-parameter model to read a file name. Every time an AI agent needs to "see" something today, it routes an image through a frontier model. OCR, object detection, checking if a button exists on screen. You're paying GPT-4o or Claude pricing for tasks that require perception, not reasoning. One agent workflow processing a few thousand screenshots per day can burn through more on vision calls than on the actual thinking. Perceptron's Isaac is 2B parameters. Built by the team that created Meta's Chameleon multimodal models. On perceptive benchmarks, it matches or beats models 50x its size. The VQA, OCR, and object detection scores are competitive with models running on infrastructure that costs orders of magnitude more. The MCP wrapper is the distribution play. One install command and every Claude Code agent can offload vision tasks to a model that runs on a single consumer GPU. The agent keeps its reasoning in the frontier model and routes perception to a specialist. That split is how you get vision-heavy agent workflows from "technically possible but expensive" to "cheap enough to run on everything." This is the same pattern that won in every other compute-intensive stack. General-purpose handles orchestration. Specialists handle the heavy lifting. Graphics went through it. Audio went through it. Video encoding went through it. Vision in AI agents is next. The teams building agents that see 10,000 images a day will care about this before anyone else does.

Aakash Gupta

55,978 Aufrufe • vor 5 Monaten

Every AI product running in production depends on an inference system someone had to engineer, optimize and more. Scheduling, batching, routing, cost per token. This is a craft. The Inference Frontier Program spotlights the builders behind that work. 💡 Watch the video and nominate a team:
1:22

Every AI product running in production depends on an inference system someone had to engineer, optimize and more. Scheduling, batching, routing, cost per token. This is a craft. The Inference Frontier Program spotlights the builders behind that work. 💡 Watch the video and nominate a team:

Nebius

54,701 Aufrufe • vor 6 Monaten