Loading video...

Video Failed to Load

Go Home

As enterprise AI usage grows, so does token usage. AMD’s Madhu Rangarajan explains how intelligent model routing can match requests to the right AI resource to help enterprises optimize growing token costs without compromising output quality. Watch his interview:

AMD's profile picture

AMD

1,283,424 subscribers

31,747 views • 4 days ago •via X (Twitter)

LIVE

Anya Rossi• Live Now

Private livecam show

0 Comments

No comments available

Comments from the original post will appear here

Related Videos

A new metric for the agentic AI era: threads per megawatt. AMD’s Madhu Rangarajan explains how AMD EPYC processors are designed to maximize concurrent workloads within existing data center power limits. Learn more:
1:36

A new metric for the agentic AI era: threads per megawatt. AMD’s Madhu Rangarajan explains how AMD EPYC processors are designed to maximize concurrent workloads within existing data center power limits. Learn more:

AMD

72,324 views • 7 days ago

There’s no one-size-fits-all SKU for agentic AI. “The customer environments are diverse, the workloads are diverse, the constraints are diverse.” AMD’s Madhu Rangarajan explains why end-to-end agentic workflows will continue to require different compute configurations:
1:54

There’s no one-size-fits-all SKU for agentic AI. “The customer environments are diverse, the workloads are diverse, the constraints are diverse.” AMD’s Madhu Rangarajan explains why end-to-end agentic workflows will continue to require different compute configurations:

AMD

27,357 views • 2 days ago

AI deployment doesn’t have to mean reinventing your infrastructure. AMD’s Suresh Andani explains how AMD Instinct MI350P PCIe GPUs combine open software, enterprise-ready AI infrastructure, and scalable inference performance to help organizations accelerate AI adoption within existing data centers. Same racks. Same cooling. Dramatically more AI. Watch the full video on YouTube:
1:14

AI deployment doesn’t have to mean reinventing your infrastructure. AMD’s Suresh Andani explains how AMD Instinct MI350P PCIe GPUs combine open software, enterprise-ready AI infrastructure, and scalable inference performance to help organizations accelerate AI adoption within existing data centers. Same racks. Same cooling. Dramatically more AI. Watch the full video on YouTube:

AMD

19,285 views • 3 months ago

Enterprise AI adoption shouldn’t require rebuilding your data center. AMD’s Suresh Andani shares how the new AMD Instinct MI350P PCIe cards enable enterprises to deploy and scale generative and agentic AI using existing air-cooled infrastructure, while delivering strong AI performance and operational simplicity. Watch the full video on YouTube:
1:05

Enterprise AI adoption shouldn’t require rebuilding your data center. AMD’s Suresh Andani shares how the new AMD Instinct MI350P PCIe cards enable enterprises to deploy and scale generative and agentic AI using existing air-cooled infrastructure, while delivering strong AI performance and operational simplicity. Watch the full video on YouTube:

AMD

14,960 views • 3 months ago

As AI model usage grows exponentially and inference demand accelerates, we believe energy, not compute, becomes the primary constraint. MARA CEO Fred Thiel explains how "electrons are a very valuable thing to have." Watch:
0:59

As AI model usage grows exponentially and inference demand accelerates, we believe energy, not compute, becomes the primary constraint. MARA CEO Fred Thiel explains how "electrons are a very valuable thing to have." Watch:

MARA

22,621 views • 9 months ago

“Any model, any agent, any accelerator, and any cloud.” Red Hat’s Brian Stevens explains why open AI infrastructure matters as enterprises scale agentic AI workloads, and how Red Hat and AMD are collaborating to help simplify deployment with AMD EPYC processors and AMD Instinct GPUs. Watch the full video on YouTube:
1:02

“Any model, any agent, any accelerator, and any cloud.” Red Hat’s Brian Stevens explains why open AI infrastructure matters as enterprises scale agentic AI workloads, and how Red Hat and AMD are collaborating to help simplify deployment with AMD EPYC processors and AMD Instinct GPUs. Watch the full video on YouTube:

AMD

17,208 views • 3 months ago

Agents are scaling. So are the token costs. CIOs are shifting to AI PCs as strategic nodes. Ryzen AI Max 400 series changes the equation with 192GB of memory for local LLMs and agent swarms. You overheard it here first at Computex.
1:29

Agents are scaling. So are the token costs. CIOs are shifting to AI PCs as strategic nodes. Ryzen AI Max 400 series changes the equation with 192GB of memory for local LLMs and agent swarms. You overheard it here first at Computex.

AMD

11,342 views • 2 months ago

Introducing Smart Routing in Unity AI Gateway. Stop overpaying for AI. Smart Routing matches each coding task to the right model and harness based on what the task needs, so higher-cost models can differentiate on intelligence while lower-cost models differentiate on cost and performance. Match frontier quality and cut task costs by 30%+.
0:37

Introducing Smart Routing in Unity AI Gateway. Stop overpaying for AI. Smart Routing matches each coding task to the right model and harness based on what the task needs, so higher-cost models can differentiate on intelligence while lower-cost models differentiate on cost and performance. Match frontier quality and cut task costs by 30%+.

Databricks

123,548 views • 8 days ago

Enterprise AI isn't one-size-fits-all. Dan McNamara, AMD SVP and GM of Compute and Enterprise AI, explains why the future is a distributed AI deployment model spanning cloud, on-premises infrastructure and AI PCs. Hear how AMD is enabling every stage of the AI journey.
0:58

Enterprise AI isn't one-size-fits-all. Dan McNamara, AMD SVP and GM of Compute and Enterprise AI, explains why the future is a distributed AI deployment model spanning cloud, on-premises infrastructure and AI PCs. Hear how AMD is enabling every stage of the AI journey.

AMD

32,843 views • 11 days ago

AMD is partnering with Luma AI to help shape AI innovation. From hardware to software, AMD and Luma AI are working together to optimize models while reducing costs. Thanks, Amit Jain (amit), for joining us on the keynote stage at CES this year.
0:59

AMD is partnering with Luma AI to help shape AI innovation. From hardware to software, AMD and Luma AI are working together to optimize models while reducing costs. Thanks, Amit Jain (amit), for joining us on the keynote stage at CES this year.

AMD

19,375 views • 7 months ago

The future of enterprise AI is increasingly open. Hear AT&T CTO Jeremy Legg discuss how his team is using AMD solutions to support its growing adoption of open-source AI models while increasing accuracy and lowering cost.
0:54

The future of enterprise AI is increasingly open. Hear AT&T CTO Jeremy Legg discuss how his team is using AMD solutions to support its growing adoption of open-source AI models while increasing accuracy and lowering cost.

AMD

37,500 views • 18 days ago

Production AI workloads demand infrastructure that is governable, efficient, and easy to deploy. Hear how Uniphore is using AMD Instinct MI350P PCIe cards to help deliver secure, enterprise-grade conversational and generative AI for more than 2,500 customers. Watch the full video on YouTube:
0:38

Production AI workloads demand infrastructure that is governable, efficient, and easy to deploy. Hear how Uniphore is using AMD Instinct MI350P PCIe cards to help deliver secure, enterprise-grade conversational and generative AI for more than 2,500 customers. Watch the full video on YouTube:

AMD

15,793 views • 3 months ago

Choosing the right model is only part of the conversation. Hear Anthropic's Head of Claude Code, Boris Cherny (@BCherny), discuss why maximizing AI returns is just as important as managing costs. Watch the latest episode of Advanced Insights now:
0:44

Choosing the right model is only part of the conversation. Hear Anthropic's Head of Claude Code, Boris Cherny (@BCherny), discuss why maximizing AI returns is just as important as managing costs. Watch the latest episode of Advanced Insights now:

AMD

32,858 views • 23 days ago

David Sacks says companies are trapped paying OpenAI & Anthropic because they can't figure out how to use open source models "I think enterprise CTOs would like to shift their token consumption to cheaper models for the obvious reason that it would be more efficient. They are seeing compute costs or token costs skyrocket right now, so everyone's trying to figure this out." "You also have the AI sovereignty issue that Alex Karp talked about. They're worried about giving up the secret sauce or the alpha in their business to a frontier lab that may one day be competing with them. "The problem is, I think in most cases, they don't have the technical ability to do it. Coinbase figured out how to do it. DoorDash figured out how to do it. They built a token routing system that allows them to send frontier tasks to frontier models and non frontier tasks to more mundane models. But I don't think your average enterprise has the technical capability to do that." "This is why the share of wallet of closed models, it actually increased. I think that open source went from 19% last year to 11% this year. So open source as a share of enterprise spending is actually decreasing." "I don't think that means usage is decreasing. I think usage is skyrocketing. It also may be the case that because the whole point of using an open model is you just pay for the compute costs, you don't have to pay a lab, so it may be that it's hard to measure that usage in terms of spend." "But nonetheless, anyone who's saying that these closed models are going to lose or are somehow losing, you're just not seeing it in the data."
2:06

David Sacks says companies are trapped paying OpenAI & Anthropic because they can't figure out how to use open source models "I think enterprise CTOs would like to shift their token consumption to cheaper models for the obvious reason that it would be more efficient. They are seeing compute costs or token costs skyrocket right now, so everyone's trying to figure this out." "You also have the AI sovereignty issue that Alex Karp talked about. They're worried about giving up the secret sauce or the alpha in their business to a frontier lab that may one day be competing with them. "The problem is, I think in most cases, they don't have the technical ability to do it. Coinbase figured out how to do it. DoorDash figured out how to do it. They built a token routing system that allows them to send frontier tasks to frontier models and non frontier tasks to more mundane models. But I don't think your average enterprise has the technical capability to do that." "This is why the share of wallet of closed models, it actually increased. I think that open source went from 19% last year to 11% this year. So open source as a share of enterprise spending is actually decreasing." "I don't think that means usage is decreasing. I think usage is skyrocketing. It also may be the case that because the whole point of using an open model is you just pay for the compute costs, you don't have to pay a lab, so it may be that it's hard to measure that usage in terms of spend." "But nonetheless, anyone who's saying that these closed models are going to lose or are somehow losing, you're just not seeing it in the data."

dnap

110,354 views • 1 month ago

$PLTR $AMD | Dr. Karp and Dr. Su were right! ✍️ Companies are now fighting back. Dr. Karp, Palantir CEO, recently told CNBC that enterprises are privately "unhappy" with frontier AI labs like OpenAI and Anthropic, accusing them of prioritizing "tokenmaxxing" or maximizing AI token consumption to signal activity over delivering real business value and understanding customer needs. Uber, Coinbases routing to capping token usage or routing to cheaper models to keep cost under control. or Microsoft revoked Claude Code licenses companywide, Priceline imposed token limits after sharp cost spikes, and reports cite Meta, Salesforce, and multiple unnamed firms facing 3x+ budget overruns or $ hundreds of millions in unexpected spend by mid-2026. Analysts note this as an emerging industry pattern, with FinOps and executives describing "existential crises" over token bills; dozens of enterprises are now adding guardrails, though public complaints remain concentrated among high-profile tech firms experimenting at scale. Dr. Lisa Su anticipated the pivot to inference economics and CPU-dense systems for agentic AI, correctly predicting that token costs, power efficiency, and deployability on standard platforms would determine scalable adoption long before the current enterprise pushback. Dr. Alex Karp accurately diagnosed the disconnect in frontier labs' approach, calling out "tokenmaxxing" as activity without outcomes; enterprises are indeed demanding real implementation and business-specific value rather than raw volume that inflates bills without proportional ROI. Together, their independent foresight validates the maturing AI thesis, efficient infrastructure (AMD Helios/EPYC optimized for lowest TCO & $/M Tokens) paired with outcome-focused platforms (Palantir AIP/Foundry) positions both companies to benefit as the market shifts from hype-driven consumption to sustainable, value-driven deployment. Yes it may look good on the revenue growth for AI Labs to show off on IPOs investors/bankers, but the customers have to find value in those tokens spent where $NVDA & In-house chips on inference claims are just false. At the end of the day, ~Token cost needs to go down more & more particularly inference by owning more AMD chips/racks. In-house chips can make all kind of claims for years, but the bills enterprises paid have to obey economic. ~Enterprises want a thick software OS or solution focused, they do not want to have unlimited budget for "tokenmaxxing" where it is leading to high costs with limited business transformation; success increasingly depends on implementation layers that route tasks, enforce policies, and connect AI to existing workflows. Not Financial Advice! DYOR!
2:07

$PLTR $AMD | Dr. Karp and Dr. Su were right! ✍️ Companies are now fighting back. Dr. Karp, Palantir CEO, recently told CNBC that enterprises are privately "unhappy" with frontier AI labs like OpenAI and Anthropic, accusing them of prioritizing "tokenmaxxing" or maximizing AI token consumption to signal activity over delivering real business value and understanding customer needs. Uber, Coinbases routing to capping token usage or routing to cheaper models to keep cost under control. or Microsoft revoked Claude Code licenses companywide, Priceline imposed token limits after sharp cost spikes, and reports cite Meta, Salesforce, and multiple unnamed firms facing 3x+ budget overruns or $ hundreds of millions in unexpected spend by mid-2026. Analysts note this as an emerging industry pattern, with FinOps and executives describing "existential crises" over token bills; dozens of enterprises are now adding guardrails, though public complaints remain concentrated among high-profile tech firms experimenting at scale. Dr. Lisa Su anticipated the pivot to inference economics and CPU-dense systems for agentic AI, correctly predicting that token costs, power efficiency, and deployability on standard platforms would determine scalable adoption long before the current enterprise pushback. Dr. Alex Karp accurately diagnosed the disconnect in frontier labs' approach, calling out "tokenmaxxing" as activity without outcomes; enterprises are indeed demanding real implementation and business-specific value rather than raw volume that inflates bills without proportional ROI. Together, their independent foresight validates the maturing AI thesis, efficient infrastructure (AMD Helios/EPYC optimized for lowest TCO & $/M Tokens) paired with outcome-focused platforms (Palantir AIP/Foundry) positions both companies to benefit as the market shifts from hype-driven consumption to sustainable, value-driven deployment. Yes it may look good on the revenue growth for AI Labs to show off on IPOs investors/bankers, but the customers have to find value in those tokens spent where $NVDA & In-house chips on inference claims are just false. At the end of the day, ~Token cost needs to go down more & more particularly inference by owning more AMD chips/racks. In-house chips can make all kind of claims for years, but the bills enterprises paid have to obey economic. ~Enterprises want a thick software OS or solution focused, they do not want to have unlimited budget for "tokenmaxxing" where it is leading to high costs with limited business transformation; success increasingly depends on implementation layers that route tasks, enforce policies, and connect AI to existing workflows. Not Financial Advice! DYOR!

Mike

253,557 views • 1 month ago

Point integrations won’t carry enterprise AI forward. At RSAC, Commvault's Michelle Graff lays out the shift: organizations need a new operating model where ecosystems move beyond integrations to agentic solutions that connect data, security, and infrastructure in real time. Watch the full interview to see how enterprises are redesigning resilience for the AI era:
0:55

Point integrations won’t carry enterprise AI forward. At RSAC, Commvault's Michelle Graff lays out the shift: organizations need a new operating model where ecosystems move beyond integrations to agentic solutions that connect data, security, and infrastructure in real time. Watch the full interview to see how enterprises are redesigning resilience for the AI era:

Six Five Media

99,352 views • 4 months ago

AI moves fast and open ecosystems help developers keep pace. AMD SVP of AI Vamsi Boppana explains how openness gives developers the choice to build with the frameworks, environments and communities they know.
0:37

AI moves fast and open ecosystems help developers keep pace. AMD SVP of AI Vamsi Boppana explains how openness gives developers the choice to build with the frameworks, environments and communities they know.

AMD

29,488 views • 4 days ago