Loading video...

Video Failed to Load

Go Home

AI inference isn’t just about GPUs. The host CPU is critical. On this Signal65 podcast, Ryan Shrout, Russ Fellows, and Mitch Lewis speak with AMD’s Madhu Rangarajan and Curt Waltman on how AMDServer EPYC CPUs improve enterprise AI inference performance. Full episode:

TheSixFiveMedia's profile picture

Six Five Media

4,535 subscribers

120,594 views • 7 months ago •via X (Twitter)

News & PoliticsEducationScience & Technology
LIVE

Anya Rossi• Live Now

Private livecam show

0 Comments

No comments available

Comments from the original post will appear here

Related Videos

AI deployment doesn’t have to mean reinventing your infrastructure. AMD’s Suresh Andani explains how AMD Instinct MI350P PCIe GPUs combine open software, enterprise-ready AI infrastructure, and scalable inference performance to help organizations accelerate AI adoption within existing data centers. Same racks. Same cooling. Dramatically more AI. Watch the full video on YouTube:
1:14

AI deployment doesn’t have to mean reinventing your infrastructure. AMD’s Suresh Andani explains how AMD Instinct MI350P PCIe GPUs combine open software, enterprise-ready AI infrastructure, and scalable inference performance to help organizations accelerate AI adoption within existing data centers. Same racks. Same cooling. Dramatically more AI. Watch the full video on YouTube:

AMD

19,285 views • 4 months ago

Agentic AI is exposing the limits of traditional LLM benchmarks—and forcing a rethink of how enterprise AI value is actually measured. Analysts Ryan Shrout & Mitch Lewis join Kamiwaza AI Platform Engineer JV Roig to unpack new research from Signal65 and Kamiwaza that demonstrates why legacy benchmarks miss real-world agentic work, and how the Kamiwaza Agentic Merit Index (KAMI) delivers a more meaningful way to evaluate enterprise-ready agentic AI.
27:29

Agentic AI is exposing the limits of traditional LLM benchmarks—and forcing a rethink of how enterprise AI value is actually measured. Analysts Ryan Shrout & Mitch Lewis join Kamiwaza AI Platform Engineer JV Roig to unpack new research from Signal65 and Kamiwaza that demonstrates why legacy benchmarks miss real-world agentic work, and how the Kamiwaza Agentic Merit Index (KAMI) delivers a more meaningful way to evaluate enterprise-ready agentic AI.

Six Five Media

166,438 views • 9 months ago

Setting the Pace for Enterprise AI Infrastructure! From HPE Discover Barcelona 2025, David Nicholson () and Ryan Shrout talk with HPE’s Trish Damkroger and AMD’s Safy Fishov about the HPE Cray XD685, the expanding HPE–AMD partnership, and the breakthroughs driving scalable performance, efficiency, and sovereign AI.
16:41

Setting the Pace for Enterprise AI Infrastructure! From HPE Discover Barcelona 2025, David Nicholson () and Ryan Shrout talk with HPE’s Trish Damkroger and AMD’s Safy Fishov about the HPE Cray XD685, the expanding HPE–AMD partnership, and the breakthroughs driving scalable performance, efficiency, and sovereign AI.

Six Five Media

183,627 views • 9 months ago

Accelerate AI innovation with ASI:Cloud, a high-performance cloud platform focusing on inference and AI workloads. Designed with performance, permissionless access, transparent pricing, and access to industry-leading LLMs, including ASI:One, the platform helps builders, developers, and enterprise teams move from idea to inference at scale. Ready to start your ASI infrastructure journey? Explore here:
0:53

Accelerate AI innovation with ASI:Cloud, a high-performance cloud platform focusing on inference and AI workloads. Designed with performance, permissionless access, transparent pricing, and access to industry-leading LLMs, including ASI:One, the platform helps builders, developers, and enterprise teams move from idea to inference at scale. Ready to start your ASI infrastructure journey? Explore here:

SingularityNET

24,547 views • 11 months ago

Exciting update for ComfyUI users on Intel hardware! - The new OpenVINO custom node is now available for ComfyUI - Unlock faster AI inference on Intel CPUs, GPUs, and NPUs - No hardware upgrade needed, just install the ComfyUI-OpenVINO node Enjoy smoother, more efficient workflows with Intel acceleration 🧵 ↓
0:57

Exciting update for ComfyUI users on Intel hardware! - The new OpenVINO custom node is now available for ComfyUI - Unlock faster AI inference on Intel CPUs, GPUs, and NPUs - No hardware upgrade needed, just install the ComfyUI-OpenVINO node Enjoy smoother, more efficient workflows with Intel acceleration 🧵 ↓

ComfyUI

10,378 views • 1 year ago

AI infra isn’t just focused on compute. Orchestration, data movement, and flexibility are becoming critical. From GTC, Brendan Burke talks with MiTAC Computing’s Raymond Huang on the “inference inflection.” What matters now: • Flexible > fixed infrastructure • Orchestration = scale • Data movement drives performance
9:47

AI infra isn’t just focused on compute. Orchestration, data movement, and flexibility are becoming critical. From GTC, Brendan Burke talks with MiTAC Computing’s Raymond Huang on the “inference inflection.” What matters now: • Flexible > fixed infrastructure • Orchestration = scale • Data movement drives performance

Six Five Media

43,968 views • 6 months ago

$AMD is becoming a two-engine AI story with EPYC CPUs for the growing compute needed around agentic workloads and Instinct GPUs for hyperscalers that need a credible alternative to $NVDA. The CPU side still looks underappreciated as AI agents require more high-core-count server compute and 2nm Venice should help AMD keep taking share as $INTC works through roadmap and manufacturing challenges. The bridge is Helios where AMD can package EPYC CPUs, Instinct GPUs and Pensando networking into a full rack-scale AI platform backed by real demand from $META, $ORCL and OpenAI.
0:59

$AMD is becoming a two-engine AI story with EPYC CPUs for the growing compute needed around agentic workloads and Instinct GPUs for hyperscalers that need a credible alternative to $NVDA. The CPU side still looks underappreciated as AI agents require more high-core-count server compute and 2nm Venice should help AMD keep taking share as $INTC works through roadmap and manufacturing challenges. The bridge is Helios where AMD can package EPYC CPUs, Instinct GPUs and Pensando networking into a full rack-scale AI platform backed by real demand from $META, $ORCL and OpenAI.

Shay Boloor

89,204 views • 2 months ago

Today, AMD and Microsoft are announcing an expanded strategic partnership to deliver a full stack of AMD AI solutions for Microsoft Azure, spanning GPUs, CPUs, networking and software. At the center of this expansion, Microsoft will deploy AMD Helios to power frontier model AI inference for Microsoft, its AI customers and support Azure AI services. Read more on the news ahead of #AdvancingAI:
0:20

Today, AMD and Microsoft are announcing an expanded strategic partnership to deliver a full stack of AMD AI solutions for Microsoft Azure, spanning GPUs, CPUs, networking and software. At the center of this expansion, Microsoft will deploy AMD Helios to power frontier model AI inference for Microsoft, its AI customers and support Azure AI services. Read more on the news ahead of #AdvancingAI:

AMD

159,091 views • 2 months ago

AkashML is live! A fully managed AI inference service on Akash Network. Deploying open models like DeepSeek shouldn’t cost $50K/month or require complex setup. AkashML makes inference simple, affordable, and automatic, so developers can run AI workloads on decentralized GPUs with ease. Try it out here 👇 Read More about it Here 👇
0:39

AkashML is live! A fully managed AI inference service on Akash Network. Deploying open models like DeepSeek shouldn’t cost $50K/month or require complex setup. AkashML makes inference simple, affordable, and automatic, so developers can run AI workloads on decentralized GPUs with ease. Try it out here 👇 Read More about it Here 👇

Akash Network

37,077 views • 10 months ago

We are innovating the full-stack AI infrastructure platform on a one-year rhythm — pushing the boundaries of inference performance across chips, systems, and software. NVIDIA Blackwell is the most advanced AI platform ever built — continuously optimized for record-breaking performance. Groundbreaking advancements include the NVIDIA-designed NVFP4 format, enabling high inference performance and accuracy. #GTCParis at #VivaTech
1:06

We are innovating the full-stack AI infrastructure platform on a one-year rhythm — pushing the boundaries of inference performance across chips, systems, and software. NVIDIA Blackwell is the most advanced AI platform ever built — continuously optimized for record-breaking performance. Groundbreaking advancements include the NVIDIA-designed NVFP4 format, enabling high inference performance and accuracy. #GTCParis at #VivaTech

NVIDIA

80,665 views • 1 year ago

What is AI inference engineering, why is it such an in-demand skill, and how do you break into the field? With author of Inference Engineering Philip Kiely and head of training at Baseten Charlie O'Neill 0:00: What is inference? 2:47: History of inference 4:59: Downstream effects of AI research on inference 13:54: What you'll learn from Inference Engineering 16:14: Advice for engineers transitioning into AI 19:00: Open source models driving inference growth 20:55: Specialization vs. frontier closed models 23:51: "Big Token" and the importance of open source AI 27:18: Where to get Inference Engineering
27:58

What is AI inference engineering, why is it such an in-demand skill, and how do you break into the field? With author of Inference Engineering Philip Kiely and head of training at Baseten Charlie O'Neill 0:00: What is inference? 2:47: History of inference 4:59: Downstream effects of AI research on inference 13:54: What you'll learn from Inference Engineering 16:14: Advice for engineers transitioning into AI 19:00: Open source models driving inference growth 20:55: Specialization vs. frontier closed models 23:51: "Big Token" and the importance of open source AI 27:18: Where to get Inference Engineering

Madison Kanna

119,268 views • 6 months ago

$AMD $AMZN partnership will 🚀 in 2026 🔥 Amazon/AMD partnership is hidden among hot headlines from OpenAI $NVDA $ORCL... TLDR: Amazon refused to bid up the overpriced $NVDA chips among other hyperscalers, and decided to work closely with $AMD. Amazon is expected to spend up to $10-$20B a year on 2026 EPYC breakthrough Gen and Future Gen. Dr. Su confirmed "we have plenty for other large customers". For its 2026 EPYC "Venice" processors, AMD is using a multi-node manufacturing strategy: the CPU core complex dies (CCDs) are built on TSMC's 2 nm-class node (N2), while the I/O die (IOD) uses the N3P (3 nm) process. Context: Andy Jassy Amazon Web Services has been working with AMD on EPYC processors since November 2018. With this "secret weapon" breakthrough(patented), this long time partnership has expanded to New breakthrough 2026 EPYC Gen. AMD's 6th Gen EPYC "Venice" processors, slated for 2026, introduce New Chiplet design breakthrough. a revolutionary chiplet interconnect fabric that redefines server scalability for AI. This isn't just faster silicon; it's a paradigm shift for AWS, enabling hyper-efficient, rack-scale AI inference that slashes costs and latency while boosting throughput. AMD to benefit AWS's $100B+ AI opportunity along with $ORCL $MSFT $GOOGL $META Saudi, UAE ,38+ countries and startups. In early October, Amazon/AWS announced the new EC2 M8a instances as their latest-generation, general-purpose compute instances now powered by AMD EPYC 9005 "Turin" processors. Amazon announced the M8a as having up to 30% higher performance and up to 19% better price performance over M7a. With my testing of both at 32 vCPUs, the new AMD EPYC Turin instance provided 1.59x the performance over the prior-generation EPYC Genoa instance! How will this impact AWS AI Inference? ~Cost Efficiency: Inference is 80%+ of AI workloads and latency-sensitive (e.g., chatbots need <1s responses). "Secret weapon" enables 35x better inference perf (per AMD's CDNA roadmap tie-in), cutting AWS's energy use by 50%+ in clusters. With $118B 2025 capex, this could save $20–$30B annually in OPEX, boosting margins to 35%-40%. ~Scalability for Agentic AI: Supports "Helios" rack-scale platforms (up to 128 GPUs + EPYC hosts), delivering 3.58x FP6 perf for distributed inference. AWS can run 700K+ more tokens/sec in 1,000-node clusters (via EPYC 9575F boosts), enabling real-time apps like personalized search or fraud detection at enterprise scale. ~Adoption Catalysts: Early partners like Oracle signal broad uptake; AWS's existing AMD instances G4ad with Radeon GPUs) pave the way. By 2026, EPYC could power 40%+ of AWS AI infra, outpacing Nvidia's GPU lock-in via open standards (ROCm 8 software). Lastly, Amazon’s trajectory toward a $320 stock price is not a speculative leap but a grounded projection rooted in its unmatched fundamentals and strategic AI leadership. With Amazon Web Services poised to surpass $100 billion in annual revenue by 2026, driven by explosive AI inference demand, Amazon is redefining cloud computing’s future. The adoption of AMD’s 2026 EPYC processors with "Secret" architecture is a game-changer, slashing costs by up to 50% and boosting inference throughput 3x, enabling AWS to dominate enterprise AI workloads with unmatched efficiency. This technological edge, combined with Amazon’s e-commerce dominance and high-margin advertising growth, supports a valuation rerating to 22x EV/EBITDA, and it is still a discount to historical highs. Trading at $222, $AMZN is undervalued for its 15–20% revenue CAGR and 25%+ EPS growth through 2030.
0:49

$AMD $AMZN partnership will 🚀 in 2026 🔥 Amazon/AMD partnership is hidden among hot headlines from OpenAI $NVDA $ORCL... TLDR: Amazon refused to bid up the overpriced $NVDA chips among other hyperscalers, and decided to work closely with $AMD. Amazon is expected to spend up to $10-$20B a year on 2026 EPYC breakthrough Gen and Future Gen. Dr. Su confirmed "we have plenty for other large customers". For its 2026 EPYC "Venice" processors, AMD is using a multi-node manufacturing strategy: the CPU core complex dies (CCDs) are built on TSMC's 2 nm-class node (N2), while the I/O die (IOD) uses the N3P (3 nm) process. Context: Andy Jassy Amazon Web Services has been working with AMD on EPYC processors since November 2018. With this "secret weapon" breakthrough(patented), this long time partnership has expanded to New breakthrough 2026 EPYC Gen. AMD's 6th Gen EPYC "Venice" processors, slated for 2026, introduce New Chiplet design breakthrough. a revolutionary chiplet interconnect fabric that redefines server scalability for AI. This isn't just faster silicon; it's a paradigm shift for AWS, enabling hyper-efficient, rack-scale AI inference that slashes costs and latency while boosting throughput. AMD to benefit AWS's $100B+ AI opportunity along with $ORCL $MSFT $GOOGL $META Saudi, UAE ,38+ countries and startups. In early October, Amazon/AWS announced the new EC2 M8a instances as their latest-generation, general-purpose compute instances now powered by AMD EPYC 9005 "Turin" processors. Amazon announced the M8a as having up to 30% higher performance and up to 19% better price performance over M7a. With my testing of both at 32 vCPUs, the new AMD EPYC Turin instance provided 1.59x the performance over the prior-generation EPYC Genoa instance! How will this impact AWS AI Inference? ~Cost Efficiency: Inference is 80%+ of AI workloads and latency-sensitive (e.g., chatbots need <1s responses). "Secret weapon" enables 35x better inference perf (per AMD's CDNA roadmap tie-in), cutting AWS's energy use by 50%+ in clusters. With $118B 2025 capex, this could save $20–$30B annually in OPEX, boosting margins to 35%-40%. ~Scalability for Agentic AI: Supports "Helios" rack-scale platforms (up to 128 GPUs + EPYC hosts), delivering 3.58x FP6 perf for distributed inference. AWS can run 700K+ more tokens/sec in 1,000-node clusters (via EPYC 9575F boosts), enabling real-time apps like personalized search or fraud detection at enterprise scale. ~Adoption Catalysts: Early partners like Oracle signal broad uptake; AWS's existing AMD instances G4ad with Radeon GPUs) pave the way. By 2026, EPYC could power 40%+ of AWS AI infra, outpacing Nvidia's GPU lock-in via open standards (ROCm 8 software). Lastly, Amazon’s trajectory toward a $320 stock price is not a speculative leap but a grounded projection rooted in its unmatched fundamentals and strategic AI leadership. With Amazon Web Services poised to surpass $100 billion in annual revenue by 2026, driven by explosive AI inference demand, Amazon is redefining cloud computing’s future. The adoption of AMD’s 2026 EPYC processors with "Secret" architecture is a game-changer, slashing costs by up to 50% and boosting inference throughput 3x, enabling AWS to dominate enterprise AI workloads with unmatched efficiency. This technological edge, combined with Amazon’s e-commerce dominance and high-margin advertising growth, supports a valuation rerating to 22x EV/EBITDA, and it is still a discount to historical highs. Trading at $222, $AMZN is undervalued for its 15–20% revenue CAGR and 25%+ EPS growth through 2030.

Mike

511,082 views • 11 months ago

AI inference is already live on UOMI Router. Access frontier open-source models through a decentralized inference network with: • Low-cost inference • OpenAI-compatible APIs • Verifiable compute • On-chain settlement Start building: And if you have idle GPUs, there's now a second way to participate. The UOMI Provider whitelist is officially open. Instead of letting your hardware sit unused, you can contribute GPU power to the UOMI Inference Network and earn from real AI demand. Join the Provider whitelist:
0:34

AI inference is already live on UOMI Router. Access frontier open-source models through a decentralized inference network with: • Low-cost inference • OpenAI-compatible APIs • Verifiable compute • On-chain settlement Start building: And if you have idle GPUs, there's now a second way to participate. The UOMI Provider whitelist is officially open. Instead of letting your hardware sit unused, you can contribute GPU power to the UOMI Inference Network and earn from real AI demand. Join the Provider whitelist:

Uomi

18,982 views • 3 months ago

Accelerate AI through Decentralization, with Oliver Shen (Gata AI) 🎧 Ep #161 | Oliver Shen (Oliver) | Gata AI (Gata) hey wagmi fam, we are joined on today's podcast episode by a leading innovator in blockchain and ai Oliver, he shares incredible insights on building decentralized AI infrastructure platform Gata transforming the trillion-dollar AI economy with tools like GataGPT, DataAgent, and decentralized model inference. enjoy the episode!
0:32

Accelerate AI through Decentralization, with Oliver Shen (Gata AI) 🎧 Ep #161 | Oliver Shen (Oliver) | Gata AI (Gata) hey wagmi fam, we are joined on today's podcast episode by a leading innovator in blockchain and ai Oliver, he shares incredible insights on building decentralized AI infrastructure platform Gata transforming the trillion-dollar AI economy with tools like GataGPT, DataAgent, and decentralized model inference. enjoy the episode!

WAGMI Ventures

12,703 views • 1 year ago

Enterprise AI adoption shouldn’t require rebuilding your data center. AMD’s Suresh Andani shares how the new AMD Instinct MI350P PCIe cards enable enterprises to deploy and scale generative and agentic AI using existing air-cooled infrastructure, while delivering strong AI performance and operational simplicity. Watch the full video on YouTube:
1:05

Enterprise AI adoption shouldn’t require rebuilding your data center. AMD’s Suresh Andani shares how the new AMD Instinct MI350P PCIe cards enable enterprises to deploy and scale generative and agentic AI using existing air-cooled infrastructure, while delivering strong AI performance and operational simplicity. Watch the full video on YouTube:

AMD

14,960 views • 4 months ago

We are just at the beginning of AI investment. Emad joined me on the podcast to discuss his paper, "How to Think About AI," and the current and future state of AI. This episode is a must-watch.
0:57

We are just at the beginning of AI investment. Emad joined me on the podcast to discuss his paper, "How to Think About AI," and the current and future state of AI. This episode is a must-watch.

Peter H. Diamandis, MD

25,081 views • 2 years ago

Decentralized GPU had its cycle. What is running now is decentralized inference, where the question stops being how many GPUs sit in your network and becomes how many people pay to run real AI work on them, verified on chain. Venice is doing some of this already.
2:08

Decentralized GPU had its cycle. What is running now is decentralized inference, where the question stops being how many GPUs sit in your network and becomes how many people pay to run real AI work on them, verified on chain. Venice is doing some of this already.

VirtualBacon

22,176 views • 7 days ago