Loading video...

Video Failed to Load

There was a problem loading this video. This could be due to a temporary network issue or the video might be unavailable.

$META is betting on $AMD for AI inference. As AI models become more commoditized, total cost of ownership for token generation matters more than ever. $AMD GPUs are far more cost-efficient than $NVDA for inference. With 3.5B daily users ready to use its AI models, $META is going all-in... show more

Daniel

23,226 subscribers

20,558 views • 7 months ago •via X (Twitter)

Anya Rossi• Live Now

Private livecam show

0 Comments

No comments available

Comments from the original post will appear here

Related Videos

$AMD $NVDA| called it! 🚨🚨🚨 $NVDA produces expensive tokens. Inference (Cost per Million Tokens) ~$NVDA B200 / HGX: ~$0.02–$0.08 ~$AMD Helios Racks: $0.0003-$0.0005 (Read more below to understand) Companies are capping Inference token! This is how AMD shareholders gonna be in 2030.

$AMD $NVDA| called it! 🚨🚨🚨 $NVDA produces expensive tokens. Inference (Cost per Million Tokens) ~$NVDA B200 / HGX: ~$0.02–$0.08 ~$AMD Helios Racks: $0.0003-$0.0005 (Read more below to understand) Companies are capping Inference token! This is how AMD shareholders gonna be in 2030.

Mike

19,843 views • 3 months ago

Today, AMD and Microsoft are announcing an expanded strategic partnership to deliver a full stack of AMD AI solutions for Microsoft Azure, spanning GPUs, CPUs, networking and software. At the center of this expansion, Microsoft will deploy AMD Helios to power frontier model AI inference for Microsoft, its AI customers and support Azure AI services. Read more on the news ahead of #AdvancingAI:

Today, AMD and Microsoft are announcing an expanded strategic partnership to deliver a full stack of AMD AI solutions for Microsoft Azure, spanning GPUs, CPUs, networking and software. At the center of this expansion, Microsoft will deploy AMD Helios to power frontier model AI inference for Microsoft, its AI customers and support Azure AI services. Read more on the news ahead of #AdvancingAI:

AMD

156,284 views • 1 month ago

Learn how Inworld AI teamed up with Modular and Oracle Cloud to unlock hardware optionality across Nvidia and AMD GPUs for their groundbreaking TTS models, cutting total cost of model ownership by 70%.

Learn how Inworld AI teamed up with Modular and Oracle Cloud to unlock hardware optionality across Nvidia and AMD GPUs for their groundbreaking TTS models, cutting total cost of model ownership by 70%.

Modular

23,351 views • 11 months ago

ROCm on Windows? Yes, with WSL. AI developers can now run AMD ROCm on Windows, unlocking easier access to AMD GPUs for AI training, inference, and experimentation — no dual booting required. Get started with ComfyUI:

ROCm on Windows? Yes, with WSL. AI developers can now run AMD ROCm on Windows, unlocking easier access to AMD GPUs for AI training, inference, and experimentation — no dual booting required. Get started with ComfyUI:

AI at AMD

32,202 views • 1 year ago

ICYMI: AI is going local. AMD and @LiquidAI are enabling on-device agents that are more secure and efficient. Watch the latest Advanced Insights episode to learn more:

ICYMI: AI is going local. AMD and @LiquidAI are enabling on-device agents that are more secure and efficient. Watch the latest Advanced Insights episode to learn more:

AMD

19,548 views • 4 months ago

The future of compute is open. Vultr and AMD are delivering a collaborative, cloud-native ecosystem for next-gen enterprise applications. 📺 See why delivering AI at scale takes more than GPUs.

The future of compute is open. Vultr and AMD are delivering a collaborative, cloud-native ecosystem for next-gen enterprise applications. 📺 See why delivering AI at scale takes more than GPUs.

AMD

26,391 views • 10 months ago

1/ $AMD is a 10x opportunity everybody ignores. Lisa Su believes that inference will be a bigger market than training. Training is the cost center of AI workload while inference is where you make money. $AMD has an advantage here. Let me explain why: 🧵

1/ $AMD is a 10x opportunity everybody ignores. Lisa Su believes that inference will be a bigger market than training. Training is the cost center of AI workload while inference is where you make money. $AMD has an advantage here. Let me explain why: 🧵

Oguz Erkan

413,014 views • 1 year ago

"The inflection point for inference has arrived." — Jensen Huang, Founder & CEO of NVIDIA We’ve officially crossed a new milestone in the inference era — where widespread adoption of AI shifts from learning to doing. The breakthrough: extreme codesign across hardware and software driving down cost per token. Lower cost → more inference More inference → more users and applications More users and applications → exponential AI revenue growth

"The inflection point for inference has arrived." — Jensen Huang, Founder & CEO of NVIDIA We’ve officially crossed a new milestone in the inference era — where widespread adoption of AI shifts from learning to doing. The breakthrough: extreme codesign across hardware and software driving down cost per token. Lower cost → more inference More inference → more users and applications More users and applications → exponential AI revenue growth

NVIDIA

82,009 views • 5 months ago

Production AI workloads demand infrastructure that is governable, efficient, and easy to deploy. Hear how Uniphore is using AMD Instinct MI350P PCIe cards to help deliver secure, enterprise-grade conversational and generative AI for more than 2,500 customers. Watch the full video on YouTube:

Production AI workloads demand infrastructure that is governable, efficient, and easy to deploy. Hear how Uniphore is using AMD Instinct MI350P PCIe cards to help deliver secure, enterprise-grade conversational and generative AI for more than 2,500 customers. Watch the full video on YouTube:

AMD

15,793 views • 3 months ago

$AMD CEO Lisa Su said Helios has industry-leading specs and is on track to launch this year. Built with $META, Helios targets large-scale AI training & inference aiming for up to 10x performance where performance per dollar matters.

$AMD CEO Lisa Su said Helios has industry-leading specs and is on track to launch this year. Built with $META, Helios targets large-scale AI training & inference aiming for up to 10x performance where performance per dollar matters.

Shay Boloor

118,072 views • 8 months ago

AMD is partnering with Luma AI to help shape AI innovation. From hardware to software, AMD and Luma AI are working together to optimize models while reducing costs. Thanks, Amit Jain (amit), for joining us on the keynote stage at CES this year.

AMD is partnering with Luma AI to help shape AI innovation. From hardware to software, AMD and Luma AI are working together to optimize models while reducing costs. Thanks, Amit Jain (amit), for joining us on the keynote stage at CES this year.

AMD

19,375 views • 7 months ago

Groq founder Jonathan Ross explains why their architecture is better for inference than GPUs. Inference doesn't require as much compute power as training. What matters in inference is speed, cost, and energy consumption. $NVDA was going to lose market share as AI workloads shift to inference. They saw this and made a highly strategic move by striking a deal with Groq. $NVDA is already dominating training, and now it's also well-positioned to dominate inference.

Groq founder Jonathan Ross explains why their architecture is better for inference than GPUs. Inference doesn't require as much compute power as training. What matters in inference is speed, cost, and energy consumption. $NVDA was going to lose market share as AI workloads shift to inference. They saw this and made a highly strategic move by striking a deal with Groq. $NVDA is already dominating training, and now it's also well-positioned to dominate inference.

Oguz Erkan

97,186 views • 8 months ago

Agentic AI is here, and AMD is helping Luma AI deliver the infrastructure needed to support these advanced models. This collaboration, spotlighted at CES, highlights how AMD and Luma AI are working together to enable what’s next. ▶️ Hear more from CEO of Luma AI, Amit Jain (amit).

Agentic AI is here, and AMD is helping Luma AI deliver the infrastructure needed to support these advanced models. This collaboration, spotlighted at CES, highlights how AMD and Luma AI are working together to enable what’s next. ▶️ Hear more from CEO of Luma AI, Amit Jain (amit).

AMD

12,902 views • 7 months ago

The future of enterprise AI is increasingly open. Hear AT&T CTO Jeremy Legg discuss how his team is using AMD solutions to support its growing adoption of open-source AI models while increasing accuracy and lowering cost.

The future of enterprise AI is increasingly open. Hear AT&T CTO Jeremy Legg discuss how his team is using AMD solutions to support its growing adoption of open-source AI models while increasing accuracy and lowering cost.

AMD

37,500 views • 1 month ago

AI deployment doesn’t have to mean reinventing your infrastructure. AMD’s Suresh Andani explains how AMD Instinct MI350P PCIe GPUs combine open software, enterprise-ready AI infrastructure, and scalable inference performance to help organizations accelerate AI adoption within existing data centers. Same racks. Same cooling. Dramatically more AI. Watch the full video on YouTube:

AI deployment doesn’t have to mean reinventing your infrastructure. AMD’s Suresh Andani explains how AMD Instinct MI350P PCIe GPUs combine open software, enterprise-ready AI infrastructure, and scalable inference performance to help organizations accelerate AI adoption within existing data centers. Same racks. Same cooling. Dramatically more AI. Watch the full video on YouTube:

AMD

19,285 views • 3 months ago

$AMD $5 Trillion MC Is Inevitable Long Term👑 This thread will focus more on Inference! 2026 EPYC "Venice" $TSM 2nm to save Large GW Scale Inference by 40% more than Prior Turin gen. Context: EPYC Turin achieves ~$0.001 per million tokens for batch inference vs $0.02-$0.12/ million tokens as I wrote the thread below. Venice is going to lower cost down to $0.0005-$0.0006/Million Tokens. OpenAI spent roughly $20B on Inference and Training, where 80-90% of that was for Inference per Analysts. AKA Renting Compute is Expensive AF! In this thread, I want to focus on why most analysts and investors are underestimating the role EPYC "Venice" and future Gen on overall Data center revenue. And $TSM ramping up 2nm supply early is a confirmation that AMD will be a major buyer long term. I will also link the thread the Gap between AMD Analysts & Reality and 2nm Ramp Thread so you have more comprehensive view of what I'm writing here. Before I go into detail this is my 2026 Projection: AI GPUs: $35-$50B EPYC Data Center: $15B-$17B Client Segment: $12-$13B Gaming: $6B Embedded: $4B-$5B Total Revenue $70-$100B Non-GAAP net income $18B-$25B Non-GAAP EPS $10.97-$15.40 Foward P/E 55x-70x= $603-$1,078 AMD's Analysts are projecting $0 Revenue for MI450 and sluggish EPYC Growth. Meaning, all analysts are either full of 💩 or Sexist, you decide! Analysts are also projecting 0% growth on AMD "Secret Weapon" Chip as $MSFT said we are at significant Windows refresh and upgrade cycle. Do you think TSMC would allocate more 2nm supply to $AMD at $0 MI450 revenue and sluggish EPYC? 1. EPYC is going to be the leader in lowest Inference! Current Turin cost saving is 95% vs $NVDA or 98-99% on Inference cost when you factor in renting Inference compute from Amazon Web Services, Microsoft Azure, or $NVDA Neocloud pets. TSMC claimed: 10-15% higher performance at iso-power, 25-30% lower power at iso-speed, and ~15% higher transistor density compared to 3nm. This reduces operational expenses (energy, cooling) while increasing throughput per chip. EPYC Turin achieves ~$0.001 per million tokens for batch inference (via vLLM on models like Llama 3 70B), driven by high core counts and low hardware costs. EPYC Venice offers ~1.7x overall performance and up to 70% more compute capability per core, with up to 256 cores (512 threads). Enhanced vector/AI instructions and open-source firmware (openSIL) optimize for inference workloads. AMD Incorporates AI Engines (now part of AMD's XDNA) for on-chip acceleration, improving efficiency for low-latency and edge inference. This reduces reliance on discrete GPUs, lowering system complexity and TCO. Venice SKUs are projected at $3,000-$15,000 ($5,000 for 256-core flagship), far below NVIDIA Rubin ($50,000-$90,000) or AMD's own MI450 GPUs ($40,000-$50,000). High memory bandwidth (up to 1.6 TB/s) supports efficient batch inference. Venice is designed exactly for Large customers that want to lower Inference Cost and MI450 Helios is for Customers that want Training at lowest TCO, TDP as well as lower Upfront 1GW scale(Full build $35-$40B vs $NVDA $55B-$80B). 2. Real World Example: OpenAI's 2025 inference spend reached ~$20B, escalating to even higher total compute rental (mostly inference) amid token volume growth(from video generating). By 2026, with usage doubling (consistent with industry trends: token demand grows 2-5x YoY), assume OpenAI processes ~1,800 billion million-tokens annually $NVDA Blackwell at $0.02-$0.12 is $36B(most optimized) Rubin is projected to be at $0.01/million tokens or $18B annual Inference Cost vs $AMD Venice $0.0005/million tokens or $0.9B annual Inference Cost => Massive saving for OpenAI or anyone that are paying 80-90% Annual Bill for Inference compute. In short, it is unsustainable to pay this much rent vs owning for all current AI players for the medium to long term. Rubin excels in low-latency decode (if Groq integration from $20B deal in 2027-2028), but Venice dominates batch (80% of inference by 2030). Actual savings depend on deployment scale (OpenAI's 6GW AMD plans), electricity rates, and software maturity. If Rubin only hits $0.03, savings swell to $53.1B vs. $17.1B. 3. Will running Inference on Venice and future Gen slow down response generation in 2026 and beyond? Human perception of "fast enough" for chat, agents, search augmentation, summarization, coding assistance is roughly Meaning, EPYC may generate $100B a year on data center revenue, Hence $MSFT $AMZN $META $GOOGL OpenAI xAI and 42+ Countries are leaning AMD for Inference, because the cost saving is MASSIVE! 4. Regular users (you, me, people using ChatGPT, Claude, Gemini, Grok, Perplexity...) are extremely unlikely to notice any slowdown and in many cases might even experience slightly faster or more consistent response times if the industry heavily shifts toward AMD EPYC for inference. What actually happens when companies save massively on inference? When OpenAI , Anthropic , Gemini , Grok Meta .... save billions on the batch/enterprise/RAG layer using EPYC Venice, they typically do one or more of these things with the savings, none of which make your chat slower but enhancing their bottom line(Profit) ~Keep prices the same → make more profit ~Lower subscription prices / increase free tier limits ~Train bigger & better models more frequently ~Offer longer context windows ~Add more reasoning steps / tool calls / agents per query ~Improve multimodal capabilities ~Build more data centers / reduce throttling during peaks In practice the consumer experience usually gets better, not worse, when inference becomes dramatically cheaper. Prime example is $META leaning AMD heavily or currently AMD largest customer. or Grok 2 to Grok 3 heavily used AMD for Inference saving. And most Grok Users reported Groke responses snappier, not slower. 5. What does this mean for potential Revenue? Noted that TSMC is massively ramping 2nm supply for $AMD both MI450 and EPYC. EPYC Conservative projection: FY2025: $10.5B(best Est) FY2026: $16B FY2027: $29B FY2028: $49B FY2029: $75B FY2030: $100B Large customers: $META OpenAI $MSFT $AMZN $GOOGL xAI (Apple?) Smaller customer: $DELL $HPE $SMCI and 42+ other countries. The roadmap to $5 Trillion is very much inevitable as Inference Cost from Renting or owning $NVDA are too high, but $NVDA will still dominate Training market share, where MI families are likely to take 15-20% market share, but the TAM is also expanding Rapidly. Most Institutions are projecting $2-$3Trillion TAM by 2030. $NVDA said $4 Trillion. Dr. Lisa Su said $1 Trillion+ by 2030. So you decide on how much TAM. If you enjoy this kind of analysis, Slap the Like/Repost and Bookmark to please the X Algo as it is Free.99! If you want to support my work further, consider subscribe to see more in-depth analysis! Alright, that is it. Not Financial Advice!

$AMD $5 Trillion MC Is Inevitable Long Term👑 This thread will focus more on Inference! 2026 EPYC "Venice" $TSM 2nm to save Large GW Scale Inference by 40% more than Prior Turin gen. Context: EPYC Turin achieves ~$0.001 per million tokens for batch inference vs $0.02-$0.12/ million tokens as I wrote the thread below. Venice is going to lower cost down to $0.0005-$0.0006/Million Tokens. OpenAI spent roughly $20B on Inference and Training, where 80-90% of that was for Inference per Analysts. AKA Renting Compute is Expensive AF! In this thread, I want to focus on why most analysts and investors are underestimating the role EPYC "Venice" and future Gen on overall Data center revenue. And $TSM ramping up 2nm supply early is a confirmation that AMD will be a major buyer long term. I will also link the thread the Gap between AMD Analysts & Reality and 2nm Ramp Thread so you have more comprehensive view of what I'm writing here. Before I go into detail this is my 2026 Projection: AI GPUs: $35-$50B EPYC Data Center: $15B-$17B Client Segment: $12-$13B Gaming: $6B Embedded: $4B-$5B Total Revenue $70-$100B Non-GAAP net income $18B-$25B Non-GAAP EPS $10.97-$15.40 Foward P/E 55x-70x= $603-$1,078 AMD's Analysts are projecting $0 Revenue for MI450 and sluggish EPYC Growth. Meaning, all analysts are either full of 💩 or Sexist, you decide! Analysts are also projecting 0% growth on AMD "Secret Weapon" Chip as $MSFT said we are at significant Windows refresh and upgrade cycle. Do you think TSMC would allocate more 2nm supply to $AMD at $0 MI450 revenue and sluggish EPYC? 1. EPYC is going to be the leader in lowest Inference! Current Turin cost saving is 95% vs $NVDA or 98-99% on Inference cost when you factor in renting Inference compute from Amazon Web Services, Microsoft Azure, or $NVDA Neocloud pets. TSMC claimed: 10-15% higher performance at iso-power, 25-30% lower power at iso-speed, and ~15% higher transistor density compared to 3nm. This reduces operational expenses (energy, cooling) while increasing throughput per chip. EPYC Turin achieves ~$0.001 per million tokens for batch inference (via vLLM on models like Llama 3 70B), driven by high core counts and low hardware costs. EPYC Venice offers ~1.7x overall performance and up to 70% more compute capability per core, with up to 256 cores (512 threads). Enhanced vector/AI instructions and open-source firmware (openSIL) optimize for inference workloads. AMD Incorporates AI Engines (now part of AMD's XDNA) for on-chip acceleration, improving efficiency for low-latency and edge inference. This reduces reliance on discrete GPUs, lowering system complexity and TCO. Venice SKUs are projected at $3,000-$15,000 ($5,000 for 256-core flagship), far below NVIDIA Rubin ($50,000-$90,000) or AMD's own MI450 GPUs ($40,000-$50,000). High memory bandwidth (up to 1.6 TB/s) supports efficient batch inference. Venice is designed exactly for Large customers that want to lower Inference Cost and MI450 Helios is for Customers that want Training at lowest TCO, TDP as well as lower Upfront 1GW scale(Full build $35-$40B vs $NVDA $55B-$80B). 2. Real World Example: OpenAI's 2025 inference spend reached ~$20B, escalating to even higher total compute rental (mostly inference) amid token volume growth(from video generating). By 2026, with usage doubling (consistent with industry trends: token demand grows 2-5x YoY), assume OpenAI processes ~1,800 billion million-tokens annually $NVDA Blackwell at $0.02-$0.12 is $36B(most optimized) Rubin is projected to be at $0.01/million tokens or $18B annual Inference Cost vs $AMD Venice $0.0005/million tokens or $0.9B annual Inference Cost => Massive saving for OpenAI or anyone that are paying 80-90% Annual Bill for Inference compute. In short, it is unsustainable to pay this much rent vs owning for all current AI players for the medium to long term. Rubin excels in low-latency decode (if Groq integration from $20B deal in 2027-2028), but Venice dominates batch (80% of inference by 2030). Actual savings depend on deployment scale (OpenAI's 6GW AMD plans), electricity rates, and software maturity. If Rubin only hits $0.03, savings swell to $53.1B vs. $17.1B. 3. Will running Inference on Venice and future Gen slow down response generation in 2026 and beyond? Human perception of "fast enough" for chat, agents, search augmentation, summarization, coding assistance is roughly Meaning, EPYC may generate $100B a year on data center revenue, Hence $MSFT $AMZN $META $GOOGL OpenAI xAI and 42+ Countries are leaning AMD for Inference, because the cost saving is MASSIVE! 4. Regular users (you, me, people using ChatGPT, Claude, Gemini, Grok, Perplexity...) are extremely unlikely to notice any slowdown and in many cases might even experience slightly faster or more consistent response times if the industry heavily shifts toward AMD EPYC for inference. What actually happens when companies save massively on inference? When OpenAI , Anthropic , Gemini , Grok Meta .... save billions on the batch/enterprise/RAG layer using EPYC Venice, they typically do one or more of these things with the savings, none of which make your chat slower but enhancing their bottom line(Profit) ~Keep prices the same → make more profit ~Lower subscription prices / increase free tier limits ~Train bigger & better models more frequently ~Offer longer context windows ~Add more reasoning steps / tool calls / agents per query ~Improve multimodal capabilities ~Build more data centers / reduce throttling during peaks In practice the consumer experience usually gets better, not worse, when inference becomes dramatically cheaper. Prime example is $META leaning AMD heavily or currently AMD largest customer. or Grok 2 to Grok 3 heavily used AMD for Inference saving. And most Grok Users reported Groke responses snappier, not slower. 5. What does this mean for potential Revenue? Noted that TSMC is massively ramping 2nm supply for $AMD both MI450 and EPYC. EPYC Conservative projection: FY2025: $10.5B(best Est) FY2026: $16B FY2027: $29B FY2028: $49B FY2029: $75B FY2030: $100B Large customers: $META OpenAI $MSFT $AMZN $GOOGL xAI (Apple?) Smaller customer: $DELL $HPE $SMCI and 42+ other countries. The roadmap to $5 Trillion is very much inevitable as Inference Cost from Renting or owning $NVDA are too high, but $NVDA will still dominate Training market share, where MI families are likely to take 15-20% market share, but the TAM is also expanding Rapidly. Most Institutions are projecting $2-$3Trillion TAM by 2030. $NVDA said $4 Trillion. Dr. Lisa Su said $1 Trillion+ by 2030. So you decide on how much TAM. If you enjoy this kind of analysis, Slap the Like/Repost and Bookmark to please the X Algo as it is Free.99! If you want to support my work further, consider subscribe to see more in-depth analysis! Alright, that is it. Not Financial Advice!

Mike

102,223 views • 8 months ago

$AMD is down more than 40% from its ATH. Meanwhile, who’s all in on $AMD? Mark Zuckerberg. Llama 405B runs inferences exclusively on the $AMD MI300X chip.

$AMD is down more than 40% from its ATH. Meanwhile, who’s all in on $AMD? Mark Zuckerberg. Llama 405B runs inferences exclusively on the $AMD MI300X chip.

Antonio Linares

150,656 views • 1 year ago

Lisa Su explains why, for at least the next few years, $AMD and $NVDA GPUs will continue to dominate the AI accelerator market. “ASICs like $GOOGL TPUs are great, but they don’t offer anywhere near the same programmability or model flexibility that GPUs provide. AI is at least a 10-year cycle, and we’re only in year two. Being so early, software developers want the flexibility to innovate on different algorithms.” Even as ASICs become competitive for inference, GPUs are on another level. $AMD and $NVDA are set to keep thriving in the years ahead.

Lisa Su explains why, for at least the next few years, $AMD and $NVDA GPUs will continue to dominate the AI accelerator market. “ASICs like $GOOGL TPUs are great, but they don’t offer anywhere near the same programmability or model flexibility that GPUs provide. AI is at least a 10-year cycle, and we’re only in year two. Being so early, software developers want the flexibility to innovate on different algorithms.” Even as ASICs become competitive for inference, GPUs are on another level. $AMD and $NVDA are set to keep thriving in the years ahead.

Daniel

125,735 views • 8 months ago