Loading video...

Video Failed to Load

Go Home

Last week at AI Infra Connect (Formerly AI Hardware and Systems #AIHWEdgeAISummit2024, Anton McGonnell gave a presentation on how SambaNova Cloud, the fastest #AI inference in the world, moves beyond #GPUs to deliver unrivaled chip efficiency at lightning speeds. 🚀🎯 Start developing 👉

SambaNovaAI's profile picture

SambaNova

29,468 subscribers

1,015,244 views • 1 year ago •via X (Twitter)

Science & Technology#AIHWEdgeAISummit2024#AI#GPUs
LIVE

Anya Rossi• Live Now

Private livecam show

0 Comments

No comments available

Comments from the original post will appear here

Related Videos

Thank you to everyone who connected with the $IREN team at the AI Infra Connect (Formerly AI Hardware and Systems AI Infra Summit! The summit’s theme – “Powering Fast, Efficient & Affordable AI” – perfectly captured the innovation driving the AI industry forward. As demand for compute continues to surge, $IREN is focused on empowering builders to turn bold AI ideas into reality.
0:40

Thank you to everyone who connected with the $IREN team at the AI Infra Connect (Formerly AI Hardware and Systems AI Infra Summit! The summit’s theme – “Powering Fast, Efficient & Affordable AI” – perfectly captured the innovation driving the AI industry forward. As demand for compute continues to surge, $IREN is focused on empowering builders to turn bold AI ideas into reality.

IREN

76,185 views • 9 months ago

AI at scale starts here. See how cohere + AMD Instinct MI350 Series GPUs and ROCm 7 software deliver performance and efficiency needed to lead in the AI era. 📺
0:27

AI at scale starts here. See how cohere + AMD Instinct MI350 Series GPUs and ROCm 7 software deliver performance and efficiency needed to lead in the AI era. 📺

AMD

22,727 views • 9 months ago

💡 Inference is hitting a major inflection point in 2025. The future of AI computing will be shaped by who can deliver performance and efficiency at scale. At AMD Advancing AI, Daniel Newman & Patrick Moorhead sat down with Andrew Dieckmann and Anush Elangovan to explore how AMD is strategically positioned to lead in both AI training and inferencing—two of the fastest-growing segments in AI compute. Learn how they're scaling real-world deployments across both training and inference. Catch the full conversation:
0:56

💡 Inference is hitting a major inflection point in 2025. The future of AI computing will be shaped by who can deliver performance and efficiency at scale. At AMD Advancing AI, Daniel Newman & Patrick Moorhead sat down with Andrew Dieckmann and Anush Elangovan to explore how AMD is strategically positioned to lead in both AI training and inferencing—two of the fastest-growing segments in AI compute. Learn how they're scaling real-world deployments across both training and inference. Catch the full conversation:

Six Five Media

29,588 views • 1 year ago

SN50 is here, the fastest chip built for agentic AI. Max speed of up to 5X faster; run agentic AI at a 3X lower cost than GPUs, unlocking cloud-scale inference economics. We’ve also planned a multi-year strategic collaboration with Intel &raised $350M+ from Vista Equity Partners, Cambium Capital & T. Rowe Price to scale manufacturing &cloud capacity. Learn more:
0:27

SN50 is here, the fastest chip built for agentic AI. Max speed of up to 5X faster; run agentic AI at a 3X lower cost than GPUs, unlocking cloud-scale inference economics. We’ve also planned a multi-year strategic collaboration with Intel &raised $350M+ from Vista Equity Partners, Cambium Capital & T. Rowe Price to scale manufacturing &cloud capacity. Learn more:

SambaNova

77,847 views • 4 months ago

What a week at #GoogleCloudNext in Las Vegas ✨ From sessions to showfloor demos to networking events, we were excited to partner with Google Cloud to advance how the AI ecosystem can build, deploy, and innovate in the cloud. Looking forward to working together to advance AI agents, physical AI, and beyond.
0:29

What a week at #GoogleCloudNext in Las Vegas ✨ From sessions to showfloor demos to networking events, we were excited to partner with Google Cloud to advance how the AI ecosystem can build, deploy, and innovate in the cloud. Looking forward to working together to advance AI agents, physical AI, and beyond.

NVIDIA

32,762 views • 2 months ago

$NVDA CEO Jensen Huang praised $NBIS during his keynote. Nebius is positioning itself as a cloud utility for the agentic AI era built to deliver inference and AI compute efficiently at scale.
0:21

$NVDA CEO Jensen Huang praised $NBIS during his keynote. Nebius is positioning itself as a cloud utility for the agentic AI era built to deliver inference and AI compute efficiently at scale.

Shay Boloor

345,774 views • 1 month ago

SITUATION EXPLAINED: Cerebras raised $5.55 billion in their IPO and closing their first day of trading valued at $66 billion, making it the biggest US tech IPO since Snowflake in 2020. Cerebras makes Wafer-Scale Engine chips built for AI inference. We asked Sarah Fong the main difference between wafer-scale chips and traditional GPUs: - GPUs are great at parallel work (graphics, training) - AI inference is sequential, AKA one token at a time This causes the "memory wall" problem: - Every GPU core needs model weights, KV cache, and activations to do its math - On a GPU, that data lives in off-chip memory (HBM) - Cores constantly load and offload from off-chip memory, which is a huge bottleneck; hardware accounts for ~70% of inference latency Cerebras' chips: -Dinner-plate sized (vs. GPUs which are palm-sized) with tens of thousands of cores -Memory sits directly on top of the cores as distributed SRAM -Weights and KV cache can be accessed at on-chip speeds in the PB/s range, compared with off-chip speeds in the TB/s range achieved by GPUs with HBM.
3:14

SITUATION EXPLAINED: Cerebras raised $5.55 billion in their IPO and closing their first day of trading valued at $66 billion, making it the biggest US tech IPO since Snowflake in 2020. Cerebras makes Wafer-Scale Engine chips built for AI inference. We asked Sarah Fong the main difference between wafer-scale chips and traditional GPUs: - GPUs are great at parallel work (graphics, training) - AI inference is sequential, AKA one token at a time This causes the "memory wall" problem: - Every GPU core needs model weights, KV cache, and activations to do its math - On a GPU, that data lives in off-chip memory (HBM) - Cores constantly load and offload from off-chip memory, which is a huge bottleneck; hardware accounts for ~70% of inference latency Cerebras' chips: -Dinner-plate sized (vs. GPUs which are palm-sized) with tens of thousands of cores -Memory sits directly on top of the cores as distributed SRAM -Weights and KV cache can be accessed at on-chip speeds in the PB/s range, compared with off-chip speeds in the TB/s range achieved by GPUs with HBM.

MTS

44,057 views • 1 month ago

📣 Partnership Announcement: Solidus AI Tech and SambaNova Systems ✨ We are excited to announce a strategic partnership with SambaNova, a distinguished Silicon Valley unicorn valued at $5 billion and recognized for developing the world's fastest AI-specialized chips. This collaboration will significantly enhance our AI Marketplace by providing unparalleled AI inferencing and training capabilities, solidifying our position as a leader in industry innovation. SambaNova’s advanced technology will bring several key benefits to our HPC Data Center: 🔹 Powering a significant portion of our infrastructure with their cutting-edge RDUs. 🔹 Achieving up to 80% energy savings compared to traditional systems. 🔹 Supporting AI models with up to 5 trillion parameters per SambaNova Node. 🔹 Setting a new benchmark for AI infrastructure performance.
0:29

📣 Partnership Announcement: Solidus AI Tech and SambaNova Systems ✨ We are excited to announce a strategic partnership with SambaNova, a distinguished Silicon Valley unicorn valued at $5 billion and recognized for developing the world's fastest AI-specialized chips. This collaboration will significantly enhance our AI Marketplace by providing unparalleled AI inferencing and training capabilities, solidifying our position as a leader in industry innovation. SambaNova’s advanced technology will bring several key benefits to our HPC Data Center: 🔹 Powering a significant portion of our infrastructure with their cutting-edge RDUs. 🔹 Achieving up to 80% energy savings compared to traditional systems. 🔹 Supporting AI models with up to 5 trillion parameters per SambaNova Node. 🔹 Setting a new benchmark for AI infrastructure performance.

AITECH CLOUD NETWORK

124,296 views • 1 year ago

Everyone is talking about AI. We're focused on the onchain economy powering it. Last week, founders, builders, and industry leaders gathered at Base AI Connect, one of the hottest AI side events during SuperAI week in Singapore. Here's a recap 👇
0:34

Everyone is talking about AI. We're focused on the onchain economy powering it. Last week, founders, builders, and industry leaders gathered at Base AI Connect, one of the hottest AI side events during SuperAI week in Singapore. Here's a recap 👇

Base APAC

16,845 views • 28 days ago

Chips are the foundation of every AI experience. That's why understanding the hardware behind the software has never mattered more. When you ask a chatbot a question or generate an image, there's a physical chip somewhere doing the heavy lifting. For most of computing history, that was a CPU—the "brain" of a computer—great for general tasks needed to run software and operating systems. AI is more complex: for workloads called training and inference, AI needs to perform trillions of calculations in parallel. That's where AI accelerators come in. Purpose-built accelerators can deliver significantly better performance and efficiency than general-purpose chips. Amazon Web Services Trainium chips are an example—purpose-built for AI training and inference. New chips for a new era. ⬇️
0:43

Chips are the foundation of every AI experience. That's why understanding the hardware behind the software has never mattered more. When you ask a chatbot a question or generate an image, there's a physical chip somewhere doing the heavy lifting. For most of computing history, that was a CPU—the "brain" of a computer—great for general tasks needed to run software and operating systems. AI is more complex: for workloads called training and inference, AI needs to perform trillions of calculations in parallel. That's where AI accelerators come in. Purpose-built accelerators can deliver significantly better performance and efficiency than general-purpose chips. Amazon Web Services Trainium chips are an example—purpose-built for AI training and inference. New chips for a new era. ⬇️

Amazon

27,151 views • 1 month ago

TARS AI was on the ground at Google Cloud Summit Nord in Düsseldorf, surrounded by builders, AI engineers, and cloud leaders. From autonomous agents to GenAI infrastructure, the takeaway was clear, the market is moving from pilots to large-scale deployment. For TARS AI, it was a sharp signal, growing demand for agent-first products and clear alignment on scaling AI systems for real-world adoption. Highlights, insights, and snapshots from the Google Cloud Summit 👇
0:35

TARS AI was on the ground at Google Cloud Summit Nord in Düsseldorf, surrounded by builders, AI engineers, and cloud leaders. From autonomous agents to GenAI infrastructure, the takeaway was clear, the market is moving from pilots to large-scale deployment. For TARS AI, it was a sharp signal, growing demand for agent-first products and clear alignment on scaling AI systems for real-world adoption. Highlights, insights, and snapshots from the Google Cloud Summit 👇

TARS AI 🤖

161,078 views • 11 months ago

📣 ANNOUNCEMENT DAY AT CEREBRAS 📣 Today, we are thrilled to share some of the biggest announcements in our company’s history. 📢 Cerebras announces CS-3, the world’s fastest AI Chip with a whopping 4 trillion transistors 📢 Cerebras selects Qualcomm to deliver unprecedented performance in AI Inference 📢 Cerebras and G42 break ground on Condor Galaxy 3, an 8 exaFLOPs AI Supercomputer Read all about it! 📰 CS-3 Press Release: 📰 Cerebras + Qualcomm Press Release: 📰 Condor Galaxy 3 Press Release: #AI #Supercomputer #ExaFLOPs #ML #Training #Inference
1:17

📣 ANNOUNCEMENT DAY AT CEREBRAS 📣 Today, we are thrilled to share some of the biggest announcements in our company’s history. 📢 Cerebras announces CS-3, the world’s fastest AI Chip with a whopping 4 trillion transistors 📢 Cerebras selects Qualcomm to deliver unprecedented performance in AI Inference 📢 Cerebras and G42 break ground on Condor Galaxy 3, an 8 exaFLOPs AI Supercomputer Read all about it! 📰 CS-3 Press Release: 📰 Cerebras + Qualcomm Press Release: 📰 Condor Galaxy 3 Press Release: #AI #Supercomputer #ExaFLOPs #ML #Training #Inference

Cerebras

128,577 views • 2 years ago

At #RenderCon Jules Urbach shared a view for the future of AI and decentralized compute, discussing how the industry is shifting from focusing on pre-training models towards inference time AI applications and agents that can run on The Render Network high performance consumer GPUs.
3:15

At #RenderCon Jules Urbach shared a view for the future of AI and decentralized compute, discussing how the industry is shifting from focusing on pre-training models towards inference time AI applications and agents that can run on The Render Network high performance consumer GPUs.

The Render Network

10,904 views • 1 year ago

🚀 AI at the Edge with #Ubuntu & Renesas Electronics! At Embedded World 2025, we demonstrated how Ubuntu enables secure, scalable, and high-performance edge AI solutions. With Secure Boot, full disk encryption, and inference running directly on a CPU in kiosk mode, this setup showcases the future of embedded intelligence. Watch the demo in action! How do you see AI at the edge transforming industries? #Ubuntu #Renesas #ew25 #embeddedworld #IoT #EdgeAI
0:29

🚀 AI at the Edge with #Ubuntu & Renesas Electronics! At Embedded World 2025, we demonstrated how Ubuntu enables secure, scalable, and high-performance edge AI solutions. With Secure Boot, full disk encryption, and inference running directly on a CPU in kiosk mode, this setup showcases the future of embedded intelligence. Watch the demo in action! How do you see AI at the edge transforming industries? #Ubuntu #Renesas #ew25 #embeddedworld #IoT #EdgeAI

Ubuntu

13,694 views • 1 year ago

Last week at TEDAI San Francisco, we brought together leaders in AI, robotics, and spatial technologies to explore how real-world AI is taking shape—connecting humans and machines in the world we share. ⭐ Watch panel recordings:
0:42

Last week at TEDAI San Francisco, we brought together leaders in AI, robotics, and spatial technologies to explore how real-world AI is taking shape—connecting humans and machines in the world we share. ⭐ Watch panel recordings:

Niantic Spatial 🌎

10,771 views • 8 months ago

AI in the network is shifting the conversation beyond GPUs. At MWC 2026, Intel's Kevork Kechichian, EVP & GM of the Data Center Group, explains why inference workloads are bringing CPUs back into focus, especially in telco environments where power, space, and efficiency matter. With platforms like Intel Xeon and Clearwater Forest, operators are seeing up to 30% performance gains and 60% better power efficiency, helping scale AI workloads without overhauling infrastructure. As networks evolve toward AI-driven operations and 6G, one principle is becoming clear: The future of AI infrastructure is about using the right compute for the right workload.
1:14

AI in the network is shifting the conversation beyond GPUs. At MWC 2026, Intel's Kevork Kechichian, EVP & GM of the Data Center Group, explains why inference workloads are bringing CPUs back into focus, especially in telco environments where power, space, and efficiency matter. With platforms like Intel Xeon and Clearwater Forest, operators are seeing up to 30% performance gains and 60% better power efficiency, helping scale AI workloads without overhauling infrastructure. As networks evolve toward AI-driven operations and 6G, one principle is becoming clear: The future of AI infrastructure is about using the right compute for the right workload.

Six Five Media

131,501 views • 4 months ago

Accelerate AI innovation with ASI:Cloud, a high-performance cloud platform focusing on inference and AI workloads. Designed with performance, permissionless access, transparent pricing, and access to industry-leading LLMs, including ASI:One, the platform helps builders, developers, and enterprise teams move from idea to inference at scale. Ready to start your ASI infrastructure journey? Explore here:
0:53

Accelerate AI innovation with ASI:Cloud, a high-performance cloud platform focusing on inference and AI workloads. Designed with performance, permissionless access, transparent pricing, and access to industry-leading LLMs, including ASI:One, the platform helps builders, developers, and enterprise teams move from idea to inference at scale. Ready to start your ASI infrastructure journey? Explore here:

SingularityNET

24,547 views • 9 months ago

🎥 Behind the Scenes of Alibaba Cloud Partner Connect 2026 We’re excited to advance our AI Alliance Program — a strategic initiative to empower AI innovation and accelerate next-gen solutions for global enterprises. Working with AI partners like ATOS, we’re helping organizations harness cloud-native data and AI capabilities to drive business transformation at scale globally. In this video, hear from Purshottam Purswani, Head of Data and AI & CTO, APAC at ATOS, on how Partner Connect 2026 is shaping the future of AI-powered collaboration — and why strategic cloud partnerships are essential for future-ready enterprises. 💬 AI Partner - Your Voice, Our Connection #AlibabaCloud #PartnerConnect2026 #AIAlliance #ATOS #CloudComputing #AI #AInnovation #LLM
2:20

🎥 Behind the Scenes of Alibaba Cloud Partner Connect 2026 We’re excited to advance our AI Alliance Program — a strategic initiative to empower AI innovation and accelerate next-gen solutions for global enterprises. Working with AI partners like ATOS, we’re helping organizations harness cloud-native data and AI capabilities to drive business transformation at scale globally. In this video, hear from Purshottam Purswani, Head of Data and AI & CTO, APAC at ATOS, on how Partner Connect 2026 is shaping the future of AI-powered collaboration — and why strategic cloud partnerships are essential for future-ready enterprises. 💬 AI Partner - Your Voice, Our Connection #AlibabaCloud #PartnerConnect2026 #AIAlliance #ATOS #CloudComputing #AI #AInnovation #LLM

Alibaba Cloud

19,233 views • 5 months ago

The Way Forward & A New Chapter For AI powered by GamerHash AI & $GHX. Welcome to the future of bleeding edge connectivity and cloud infrastructure ⚡ GamerHash AI is the answer to the billion dollar question on how to offset the GPU scarcity, enable exponential growth of AI through utilizing consumer-level GPUs and establishing a powerful sharing economy by sourcing a global network of gamers. The synergy of our GPU #DePIN and blockchain for #AI #inference is the technology of the future that already works today. See you in the network!
1:01

The Way Forward & A New Chapter For AI powered by GamerHash AI & $GHX. Welcome to the future of bleeding edge connectivity and cloud infrastructure ⚡ GamerHash AI is the answer to the billion dollar question on how to offset the GPU scarcity, enable exponential growth of AI through utilizing consumer-level GPUs and establishing a powerful sharing economy by sourcing a global network of gamers. The synergy of our GPU #DePIN and blockchain for #AI #inference is the technology of the future that already works today. See you in the network!

GamerHash AI

1,866,164 views • 1 year ago