Video wird geladen...

Video konnte nicht geladen werden

Zur Startseite

Last week at AI Infra Connect (Formerly AI Hardware and Systems #AIHWEdgeAISummit2024, Anton McGonnell gave a presentation on how SambaNova Cloud, the fastest #AI inference in the world, moves beyond #GPUs to deliver unrivaled chip efficiency at lightning speeds. 🚀🎯 Start developing 👉

SambaNovaAI's profile picture

SambaNova

29,468 subscribers

1,015,244 Aufrufe • vor 2 Jahren •via X (Twitter)

Wissenschaft & Technologie#AIHWEdgeAISummit2024#AI#GPUs
LIVE

Anya Rossi• Live Now

Private livecam show

0 Kommentare

Keine Kommentare verfügbar

Kommentare vom Original-Post werden hier angezeigt

Ähnliche Videos

Thank you to everyone who connected with the $IREN team at the AI Infra Connect (Formerly AI Hardware and Systems AI Infra Summit! The summit’s theme – “Powering Fast, Efficient & Affordable AI” – perfectly captured the innovation driving the AI industry forward. As demand for compute continues to surge, $IREN is focused on empowering builders to turn bold AI ideas into reality.
0:40

Thank you to everyone who connected with the $IREN team at the AI Infra Connect (Formerly AI Hardware and Systems AI Infra Summit! The summit’s theme – “Powering Fast, Efficient & Affordable AI” – perfectly captured the innovation driving the AI industry forward. As demand for compute continues to surge, $IREN is focused on empowering builders to turn bold AI ideas into reality.

IREN

76,185 Aufrufe • vor 11 Monaten

SN50 is here, the fastest chip built for agentic AI. Max speed of up to 5X faster; run agentic AI at a 3X lower cost than GPUs, unlocking cloud-scale inference economics. We’ve also planned a multi-year strategic collaboration with Intel &raised $350M+ from Vista Equity Partners, Cambium Capital & T. Rowe Price to scale manufacturing &cloud capacity. Learn more:
0:27

SN50 is here, the fastest chip built for agentic AI. Max speed of up to 5X faster; run agentic AI at a 3X lower cost than GPUs, unlocking cloud-scale inference economics. We’ve also planned a multi-year strategic collaboration with Intel &raised $350M+ from Vista Equity Partners, Cambium Capital & T. Rowe Price to scale manufacturing &cloud capacity. Learn more:

SambaNova

79,638 Aufrufe • vor 7 Monaten

What a week at #GoogleCloudNext in Las Vegas ✨ From sessions to showfloor demos to networking events, we were excited to partner with Google Cloud to advance how the AI ecosystem can build, deploy, and innovate in the cloud. Looking forward to working together to advance AI agents, physical AI, and beyond.
0:29

What a week at #GoogleCloudNext in Las Vegas ✨ From sessions to showfloor demos to networking events, we were excited to partner with Google Cloud to advance how the AI ecosystem can build, deploy, and innovate in the cloud. Looking forward to working together to advance AI agents, physical AI, and beyond.

NVIDIA

32,762 Aufrufe • vor 5 Monaten

$NVDA CEO Jensen Huang praised $NBIS during his keynote. Nebius is positioning itself as a cloud utility for the agentic AI era built to deliver inference and AI compute efficiently at scale.
0:21

$NVDA CEO Jensen Huang praised $NBIS during his keynote. Nebius is positioning itself as a cloud utility for the agentic AI era built to deliver inference and AI compute efficiently at scale.

Shay Boloor

348,251 Aufrufe • vor 4 Monaten

SITUATION EXPLAINED: Cerebras raised $5.55 billion in their IPO and closing their first day of trading valued at $66 billion, making it the biggest US tech IPO since Snowflake in 2020. Cerebras makes Wafer-Scale Engine chips built for AI inference. We asked Sarah Fong the main difference between wafer-scale chips and traditional GPUs: - GPUs are great at parallel work (graphics, training) - AI inference is sequential, AKA one token at a time This causes the "memory wall" problem: - Every GPU core needs model weights, KV cache, and activations to do its math - On a GPU, that data lives in off-chip memory (HBM) - Cores constantly load and offload from off-chip memory, which is a huge bottleneck; hardware accounts for ~70% of inference latency Cerebras' chips: -Dinner-plate sized (vs. GPUs which are palm-sized) with tens of thousands of cores -Memory sits directly on top of the cores as distributed SRAM -Weights and KV cache can be accessed at on-chip speeds in the PB/s range, compared with off-chip speeds in the TB/s range achieved by GPUs with HBM.
3:14

SITUATION EXPLAINED: Cerebras raised $5.55 billion in their IPO and closing their first day of trading valued at $66 billion, making it the biggest US tech IPO since Snowflake in 2020. Cerebras makes Wafer-Scale Engine chips built for AI inference. We asked Sarah Fong the main difference between wafer-scale chips and traditional GPUs: - GPUs are great at parallel work (graphics, training) - AI inference is sequential, AKA one token at a time This causes the "memory wall" problem: - Every GPU core needs model weights, KV cache, and activations to do its math - On a GPU, that data lives in off-chip memory (HBM) - Cores constantly load and offload from off-chip memory, which is a huge bottleneck; hardware accounts for ~70% of inference latency Cerebras' chips: -Dinner-plate sized (vs. GPUs which are palm-sized) with tens of thousands of cores -Memory sits directly on top of the cores as distributed SRAM -Weights and KV cache can be accessed at on-chip speeds in the PB/s range, compared with off-chip speeds in the TB/s range achieved by GPUs with HBM.

MTS

44,057 Aufrufe • vor 4 Monaten

📣 Partnership Announcement: Solidus AI Tech and SambaNova Systems ✨ We are excited to announce a strategic partnership with SambaNova, a distinguished Silicon Valley unicorn valued at $5 billion and recognized for developing the world's fastest AI-specialized chips. This collaboration will significantly enhance our AI Marketplace by providing unparalleled AI inferencing and training capabilities, solidifying our position as a leader in industry innovation. SambaNova’s advanced technology will bring several key benefits to our HPC Data Center: 🔹 Powering a significant portion of our infrastructure with their cutting-edge RDUs. 🔹 Achieving up to 80% energy savings compared to traditional systems. 🔹 Supporting AI models with up to 5 trillion parameters per SambaNova Node. 🔹 Setting a new benchmark for AI infrastructure performance.
0:29

📣 Partnership Announcement: Solidus AI Tech and SambaNova Systems ✨ We are excited to announce a strategic partnership with SambaNova, a distinguished Silicon Valley unicorn valued at $5 billion and recognized for developing the world's fastest AI-specialized chips. This collaboration will significantly enhance our AI Marketplace by providing unparalleled AI inferencing and training capabilities, solidifying our position as a leader in industry innovation. SambaNova’s advanced technology will bring several key benefits to our HPC Data Center: 🔹 Powering a significant portion of our infrastructure with their cutting-edge RDUs. 🔹 Achieving up to 80% energy savings compared to traditional systems. 🔹 Supporting AI models with up to 5 trillion parameters per SambaNova Node. 🔹 Setting a new benchmark for AI infrastructure performance.

AITECH CLOUD NETWORK

124,319 Aufrufe • vor 2 Jahren

BREAKING: SambaNova Announces First Close of $1 Billion Series E at $11B Valuation Led by General Atlantic, with participation from Seligman Ventures, T. Rowe Price, & Capital Group SambaNova CEO Rodrigo Liang (Rodrigo Liang) says AI is entering a new era of "premium inference" "The world of inference is running into an economics problem." Enter: new SambaNova "SM50" "A cloud-scale RDU that allows us to deliver premium inference at significantly higher performance than you can get with GPUs, at a fraction of the cost & a fraction of the power." Why does that matter? "When you're running faster with the high-accuracy models, you can charge more at a lower cost, allowing our service providers to generate more margin." Liang says the shift is just beginning: "The world's moving into inference." And after today's funding announcement: "We're using this capital to accelerate our supply chain and make sure we can deliver the racks to customers worldwide." Full interview from Paris coming soon.
2:14

BREAKING: SambaNova Announces First Close of $1 Billion Series E at $11B Valuation Led by General Atlantic, with participation from Seligman Ventures, T. Rowe Price, & Capital Group SambaNova CEO Rodrigo Liang (Rodrigo Liang) says AI is entering a new era of "premium inference" "The world of inference is running into an economics problem." Enter: new SambaNova "SM50" "A cloud-scale RDU that allows us to deliver premium inference at significantly higher performance than you can get with GPUs, at a fraction of the cost & a fraction of the power." Why does that matter? "When you're running faster with the high-accuracy models, you can charge more at a lower cost, allowing our service providers to generate more margin." Liang says the shift is just beginning: "The world's moving into inference." And after today's funding announcement: "We're using this capital to accelerate our supply chain and make sure we can deliver the racks to customers worldwide." Full interview from Paris coming soon.

Molly O’Shea

14,162 Aufrufe • vor 2 Monaten

Everyone is talking about AI. We're focused on the onchain economy powering it. Last week, founders, builders, and industry leaders gathered at Base AI Connect, one of the hottest AI side events during SuperAI week in Singapore. Here's a recap 👇
0:34

Everyone is talking about AI. We're focused on the onchain economy powering it. Last week, founders, builders, and industry leaders gathered at Base AI Connect, one of the hottest AI side events during SuperAI week in Singapore. Here's a recap 👇

Base APAC

17,396 Aufrufe • vor 3 Monaten

Chips are the foundation of every AI experience. That's why understanding the hardware behind the software has never mattered more. When you ask a chatbot a question or generate an image, there's a physical chip somewhere doing the heavy lifting. For most of computing history, that was a CPU—the "brain" of a computer—great for general tasks needed to run software and operating systems. AI is more complex: for workloads called training and inference, AI needs to perform trillions of calculations in parallel. That's where AI accelerators come in. Purpose-built accelerators can deliver significantly better performance and efficiency than general-purpose chips. Amazon Web Services Trainium chips are an example—purpose-built for AI training and inference. New chips for a new era. ⬇️
0:43

Chips are the foundation of every AI experience. That's why understanding the hardware behind the software has never mattered more. When you ask a chatbot a question or generate an image, there's a physical chip somewhere doing the heavy lifting. For most of computing history, that was a CPU—the "brain" of a computer—great for general tasks needed to run software and operating systems. AI is more complex: for workloads called training and inference, AI needs to perform trillions of calculations in parallel. That's where AI accelerators come in. Purpose-built accelerators can deliver significantly better performance and efficiency than general-purpose chips. Amazon Web Services Trainium chips are an example—purpose-built for AI training and inference. New chips for a new era. ⬇️

Amazon

27,151 Aufrufe • vor 4 Monaten

Today, AMD and Microsoft are announcing an expanded strategic partnership to deliver a full stack of AMD AI solutions for Microsoft Azure, spanning GPUs, CPUs, networking and software. At the center of this expansion, Microsoft will deploy AMD Helios to power frontier model AI inference for Microsoft, its AI customers and support Azure AI services. Read more on the news ahead of #AdvancingAI:
0:20

Today, AMD and Microsoft are announcing an expanded strategic partnership to deliver a full stack of AMD AI solutions for Microsoft Azure, spanning GPUs, CPUs, networking and software. At the center of this expansion, Microsoft will deploy AMD Helios to power frontier model AI inference for Microsoft, its AI customers and support Azure AI services. Read more on the news ahead of #AdvancingAI:

AMD

159,091 Aufrufe • vor 2 Monaten

Last week at Signals, we brought together leaders in AI, robotics, and spatial technologies to explore how real-world AI is taking shape—connecting humans and machines in the world we share. ⭐ Watch panel recordings:
0:42

Last week at Signals, we brought together leaders in AI, robotics, and spatial technologies to explore how real-world AI is taking shape—connecting humans and machines in the world we share. ⭐ Watch panel recordings:

Niantic Spatial 🌎

10,895 Aufrufe • vor 10 Monaten

TARS AI was on the ground at Google Cloud Summit Nord in Düsseldorf, surrounded by builders, AI engineers, and cloud leaders. From autonomous agents to GenAI infrastructure, the takeaway was clear, the market is moving from pilots to large-scale deployment. For TARS AI, it was a sharp signal, growing demand for agent-first products and clear alignment on scaling AI systems for real-world adoption. Highlights, insights, and snapshots from the Google Cloud Summit 👇
0:35

TARS AI was on the ground at Google Cloud Summit Nord in Düsseldorf, surrounded by builders, AI engineers, and cloud leaders. From autonomous agents to GenAI infrastructure, the takeaway was clear, the market is moving from pilots to large-scale deployment. For TARS AI, it was a sharp signal, growing demand for agent-first products and clear alignment on scaling AI systems for real-world adoption. Highlights, insights, and snapshots from the Google Cloud Summit 👇

TARS AI 🤖

161,445 Aufrufe • vor 1 Jahr

📣 ANNOUNCEMENT DAY AT CEREBRAS 📣 Today, we are thrilled to share some of the biggest announcements in our company’s history. 📢 Cerebras announces CS-3, the world’s fastest AI Chip with a whopping 4 trillion transistors 📢 Cerebras selects Qualcomm to deliver unprecedented performance in AI Inference 📢 Cerebras and G42 break ground on Condor Galaxy 3, an 8 exaFLOPs AI Supercomputer Read all about it! 📰 CS-3 Press Release: 📰 Cerebras + Qualcomm Press Release: 📰 Condor Galaxy 3 Press Release: #AI #Supercomputer #ExaFLOPs #ML #Training #Inference
1:17

📣 ANNOUNCEMENT DAY AT CEREBRAS 📣 Today, we are thrilled to share some of the biggest announcements in our company’s history. 📢 Cerebras announces CS-3, the world’s fastest AI Chip with a whopping 4 trillion transistors 📢 Cerebras selects Qualcomm to deliver unprecedented performance in AI Inference 📢 Cerebras and G42 break ground on Condor Galaxy 3, an 8 exaFLOPs AI Supercomputer Read all about it! 📰 CS-3 Press Release: 📰 Cerebras + Qualcomm Press Release: 📰 Condor Galaxy 3 Press Release: #AI #Supercomputer #ExaFLOPs #ML #Training #Inference

Cerebras

128,669 Aufrufe • vor 2 Jahren

That's a wrap on #AllInSummit. Thousands came by the IREN AI Cloud Lounge to see how our vertically integrated AI Cloud efficiently serves training and inference workloads. Thank you to everyone who stopped by and The All-In Podcast for setting the stage. See you again in 2027.
1:43

That's a wrap on #AllInSummit. Thousands came by the IREN AI Cloud Lounge to see how our vertically integrated AI Cloud efficiently serves training and inference workloads. Thank you to everyone who stopped by and The All-In Podcast for setting the stage. See you again in 2027.

IREN

48,709 Aufrufe • vor 10 Tagen

AI in the network is shifting the conversation beyond GPUs. At MWC 2026, Intel's Kevork Kechichian, EVP & GM of the Data Center Group, explains why inference workloads are bringing CPUs back into focus, especially in telco environments where power, space, and efficiency matter. With platforms like Intel Xeon and Clearwater Forest, operators are seeing up to 30% performance gains and 60% better power efficiency, helping scale AI workloads without overhauling infrastructure. As networks evolve toward AI-driven operations and 6G, one principle is becoming clear: The future of AI infrastructure is about using the right compute for the right workload.
1:14

AI in the network is shifting the conversation beyond GPUs. At MWC 2026, Intel's Kevork Kechichian, EVP & GM of the Data Center Group, explains why inference workloads are bringing CPUs back into focus, especially in telco environments where power, space, and efficiency matter. With platforms like Intel Xeon and Clearwater Forest, operators are seeing up to 30% performance gains and 60% better power efficiency, helping scale AI workloads without overhauling infrastructure. As networks evolve toward AI-driven operations and 6G, one principle is becoming clear: The future of AI infrastructure is about using the right compute for the right workload.

Six Five Media

131,501 Aufrufe • vor 6 Monaten