Video wird geladen...

Video konnte nicht geladen werden

Zur Startseite

Everyone talks about our hardware @Cerebras. Few notice the software. Ryan Loney breaks down the hidden optimizations powering 20× faster LLM inference than GPUs, speculative decoding, token reuse, and why we’re just getting started. Watch the full story here

cerebras's profile picture

Cerebras

59,159 subscribers

222,816 Aufrufe • vor 6 Monaten •via X (Twitter)

LIVE

Anya Rossi• Live Now

Private livecam show

0 Kommentare

Keine Kommentare verfügbar

Kommentare vom Original-Post werden hier angezeigt

Ähnliche Videos

🚨 Cerebras Inference is now 3x faster: Llama3.1-70B just broke 2,100 tokens/s - 16x faster than the fastest GPU solution - 8x faster than GPUs running Llama *3B* - It's like the perf of a new hardware generation in a single software release Available now at
0:26

🚨 Cerebras Inference is now 3x faster: Llama3.1-70B just broke 2,100 tokens/s - 16x faster than the fastest GPU solution - 8x faster than GPUs running Llama *3B* - It's like the perf of a new hardware generation in a single software release Available now at

Cerebras

236,067 Aufrufe • vor 1 Jahr

Introducing Cerebras Inference ‣ Llama3.1-70B at 450 tokens/s – 20x faster than GPUs ‣ 60c per M tokens – a fifth the price of hyperscalers ‣ Full 16-bit precision for full model accuracy ‣ Generous rate limits for devs Try now:
0:21

Introducing Cerebras Inference ‣ Llama3.1-70B at 450 tokens/s – 20x faster than GPUs ‣ 60c per M tokens – a fifth the price of hyperscalers ‣ Full 16-bit precision for full model accuracy ‣ Generous rate limits for devs Try now:

Cerebras

706,706 Aufrufe • vor 1 Jahr

After 9 years at NVIDIA, James Wang left and joined Cerebras. In this Big Chip Club episode, James Wang breaks down the bottlenecks of NVIDIA GPUs, and what's keeping them OUT OF first place... Drop your follow-up questions below 👇
1:24

After 9 years at NVIDIA, James Wang left and joined Cerebras. In this Big Chip Club episode, James Wang breaks down the bottlenecks of NVIDIA GPUs, and what's keeping them OUT OF first place... Drop your follow-up questions below 👇

Cerebras

411,916 Aufrufe • vor 7 Monaten

Fully homomorphic encryption was invented in the 1980s. Why wasn't it adopted sooner? A 100,000x slowdown, driven by memory boundedness. Ajay Joshi from CipherSonic AI explains how his team got it down to less than 2x. (if this pattern sounds familar... LLM inference is memory-bound too. It's why wafer-scale exists.)
2:12

Fully homomorphic encryption was invented in the 1980s. Why wasn't it adopted sooner? A 100,000x slowdown, driven by memory boundedness. Ajay Joshi from CipherSonic AI explains how his team got it down to less than 2x. (if this pattern sounds familar... LLM inference is memory-bound too. It's why wafer-scale exists.)

Cerebras

57,585 Aufrufe • vor 2 Monaten

NVIDIA paid $20B for Groq. AWS partnered with Cerebras for the same purpose. A quick breakdown of why disaggregated inference is the next thing in AI infrastructure.
1:06

NVIDIA paid $20B for Groq. AWS partnered with Cerebras for the same purpose. A quick breakdown of why disaggregated inference is the next thing in AI infrastructure.

Cerebras

383,060 Aufrufe • vor 1 Monat

gpt-oss-120b is one of the most-used models on Cerebras Inference. We sat down with Anastasios Nikolas Angelopoulos from Arena.ai and @SarahChieng to break down its strengths, weaknesses, and where it's outperforming. Here's what he's seeing.
2:46

gpt-oss-120b is one of the most-used models on Cerebras Inference. We sat down with Anastasios Nikolas Angelopoulos from Arena.ai and @SarahChieng to break down its strengths, weaknesses, and where it's outperforming. Here's what he's seeing.

Cerebras

13,076 Aufrufe • vor 4 Monaten

📣 ANNOUNCEMENT DAY AT CEREBRAS 📣 Today, we are thrilled to share some of the biggest announcements in our company’s history. 📢 Cerebras announces CS-3, the world’s fastest AI Chip with a whopping 4 trillion transistors 📢 Cerebras selects Qualcomm to deliver unprecedented performance in AI Inference 📢 Cerebras and G42 break ground on Condor Galaxy 3, an 8 exaFLOPs AI Supercomputer Read all about it! 📰 CS-3 Press Release: 📰 Cerebras + Qualcomm Press Release: 📰 Condor Galaxy 3 Press Release: #AI #Supercomputer #ExaFLOPs #ML #Training #Inference
1:17

📣 ANNOUNCEMENT DAY AT CEREBRAS 📣 Today, we are thrilled to share some of the biggest announcements in our company’s history. 📢 Cerebras announces CS-3, the world’s fastest AI Chip with a whopping 4 trillion transistors 📢 Cerebras selects Qualcomm to deliver unprecedented performance in AI Inference 📢 Cerebras and G42 break ground on Condor Galaxy 3, an 8 exaFLOPs AI Supercomputer Read all about it! 📰 CS-3 Press Release: 📰 Cerebras + Qualcomm Press Release: 📰 Condor Galaxy 3 Press Release: #AI #Supercomputer #ExaFLOPs #ML #Training #Inference

Cerebras

128,577 Aufrufe • vor 2 Jahren

In pick the best model > improve your prompts > catch bugs with Braintrust and Cerebras inference. Avoid the AI deleting your entire codebase this halloween and remember, our free tier gets you 1M+ free toks/day per model.
1:16

In pick the best model > improve your prompts > catch bugs with Braintrust and Cerebras inference. Avoid the AI deleting your entire codebase this halloween and remember, our free tier gets you 1M+ free toks/day per model.

Cerebras

299,029 Aufrufe • vor 8 Monaten

Our coding workflows were designed to accommodate slow inference. OpenAI's Codex Spark powered by Cerebras changes the game. Here's how we make the most out of 1,200 tokens per second, with Sarah Fong.
5:26

Our coding workflows were designed to accommodate slow inference. OpenAI's Codex Spark powered by Cerebras changes the game. Here's how we make the most out of 1,200 tokens per second, with Sarah Fong.

Cerebras

13,370 Aufrufe • vor 4 Monaten

🎂 Cerebras Inference turns 1! 🚀 Let's break it down: - 6x faster than when we launched — From Meta Llama to Qwen 3 to OpenAI OSS, models running on Cerebras deliver 𝟯,𝟬𝟬𝟬+ 𝘁𝗼𝗸𝗲𝗻𝘀/𝘀𝗲𝗰 - Our inference powers the best AI natives, global enterprises, and developers including Meta, IBM , AlphaSense, Docker, GSK , Mayo Clinic, Core42, Vercel and more - Largest model served: ~half a trillion parameters, 7x bigger than launch - #1 provider of tokens on Hugging Face 🤗 - Serving billions of tokens per day on OpenRouter - The leading code gen inference provider, powering AI developers with Cline and Windsurf We’re just getting started… but couldn’t have done Year 1 without YOU. Build on, builders. ❤️‍🔥
0:39

🎂 Cerebras Inference turns 1! 🚀 Let's break it down: - 6x faster than when we launched — From Meta Llama to Qwen 3 to OpenAI OSS, models running on Cerebras deliver 𝟯,𝟬𝟬𝟬+ 𝘁𝗼𝗸𝗲𝗻𝘀/𝘀𝗲𝗰 - Our inference powers the best AI natives, global enterprises, and developers including Meta, IBM , AlphaSense, Docker, GSK , Mayo Clinic, Core42, Vercel and more - Largest model served: ~half a trillion parameters, 7x bigger than launch - #1 provider of tokens on Hugging Face 🤗 - Serving billions of tokens per day on OpenRouter - The leading code gen inference provider, powering AI developers with Cline and Windsurf We’re just getting started… but couldn’t have done Year 1 without YOU. Build on, builders. ❤️‍🔥

Cerebras

34,546 Aufrufe • vor 10 Monaten

🟧 Cerebras Inference self-serve is finally here 🟧 – Pay by credit card starting at $10 – Run Qwen3 Coder, GPT OSS & more at 2,000+ TPS – 20x the speed of GPU-based model providers Go ahead. Melt our wafers.
0:40

🟧 Cerebras Inference self-serve is finally here 🟧 – Pay by credit card starting at $10 – Run Qwen3 Coder, GPT OSS & more at 2,000+ TPS – 20x the speed of GPU-based model providers Go ahead. Melt our wafers.

Cerebras

52,763 Aufrufe • vor 9 Monaten

🚨 Big news! Cerebras is launching six new AI data centers across North America & Europe. This expands our capacity to 40M+ tokens/sec, making Cerebras the first hyperscale cloud for high-speed AI inference. Read more:
0:53

🚨 Big news! Cerebras is launching six new AI data centers across North America & Europe. This expands our capacity to 40M+ tokens/sec, making Cerebras the first hyperscale cloud for high-speed AI inference. Read more:

Cerebras

27,477 Aufrufe • vor 1 Jahr

10 academic papers. Parsed, analyzed, and synthesized. In under 10 seconds. We built a research agent with @Cerebras Inference and Unstructured that processes entire literature reviews so you become a subject expert faster
0:39

10 academic papers. Parsed, analyzed, and synthesized. In under 10 seconds. We built a research agent with @Cerebras Inference and Unstructured that processes entire literature reviews so you become a subject expert faster

Cerebras

14,588 Aufrufe • vor 4 Monaten

Introducing SuperNinja – the world’s fastest deep research by NinjaTech AI powered by Cerebras: ‣ 1-2min for full answer instead of 10min ‣ 5x faster than o3, Gemini Pro etc. ‣ Same accuracy as measured by GAIA
0:47

Introducing SuperNinja – the world’s fastest deep research by NinjaTech AI powered by Cerebras: ‣ 1-2min for full answer instead of 10min ‣ 5x faster than o3, Gemini Pro etc. ‣ Same accuracy as measured by GAIA

Cerebras

25,541 Aufrufe • vor 11 Monaten

OpenAI Codex-Spark powered by Cerebras You can now just build things faster—at 1,000 tokens/s.
0:47

OpenAI Codex-Spark powered by Cerebras You can now just build things faster—at 1,000 tokens/s.

Cerebras

287,547 Aufrufe • vor 5 Monaten

Cerebras Code: 20x faster than Claude, 1x the price Today we are launching two monthly coding plans: ➡️Cerebras Code Pro: $50/m – for indie developers ➡️Cerebras Code Max: $200/m – for power users with 5x rate limits Both plans get: Qwen3-Coder at 2,000 tokens/s, 131K context, and no weekly limits. Sign up now:
0:43

Cerebras Code: 20x faster than Claude, 1x the price Today we are launching two monthly coding plans: ➡️Cerebras Code Pro: $50/m – for indie developers ➡️Cerebras Code Max: $200/m – for power users with 5x rate limits Both plans get: Qwen3-Coder at 2,000 tokens/s, 131K context, and no weekly limits. Sign up now:

Cerebras

461,227 Aufrufe • vor 11 Monaten

"I used a billion tokens this week. I'm not even in the top 100 Codex users at OpenAI." We sat down with jason (creator of Instructor, now on OpenAI's Developer Experience team) to talk about how zero-latency inference is changing the way engineers work.
0:37

"I used a billion tokens this week. I'm not even in the top 100 Codex users at OpenAI." We sat down with jason (creator of Instructor, now on OpenAI's Developer Experience team) to talk about how zero-latency inference is changing the way engineers work.

Cerebras

93,023 Aufrufe • vor 3 Monaten

"The hardware lottery got worse." Six years after Sara Hooker's landmark essay, she's even more convinced that our current chips are constraining which AI ideas succeed — and which never get a chance.
1:04

"The hardware lottery got worse." Six years after Sara Hooker's landmark essay, she's even more convinced that our current chips are constraining which AI ideas succeed — and which never get a chance.

Cerebras

18,564 Aufrufe • vor 9 Tagen

We gave two agents the same task: “Find images matching this description.” Both use Gemma 4 31B. One runs on Cerebras. The other runs on GPUs. You can see the difference. Speed changes the product experience. What would you build if you didn't have to wait?
1:11

We gave two agents the same task: “Find images matching this description.” Both use Gemma 4 31B. One runs on Cerebras. The other runs on GPUs. You can see the difference. Speed changes the product experience. What would you build if you didn't have to wait?

Cerebras

87,056 Aufrufe • vor 14 Tagen

🎥 EARN’M in 1 Minute - Episode 5 is LIVE! Today we’re breaking down $EARNM - the native token powering everything behind the scenes. 🧩 What $EARNM is ⚙️ How it fuels our entire ecosystem 📲 And why it’s more than “just a token” From staking to newest EARNM L2, $EARNM drives it all. Watch now & see how it fits into the bigger picture 👇
0:59

🎥 EARN’M in 1 Minute - Episode 5 is LIVE! Today we’re breaking down $EARNM - the native token powering everything behind the scenes. 🧩 What $EARNM is ⚙️ How it fuels our entire ecosystem 📲 And why it’s more than “just a token” From staking to newest EARNM L2, $EARNM drives it all. Watch now & see how it fits into the bigger picture 👇

$EARNM Ecosystem

50,725 Aufrufe • vor 8 Monaten