Video yükleniyor...

Video Yüklenemedi

Bu video yüklenirken bir sorun oluştu. Bu geçici bir ağ sorunundan kaynaklanıyor olabilir veya video kullanılamıyor olabilir.

Ana Sayfaya Dön

Let's talk about MoE: 🔶 How many experts should you use? 🔶 How does dynamic routing actually behave in production? 🔶 How do you debug a model that won’t train? 🔶 What does 8x7B actually mean for memory and compute? 🔶 What hardware optimizations matter for sparse models? Mixture... show more

Cerebras

58,428 subscribers

345,732 görüntüleme • 1 yıl önce •via X (Twitter)

Bilim & Teknoloji Eğitim

Anya Rossi• Live Now

Private livecam show

0 Yorum

Yorum bulunmuyor

Orijinal gönderinin yorumları burada görünecek

Benzer Videolar

A common misconception in AI right now is that everything we’re excited about is new. When I graduated from MIT in 2023, only 3% of students majored in AI (Course 6-4). I wasn’t one of them...oops. What I know about models, agents, frameworks, and hardware I learned after graduating. And if you’re newer to the field like me, it’s easy to assume today’s breakthroughs are fairly recent. After all, GPT-1 shipped in 2018... so it’s tempting for us to think the important ideas are less than a decade old. They aren’t. Mixture-of-Experts, the backbone of top models from companies like OpenAI and Google was invented in 1991 by Jacobs, Jordan, and Nowlan in “Adaptive Mixtures of Local Experts.” Over 30 years ago! In this conversation with Daria Soboleva, we discuss why MoEs are resurfacing now, the rapidly emerging compute bottlenecks, and how newer hardware architectures change the equation (Cerebras). A reminder that what feels “frontier” today is often decades in the making :)

A common misconception in AI right now is that everything we’re excited about is new. When I graduated from MIT in 2023, only 3% of students majored in AI (Course 6-4). I wasn’t one of them...oops. What I know about models, agents, frameworks, and hardware I learned after graduating. And if you’re newer to the field like me, it’s easy to assume today’s breakthroughs are fairly recent. After all, GPT-1 shipped in 2018... so it’s tempting for us to think the important ideas are less than a decade old. They aren’t. Mixture-of-Experts, the backbone of top models from companies like OpenAI and Google was invented in 1991 by Jacobs, Jordan, and Nowlan in “Adaptive Mixtures of Local Experts.” Over 30 years ago! In this conversation with Daria Soboleva, we discuss why MoEs are resurfacing now, the rapidly emerging compute bottlenecks, and how newer hardware architectures change the equation (Cerebras). A reminder that what feels “frontier” today is often decades in the making :)

Sarah Chieng

360,067 görüntüleme • 6 ay önce

New short course with Mistral AI ! Mistral's open-source Mixtral 8x7B model uses a "mixture of experts" (MoE) architecture. Unlike a standard transformer, an MoE model has multiple expert feed-forward networks (8 in this case), with a gating network selecting two experts at inference time. This enables MoE to match the performance of a large model but faster inference. Mixtral 8x7B has 46.7B parameters but activates only 12.9B at inference to predict the next token. In Getting Started with Mistral, you’ll learn from Mistral’s Sophia Yang, Ph.D. to: - Explore Mistral's open-source models (Mistral 7B, Mixtral 8x7B) and commercial models via API calls and Mistral AI's Le Chat website - Implement JSON mode to generate structured outputs to integrate directly into larger software systems. - Use function calling for Tool Use, such as calling custom Python code that queries tabular data - Ground your LLM's response with external knowledge sources using RAG - Build a Mistral-powered chat interface that can reference external documents This course will help deepen your prompt engineering skills. Please sign up here:

New short course with Mistral AI ! Mistral's open-source Mixtral 8x7B model uses a "mixture of experts" (MoE) architecture. Unlike a standard transformer, an MoE model has multiple expert feed-forward networks (8 in this case), with a gating network selecting two experts at inference time. This enables MoE to match the performance of a large model but faster inference. Mixtral 8x7B has 46.7B parameters but activates only 12.9B at inference to predict the next token. In Getting Started with Mistral, you’ll learn from Mistral’s Sophia Yang, Ph.D. to: - Explore Mistral's open-source models (Mistral 7B, Mixtral 8x7B) and commercial models via API calls and Mistral AI's Le Chat website - Implement JSON mode to generate structured outputs to integrate directly into larger software systems. - Use function calling for Tool Use, such as calling custom Python code that queries tabular data - Ground your LLM's response with external knowledge sources using RAG - Build a Mistral-powered chat interface that can reference external documents This course will help deepen your prompt engineering skills. Please sign up here:

Andrew Ng

387,018 görüntüleme • 2 yıl önce

.Scott Wu to Joe Lonsdale on why Cognition uses AI in job interviews: "One or two years ago, people had this mentality of 'How do we make sure people aren't using AI while we're interviewing them?' And I think that has totally flipped. Honestly, I think that was wrong... If you're asking the question of like, how do we evaluate people on exactly the thing that AI can already do, that seems kind of the wrong. Our interview process has always been... you can use as much AI as you want to use. We're going to give you a few hours. Just build your whole own product surface. A lot of these are projects that, frankly, is like, if you were trying to do this by hand, you would not be able to get done in a few hours. So you kind of have to use AI for this. But in reality, what we actually want to test is, in addition to how familiar you are with these tools, what we actually want to test is, what do you think is the right thing to build? Or how do you make these product decisions? How do you make these trade-offs? How do you decide or collect information about what you should be doing?"

.Scott Wu to Joe Lonsdale on why Cognition uses AI in job interviews: "One or two years ago, people had this mentality of 'How do we make sure people aren't using AI while we're interviewing them?' And I think that has totally flipped. Honestly, I think that was wrong... If you're asking the question of like, how do we evaluate people on exactly the thing that AI can already do, that seems kind of the wrong. Our interview process has always been... you can use as much AI as you want to use. We're going to give you a few hours. Just build your whole own product surface. A lot of these are projects that, frankly, is like, if you were trying to do this by hand, you would not be able to get done in a few hours. So you kind of have to use AI for this. But in reality, what we actually want to test is, in addition to how familiar you are with these tools, what we actually want to test is, what do you think is the right thing to build? Or how do you make these product decisions? How do you make these trade-offs? How do you decide or collect information about what you should be doing?"

American Optimist

13,182 görüntüleme • 3 ay önce

What is your opponent's vision for America, and how do you differ? What kind of a country do we want to live in, what does that mean, and what is the American dream?

What is your opponent's vision for America, and how do you differ? What kind of a country do we want to live in, what does that mean, and what is the American dream?

Steven Crowder

29,896 görüntüleme • 11 ay önce

Some of our top customers are still choosing Llama 3.1 8B. For a while, we jumped to whatever hottest, latest model was taking up our twitter feed. 🙈 But as we are quickly realizing, to create a SOTA product, you need a model that fits your exact use case. Here’s what our customers tell us: > a lot of the legwork is actually around prompting > there’s an art to selecting and combining multiple models > benchmarks only show part of the picture. you have to understand the unique quirks of each model. Especially as model releases become more and more frequent, we need a clear way to evaluate new models. We have to break free of the naive trend to migrate to the ‘latest and greatest’. And you can easily achieve this using tools like Cerebras and Braintrust to swap models safely (without breaking production).

Some of our top customers are still choosing Llama 3.1 8B. For a while, we jumped to whatever hottest, latest model was taking up our twitter feed. 🙈 But as we are quickly realizing, to create a SOTA product, you need a model that fits your exact use case. Here’s what our customers tell us: > a lot of the legwork is actually around prompting > there’s an art to selecting and combining multiple models > benchmarks only show part of the picture. you have to understand the unique quirks of each model. Especially as model releases become more and more frequent, we need a clear way to evaluate new models. We have to break free of the naive trend to migrate to the ‘latest and greatest’. And you can easily achieve this using tools like Cerebras and Braintrust to swap models safely (without breaking production).

Cerebras

346,446 görüntüleme • 7 ay önce

We are told from a young age to pursue love. But how do you actually define love? And once you do, how do you find it? Poet Cleo Wade is the right person to ask, and our conversation about love led down many paths. Listen to our full conversation:

We are told from a young age to pursue love. But how do you actually define love? And once you do, how do you find it? Poet Cleo Wade is the right person to ask, and our conversation about love led down many paths. Listen to our full conversation:

Simon Sinek

62,457 görüntüleme • 2 yıl önce

🏀 RUMBLE KONG LEAGUE: 3 THINGS WE LOVED IN PLAYTEST 🏀 Rumble Kong League SZN 1 Coastal Clash playtest was an absolute blast! This 3v3 mobile basketball had us hyped as we competed and climbed the ranks. Let’s dive into the 3 things we loved about the game that got us hooked ⬇️ — 🟠 THE RUMBLE PASS 🔶 Collect and unlock exclusive rewards by playing and winning matches. 🔶 Earn $FAME points, in-game accessories, and other valuable items. 🔶 After reaching the final level, continue earning unlimited rewards for every 3 wins. — 🟠 SET UP YOUR KONG 🔶 Choose 3 Kongs for left, right, and center positions to shape your team strategy. 🔶 Equip your Kongs with items that match your playstyle, enhancing stats and performance. 🔶 Select special attack and defense abilities that can influence the outcome of battles. — 🟠 DYNAMIC GAMEPLAY 🔶 Enjoy fast-paced, back-and-forth action from jumpball to final buzzer. 🔶 Special skills come to life with incredible visual effects that elevate the gameplay experience. 🔶 Shooting, stealing, and blocking are smooth, and we can’t wait for enhanced dribbling moves. — With its intense 3v3 matches, strategic gameplay, and endless rewards, Rumble Kong League is a must-play for gamers. 🏀 Are you ready for the next playtest and dominate the court? Stay updated and connect with the community on Discord! [link in bio] 🎮

🏀 RUMBLE KONG LEAGUE: 3 THINGS WE LOVED IN PLAYTEST 🏀 Rumble Kong League SZN 1 Coastal Clash playtest was an absolute blast! This 3v3 mobile basketball had us hyped as we competed and climbed the ranks. Let’s dive into the 3 things we loved about the game that got us hooked ⬇️ — 🟠 THE RUMBLE PASS 🔶 Collect and unlock exclusive rewards by playing and winning matches. 🔶 Earn $FAME points, in-game accessories, and other valuable items. 🔶 After reaching the final level, continue earning unlimited rewards for every 3 wins. — 🟠 SET UP YOUR KONG 🔶 Choose 3 Kongs for left, right, and center positions to shape your team strategy. 🔶 Equip your Kongs with items that match your playstyle, enhancing stats and performance. 🔶 Select special attack and defense abilities that can influence the outcome of battles. — 🟠 DYNAMIC GAMEPLAY 🔶 Enjoy fast-paced, back-and-forth action from jumpball to final buzzer. 🔶 Special skills come to life with incredible visual effects that elevate the gameplay experience. 🔶 Shooting, stealing, and blocking are smooth, and we can’t wait for enhanced dribbling moves. — With its intense 3v3 matches, strategic gameplay, and endless rewards, Rumble Kong League is a must-play for gamers. 🏀 Are you ready for the next playtest and dominate the court? Stay updated and connect with the community on Discord! [link in bio] 🎮

Beam Gamers

10,628 görüntüleme • 1 yıl önce

The more AI can do, the more we need to ask what it should and shouldn’t do. OpenAI researcher Jason Wolfe joins host Andrew Mayne to explore the Model Spec, the public framework that defines how models are intended to behave. They break down how it works in practice, from the chain of command that resolves conflicting instructions to the way it evolves over time through real-world use, feedback, and new model capabilities.

The more AI can do, the more we need to ask what it should and shouldn’t do. OpenAI researcher Jason Wolfe joins host Andrew Mayne to explore the Model Spec, the public framework that defines how models are intended to behave. They break down how it works in practice, from the chain of command that resolves conflicting instructions to the way it evolves over time through real-world use, feedback, and new model capabilities.

OpenAI

225,477 görüntüleme • 4 ay önce

AI is changing everything, but how does it actually work? We break down machine learning, training, inference, and what happens behind the scenes when you use AI in the latest episode of #TheBringUp, featuring a hands-on model demo. 🎥 Watch now:

AI is changing everything, but how does it actually work? We break down machine learning, training, inference, and what happens behind the scenes when you use AI in the latest episode of #TheBringUp, featuring a hands-on model demo. 🎥 Watch now:

AMD

23,492 görüntüleme • 1 ay önce

Jensen Huang says, In the future, we will be able to talk to a protein We'll ask it: "what are you? are you soluble? how do you react to heat or chemicals?" This is how AI can talk to an image today, and how we've moved from only processing data to actually understanding it

Jensen Huang says, In the future, we will be able to talk to a protein We'll ask it: "what are you? are you soluble? how do you react to heat or chemicals?" This is how AI can talk to an image today, and how we've moved from only processing data to actually understanding it

Haider.

149,649 görüntüleme • 8 ay önce

Built an AI maturity assessment. It's designed to answer... • how AI-native your team really is • where the bottlenecks are • what good looks like • and what to do next We turned the AI transformation model into something practical you can actually use. Takes about 3 minutes. Chat with it and it gives back: • a detailed AI maturity assessment • strengths and gaps across your workflows • practical recommendations • a downloadable report you can share internally The goal wasn’t to make a gimmicky quiz (please give me direct feedback on how to improve). It’s meant to be a practical diagnostic for how modern teams are actually adopting AI at work. Give it shot!

Built an AI maturity assessment. It's designed to answer... • how AI-native your team really is • where the bottlenecks are • what good looks like • and what to do next We turned the AI transformation model into something practical you can actually use. Takes about 3 minutes. Chat with it and it gives back: • a detailed AI maturity assessment • strengths and gaps across your workflows • practical recommendations • a downloadable report you can share internally The goal wasn’t to make a gimmicky quiz (please give me direct feedback on how to improve). It’s meant to be a practical diagnostic for how modern teams are actually adopting AI at work. Give it shot!

Hurley

33,202 görüntüleme • 2 ay önce

Yesterday, I joined TBPN to talk about what it really means to give AI a memory. And, why that’s becoming the next big moat. We discussed: - Why today’s AI apps are stateless - How memory is quickly becoming the real moat for AI systems - How Mem0 is decoupling memory from models - Why users should be able to own and carry their AI memories across apps - And, how 200 cold emails changed my life🙂 Appreciate John Coogan, Jordi Hays & the TBPN team for having me and for such a thoughtful discussion around the future of AI infrastructure.

Yesterday, I joined TBPN to talk about what it really means to give AI a memory. And, why that’s becoming the next big moat. We discussed: - Why today’s AI apps are stateless - How memory is quickly becoming the real moat for AI systems - How Mem0 is decoupling memory from models - Why users should be able to own and carry their AI memories across apps - And, how 200 cold emails changed my life🙂 Appreciate John Coogan, Jordi Hays & the TBPN team for having me and for such a thoughtful discussion around the future of AI infrastructure.

Taranjeet

14,913 görüntüleme • 8 ay önce

They Want To Know How Many Bedrooms Are In Your Home Why? The Reason Should Worry You! The 2026 Census long form doesn't just ask how many people live in your home. It asks how many rooms are in your dwelling. Then it asks how many of those rooms are bedrooms. Why does the government need to know that? Look at what is already happening in the UK. Some local councils are implementing what they call under-occupancy premiums. If you have rooms in your home that you are not using they are taxing you for them. This is not a conspiracy theory. It is happening right now. And the Canadian government just made you tell them exactly how many rooms you have. Connect the dots. watch my full breakdown 👇

They Want To Know How Many Bedrooms Are In Your Home Why? The Reason Should Worry You! The 2026 Census long form doesn't just ask how many people live in your home. It asks how many rooms are in your dwelling. Then it asks how many of those rooms are bedrooms. Why does the government need to know that? Look at what is already happening in the UK. Some local councils are implementing what they call under-occupancy premiums. If you have rooms in your home that you are not using they are taxing you for them. This is not a conspiracy theory. It is happening right now. And the Canadian government just made you tell them exactly how many rooms you have. Connect the dots. watch my full breakdown 👇

Nico Lagan

48,140 görüntüleme • 2 ay önce

The biggest model is no longer the advantage. The right model is. Generic AI can do a little of everything, but it rarely optimizes for what matters in production. Oumi is changing that by making custom models fast and accessible. It feels like we are entering the era of building your own AI. Manos Koukoumidis Oumi

The biggest model is no longer the advantage. The right model is. Generic AI can do a little of everything, but it rarely optimizes for what matters in production. Oumi is changing that by making custom models fast and accessible. It feels like we are entering the era of building your own AI. Manos Koukoumidis Oumi

Leonardo

15,571 görüntüleme • 3 ay önce

Punch with moe infront his biological mother🥹🐵 Punch seems to have been adopted by Moe, who is so affectionate toward him 🥹. She even carries him on her back and walks with him. Suddenly, he stretches his body right in front of an adult female monkey… 💔and wait… that’s actually Kibe, Punch’s mother 😮‍💨😮‍💨 the one you mentioned yesterday. It really shows how destiny works… mother and child, separated for a while, crossing paths again in such an emotional way 🥺💔💔💔 #Punch #kibe #moe

Punch with moe infront his biological mother🥹🐵 Punch seems to have been adopted by Moe, who is so affectionate toward him 🥹. She even carries him on her back and walks with him. Suddenly, he stretches his body right in front of an adult female monkey… 💔and wait… that’s actually Kibe, Punch’s mother 😮‍💨😮‍💨 the one you mentioned yesterday. It really shows how destiny works… mother and child, separated for a while, crossing paths again in such an emotional way 🥺💔💔💔 #Punch #kibe #moe

Animal Love

140,291 görüntüleme • 2 ay önce

What does autonomous AI actually mean for engineering? In the Season 3 premiere of Advanced Insights, Mark Papermaster sat down with Alex Starr to unpack a shift that’s redefining how systems are designed, built and evolved. Watch the full episode on YouTube:

What does autonomous AI actually mean for engineering? In the Season 3 premiere of Advanced Insights, Mark Papermaster sat down with Alex Starr to unpack a shift that’s redefining how systems are designed, built and evolved. Watch the full episode on YouTube:

AMD

15,643 görüntüleme • 4 ay önce

The Vijñāna-Bhairava Tantra: 112 Gateways to Radical Presence.🕉️ Forget dense philosophy. The Vijñāna-Bhairava Tantra (VBT) is a masterclass in direct experience—a 163-stanza "field manual" for waking up. Presented as an intimate dialogue between the divine consciousnesses of Śiva and Śakti, it isn't meant to be read; it is meant to be practiced. 🔶The Essence of the Text:🔶 🔺A Radical Toolkit: Contained within these verses are 112 meditation techniques (dhāraṇās) designed to collapse the distance between you and supreme awareness. 🔺The Approach: It is deliberately terse and poetic. Each stanza acts as a "seed"—a concise, explosive prompt meant to trigger an immediate shift in perception. 🔺The Scope: The practices are brilliantly diverse, spanning breath-work, sensory immersion, the power of sound, lucid dreaming, and the contemplative plunge into the "void" (śūnya). 🔶Origins & Authority:🔶 🔺Lineage: Emerging from the 7th–10th century Kashmir Shaivism (Kaula/Trika tradition), this text is less a single book and more an ancient transmission of lived experience. 🔺Intellectual Pedigree: Despite its practical focus, it carries immense weight. Masters like Abhinavagupta held it in the same high regard as the sacred Upaniṣads, recognizing that true liberation happens in the body and mind, not just on the page. 🔶Why It Matters Now?🔶 In a world of information overload, the VBT is a surgical tool. It bypasses the intellect to offer immediate, experiential doorways into nondual awareness. Whether you are a scholar of traditions or a modern seeker looking for a meditation practice that actually works, the VBT provides a diverse, customizable toolkit to inhabit your own consciousness fully. "The VBT does not ask for belief; it demands experimentation. It is arguably the most practical, comprehensive, and adventurous meditation manual in the history of human consciousness." 📽️historified_in

The Vijñāna-Bhairava Tantra: 112 Gateways to Radical Presence.🕉️ Forget dense philosophy. The Vijñāna-Bhairava Tantra (VBT) is a masterclass in direct experience—a 163-stanza "field manual" for waking up. Presented as an intimate dialogue between the divine consciousnesses of Śiva and Śakti, it isn't meant to be read; it is meant to be practiced. 🔶The Essence of the Text:🔶 🔺A Radical Toolkit: Contained within these verses are 112 meditation techniques (dhāraṇās) designed to collapse the distance between you and supreme awareness. 🔺The Approach: It is deliberately terse and poetic. Each stanza acts as a "seed"—a concise, explosive prompt meant to trigger an immediate shift in perception. 🔺The Scope: The practices are brilliantly diverse, spanning breath-work, sensory immersion, the power of sound, lucid dreaming, and the contemplative plunge into the "void" (śūnya). 🔶Origins & Authority:🔶 🔺Lineage: Emerging from the 7th–10th century Kashmir Shaivism (Kaula/Trika tradition), this text is less a single book and more an ancient transmission of lived experience. 🔺Intellectual Pedigree: Despite its practical focus, it carries immense weight. Masters like Abhinavagupta held it in the same high regard as the sacred Upaniṣads, recognizing that true liberation happens in the body and mind, not just on the page. 🔶Why It Matters Now?🔶 In a world of information overload, the VBT is a surgical tool. It bypasses the intellect to offer immediate, experiential doorways into nondual awareness. Whether you are a scholar of traditions or a modern seeker looking for a meditation practice that actually works, the VBT provides a diverse, customizable toolkit to inhabit your own consciousness fully. "The VBT does not ask for belief; it demands experimentation. It is arguably the most practical, comprehensive, and adventurous meditation manual in the history of human consciousness." 📽️historified_in

The Melting Pot

12,413 görüntüleme • 1 ay önce

you might've heard about context engineering, but nobody has explained what it really is... that's why I made a full practical walkthrough on how to use it to make your AI outputs personalized and consistent in this walkthrough, I go over: – what context engineering actually is (without the jargon) – how to train AI on your own data and preferences – how to get outputs that sound like you wrote them (not generic AI) reply "context" and I'll DM it to you (must be following)

you might've heard about context engineering, but nobody has explained what it really is... that's why I made a full practical walkthrough on how to use it to make your AI outputs personalized and consistent in this walkthrough, I go over: – what context engineering actually is (without the jargon) – how to train AI on your own data and preferences – how to get outputs that sound like you wrote them (not generic AI) reply "context" and I'll DM it to you (must be following)

Tyler

20,012 görüntüleme • 10 ay önce

What is the New World screwworm? What does it mean for Texas? And what can you do about it? Experts across The Texas A&M University System have been preparing for this moment, but they cannot do it alone. Texans are urged to monitor their animals and report any unusual activity to Texas Animal Health Commission or Texas Parks & Wildlife. Learn how to report suspected cases and more here:

What is the New World screwworm? What does it mean for Texas? And what can you do about it? Experts across The Texas A&M University System have been preparing for this moment, but they cannot do it alone. Texans are urged to monitor their animals and report any unusual activity to Texas Animal Health Commission or Texas Parks & Wildlife. Learn how to report suspected cases and more here:

Texas A&M System

313,039 görüntüleme • 1 ay önce

“That’s job number one as coaches. What is the best way for them to learn? How do we motivate them? You get a guy that got a lot of talent. Why does it work out? If you really believe in the coaches you have, what your teaching and how to go about it,” Dan Campbell Trust wins.

“That’s job number one as coaches. What is the best way for them to learn? How do we motivate them? You get a guy that got a lot of talent. Why does it work out? If you really believe in the coaches you have, what your teaching and how to go about it,” Dan Campbell Trust wins.

The Winning Difference

35,086 görüntüleme • 1 yıl önce