Загрузка видео...

Не удалось загрузить видео

На главную

OpenAI and Broadcom have developed a custom artificial intelligence chip called Jalapeno. OpenAI is now testing the samples. The companies say this chip can cut costs by 50%. Ed Ludlow reports

18,735 просмотров • 2 месяцев назад •via X (Twitter)

Комментарии: 0

Нет доступных комментариев

Здесь появятся комментарии из оригинального поста

Похожие видео

Google just admitted it can't build data centers fast enough, so it's planning on baking its AI model directly into the chip instead (Save this). Google's new Frozen v2 chip permanently embeds parts of Gemini's architecture into the silicon itself, cutting down on the calculations and data movement needed to answer a query. Engineers estimate it could process 6 to 10 times more tokens per unit of power than Google's current TPUs. The real story is why Google is building this in the first place because Frozen v2 is meant to ease a severe internal compute crunch that's caused friction between teams at Google. It reportedly pushed Google Cloud to turn away outside business because it simply doesn't have enough spare capacity to go around. If Google, one of the largest chipmakers in the world, is short enough on compute to turn away paying Cloud customers, that's confirmation this shortage isn't a scaling problem unique to smaller players, it's systemic across the entire industry. This ties into a much bigger power struggle happening right now. More AI companies are trying to cut their reliance on Nvidia by building their own chips. OpenAI rolled out a custom chip called Jalapeno alongside Broadcom last month and Anthropic is now partnering with Samsung on something similar. The reasoning is pretty simple, Nvidia effectively acts as landlord for every hyperscaler out there, and the rent isn't cheap. Nvidia hardware can account for anywhere from 20% to 60% of total AI infrastructure spend, and once a company is tied into its ecosystem, every hardware refresh forces another costly one. That's exactly why Google built TPUs and Amazon built Trainium, both trying to protect their own margins for shareholders. Bullish on Marvell + Broadcom who makes these custom chips and follow me Melvin for more infrastructure plays and check out the link below for more!

Melvin

63,457 просмотров • 1 месяц назад