正在加载视频...

视频加载失败

OpenAI and Broadcom have developed a custom artificial intelligence chip called Jalapeno. OpenAI is now testing the samples. The companies say this chip can cut costs by 50%. Ed Ludlow reports

18,790 次观看 • 4 个月前 •via X (Twitter)

3 条评论

Pranav 的头像
Pranav4 个月前

50% cheaper inference compounds. inference is the cost you pay every day a model is serving users, not a one-time training bill. halve it and every product margin at openai just moved.

Inflectiv AI ⧉ 的头像
Inflectiv AI ⧉4 个月前

🔥🔥

Dr. Paul De Santis, PharmD 的头像
Dr. Paul De Santis, PharmD4 个月前

Worst branding Award 🥇

相关视频

Google just admitted it can't build data centers fast enough, so it's planning on baking its AI model directly into the chip instead (Save this). Google's new Frozen v2 chip permanently embeds parts of Gemini's architecture into the silicon itself, cutting down on the calculations and data movement needed to answer a query. Engineers estimate it could process 6 to 10 times more tokens per unit of power than Google's current TPUs. The real story is why Google is building this in the first place because Frozen v2 is meant to ease a severe internal compute crunch that's caused friction between teams at Google. It reportedly pushed Google Cloud to turn away outside business because it simply doesn't have enough spare capacity to go around. If Google, one of the largest chipmakers in the world, is short enough on compute to turn away paying Cloud customers, that's confirmation this shortage isn't a scaling problem unique to smaller players, it's systemic across the entire industry. This ties into a much bigger power struggle happening right now. More AI companies are trying to cut their reliance on Nvidia by building their own chips. OpenAI rolled out a custom chip called Jalapeno alongside Broadcom last month and Anthropic is now partnering with Samsung on something similar. The reasoning is pretty simple, Nvidia effectively acts as landlord for every hyperscaler out there, and the rent isn't cheap. Nvidia hardware can account for anywhere from 20% to 60% of total AI infrastructure spend, and once a company is tied into its ecosystem, every hardware refresh forces another costly one. That's exactly why Google built TPUs and Amazon built Trainium, both trying to protect their own margins for shareholders. Bullish on Marvell + Broadcom who makes these custom chips and follow me Melvin for more infrastructure plays and check out the link below for more!

Melvin

63,457 次观看 • 3 个月前