Chamath Palihapitiya's banner
Chamath Palihapitiya's profile picture

Chamath Palihapitiya

@chamath2,113,494 subscribers

God is in the details.

Videos

chamath's profile picture

On Friday, I hosted a Space with Jonathan Ross, the founder and CEO of Groq Inc - a company I invested in that is building custom chips for AI inference. Jonathan, a former high-school dropout, entered the chip industry while working on ad optimization at Google’s New York office. Jonathan overheard the speech recognition team complaining that they couldn't get enough compute. These were the early days of AI, and machine learning wasn’t really a thing yet. So he asked for some budget from Google and started putting together a chip-based machine learning accelerator for them. During the day, Jonathan would work in the normal ads part of the business, and at night, he would work with the accelerator team. After winning approval from Google, Jonathan and his team built a new chip called the Tensor Processing Unit, and began deploying it across Google’s data centers within a year. The TPU was a huge success within Google, eventually underpinning more than 50% of all of Google’s compute power. When the other hyper-scalers learned of this success, they tried to hire Jonathan to build custom chips for them too. During this process, it became increasingly clear to Jonathan that a gap would emerge between companies that had access to next-gen compute and companies that didn’t. So he founded Groq and set out to build a chip that would be available to everyone. I led Groq’s founding investment in 2016, and since then, Jonathan and his team have developed several types of AI hardware including the Language Processing Unit (LPU), a new type of silicon that is hyper-efficient at running inference for LLMs. In our conversation on Friday, we discussed the founding story of Groq, what you need for great AI hardware, large language models, and some of the implications for the key players in AI. It’s one of the most interesting conversations I’ve had on AI with a lot of learnings. You can listen to our conversation below:

Chamath Palihapitiya

326,508 views • 2 years ago

No more content to load