Video yükleniyor...

Video Yüklenemedi

Ana Sayfaya Dön

Very few people have built successful chips for AI, and Jonathan Ross has done it twice, first with the Google TPU and then again with the Groq Inc LPU.

sundeep's profile picture

sunny madra

36,682 subscribers

504,798 görüntüleme • 10 ay önce •via X (Twitter)

EğitimBilim & Teknoloji
LIVE

Anya Rossi• Live Now

Private livecam show

0 Yorum

Yorum bulunmuyor

Orijinal gönderinin yorumları burada görünecek

Benzer Videolar

Here is a conversation between myself and Groq Inc founder Jonathan Ross at the RAISE AI Conference last week in Paris. Some very good tidbits in here - especially for all the Nvidia bulls. Change is slow...then all at once.
34:56

Here is a conversation between myself and Groq Inc founder Jonathan Ross at the RAISE AI Conference last week in Paris. Some very good tidbits in here - especially for all the Nvidia bulls. Change is slow...then all at once.

Chamath Palihapitiya

421,301 görüntüleme • 2 yıl önce

On Friday, I hosted a Space with Jonathan Ross, the founder and CEO of Groq Inc - a company I invested in that is building custom chips for AI inference. Jonathan, a former high-school dropout, entered the chip industry while working on ad optimization at Google’s New York office. Jonathan overheard the speech recognition team complaining that they couldn't get enough compute. These were the early days of AI, and machine learning wasn’t really a thing yet. So he asked for some budget from Google and started putting together a chip-based machine learning accelerator for them. During the day, Jonathan would work in the normal ads part of the business, and at night, he would work with the accelerator team. After winning approval from Google, Jonathan and his team built a new chip called the Tensor Processing Unit, and began deploying it across Google’s data centers within a year. The TPU was a huge success within Google, eventually underpinning more than 50% of all of Google’s compute power. When the other hyper-scalers learned of this success, they tried to hire Jonathan to build custom chips for them too. During this process, it became increasingly clear to Jonathan that a gap would emerge between companies that had access to next-gen compute and companies that didn’t. So he founded Groq and set out to build a chip that would be available to everyone. I led Groq’s founding investment in 2016, and since then, Jonathan and his team have developed several types of AI hardware including the Language Processing Unit (LPU), a new type of silicon that is hyper-efficient at running inference for LLMs. In our conversation on Friday, we discussed the founding story of Groq, what you need for great AI hardware, large language models, and some of the implications for the key players in AI. It’s one of the most interesting conversations I’ve had on AI with a lot of learnings. You can listen to our conversation below:
1:01:35

On Friday, I hosted a Space with Jonathan Ross, the founder and CEO of Groq Inc - a company I invested in that is building custom chips for AI inference. Jonathan, a former high-school dropout, entered the chip industry while working on ad optimization at Google’s New York office. Jonathan overheard the speech recognition team complaining that they couldn't get enough compute. These were the early days of AI, and machine learning wasn’t really a thing yet. So he asked for some budget from Google and started putting together a chip-based machine learning accelerator for them. During the day, Jonathan would work in the normal ads part of the business, and at night, he would work with the accelerator team. After winning approval from Google, Jonathan and his team built a new chip called the Tensor Processing Unit, and began deploying it across Google’s data centers within a year. The TPU was a huge success within Google, eventually underpinning more than 50% of all of Google’s compute power. When the other hyper-scalers learned of this success, they tried to hire Jonathan to build custom chips for them too. During this process, it became increasingly clear to Jonathan that a gap would emerge between companies that had access to next-gen compute and companies that didn’t. So he founded Groq and set out to build a chip that would be available to everyone. I led Groq’s founding investment in 2016, and since then, Jonathan and his team have developed several types of AI hardware including the Language Processing Unit (LPU), a new type of silicon that is hyper-efficient at running inference for LLMs. In our conversation on Friday, we discussed the founding story of Groq, what you need for great AI hardware, large language models, and some of the implications for the key players in AI. It’s one of the most interesting conversations I’ve had on AI with a lot of learnings. You can listen to our conversation below:

Chamath Palihapitiya

326,752 görüntüleme • 2 yıl önce

Early on, Jonathan Ross foresaw the unprecedented demand for compute of the 2020s. After pioneering Google's TPUs, he founded Groq, a "Language" Processing Unit dedicated for inference. After joining NVIDIA, he is betting on the GPU+LPU combo to power the agentic chains of AI calling AI calling AI. This interview is part of my larger series on dedicated AI chips, so drop any suggestions/questions below. Thank you NVIDIA for hosting us at your HQ! 00:00 Intro 01:00 The Google TPU & Groq origin story 02:41 How is Groq different from a GPU? 04:43 Static scheduling makes Groq faster 05:47 Does Groq work with Mixture-of-Experts? 09:27 Are LPUs limited to text models? 11:03 Diffusion models 13:41 NVIDIA Vera Rubin: the GPU+LPU combo 15:26 Will Groq still be sold as a standalone chip? 16:49 How does agentic AI impact inference economics? 19:21 Will AI replace CUDA kernel engineers? 21:08 Will AI democratize hardware design? 26:11 Jevon's paradox: An endless demand for compute 29:04 What should kids learn in the AI age?
30:38

Early on, Jonathan Ross foresaw the unprecedented demand for compute of the 2020s. After pioneering Google's TPUs, he founded Groq, a "Language" Processing Unit dedicated for inference. After joining NVIDIA, he is betting on the GPU+LPU combo to power the agentic chains of AI calling AI calling AI. This interview is part of my larger series on dedicated AI chips, so drop any suggestions/questions below. Thank you NVIDIA for hosting us at your HQ! 00:00 Intro 01:00 The Google TPU & Groq origin story 02:41 How is Groq different from a GPU? 04:43 Static scheduling makes Groq faster 05:47 Does Groq work with Mixture-of-Experts? 09:27 Are LPUs limited to text models? 11:03 Diffusion models 13:41 NVIDIA Vera Rubin: the GPU+LPU combo 15:26 Will Groq still be sold as a standalone chip? 16:49 How does agentic AI impact inference economics? 19:21 Will AI replace CUDA kernel engineers? 21:08 Will AI democratize hardware design? 26:11 Jevon's paradox: An endless demand for compute 29:04 What should kids learn in the AI age?

Julia Turc

46,967 görüntüleme • 2 ay önce

Groq CEO Jonathan Ross explains the importance of speed in delivering a service and relevance for AI. For Google, a 100 millisecond speed-up leads to 8% higher conversion rate. In consumer products, there’s correlation with time to dopamine and higher margin (eg. cigs > soda).
2:14

Groq CEO Jonathan Ross explains the importance of speed in delivering a service and relevance for AI. For Google, a 100 millisecond speed-up leads to 8% higher conversion rate. In consumer products, there’s correlation with time to dopamine and higher margin (eg. cigs > soda).

Trung Phan

253,708 görüntüleme • 8 ay önce

Good time to repost my interview with Jonathan Ross from April 2024. 0:00 - Intro 0:38 - Founding Story 3:20 - Groq Chip Memory 6:24 - Chips vs. Cloud 9:28 - Future of AI 11:04 - Where is the Value in AI? 13:45 - Agents & Inference Speed 17:18 - Optimizing Models for Groq 19:32 - Fears and Hope for the Future 22:24 - Bias and Algo Control
24:21

Good time to repost my interview with Jonathan Ross from April 2024. 0:00 - Intro 0:38 - Founding Story 3:20 - Groq Chip Memory 6:24 - Chips vs. Cloud 9:28 - Future of AI 11:04 - Where is the Value in AI? 13:45 - Agents & Inference Speed 17:18 - Optimizing Models for Groq 19:32 - Fears and Hope for the Future 22:24 - Bias and Algo Control

Matthew Berman

26,560 görüntüleme • 8 ay önce

Introducing DeepSeek based AI Agents! We built an Executive AI Assistant that can, - Listen to incoming emails - Fetch all your unread emails and summarize the important ones - Draft and Send reply emails Connect with Gmail, Calendar, Slack and more with Frontend designed with Vercel v0 Use Deepseek and other LLMs with Groq Inc with AI SDK code:
0:40

Introducing DeepSeek based AI Agents! We built an Executive AI Assistant that can, - Listen to incoming emails - Fetch all your unread emails and summarize the important ones - Draft and Send reply emails Connect with Gmail, Calendar, Slack and more with Frontend designed with Vercel v0 Use Deepseek and other LLMs with Groq Inc with AI SDK code:

Karan Vaidya

81,149 görüntüleme • 1 yıl önce

A blueprint for tomorrow’s AI world with Eric Schmidt and Jonathan Ross
1:23

A blueprint for tomorrow’s AI world with Eric Schmidt and Jonathan Ross

sunny madra

21,051 görüntüleme • 9 ay önce

Wall Street has NO IDEA what $NVDA's about to ship Here's an exclusive look at NVIDIA's mind-blowing Vera Rubin systems and the new Groq 3 LPU chips Don't say I didn't warn you:
27:47

Wall Street has NO IDEA what $NVDA's about to ship Here's an exclusive look at NVIDIA's mind-blowing Vera Rubin systems and the new Groq 3 LPU chips Don't say I didn't warn you:

Alex

58,766 görüntüleme • 4 ay önce

The future of education. Talk to an AI tutor, it speaks back, and uses a shared whiteboard with the student. Check out this Calculus Tutor powered by Groq Inc and xRx by 8090 Solutions Inc.. Open source, as usual! (Thread 🧵)
0:35

The future of education. Talk to an AI tutor, it speaks back, and uses a shared whiteboard with the student. Check out this Calculus Tutor powered by Groq Inc and xRx by 8090 Solutions Inc.. Open source, as usual! (Thread 🧵)

Ben Klieger

71,162 görüntüleme • 1 yıl önce

MrBeast tried the viral 'Breath Death' poprock mints for the very first time with Adin Ross and surprisingly really liked it 👀
1:02

MrBeast tried the viral 'Breath Death' poprock mints for the very first time with Adin Ross and surprisingly really liked it 👀

yoxic

41,308 görüntüleme • 1 yıl önce

Perfect background music for flow state at 2am - made with the new Lyria 3 Pro. Google AI subscribers can try it in the Google Gemini and developers can build with the API in Google AI Studio - have fun!!
1:00

Perfect background music for flow state at 2am - made with the new Lyria 3 Pro. Google AI subscribers can try it in the Google Gemini and developers can build with the API in Google AI Studio - have fun!!

Demis Hassabis

159,597 görüntüleme • 5 ay önce

From today’s year-end The All-In Podcast Jensen Huang seeing Groq’s tech and saying “this is real” says everything. Jonathan Ross + Groq+ Nvidia is a serious combo. Very excited for the future of AI. My last post of 2025. Happy New Year 🎉
0:58

From today’s year-end The All-In Podcast Jensen Huang seeing Groq’s tech and saying “this is real” says everything. Jonathan Ross + Groq+ Nvidia is a serious combo. Very excited for the future of AI. My last post of 2025. Happy New Year 🎉

Ben Pouladian

112,110 görüntüleme • 8 ay önce

Asked @pieterbot on AOL why NVIDIA acquired Groq Inc And they apparently did not, they just did a licensing deal for $20B Possibly to avoid antitrust laws (so Nvidia doesn't get a monopoly) "In a Christmas Eve deal, Nvidia has entered into a nonexclusive agreement to license technology from artificial intelligence chip start-up Groq, according to a statement on Groq’s website. Groq founder Jonathan Ross and sunny madra, Groq’s president, will leave the company and join Nvidia, bringing other engineering talent with them, according to the statement. Groq will remain an independent company, but it isn’t clear if Nvidia is taking an equity stake."
2:12

Asked @pieterbot on AOL why NVIDIA acquired Groq Inc And they apparently did not, they just did a licensing deal for $20B Possibly to avoid antitrust laws (so Nvidia doesn't get a monopoly) "In a Christmas Eve deal, Nvidia has entered into a nonexclusive agreement to license technology from artificial intelligence chip start-up Groq, according to a statement on Groq’s website. Groq founder Jonathan Ross and sunny madra, Groq’s president, will leave the company and join Nvidia, bringing other engineering talent with them, according to the statement. Groq will remain an independent company, but it isn’t clear if Nvidia is taking an equity stake."

@levelsio

655,867 görüntüleme • 8 ay önce