tae kim's banner
tae kim's profile picture

tae kim

@firstadopter106,219 subscribers

"Key Context" Substack covering AI and chips. Reached #1 new bestseller first 24 hrs Subscribe https://t.co/3N2fHOXQfL "Be so good they can't ignore you"

Shorts

Amazon Web Services CEO Matt Garman said today there is so much demand they have NEVER retired an Nvidia A100 GPU. The A100 is nearly SIX YEARS OLD. And you're still bearish? "Because there is so much more demand than supply, there typically still is demand for the older chips .. we actually are completely sold out and have never retired an A100 server"

Amazon Web Services CEO Matt Garman said today there is so much demand they have NEVER retired an Nvidia A100 GPU. The A100 is nearly SIX YEARS OLD. And you're still bearish? "Because there is so much more demand than supply, there typically still is demand for the older chips .. we actually are completely sold out and have never retired an A100 server"

145,227 просмотров

Videos

firstadopter's profile picture

Sergey Brin on AI and Jeff Dean back in December when Gemini peaked: “I would say in some ways we for sure messed up in that we underinvested and sort of didn't take it as seriously as we should have, say, eight years ago when we published the Transformer paper. We actually didn't take it all that seriously and didn't necessarily invest in scaling the compute. And also we were too scared to bring it to people because chatbots say dumb things. And, you know, OpenAI ran with it, which is good for them. It was a super smart insight, and it was also our people like Ilya who went there to do that. But I do think we still have benefited from that long history. So we had a lot of the research and development of neural networks kind of going back to Google Brain. That was also kind of lucky. It wasn't luck that we hired Jeff Dean. I mean, we were lucky to get him. But we were in this sort of mindset that deep technical things matter. And so we hired him. We hired a lot of people from DEC, honestly, because they had the top research labs at the time. But he [Jeff Dean] was passionate about neural networks. And it stemmed, I think, from actually his college experiment. I don't know. He was like, whatever, curing third world disease and figuring out neural networks when he was like 16. He's done crazy things. But he was passionate about it. He built up a whole effort. And actually in my division at the time in Google X. We had him but I didn't I was like okay Jeff you do whatever you want. He's like oh we can tell cats from dogs. I'm like oh okay cool. But you know, you also trust your technical people and soon enough they were developing all these algorithms these neural nets that were doing some of our search. And then, you know, Noam came up with a transformer and we were able to do more and more. But yeah, I mean, so we had the underpinnings, we had the R&D. We did underinvest for a number of years and didn't take it as seriously as we should have.” Both Jeff Dean and Noam Shazeer left Google in the past two months.

tae kim

249,117 просмотров • 1 месяц назад

firstadopter's profile picture

How can OpenAI with $13 billion in revenues make $1.4 trillion of spend commitments? (Source: Bg2 Pod ) Sam Altman: “First of all. We’re doing well more revenue than that. Second of all, Brad, if you want to sell your shares, I'll find you a buyer. I just, enough. I think there's a lot of people who would love to buy OpenAI shares. I think people who talk with a lot of breathless concern about our compute stuff or whatever, that would be thrilled to buy shares. So I think we could sell your shares or anybody else's to some of the people who are making the most noise on Twitter about this very quickly. We do plan for revenue to grow steeply. Revenue is growing steeply. We are taking a forward bet that it's going to continue to grow and that not only will ChatGPT keep growing, but we will be able to become one of the important AI clouds, that our consumer device business will be a significant and important thing, that AI that can automate science will create huge value. There are not many times that I want to be a public company, but one of the rare times it's appealing is when those people are writing these ridiculous OpenAI is about to go out of business. I would love to tell them they could just short the stock, and I would love to see them get burned on that. But we carefully plan. We understand where the technology, where the capability is going to grow and how the products we can build around that and the revenue we can generate. We might screw it up. This is the bet that we're making and we're taking a risk along with that. A certain risk is if we don't have the compute, we will not be able to generate the revenue or make the models at this kind of scale.” Satya Nadella: “And let me just say one thing as both a partner and an investor. There is not been a single business plan that I've seen from OpenAI that they've put in and not beaten it. So in some sense, this is the one place where in terms of their growth and just even the business, it's been unbelievable execution, quite frankly. I mean, obviously, OpenAI, everyone talks about all the success and the usage and what have you. But even I'd say all up, the business execution has been just pretty unbelievable.”

tae kim

1,566,511 просмотров • 10 месяцев назад

firstadopter's profile picture

"Faker has a 5070. This is a 5090" 🤣

tae kim

482,260 просмотров • 3 месяцев назад

firstadopter's profile picture

"No HBM for you. I need HBM" - Jensen Fact check. True. $NVDA

tae kim

366,536 просмотров • 3 месяцев назад