Video wird geladen...

Video konnte nicht geladen werden

Zur Startseite

Gavin Baker Gavin Baker says open source is "awesome" for AI infrastructure names because it shifts the economic value from the frontier labs to the infrastructure, and it is already 80% plus of all tokens processed. "A misconception that a lot of people have is that open source models...

162,832 Aufrufe • vor 28 Tagen •via X (Twitter)

0 Kommentare

Keine Kommentare verfügbar

Kommentare vom Original-Post werden hier angezeigt

Ähnliche Videos

David Sacks says companies are trapped paying OpenAI & Anthropic because they can't figure out how to use open source models "I think enterprise CTOs would like to shift their token consumption to cheaper models for the obvious reason that it would be more efficient. They are seeing compute costs or token costs skyrocket right now, so everyone's trying to figure this out." "You also have the AI sovereignty issue that Alex Karp talked about. They're worried about giving up the secret sauce or the alpha in their business to a frontier lab that may one day be competing with them. "The problem is, I think in most cases, they don't have the technical ability to do it. Coinbase figured out how to do it. DoorDash figured out how to do it. They built a token routing system that allows them to send frontier tasks to frontier models and non frontier tasks to more mundane models. But I don't think your average enterprise has the technical capability to do that." "This is why the share of wallet of closed models, it actually increased. I think that open source went from 19% last year to 11% this year. So open source as a share of enterprise spending is actually decreasing." "I don't think that means usage is decreasing. I think usage is skyrocketing. It also may be the case that because the whole point of using an open model is you just pay for the compute costs, you don't have to pay a lab, so it may be that it's hard to measure that usage in terms of spend." "But nonetheless, anyone who's saying that these closed models are going to lose or are somehow losing, you're just not seeing it in the data."

dnap

110,354 Aufrufe • vor 1 Monat

Chamath: Frontier AI Leaders “Created a Total F*cking Mess” Short-sighted fearmongering and immaturity from frontier AI leaders has created deep mistrust, threatening AI’s potential as an open engine of economic mobility. That mistrust gives hyperscalers the chance to position themselves as trusted gatekeepers, using KYC, audit trails, and compliance infrastructure to turn AI into an oligopoly. Chamath Palihapitiya on the All-In Pod: “I think the leaders of the frontier labs leave a lot to be desired. I think what we're seeing is a consistent pattern of evasiveness and immaturity, and I think that does a huge disservice to the entire movement of AI. The key to a vibrant life is rooted in economic mobility, and I think AI is the grand leveler. It is the thing that can enable everyone to have unique amounts of economic mobility because they are unencumbered to figure out what their upper bound is. And against that backdrop, we have to live in this constant doomerism, hype cycle, naivety, and I think it holds us back. How does it hold us back? Tactically, number one, it creates mistrust. I think that Silicon Valley was already decaying in the prestige that it held in American society. We built important things. Then we veered away from that, and we started building less important things. And now we're at a point where we've potentially started to rebuild important things again, but we have this veneer of negativity and mistrust that are created in large part because we just cannot get our sh*t together. And the leaders of the frontier labs are public enemy number one. Number two, I think what it creates, which I think is bad, but what it creates is an incredible opportunity for the hyperscalers. And the very simple opportunity is to convince governments all around the world, not just America, that they should be the gatekeeper. A: You can't trust these guys. B: These models are all over the place. C: Let us be the ones that provision them to the world. We will wrap it in KYC. I've been now talking about KYC for a while, right? Who are these customers? Do they have identification? Why are they allowed to run these models? What are they prompting? Let's keep them so that there's an audit trail. All of these things are going to become issues. The Frontier Lab folks made it an issue because of how they've handled all of this up until now. And what does that create? Now that creates an oligopoly for AI, the most powerful economically leveling instrument we've ever seen in the hands of maybe a handful of hyperscalers, who by the way, would make an incredibly compelling argument, and they would be right. And the only counterfactual to it would be, ‘Well, trust us, guys, it should actually be much more open and in a far more distributed environment.’ Can you imagine the cost and the complexity if you ask the neoscaler to build the same robust KYC or the same VPC infrastructure that Amazon and Microsoft and Google have spent decades investing trillions of dollars in? It's an impossibility, Jason. So you can take all of those datacenters off the map. You can take all of the neoscaler market off the map. All of this was preventable. So instead of a diverse, robust, open ecosystem giving a tool that is the fundamental unlock for humans, we are now going to debate gatekeeping and duopoly versus oligopoly. They have created a total f*cking mess, and it's a shame.”

The All-In Podcast

141,660 Aufrufe • vor 1 Monat

Brad Gerstner: Companies Will Pay 5x More for the Best AI, No Evidence of Pricing Pressure from Open Source Brad Gerstner: “Jason, you talked about summarizing a document, it may take 20,000 cheap tokens to do. Of course, shoot that to a lagging model or an open source model. But if you're talking about replacing a software engineer for two hours, that may take two million expensive tokens, and the consequence of using something that's 95% as good is really high. Because you have a long-running task, and if the task breaks early, or it breaks in the middle, or it breaks at the end, there's a huge cost to that.” @jason: “You still burn the tokens, right? And back to this analogy I was using, you're pulling the slot machine, and you lose.” Brad: “And (you lose) the time and the compute. So if an AI agent is replacing a $200 an hour consultant, right? Take that as an example. So three consulting firms, they're competing. They need the smartest consultant. They're charging $200 an hour. The difference between spending $3 on a cheap model or $15 on an expensive model to replace a $200/hour consultant, it's just irrelevant. That inference cost difference is irrelevant if you're getting something that's bulletproof for $15, and so I think that's what we're seeing play out. The best evidence for all of this is just revenue growth. I'm talking about, what is Anthropic's revenue growth compared to OpenAI, compared to the open source models? Millions of independent actors are choosing every single day. The open source companies are growing, right? But they're growing selling something that is really, really cheap. And there's room in every single market for premium products, for mid-tier products, and for commodity products, and I think we see a lot of this token growth, people are speculating that the intelligence gap between that commodity stuff and the frontier stuff is going to collapse to the point that people won't pay for the frontier stuff. There is no evidence of that on the field today.”

The All-In Podcast

52,289 Aufrufe • vor 1 Monat