Loading video...

Video Failed to Load

Go Home

Jensen says Open Source can be MORE expensive for enterprises, Brad Gerstner explains why: Brad Gerstner: “Over the last two weeks, everybody's been saying that the Chinese have caught up, that open source tokens have caught up in intelligence, that they're much cheaper, etc. And Elon comes out and...

60,603 views • 8 days ago •via X (Twitter)

0 Comments

No comments available

Comments from the original post will appear here

Related Videos

David Sacks says companies are trapped paying OpenAI & Anthropic because they can't figure out how to use open source models "I think enterprise CTOs would like to shift their token consumption to cheaper models for the obvious reason that it would be more efficient. They are seeing compute costs or token costs skyrocket right now, so everyone's trying to figure this out." "You also have the AI sovereignty issue that Alex Karp talked about. They're worried about giving up the secret sauce or the alpha in their business to a frontier lab that may one day be competing with them. "The problem is, I think in most cases, they don't have the technical ability to do it. Coinbase figured out how to do it. DoorDash figured out how to do it. They built a token routing system that allows them to send frontier tasks to frontier models and non frontier tasks to more mundane models. But I don't think your average enterprise has the technical capability to do that." "This is why the share of wallet of closed models, it actually increased. I think that open source went from 19% last year to 11% this year. So open source as a share of enterprise spending is actually decreasing." "I don't think that means usage is decreasing. I think usage is skyrocketing. It also may be the case that because the whole point of using an open model is you just pay for the compute costs, you don't have to pay a lab, so it may be that it's hard to measure that usage in terms of spend." "But nonetheless, anyone who's saying that these closed models are going to lose or are somehow losing, you're just not seeing it in the data."

dnap

110,354 views • 1 month ago

Brad Gerstner: Companies Will Pay 5x More for the Best AI, No Evidence of Pricing Pressure from Open Source Brad Gerstner: “Jason, you talked about summarizing a document, it may take 20,000 cheap tokens to do. Of course, shoot that to a lagging model or an open source model. But if you're talking about replacing a software engineer for two hours, that may take two million expensive tokens, and the consequence of using something that's 95% as good is really high. Because you have a long-running task, and if the task breaks early, or it breaks in the middle, or it breaks at the end, there's a huge cost to that.” @jason: “You still burn the tokens, right? And back to this analogy I was using, you're pulling the slot machine, and you lose.” Brad: “And (you lose) the time and the compute. So if an AI agent is replacing a $200 an hour consultant, right? Take that as an example. So three consulting firms, they're competing. They need the smartest consultant. They're charging $200 an hour. The difference between spending $3 on a cheap model or $15 on an expensive model to replace a $200/hour consultant, it's just irrelevant. That inference cost difference is irrelevant if you're getting something that's bulletproof for $15, and so I think that's what we're seeing play out. The best evidence for all of this is just revenue growth. I'm talking about, what is Anthropic's revenue growth compared to OpenAI, compared to the open source models? Millions of independent actors are choosing every single day. The open source companies are growing, right? But they're growing selling something that is really, really cheap. And there's room in every single market for premium products, for mid-tier products, and for commodity products, and I think we see a lot of this token growth, people are speculating that the intelligence gap between that commodity stuff and the frontier stuff is going to collapse to the point that people won't pay for the frontier stuff. There is no evidence of that on the field today.”

The All-In Podcast

52,289 views • 1 month ago

Chamath: Frontier AI Leaders “Created a Total F*cking Mess” Short-sighted fearmongering and immaturity from frontier AI leaders has created deep mistrust, threatening AI’s potential as an open engine of economic mobility. That mistrust gives hyperscalers the chance to position themselves as trusted gatekeepers, using KYC, audit trails, and compliance infrastructure to turn AI into an oligopoly. Chamath Palihapitiya on the All-In Pod: “I think the leaders of the frontier labs leave a lot to be desired. I think what we're seeing is a consistent pattern of evasiveness and immaturity, and I think that does a huge disservice to the entire movement of AI. The key to a vibrant life is rooted in economic mobility, and I think AI is the grand leveler. It is the thing that can enable everyone to have unique amounts of economic mobility because they are unencumbered to figure out what their upper bound is. And against that backdrop, we have to live in this constant doomerism, hype cycle, naivety, and I think it holds us back. How does it hold us back? Tactically, number one, it creates mistrust. I think that Silicon Valley was already decaying in the prestige that it held in American society. We built important things. Then we veered away from that, and we started building less important things. And now we're at a point where we've potentially started to rebuild important things again, but we have this veneer of negativity and mistrust that are created in large part because we just cannot get our sh*t together. And the leaders of the frontier labs are public enemy number one. Number two, I think what it creates, which I think is bad, but what it creates is an incredible opportunity for the hyperscalers. And the very simple opportunity is to convince governments all around the world, not just America, that they should be the gatekeeper. A: You can't trust these guys. B: These models are all over the place. C: Let us be the ones that provision them to the world. We will wrap it in KYC. I've been now talking about KYC for a while, right? Who are these customers? Do they have identification? Why are they allowed to run these models? What are they prompting? Let's keep them so that there's an audit trail. All of these things are going to become issues. The Frontier Lab folks made it an issue because of how they've handled all of this up until now. And what does that create? Now that creates an oligopoly for AI, the most powerful economically leveling instrument we've ever seen in the hands of maybe a handful of hyperscalers, who by the way, would make an incredibly compelling argument, and they would be right. And the only counterfactual to it would be, ‘Well, trust us, guys, it should actually be much more open and in a far more distributed environment.’ Can you imagine the cost and the complexity if you ask the neoscaler to build the same robust KYC or the same VPC infrastructure that Amazon and Microsoft and Google have spent decades investing trillions of dollars in? It's an impossibility, Jason. So you can take all of those datacenters off the map. You can take all of the neoscaler market off the map. All of this was preventable. So instead of a diverse, robust, open ecosystem giving a tool that is the fundamental unlock for humans, we are now going to debate gatekeeping and duopoly versus oligopoly. They have created a total f*cking mess, and it's a shame.”

The All-In Podcast

141,660 views • 1 month ago

Elon exposes OpenAI -- OpenAI execs betrayed the founding mission as soon as there was revenue and profits to be had -- If it started as a for-profit, Elon would own 50% Elon Musk: “There's a mountain of evidence that shows that OpenAI was created as an open source nonprofit.” “That's the exact description in the incorporation documents. They have completely violated that.” “And they tried to change the definition of OpenAI to mean open to everyone instead of open source, even though it always meant open source.” “ I came up with the name. That’s how I know.” “ I mean, essentially, since I came up with the idea for the company, named it, provided the A, B, and C rounds of funding, recruited the critical personnel, and told them everything I know, if that had been a commercial corporation, I'd probably own half the company.” “It was totally at my discretion. I could have done that.” “But I created it as an open source nonprofit for the world.” Chamath: “ Do you think the right thing to do is to take those models and just open source them today?” Elon: “ Yeah, I think that is what it was created to do, so it should.” “Try using any of the recent so-called OpenAI open source models, they don't work.” “They open sourced a broken, non-working version of their models as a fig leaf.” “I mean, do you know anyone who's running OpenAI's open source models? Jason: “No.” Elon: “Exactly.”

The All-In Podcast

387,223 views • 9 months ago

American Citizens Are Calling For Accountably Of Their Money Being Spent On Illegal Immigration Programs Illegal Immigrants Given Up To $9,000 Per Month For Housing Assistance 🚨 “Let's talk about the money that is being spent. I think that there needs to be a federal audit against the company that we have contracted out to take care of the migrants. We have nurses that are being paid $64,000 a month. We have security officers that are being paid as much as $24,000 a month. We have home health care workers that are being paid up to $17,000 a month. You don't think that Chicagoans could have benefited from that? We have citizens in this city that have been on the waiting list for affordable housing for years, and migrants have been bumped in front of them. We have people who have been given up to $9,000 a month for housing assistance. That amount of the city of Chicago. We are not am pro black. I am for my marginalized who have been expect us to give up our parks places in our community for others. We're not saying that there's not room here, but what we are saying is that we are not going to step aside for you to accommodate them when you have continued to leave us out of the equation. So I'm not just talking to Brandon Johnson right now. I'm talking to Governor Pritzker and I'm talking to President Biden and I want you to understand This upcoming political year where the Democratic Party is on the menu, hear me, people of Chicago, of Illinois and of the United States. It is time for us as black people to stop voting party. It is time for us to stop voting color. It is time for us to start voting our self-interest. And if the Democrats in the city of Chicago, the state of Illinois, and the country of USA refuses to listen to us, then it is time for us to start looking at other alternatives. We are looking at all the alternatives. We will not step aside and continue to be mistreated. We will not continue to be disrespected. I'm looking at people who are coming here from another country giving work visas, giving social security cards. Nobody is asking them what walk of life that they come from. You don't think that our brothers who have been in prison, out and who have changed their lives will benefit for the same opportunities that we're giving these migrants. And I'm not saying that they don't deserve those opportunities. But what I am saying is we deserve them first. What I am saying is you can't continue to put us on the back burner and think that we're going to continue to be okay with it. We've done that for long enough. And what we're saying here today is that is no longer acceptable to our governor that you're not going to continue to set money aside for people who don't live here and disrespect, mistreat and forget about us. You've forgotten about us. You have treated us as if we don't matter and we're saying to you you're not going to continue to do this. We're saying to you to see us. You're dumping people into our communities who are going to at some point move us out of the say to you, if you want to glimpse into what's going to happen, look at how people of color are being treated in Venezuela right now. We seem to forget that Venezuela was one of the first places that had African slaves that they were taken to. We're forgetting about that. And so we're forgetting that there are blacks in Venezuela who are being treated the same way we are. And so for us to expect that they're going to come here and be put into society and treat us differently is a pipe drain.”

Wall Street Apes

199,495 views • 2 years ago