Loading video...

Video Failed to Load

Go Home

.Decagon co-founder and CEO Jesse Zhang says enterprise open-source adoption is falling right now, and that's a sign of adoption rather than rejection: "Even though there's a lot of hype for open-source, the share of open-source inference is actually going down right now." "People are spinning up all these...

36,749 views • 1 month ago •via X (Twitter)

11 Comments

Tessa Archer's profile picture
Tessa Archer1 month ago

@DecagonAI Jesse's declining-share framing is misleading. Open-source inference volume is growing. New frontier use cases just inflate the denominator faster than migrations complete.

Nam Đầu Tư's profile picture
Nam Đầu Tư1 month ago

@DecagonAI Mình thấy y hệt với team fintech ở HN. Họ chạy PoC bằng GPT-4 6 tháng trước, giờ mới bắt đầu audit để self-host Llama.

icefrog.◎'s profile picture
icefrog.◎1 month ago

@DecagonAI prove then port

安叫兽|Bird🕊️ 🔶 BNB's profile picture
安叫兽|Bird🕊️ 🔶 BNB1 month ago

@DecagonAI 先用闭源跑通,再慢慢换开源,很现实

felix negentropy. weallareeuropean's profile picture
felix negentropy. weallareeuropean1 month ago

@DecagonAI Share can fall while absolute open-source inference grows. Track workload migrations and token volume separately or a fast-growing frontier-model denominator will make adoption look like retreat.

Winston B.'s profile picture
Winston B.1 month ago

Governance review and security signoff don't move at model-improvement speed, so a use case can be proven out for months before procurement clears the switch to open source. That lag is probably where the gap between the hype and the falling spend share comes from. The maturity happens quietly, the queue is what's slow.

techVector's profile picture
techVector1 month ago

@DecagonAI Open source is just getting too complicated for most companies to manage. Makes sense theyd rather pay for something that just works.

Tanishq Saluja's profile picture
Tanishq Saluja1 month ago

@DecagonAI Support is a perfect AI wedge because the value is measurable. The hard part is staying useful when the answer is not already in a help center.

Rabnoor Singh's profile picture
Rabnoor Singh1 month ago

@DecagonAI The migration step is the one that mostly does not happen. Once something works in production nobody gets rewarded for making it cheaper and slightly worse. That incentive is real at the CFO level and completely absent for the person who has to do the swap and own the regression.

sindikitil's profile picture
sindikitil1 month ago

@DecagonAI Seen the same. Teams prototype on open weights, then swap to Anthropic/OpenAI when legal/security review hits. Open source wins dev mindshare, closes lose procurement.

Julien Active's profile picture
Julien Active1 month ago

@DecagonAI The $10 customer finally gets the $100K treatment. Next shift is mobile-first, voice and screenshots, not just text.

Related Videos

David Sacks says companies are trapped paying OpenAI & Anthropic because they can't figure out how to use open source models "I think enterprise CTOs would like to shift their token consumption to cheaper models for the obvious reason that it would be more efficient. They are seeing compute costs or token costs skyrocket right now, so everyone's trying to figure this out." "You also have the AI sovereignty issue that Alex Karp talked about. They're worried about giving up the secret sauce or the alpha in their business to a frontier lab that may one day be competing with them. "The problem is, I think in most cases, they don't have the technical ability to do it. Coinbase figured out how to do it. DoorDash figured out how to do it. They built a token routing system that allows them to send frontier tasks to frontier models and non frontier tasks to more mundane models. But I don't think your average enterprise has the technical capability to do that." "This is why the share of wallet of closed models, it actually increased. I think that open source went from 19% last year to 11% this year. So open source as a share of enterprise spending is actually decreasing." "I don't think that means usage is decreasing. I think usage is skyrocketing. It also may be the case that because the whole point of using an open model is you just pay for the compute costs, you don't have to pay a lab, so it may be that it's hard to measure that usage in terms of spend." "But nonetheless, anyone who's saying that these closed models are going to lose or are somehow losing, you're just not seeing it in the data."

dnap

110,354 views • 2 months ago

Chamath: Banning Open Source AI Will Crash the Stock Market Chamath Palihapitiya: “If the United States government intervenes, it will tank the stock market. Not debatable. Now, you can debate which companies get tanked. For example, if they said, ‘No more open source. American companies cannot use open source.’ Okay, let's take an average normal company, Coca-Cola. ‘Hey, Coca-Cola, you're trying to use AI to improve your business. You know what? You can only use these two options. And those things cost 50-100x more than your other best alternative that you may use otherwise.’ That will eventually show up in your costs. And so this incredibly important input into your cost model is now orders of magnitude, multiples greater than your competitors that are outside the United States, simply because you're in the United States. So what would the capital markets do? They're going to say, ‘Wow, you have a crazy cost structure. This doesn't make sense.’ You're forced to absorb costs that aren't rational nor market-driven. So then Coca-Cola has to get re-rated. But then you look at the people who are selling those tokens, and this is where Anthropic and OpenAI need to understand, if the government comes in and actually tells you that there's no open source, their valuation will crater. Why? Because all of that revenue is artificially being propped up. It's not being driven by market demand where you're being forced to compete. It's because of regulatory capture where you now get an artificial constraint. But it only works in one market. All roads lead to market chaos if anybody gets involved, so we should just not get involved.”

The All-In Podcast

211,679 views • 2 months ago

Baseten Head of AI Model Training Charlie O'Neill says the future is many specialized LLMs dedicated to specific tasks, with bigger labs deployed on the frontiers of areas like science and math: "People are thinking about intelligence capabilities in the wrong way. People are thinking about intelligence relativistically. They say, 'OK, the open-source gap is like 6 months behind closed-source, and GLM 5.3 is as good as Opus 4.8,' or whatever." "The best way to think about what models can do for you, and for the world, is in an absolute sense." "So for any given task that you want to do with an LLM, there's some intelligence threshold where below that you can't do the task, and above that you have very diminishing returns to more intelligence on the task." "So when you think about it that way, the game of LLMs over the last 5 years has been, 'OK, we have these things we want to do with them. Closed source hits it first... but open-source can eventually do that task. And then for many reasons, once you have the base level of intelligence required to do it, you probably do want to swap to open-source." "It's not really about the [frontier lab] God model being better. Like, if I'm filing a tax return, there is a limit to how much intelligence I need to do that particular thing." "So I think the world is going to look like — frontier closed-source labs are going to continue to push the frontier. You do want to use the most intelligent model. You have very inelastic demand for intelligence when you're doing frontier science or frontier math." "But for a lot of the economically valuable things, it looks a lot like, 'I'm a Cursor, or I'm one of these big companies who are realizing I can't just be a wrapper anymore. I've been through the life cycle of building a product that people love. And I should be using that information to make my model better at the things that I care about, and not at anything else.'"

TBPN

50,531 views • 22 days ago