Fireside Alpha's banner
Fireside Alpha's profile picture

Fireside Alpha

@firesidealpha2,057 subscribers

Summary and synthesis of the best business, technology, and consumer conversations

Videos

firesidealpha's profile picture

The July 4th weekend All-In The All-In Podcast turned into a long argument about who owns the intelligence layer. The besties think enterprises just woke up to a trap they had been walking into, here's how the conversation went (save this): ◽️ The Palantir-Nvidia deal is a bet against the model-layer duopoly. Palantir will use Nvidia's Nemotron open models to build a custom frontier-quality model for US government agencies, and the agencies own the hardware, the data, and the weights. Sacks framed it as structural: an application company and a chip company both want a competitive model layer, so they are natural partners against a two-provider middle. ◽️ Alex Karp's CNBC "crashout" was actually the thesis. Karp argued enterprises have lost trust in the frontier labs and want to own their compute, models, data, and alpha. Sacks translated it as a new definition of enterprise AI safety: safety means the model provider cannot hoover up your proprietary knowledge and turn it into its next product. ◽️ Figma is the cautionary tale that made it real. Anthropic launched Claude Design into Figma's category, its chief product officer sat on Figma's board and resigned only 3 days before launch, and Figma's stock is down about 50% this year while Anthropic's valuation surged. Sacks listed Claude Science, Security, Legal, Financial, and Code as the same move: dominate the model layer, then take the lucrative verticals. ◽️ The playbook has a name, and it is Microsoft and Google. Sacks argued Anthropic is running the operating-system strategy: own the layer everyone builds on, then walk up the stack. His Google receipt is that fewer than half of searches now send you off-site, versus an early Google that prided itself on how fast it kicked you away. ◽️ The BCG number is what raises the stakes. Chamath cited a BCG return-on-capital-employed study: the cost of capital is back to its long-run 8 to 11%, and half of large US companies cannot earn returns above it. If you are already teetering on your cost of capital, handing your alpha to a provider that may compete with you is not a luxury risk, it is fatal. ◽️ The 16.4x number is the whole argument in one data point. Chamath ran a code-migration task through 8090's harness. Wrapping Claude was 1.4x cheaper and 1.5x faster than Claude Opus alone. Wrapping the best open-source model was 16.4x cheaper, at about 3x slower. For a background task, three extra hours to cut cost by 16x is not a close call. ◽️ Even at 100x cheaper, enterprises were saying no for the wrong reason. Chamath relayed an ex-Meta PM's point that companies reject open models over China and safety fears, when they could host those same open weights on their own GPUs in US data centers with nothing flowing back. The safety objection, she argued, is backwards: the leak is the data you hand the frontier labs. ◽️ Friedberg says the frontier labs are trying to commoditize their own customers. Anthropic has been signing up life-sciences companies to feed a new life-focused model in exchange for early access, and nearly everyone he has talked to now refuses, recognizing that data they spent billions generating becomes worthless once it is pooled with everyone else's. ◽️ The deployment topology is shifting from big hubs to distributed spokes. Friedberg's map: the old assumption was a few capital-advantaged mega-clusters plus inference clouds. The new one is large hubs, medium hubs (enterprise training clusters), and distributed spokes, including on-prem inference in your own building. Owning your weights is the point. ◽️ Chamath's endgame is running GLM himself. An industry contact told him that with harness post-training and telemetry, an open Chinese model like GLM could get as good as Anthropic's Mythos. His conclusion: take GLM, control it soup-to-nuts on US hardware with only US citizens touching it, and pay a fraction. ◽️ The Apple analogy sharpens why renting intelligence is different from renting distribution. Chamath argued Apple is the only platform that respected developers, deliberately keeping its stock apps basic to protect the ecosystem and collect its 30% tax. There is no 30% tax on open models, and worse, you cannot rent intelligence from the same place that rents it to your competitor without ending up identical to them. ◽️ Nvidia's open model is now good enough to matter. Calacanis claimed you cannot tell Jensen Huang's Nemotron from Claude on 95% of searches, and that Nvidia downplayed the model until now to avoid alarming its top customers. The gloves came off once OpenAI, Anthropic, and Elon all signaled their own silicon ambitions. ◽️ Sacks sized the duopoly: roughly $60B and $40B in ARR. Anthropic is around ~$60 billion of ARR, OpenAI at ~$40 billion, and no one else generates meaningful model-layer revenue. Sacks's policy line: the US does not ban monopolies, only anti-competitive tactics, but the government should do nothing to make the duopoly more likely. ◽️ The token deflation call: 90% a year for three years. Calacanis predicted token costs fall 90% annually for three years, putting the price of intelligence near free and making it rational to waste tokens on hardware you already own. Friedberg's version is a 70/20/10 split between big cloud, local, and other clouds. ◽️ A wave of platform lock-in spending is already landing. Calacanis flagged Microsoft standing up a roughly $2.5 billion forward-deployed-engineer effort and Amazon spending about $1 billion on the same, plus OpenAI's version. His read: enterprises will slam the door, because letting a provider's engineers study your business is how it ends up in their model. ◽️ The server-per-employee prediction. Calacanis expects every employee to get $10,000 to $20,000 of local compute, a Mac Studio or a high-RAM Dell, running a personal local model that syncs to a thin laptop. A server per person, so nothing leaks. ◽️ On jobs, the data does not show present-tense loss. Sacks cited a RAMP and Revelio Labs study of over 21,000 US firms: the heaviest AI spenders grew headcount about 10% over two years, and entry-level headcount grew even faster at 12%. Friedberg's harder claim: there is no AI job loss yet, only clunky, gradual value creation, and the media will not reverse its narrative because that destroys its credibility. ◽️ The displacement case is real but forward-dated. The counterpoint on the show was that customer support, entry-level data entry and BPO, and driving are the near-term displacements, with Waymo cited as present-tense evidence: in markets where it hits critical mass, Uber and Lyft stop recruiting drivers. Sacks noted most US entry-level support was already offshored, so the acute risk sits in those countries first. ◽️ The human-premium counternarrative. Friedberg argued that as automation spreads, human interaction gets a premium: the skilled bartender, the real driver, the human-in-the-loop tier. He cited the company (referenced as Klarna) that hyped replacing its whole support team with AI, then reversed a year later on brand grounds. ◽️ The export-control episode needed three conditions, and Sacks says do not over-read it. Commerce lifted controls on Anthropic's Fable 5 after two weeks, with Mythos 5 restored to US customers around June 26 once co-founder Tom Brown replaced Dario as lead negotiator. Sacks's three conditions: Dario boasting for months about a cyber weapon, Amazon reporting failed guardrails in testing, and Dario refusing to roll Fable back. His message to allies: this was a particular set of circumstances rather than the debut of a standing lever. ◽️ The import question nobody answered cleanly. Calacanis pressed on why the US blocks Chinese cars and drones but not Chinese open models like DeepSeek and Kimi. Sacks's answer: a forked open model run on US hardware stops being Chinese, and banning open source would isolate the US and impose a token tax on American enterprises, so let the market decide if American open models win. ◽️ The California fiscal story is a business-climate story. Friedberg walked through the numbers behind Newsom's "balanced" $351B budget: expenses exceed revenue and $20-40B is borrowed to close the gap, the budget grew 65% in six years ($215B to $355B), personal income tax is $142B of ~$211B revenue with the top 1% (150,000 people) paying $70B of it, and the corporate rate of 8.9% sits far above Texas at zero. ◽️ The tax base is leaving, and the state is now taxing everyone else. Friedberg cited 1 to 1.5% of adjusted gross income leaving each year (about 15% over a decade), at least 15 Fortune 500 HQs and ~2,100 firms gone since 2019, and a new 8% software sales tax hitting Word, Gmail, and ChatGPT subscriptions plus a health-insurance tax, on top of a now-permanent 14.4% top bracket. The liabilities behind it run $1.4T in debt, up to $1.5T in unfunded pensions senior to state bonds, and ~$40B/year in out-year deficits. Lastly, the line that framed the whole show: "You can't rent intelligence from the same place that rents it to your competitor." That is the sovereignty thesis in one sentence, and every number in this episode is an argument for it. ____ Follow Fireside Alpha for more summaries on key business and technology conversations.

Fireside Alpha

51,999 次观看 • 6 天前

firesidealpha's profile picture

The creator of High Bandwidth Memory (HBM) put a number on the AI build that should stop every infra investor cold. A cluster of a million GPUs runs at roughly 10-20% utilization (Save this). Kim Jung-ho spent thirty years building what feeds the GPU, and his claim is that the GPU is barely working. Here is what is actually happening. Every time a model generates output, the data has to be read out of memory, computed, and written back. The read and the write swallow almost the entire cycle. While that data moves, the GPU does nothing. It sits there, fully powered, fully paid for, waiting. By Kim's estimate the memory is doing only about 30 percent of the work it needs to do. The processor idles the rest. So a million installed GPUs run at 10 to 20 percent. You are not compute constrained. You are memory constrained, and the expensive part is standing around. Adding more GPUs does not fix this. It gives you more processors starving for the same data. Here is the part that decides the next decade. Memory can grow. When a cell cannot shrink any further, you stack it into a high-rise, layer on layer. A GPU cannot be stacked. It runs too hot and needs a cooler bolted to its back, so the one move that rescues memory is closed to the processor. The thing that can keep stacking compounds. The thing that cannot plateaus. The marginal dollar in an AI build now buys more by fixing the memory path than by bolting on another idle GPU. Which is why the companies that control memory bandwidth and supply are not suppliers to the AI trade. They are the AI trade.

Fireside Alpha

38,370 次观看 • 10 天前

没有更多内容可加载