Video yükleniyor...

Video Yüklenemedi

Bu video yüklenirken bir sorun oluştu. Bu geçici bir ağ sorunundan kaynaklanıyor olabilir veya video kullanılamıyor olabilir.

Ana Sayfaya Dön

Everyone’s obsessed with cheaper tokens. Meanwhile, enterprise AI spend keeps going up. Chamath says costs are doubling every 45 days for ~5% productivity gains. Glean’s founder says the metric that actually matters is cost per successful task, not cost per token.

Not Jerome Powell

1,631,492 subscribers

45,215 görüntüleme • 14 gün önce •via X (Twitter)

Bilim & Teknoloji Finans Haberler & Politika

Anya Rossi• Live Now

Private livecam show

0 Yorum

Yorum bulunmuyor

Orijinal gönderinin yorumları burada görünecek

Benzer Videolar

BILLIONAIRE CHAMATH SAID HIS COMPANY'S AI TOKEN COSTS ARE DOUBLING EVERY 45 DAYS... BUT PRODUCTIVITY IS UP JUST 5%. "OUR TOKEN COSTS ARE DOUBLING EVERY 45 DAYS." "OUR UPSIDE IS ESSENTIALLY FLAT." "I SUSPECT THAT IF YOU CAN GET OUT NOW, YOU SHOULD GET OUT NOW." THAT'S A BIG WARNING FOR THE AI INDUSTRY.

BILLIONAIRE CHAMATH SAID HIS COMPANY'S AI TOKEN COSTS ARE DOUBLING EVERY 45 DAYS... BUT PRODUCTIVITY IS UP JUST 5%. "OUR TOKEN COSTS ARE DOUBLING EVERY 45 DAYS." "OUR UPSIDE IS ESSENTIALLY FLAT." "I SUSPECT THAT IF YOU CAN GET OUT NOW, YOU SHOULD GET OUT NOW." THAT'S A BIG WARNING FOR THE AI INDUSTRY.

Vivek Sen

53,180 görüntüleme • 11 saat önce

🚩 Chamath Says His Company’s Token Costs are Doubling Every 45 Days With Only a 5% Productivity Improvement “I don't know how many other companies will actually go through this reckoning now, but the point is, everybody in the next three or four years will for sure go through it.”

🚩 Chamath Says His Company’s Token Costs are Doubling Every 45 Days With Only a 5% Productivity Improvement “I don't know how many other companies will actually go through this reckoning now, but the point is, everybody in the next three or four years will for sure go through it.”

Chief Nerd

118,601 görüntüleme • 25 gün önce

🎙️ Want a full breakdown on why cost per token is a key metric for AI infrastructure TCO? We’re operating in a power-constrained world. Demand for intelligence is scaling faster than infrastructure can keep up—so metrics like cost per GPU hour or FLOPs per dollar don’t tell the full story. When it comes to TCO, Cost per Token is the metric that captures end-to-end performance across GPUs, CPUs, networking, software, and ecosystem making it the key driver of real profitability and scalability in AI. If you’re not measuring efficiency at the token level, you’re missing what actually drives cost. Watch the deep-dive conversation with Dr. Gerro Prinsloo , Nader Khalil and Carter Abdallah, live on the NVIDIA YouTube channel.

🎙️ Want a full breakdown on why cost per token is a key metric for AI infrastructure TCO? We’re operating in a power-constrained world. Demand for intelligence is scaling faster than infrastructure can keep up—so metrics like cost per GPU hour or FLOPs per dollar don’t tell the full story. When it comes to TCO, Cost per Token is the metric that captures end-to-end performance across GPUs, CPUs, networking, software, and ecosystem making it the key driver of real profitability and scalability in AI. If you’re not measuring efficiency at the token level, you’re missing what actually drives cost. Watch the deep-dive conversation with Dr. Gerro Prinsloo , Nader Khalil and Carter Abdallah, live on the NVIDIA YouTube channel.

NVIDIA

21,970 görüntüleme • 3 ay önce

Chamath reveals his company's AI token costs are doubling every 45 days but productivity is only up 5% "I sat down with my CTO today, I said how are we doing on token spend. And he said the most incredible thing, he said right now, our token costs are doubling every 45 days. I said well what is the downstream productivity? And he said maybe 5% max." "So my costs are doubling every 45 days, my upside is essentially flat. He said honestly, what we're finding out is that you need to use a lot more tokens to get to this next iteration of improvement because we've effectively already asymptoted." "We're going to take a step back and try to figure out what to do. I don't know how many other companies will actually go through this reckoning now, but the point is everybody in the next three or four years will for sure go through it." "I suspect that if you can get out now, you should get out now before all of that starts to seep into the water table. Because I think that's probably what allows you to get out at a huge price and raise a huge amount of money."

Chamath reveals his company's AI token costs are doubling every 45 days but productivity is only up 5% "I sat down with my CTO today, I said how are we doing on token spend. And he said the most incredible thing, he said right now, our token costs are doubling every 45 days. I said well what is the downstream productivity? And he said maybe 5% max." "So my costs are doubling every 45 days, my upside is essentially flat. He said honestly, what we're finding out is that you need to use a lot more tokens to get to this next iteration of improvement because we've effectively already asymptoted." "We're going to take a step back and try to figure out what to do. I don't know how many other companies will actually go through this reckoning now, but the point is everybody in the next three or four years will for sure go through it." "I suspect that if you can get out now, you should get out now before all of that starts to seep into the water table. Because I think that's probably what allows you to get out at a huge price and raise a huge amount of money."

dnap

1,530,558 görüntüleme • 25 gün önce

Liquid AI (Liquid AI) CEO Ramin Hasani (Ramin) says: "We're bringing the cost of tokens to zero." "The axis was maximizing intelligence at all costs." Foundation models need to optimize across 3 axes: 1.) Intelligence and capability 2.) Efficiency and cost 3.) Substrate: where the intelligence actually runs "Efficiency is not an afterthought. Energy is not abundant." "If you maximize intelligence at all costs, that axis alone is not going to get you to the place that you want to go." "Efficiency and cost of intelligence as a first-class citizen, and not an afterthought." "Where does this intelligence system go? AI is majorly getting hosted in data centers, but you could also bring intelligence on phones, on laptops, on airplanes, on cars." "Imagine if it's not tokens that are actually important. It's just the outcome that actually matters." "Not just thinking about foundation models as the token machines that are generating money and revenue for the foundation model companies that are useless tokens, and getting them into the place where they can actually unlock true value for enterprises."

Liquid AI (Liquid AI) CEO Ramin Hasani (Ramin) says: "We're bringing the cost of tokens to zero." "The axis was maximizing intelligence at all costs." Foundation models need to optimize across 3 axes: 1.) Intelligence and capability 2.) Efficiency and cost 3.) Substrate: where the intelligence actually runs "Efficiency is not an afterthought. Energy is not abundant." "If you maximize intelligence at all costs, that axis alone is not going to get you to the place that you want to go." "Efficiency and cost of intelligence as a first-class citizen, and not an afterthought." "Where does this intelligence system go? AI is majorly getting hosted in data centers, but you could also bring intelligence on phones, on laptops, on airplanes, on cars." "Imagine if it's not tokens that are actually important. It's just the outcome that actually matters." "Not just thinking about foundation models as the token machines that are generating money and revenue for the foundation model companies that are useless tokens, and getting them into the place where they can actually unlock true value for enterprises."

Molly O’Shea

12,816 görüntüleme • 27 gün önce

🚨 THE AI COST BUBBLE IS GETTING WORSE. Companies pushed employees to “tokenmaxx” and aggressively use AI tools to boost productivity scores, but agentic AI can consume up to 1,000x more tokens than normal AI queries. Now the same companies that hyped AI cost savings are discovering that heavy AI usage is actually exploding operating costs instead of reducing them.

🚨 THE AI COST BUBBLE IS GETTING WORSE. Companies pushed employees to “tokenmaxx” and aggressively use AI tools to boost productivity scores, but agentic AI can consume up to 1,000x more tokens than normal AI queries. Now the same companies that hyped AI cost savings are discovering that heavy AI usage is actually exploding operating costs instead of reducing them.

Crypto Rover

69,155 görüntüleme • 2 ay önce

Sam Altman says AI models will get exponentially more capable and cheaper per task History proves that as costs drop, demand explodes Even as models become efficient enough to run on our phones, the world's hunger for tokens will only increase "capitalism is doing its thing"

Sam Altman says AI models will get exponentially more capable and cheaper per task History proves that as costs drop, demand explodes Even as models become efficient enough to run on our phones, the world's hunger for tokens will only increase "capitalism is doing its thing"

Haider.

38,159 görüntüleme • 6 ay önce

Gavin Baker: "Anthropic is roughly four times more capital efficient than OpenAI - they're growing really fast and they're not burning that much cash" this is him explaining why he thinks token efficiency decides who wins, why xAI has the lowest cost per token of anyone, and what a Tesla board member says is actually the most advanced AI in the world right now "an Anthropic model can give you a comparable quality answer to a Google model using half as many tokens - and each token is literally cost" "xAI has the lowest cost per token because they build data centers faster and at a lower cost than everyone, and they run GPUs at a higher utilization" Tesla board member Antonio Gracias: "Tesla actually is today the most advanced AI in the world - it does the most complex thing a human does, drive a car" bookmark & watch the full conversation ↓

Gavin Baker: "Anthropic is roughly four times more capital efficient than OpenAI - they're growing really fast and they're not burning that much cash" this is him explaining why he thinks token efficiency decides who wins, why xAI has the lowest cost per token of anyone, and what a Tesla board member says is actually the most advanced AI in the world right now "an Anthropic model can give you a comparable quality answer to a Google model using half as many tokens - and each token is literally cost" "xAI has the lowest cost per token because they build data centers faster and at a lower cost than everyone, and they run GPUs at a higher utilization" Tesla board member Antonio Gracias: "Tesla actually is today the most advanced AI in the world - it does the most complex thing a human does, drive a car" bookmark & watch the full conversation ↓

Сarm1ne

124,996 görüntüleme • 6 gün önce

Eric Schmidt says the cost of intelligence is falling 10x per year. “It's essentially the industrialization of platforms.” What engines did in 70 years, AI is replicating in 5. A new fab layer for civilization is booting up.

Eric Schmidt says the cost of intelligence is falling 10x per year. “It's essentially the industrialization of platforms.” What engines did in 70 years, AI is replicating in 5. A new fab layer for civilization is booting up.

vitrupo

46,682 görüntüleme • 1 yıl önce

⚡️ JUST IN: MUSK LAUNCHES GROK 4.5, CALLING IT "OPUS-CLASS" AI MODEL Musk just released Grok 4.5 on Grok Build, Cursor, and the SpaceXAI Console, calling it an "Opus-class" AI model. He says it is faster, more token-efficient and lower cost, with EU access expected by mid-July. Built on a 1.5 TRILLION parameter foundation model, it drops the same day as OpenAI's GPT-5.6. API pricing is $2 per million input tokens and $6 per million output tokens.

⚡️ JUST IN: MUSK LAUNCHES GROK 4.5, CALLING IT "OPUS-CLASS" AI MODEL Musk just released Grok 4.5 on Grok Build, Cursor, and the SpaceXAI Console, calling it an "Opus-class" AI model. He says it is faster, more token-efficient and lower cost, with EU access expected by mid-July. Built on a 1.5 TRILLION parameter foundation model, it drops the same day as OpenAI's GPT-5.6. API pricing is $2 per million input tokens and $6 per million output tokens.

Coin Bureau

50,488 görüntüleme • 27 gün önce

A client accidentally spent $500M in one month on Claude. $16.6M per day. No usage controls. Chamath Palihapitiya on The All-In Podcast EP275: a Fortune-level company failed to set token limits. The bill arrived at end of month. A separate Fortune 20 company is 6 months into a $1B AI-driven OPEX reduction program. $200M in tokens spent. Minimal results. Microsoft is already canceling Claude enterprise licenses. David Sacks calls it a "meme" forming - that token spend is wasteful and the market is overcorrecting. For enterprise AI buyers: the companies building spend-control and measurable-ROI infrastructure now are positioned to capture budget as the backlash unfolds. Full enterprise spend breakdown and what it means for AI vendor pricing power on The All-In Podcast: Source: All-In Podcast -

A client accidentally spent $500M in one month on Claude. $16.6M per day. No usage controls. Chamath Palihapitiya on The All-In Podcast EP275: a Fortune-level company failed to set token limits. The bill arrived at end of month. A separate Fortune 20 company is 6 months into a $1B AI-driven OPEX reduction program. $200M in tokens spent. Minimal results. Microsoft is already canceling Claude enterprise licenses. David Sacks calls it a "meme" forming - that token spend is wasteful and the market is overcorrecting. For enterprise AI buyers: the companies building spend-control and measurable-ROI infrastructure now are positioned to capture budget as the backlash unfolds. Full enterprise spend breakdown and what it means for AI vendor pricing power on The All-In Podcast: Source: All-In Podcast -

Podcast Alpha

31,016 görüntüleme • 2 ay önce

Introducing Entelligence AI Model Router, dynamic turn based routing trained on engineering tasks that cuts costs by over 50% Automatically route every coding turn to the model with the best balance of quality, latency, and cost. Escalate to frontier models when they’re actually needed Balanced mode reduces spend by 46% per session Eco mode helps teams save > 76%

Introducing Entelligence AI Model Router, dynamic turn based routing trained on engineering tasks that cuts costs by over 50% Automatically route every coding turn to the model with the best balance of quality, latency, and cost. Escalate to frontier models when they’re actually needed Balanced mode reduces spend by 46% per session Eco mode helps teams save > 76%

Aiswarya Sankar

80,966 görüntüleme • 20 gün önce

10 repos that cut your ai agent token bill by up to 80% 1. microsoft/LLMLingua → cuts prompt size by up to 95% compresses prompts before the api call. 20x compression. published at EMNLP + ACL. near-zero quality loss. 6,100 stars 2. mem0ai/mem0 → replaces full conversation history in context stores what matters. retrieves only what's needed. 10,000 token history → 200 token memory. per agent. 54,800 stars 3. BerriAI/litellm → routes each call to the cheapest model simple task → haiku. complex task → sonnet. tracks cost per agent, per call, per day. 45,700 stars 4. run-llama/llama_index → replaces sending full documents rag: 100-page doc → 3 relevant chunks → same answer. 98% fewer tokens per query. 49,100 stars 5. chroma-core/chroma → replaces keyword search in full context vector store. finds the closest match. feeds only that. 50-200 tokens per query instead of thousands. 27,800 stars 6. letta-ai/letta → replaces infinite context window crashes paged memory for agents. loads only relevant memory. stops your agent from hitting limits and retrying. 22,400 stars 7. guidance-ai/guidance → cuts output token bloat by 30-50% structured generation. constrains model output natively. no more 100-token prompts to get json back. 21,400 stars 8. Aider-AI/aider → replaces pasting entire codebases builds a repo map. sends only files relevant to the task. not your whole project. just what the agent needs. 44,300 stars 9. openai/tiktoken → count tokens before you send know the exact cost before the api call happens. not after the bill arrives. 18,100 stars 10. simonw/ttok → hard cap on what gets sent cli tool: count tokens, truncate to budget limit. pipe any text in. get truncated output back. 389 stars most agents are expensive not because the model is expensive. because nobody checked what was being sent to it.

10 repos that cut your ai agent token bill by up to 80% 1. microsoft/LLMLingua → cuts prompt size by up to 95% compresses prompts before the api call. 20x compression. published at EMNLP + ACL. near-zero quality loss. 6,100 stars 2. mem0ai/mem0 → replaces full conversation history in context stores what matters. retrieves only what's needed. 10,000 token history → 200 token memory. per agent. 54,800 stars 3. BerriAI/litellm → routes each call to the cheapest model simple task → haiku. complex task → sonnet. tracks cost per agent, per call, per day. 45,700 stars 4. run-llama/llama_index → replaces sending full documents rag: 100-page doc → 3 relevant chunks → same answer. 98% fewer tokens per query. 49,100 stars 5. chroma-core/chroma → replaces keyword search in full context vector store. finds the closest match. feeds only that. 50-200 tokens per query instead of thousands. 27,800 stars 6. letta-ai/letta → replaces infinite context window crashes paged memory for agents. loads only relevant memory. stops your agent from hitting limits and retrying. 22,400 stars 7. guidance-ai/guidance → cuts output token bloat by 30-50% structured generation. constrains model output natively. no more 100-token prompts to get json back. 21,400 stars 8. Aider-AI/aider → replaces pasting entire codebases builds a repo map. sends only files relevant to the task. not your whole project. just what the agent needs. 44,300 stars 9. openai/tiktoken → count tokens before you send know the exact cost before the api call happens. not after the bill arrives. 18,100 stars 10. simonw/ttok → hard cap on what gets sent cli tool: count tokens, truncate to budget limit. pipe any text in. get truncated output back. 389 stars most agents are expensive not because the model is expensive. because nobody checked what was being sent to it.

self.dll

39,554 görüntüleme • 3 ay önce

RFK Jr: “What we’re finding is that it’s actually cheaper, counter intuitively, to eat well than it is to eat processed food.” “The meals that are now terrible, that are given to our military, cost $18 a day per soldier.” “We’re changing the military right now.” “We’re going into 20 bases with Chef Robert Irvine.” “He’s feeding them fresh whole foods for $10 a day.” “So you don’t need to spend more money.” “You just need to be smarter.” “We’re going to make sure there is fresh food in every jurisdiction.”

RFK Jr: “What we’re finding is that it’s actually cheaper, counter intuitively, to eat well than it is to eat processed food.” “The meals that are now terrible, that are given to our military, cost $18 a day per soldier.” “We’re changing the military right now.” “We’re going into 20 bases with Chef Robert Irvine.” “He’s feeding them fresh whole foods for $10 a day.” “So you don’t need to spend more money.” “You just need to be smarter.” “We’re going to make sure there is fresh food in every jurisdiction.”

MAHA Action

208,059 görüntüleme • 5 ay önce

#NEW: Small, fast drones are rewriting modern warfare from Ukraine to the Middle East. Now a Texas company is fighting back with “Bullfrog,” an AI drone killer that costs just $10 per kill, compared to traditional missile interceptors that can cost up to $1 million.

#NEW: Small, fast drones are rewriting modern warfare from Ukraine to the Middle East. Now a Texas company is fighting back with “Bullfrog,” an AI drone killer that costs just $10 per kill, compared to traditional missile interceptors that can cost up to $1 million.

Brooke Taylor

38,225 görüntüleme • 3 ay önce

Everywhere I go, parents are FED UP with having to pay for basic school supplies. Meanwhile, California is spending $28,000 PER STUDENT every year! Where is all that money going? Susan Shelley has the answer 👇

Everywhere I go, parents are FED UP with having to pay for basic school supplies. Meanwhile, California is spending $28,000 PER STUDENT every year! Where is all that money going? Susan Shelley has the answer 👇

Steve Hilton

43,680 görüntüleme • 2 ay önce

OpenAI chairman Bret Taylor talks to about 100 CEOs every month. His answer to the cheap open-weight model panic: cheaper to train does not mean cheaper to use, and the number that decides it is token efficiency. "One thing that I think is a little bit overblown about these open weight models is they're not necessarily cheaper to run. Whether or not they're cheaper to train, you don't care. Because you're using just as many tokens. In fact, they may be less efficient." "There's this thing called token efficiency. And it turns out the frontier models are much, much more token efficient." "A token is to intelligence like a watt is to electricity... how many tokens does it take to complete a task? Not every token is actually equal." "For a lot of tasks, it turns out these frontier models from OpenAI and Anthropic are actually just better than these open weight models... just having open weights isn't actually the main thing driving any of those costs." Later in the same interview he goes after the billing unit itself: "It would be like if you signed up for Gmail and you paid for CPU cycle or something... where the world is going is paying for outcomes." The unresolved column: the chart CNBC airs mid-answer, from Artificial Analysis, prices a completed task at $0.94 on Kimi K3 against $2.75 on Claude Fable 5, efficiency folded in. If that gap holds, the premium he is defending gets earned on quality, not price. - Bret Taylor (Bret Taylor), OpenAI chairman and Sierra co-founder, on CNBC's Squawk Box.

OpenAI chairman Bret Taylor talks to about 100 CEOs every month. His answer to the cheap open-weight model panic: cheaper to train does not mean cheaper to use, and the number that decides it is token efficiency. "One thing that I think is a little bit overblown about these open weight models is they're not necessarily cheaper to run. Whether or not they're cheaper to train, you don't care. Because you're using just as many tokens. In fact, they may be less efficient." "There's this thing called token efficiency. And it turns out the frontier models are much, much more token efficient." "A token is to intelligence like a watt is to electricity... how many tokens does it take to complete a task? Not every token is actually equal." "For a lot of tasks, it turns out these frontier models from OpenAI and Anthropic are actually just better than these open weight models... just having open weights isn't actually the main thing driving any of those costs." Later in the same interview he goes after the billing unit itself: "It would be like if you signed up for Gmail and you paid for CPU cycle or something... where the world is going is paying for outcomes." The unresolved column: the chart CNBC airs mid-answer, from Artificial Analysis, prices a completed task at $0.94 on Kimi K3 against $2.75 on Claude Fable 5, efficiency folded in. If that gap holds, the premium he is defending gets earned on quality, not price. - Bret Taylor (Bret Taylor), OpenAI chairman and Sierra co-founder, on CNBC's Squawk Box.

Karl Mehta

16,614 görüntüleme • 13 gün önce

Chinese models are 112x cheaper than Anthropic per million tokens. Chamath laid it out on CNBC: a "barrel of intelligence" costs $56 from Anthropic, $26 from OpenAI, $1.50 from Meta, $1 from xAI and Google, and $0.50 from Chinese models. That is not a pricing quirk. That is the steepest commodity curve any technology has run in recorded history. Oil took 40 years to compress like this. Semiconductors took 20. AI inference is doing it in months. The companies sitting at $26 and $56 are not stupid. They're buying time… betting that trust, safety, and enterprise contracts hold the premium long enough for costs to catch up. What they cannot bet on is the timeline. Because the $0.50 model is not a demo. I've been inside the labs building it.

Chinese models are 112x cheaper than Anthropic per million tokens. Chamath laid it out on CNBC: a "barrel of intelligence" costs $56 from Anthropic, $26 from OpenAI, $1.50 from Meta, $1 from xAI and Google, and $0.50 from Chinese models. That is not a pricing quirk. That is the steepest commodity curve any technology has run in recorded history. Oil took 40 years to compress like this. Semiconductors took 20. AI inference is doing it in months. The companies sitting at $26 and $56 are not stupid. They're buying time… betting that trust, safety, and enterprise contracts hold the premium long enough for costs to catch up. What they cannot bet on is the timeline. Because the $0.50 model is not a demo. I've been inside the labs building it.

Shruti

837,227 görüntüleme • 19 gün önce

Chinese models are 112x cheaper than Anthropic per million tokens. Chamath laid it out on CNBC: a "barrel of intelligence" costs $56 from Anthropic, $26 from OpenAI, $1.50 from Meta, $1 from xAI and Google, and $0.50 from Chinese models. That is not a pricing quirk. That is the steepest commodity curve any technology has run in recorded history. Oil took 40 years to compress like this. Semiconductors took 20. AI inference is doing it in months. The companies sitting at $26 and $56 are not stupid. They're buying time… betting that trust, safety, and enterprise contracts hold the premium long enough for costs to catch up. What they cannot bet on is the timeline. Because the $0.50 model is not a demo. I've been inside the labs building it.

Chinese models are 112x cheaper than Anthropic per million tokens. Chamath laid it out on CNBC: a "barrel of intelligence" costs $56 from Anthropic, $26 from OpenAI, $1.50 from Meta, $1 from xAI and Google, and $0.50 from Chinese models. That is not a pricing quirk. That is the steepest commodity curve any technology has run in recorded history. Oil took 40 years to compress like this. Semiconductors took 20. AI inference is doing it in months. The companies sitting at $26 and $56 are not stupid. They're buying time… betting that trust, safety, and enterprise contracts hold the premium long enough for costs to catch up. What they cannot bet on is the timeline. Because the $0.50 model is not a demo. I've been inside the labs building it.

Clara Bennett

94,674 görüntüleme • 18 gün önce