Loading video...

Video Failed to Load

There was a problem loading this video. This could be due to a temporary network issue or the video might be unavailable.

Google Jeff Dean says bigger context windows alone are not enough What matters is staged retrieval: lightweight mechanisms that narrow a trillion tokens down to 10 million, then to the million you actually need "you don't need a trillion at once, you need the right million"

Haider.

67,327 subscribers

141,043 views • 3 months ago •via X (Twitter)

Science & Technology

Anya Rossi• Live Now

Private livecam show

0 Comments

No comments available

Comments from the original post will appear here

Related Videos

India's high commissioner to Canada says we need a bigger population and India can help: "You're the second-largest country in the world with a 40 million population..you need at least about a 100 million population" "You need people to man many of your resources"

India's high commissioner to Canada says we need a bigger population and India can help: "You're the second-largest country in the world with a 40 million population..you need at least about a 100 million population" "You need people to man many of your resources"

Riley Donovan

20,744 views • 1 month ago

Are humanoids the largest addressable market in history? Andrew Kang says "to understand that you have to look at what is the total market for human labor. It's something like 50% of GDP, some people put it at $40 trillion or $60 trillion." "The way that I would think about it is a humanoid can do everything that a human can do in the future, but it doesn't need to rest, it doesn't need to take breaks, it doesn't need to go on vacation. It's not going to quit on you, so you don't need to hire and retrain somebody else."

Are humanoids the largest addressable market in history? Andrew Kang says "to understand that you have to look at what is the total market for human labor. It's something like 50% of GDP, some people put it at $40 trillion or $60 trillion." "The way that I would think about it is a humanoid can do everything that a human can do in the future, but it doesn't need to rest, it doesn't need to take breaks, it doesn't need to go on vacation. It's not going to quit on you, so you don't need to hire and retrain somebody else."

Anthony Pompliano 🌪

109,437 views • 1 month ago

Prime Intellect engineer: "everyone's bragging about a million-token context. here's what they don't tell you. at 256k tokens GPT-5.5 scores 80% on retrieval. push it to a million and it drops to 36%. the model accepts the context, it just can't reason across it. people call it context rot." in a 20-minute talk he explains why bigger context windows won't save your agents. continual learning + training on your own traces + real environments - that's the fix. Watch the talk, then save!

Prime Intellect engineer: "everyone's bragging about a million-token context. here's what they don't tell you. at 256k tokens GPT-5.5 scores 80% on retrieval. push it to a million and it drops to 36%. the model accepts the context, it just can't reason across it. people call it context rot." in a 20-minute talk he explains why bigger context windows won't save your agents. continual learning + training on your own traces + real environments - that's the fix. Watch the talk, then save!

Carnage

716,415 views • 4 days ago

Kevin O'Leary says $5 million liquid in t-bills is when you know you've actually made it. "the hardest thing is to make the first million, when you make it put it in t-bills, two to three million is actually quite easy once you figure it out, but where people get undisciplined is buying shit they don't need, your mandate is $5 million liquid in t-bills, liquidity with wealth is actually a superpower, most people who think they're wealthy couldn't raise a million dollars by 2pm if they tried"

Kevin O'Leary says $5 million liquid in t-bills is when you know you've actually made it. "the hardest thing is to make the first million, when you make it put it in t-bills, two to three million is actually quite easy once you figure it out, but where people get undisciplined is buying shit they don't need, your mandate is $5 million liquid in t-bills, liquidity with wealth is actually a superpower, most people who think they're wealthy couldn't raise a million dollars by 2pm if they tried"

Yonan

1,068,648 views • 3 months ago

Fun starts at exactly $10 million Ski, podcast, do whatever you want. Just exist. Jason says you need $10 million. You make 5% on your money each year. That's half a million every single year.

Fun starts at exactly $10 million Ski, podcast, do whatever you want. Just exist. Jason says you need $10 million. You make 5% on your money each year. That's half a million every single year.

This Week in Startups

56,221 views • 1 month ago

Demis Hassabis says bigger context windows are still a brute force answer to memory. The human brain does something stranger. During sleep, it replays what matters and folds new knowledge into what it already knows. AI does not need infinite context. It needs the right memory at the right moment.

Demis Hassabis says bigger context windows are still a brute force answer to memory. The human brain does something stranger. During sleep, it replays what matters and folds new knowledge into what it already knows. AI does not need infinite context. It needs the right memory at the right moment.

vitrupo

80,388 views • 2 months ago

Trump: You don't need reservoirs. You have reservoirs because you are trying to hold water. You have natural water coming down along the coast, for a million years it has been coming.

Trump: You don't need reservoirs. You have reservoirs because you are trying to hold water. You have natural water coming down along the coast, for a million years it has been coming.

Acyn

1,932,377 views • 1 year ago

Rubi Rose says you need to make $5 million a year to date her 👀

Sensitive content

Rubi Rose says you need to make $5 million a year to date her 👀

FearBuck

1,923,613 views • 1 year ago

Coogan says the Google AI cancer discovery vindicates roon's take from last year that "text is the universal interface." "You don't need some new data primitive. You can actually use tokens — text — to understand a cell."

Coogan says the Google AI cancer discovery vindicates roon's take from last year that "text is the universal interface." "You don't need some new data primitive. You can actually use tokens — text — to understand a cell."

TBPN

33,306 views • 9 months ago

Jeff Booth says "The system bounded by ENERGY will reprice all $900 trillion of assets.....divide that by 21 million Bitcoin and you get $43 million per coin." WE'RE SO EARLY.

Jeff Booth says "The system bounded by ENERGY will reprice all $900 trillion of assets.....divide that by 21 million Bitcoin and you get $43 million per coin." WE'RE SO EARLY.

Simple Mining

34,206 views • 9 months ago

All that matters is what it means to you. That’s all the proof you need to know that you’re doing the right thing. All you need is your validation.

All that matters is what it means to you. That’s all the proof you need to know that you’re doing the right thing. All you need is your validation.

꩜ Erica 444 U ♊️🪽⭐️ ꩜

15,185 views • 1 year ago

What do people get when the State sends you to prison for a crime you did not commit? £1 million? £10 million? £20 million? The truth is a lot less than you may think👇🏻

What do people get when the State sends you to prison for a crime you did not commit? £1 million? £10 million? £20 million? The truth is a lot less than you may think👇🏻

David Davis MP

14,165 views • 1 year ago

Jensen Huang says AI has advanced a million-fold in a decade. “To me, AI is moving at just the right speed. The speed I'm making it go.” To survive, he says, you need to get on the rocketship -- then everything else slows down. His advice? Engage it deeply. And fast.

Jensen Huang says AI has advanced a million-fold in a decade. “To me, AI is moving at just the right speed. The speed I'm making it go.” To survive, he says, you need to get on the rocketship -- then everything else slows down. His advice? Engage it deeply. And fast.

vitrupo

75,085 views • 1 year ago

Martin Shkreli says drug companies can charge $2.3 million for a cure because you only need it once “If you have a cure, you can price it higher as if it was gonna be used for a lifetime” “Zolgensma is $2.3 million. It rewrites the DNA in your genes, fixes you, and you never need it again, but you’re paying $2.3 million one way or the other”

Martin Shkreli says drug companies can charge $2.3 million for a cure because you only need it once “If you have a cure, you can price it higher as if it was gonna be used for a lifetime” “Zolgensma is $2.3 million. It rewrites the DNA in your genes, fixes you, and you never need it again, but you’re paying $2.3 million one way or the other”

Yonan

445,422 views • 2 months ago

Sam Altman says the perfect AI is “a very tiny model with superhuman reasoning, 1 trillion tokens of context, and access to every tool you can imagine.” It doesn't need to contain the knowledge - just the ability to think, search, simulate, and solve anything.

Sam Altman says the perfect AI is “a very tiny model with superhuman reasoning, 1 trillion tokens of context, and access to every tool you can imagine.” It doesn't need to contain the knowledge - just the ability to think, search, simulate, and solve anything.

vitrupo

775,766 views • 1 year ago

You want to make 24 hundred trillion billion dollars, right? This is the most IMPORTANT lesson you need to learn! ⬇️

You want to make 24 hundred trillion billion dollars, right? This is the most IMPORTANT lesson you need to learn! ⬇️

Aj

13,144 views • 1 year ago

A record-breaking 45 million Americans are expected to travel for Memorial Day weekend, according to AAA. Whether you are hitting the road or taking to the skies, travel expert Katy Nastro breaks down what you need to know.

A record-breaking 45 million Americans are expected to travel for Memorial Day weekend, according to AAA. Whether you are hitting the road or taking to the skies, travel expert Katy Nastro breaks down what you need to know.

ABC News

20,901 views • 1 month ago

How do you navigate lobbying the Trump administration? "You don't need $2 million in TV spend anymore to manipulate a conversation. You need the right few influencers and the right bots," National Cattlemen's Beef Association's Ethan Lane tells Eleanor Mueller. "We're a grassroots industry, so we take pride in the fact that we don't need that. But when you're getting outspent and outgunned by computers, it's a very frustrating situation."

How do you navigate lobbying the Trump administration? "You don't need $2 million in TV spend anymore to manipulate a conversation. You need the right few influencers and the right bots," National Cattlemen's Beef Association's Ethan Lane tells Eleanor Mueller. "We're a grassroots industry, so we take pride in the fact that we don't need that. But when you're getting outspent and outgunned by computers, it's a very frustrating situation."

Semafor

194,687 views • 8 months ago

The Irish government saw this and said 'not diverse enough, we need to import a million foreigners.'

The Irish government saw this and said 'not diverse enough, we need to import a million foreigners.'

MichaeloKeeffe

61,230 views • 4 months ago