Загрузка видео...

Не удалось загрузить видео

На главную

Why Richard Sutton thinks LLMs go against the bitter lesson:

dwarkesh_sp's profile picture

Dwarkesh Patel

202,473 subscribers

67,497 просмотров • 10 месяцев назад •via X (Twitter)

Наука и технологииОбразование
LIVE

Anya Rossi• Live Now

Private livecam show

Комментарии: 0

Нет доступных комментариев

Здесь появятся комментарии из оригинального поста

Похожие видео

Lots of people think it's obvious that humans learn by imitation, starting with babies imitating their parents. Richard Sutton thinks this is completely wrong. Sutton basically thinks direct imitation plays almost no role in animal learning, and at most a small role in human intelligence. When one animal ends up doing the same thing as another, he thinks this is the result of RL-style trial-and-error, not direct imitation. And if imitation isn't really a kind of learning, then training LLMs to imitate humans isn't really Bitter Lesson–pilled.
1:41

Lots of people think it's obvious that humans learn by imitation, starting with babies imitating their parents. Richard Sutton thinks this is completely wrong. Sutton basically thinks direct imitation plays almost no role in animal learning, and at most a small role in human intelligence. When one animal ends up doing the same thing as another, he thinks this is the result of RL-style trial-and-error, not direct imitation. And if imitation isn't really a kind of learning, then training LLMs to imitate humans isn't really Bitter Lesson–pilled.

Dwarkesh Patel

54,245 просмотров • 1 месяц назад

Why Sutton Stracke thinks her ex wanted the annulment #WWHL #RHOBH
1:21

Why Sutton Stracke thinks her ex wanted the annulment #WWHL #RHOBH

Watch What Happens Live!

21,200 просмотров • 6 месяцев назад

.Richard Sutton, father of reinforcement learning, doesn’t think LLMs are bitter-lesson-pilled. My steel man of Richard’s position: we need some new architecture to enable continual (on-the-job) learning. And if we have continual learning, we don't need a special training phase - the agent just learns on-the-fly - like all humans, and indeed, like all animals. This new paradigm will render our current approach with LLMs obsolete. I did my best to represent the view that LLMs will function as the foundation on which this experiential learning can happen. Some sparks flew. 0:00:00 – Are LLMs a dead-end? 0:13:51 – Do humans do imitation learning? 0:23:57 – The Era of Experience 0:34:25 – Current architectures generalize poorly out of distribution 0:42:17 – Surprises in the AI field 0:47:28 – Will The Bitter Lesson still apply after AGI? 0:54:35 – Succession to AI
1:07:08

.Richard Sutton, father of reinforcement learning, doesn’t think LLMs are bitter-lesson-pilled. My steel man of Richard’s position: we need some new architecture to enable continual (on-the-job) learning. And if we have continual learning, we don't need a special training phase - the agent just learns on-the-fly - like all humans, and indeed, like all animals. This new paradigm will render our current approach with LLMs obsolete. I did my best to represent the view that LLMs will function as the foundation on which this experiential learning can happen. Some sparks flew. 0:00:00 – Are LLMs a dead-end? 0:13:51 – Do humans do imitation learning? 0:23:57 – The Era of Experience 0:34:25 – Current architectures generalize poorly out of distribution 0:42:17 – Surprises in the AI field 0:47:28 – Will The Bitter Lesson still apply after AGI? 0:54:35 – Succession to AI

Dwarkesh Patel

3,082,253 просмотров • 10 месяцев назад

Bozoma Saint John thinks this is why Sutton Stracke gets invited to The Met Ball every year #RHOBH #WWHL
0:43

Bozoma Saint John thinks this is why Sutton Stracke gets invited to The Met Ball every year #RHOBH #WWHL

Watch What Happens Live!

83,733 просмотров • 9 месяцев назад

Sutton talks why she let Avi go: Kyle, Sutton, & Erika discuss Garcelle. #RHOBH Source: Bravo
1:50

Sutton talks why she let Avi go: Kyle, Sutton, & Erika discuss Garcelle. #RHOBH Source: Bravo

jay

35,514 просмотров • 7 месяцев назад

Richard Sutton says that the current dominance of LLMs is a "momentary fixation" the real breakthroughs will come from scaling computation, not building AI systems based on how humans think they work. LLMs will not be the leading edge of AI for more than another decade, perhaps even half a decade.
1:16

Richard Sutton says that the current dominance of LLMs is a "momentary fixation" the real breakthroughs will come from scaling computation, not building AI systems based on how humans think they work. LLMs will not be the leading edge of AI for more than another decade, perhaps even half a decade.

Haider.

137,573 просмотров • 1 год назад

"Who are we to decide how the universe is going to evolve?" Richard Sutton argues against controlling AI's long-term future. If we intend to birth "descendants of humanity" reflecting us, why obstruct their evolution?
2:08

"Who are we to decide how the universe is going to evolve?" Richard Sutton argues against controlling AI's long-term future. If we intend to birth "descendants of humanity" reflecting us, why obstruct their evolution?

vitrupo

28,308 просмотров • 1 год назад

Genie 2 vs Genie 3. Just 7 months between them. The bitter lesson continues to be bitter.
0:41

Genie 2 vs Genie 3. Just 7 months between them. The bitter lesson continues to be bitter.

Bilawal Sidhu

380,494 просмотров • 11 месяцев назад

Seeing Richard Inman go on a rant about why he thinks Restore Britain is racist before accidentally referring to Shabana Mahmood as 'Banana Mahmood' was absolutely hilarious 🤣
0:29

Seeing Richard Inman go on a rant about why he thinks Restore Britain is racist before accidentally referring to Shabana Mahmood as 'Banana Mahmood' was absolutely hilarious 🤣

Basil the Great

17,310 просмотров • 4 месяцев назад

⚔️ | "It's Wilder against the world! We've seen it all before." Conor McGilligan thinks Sheff Utd might be starting to put a serious run together. Simon Lillibury Gabriel Sutton
0:44

⚔️ | "It's Wilder against the world! We've seen it all before." Conor McGilligan thinks Sheff Utd might be starting to put a serious run together. Simon Lillibury Gabriel Sutton

Betfred

39,730 просмотров • 5 месяцев назад

Chris Sutton thinks Tottenham will be relegated from the Premier League this season ⚪⬇️
0:48

Chris Sutton thinks Tottenham will be relegated from the Premier League this season ⚪⬇️

Match of the Day

133,296 просмотров • 3 месяцев назад

Richard Tice calls on Labour MPs to go against the whip and investigate Keir Starmer. 🚨
5:31

Richard Tice calls on Labour MPs to go against the whip and investigate Keir Starmer. 🚨

Reform UK

114,574 просмотров • 3 месяцев назад

Why couldn't he go by "Richard"? 😒 Tune into the newest season of Model Farmers on OFTV:
0:32

Why couldn't he go by "Richard"? 😒 Tune into the newest season of Model Farmers on OFTV:

OFTV

15,388 просмотров • 3 лет назад

'Why doesn't the road tax go towards filling potholes?' Richard Madeley and Susanna Reid question Heidi Alexander MP.
1:37

'Why doesn't the road tax go towards filling potholes?' Richard Madeley and Susanna Reid question Heidi Alexander MP.

Good Morning Britain

186,417 просмотров • 1 год назад

why are the white girls so bitter bro djdjfj
0:21

Sensitive content

why are the white girls so bitter bro djdjfj

tigs 🇰🇪🇲🇽

158,475 просмотров • 8 месяцев назад

Why Nayib Bukele’s successful campaign against the gangs of El Salvador is a lesson for both Mexico and the United States. Nayib Bukele
7:44

Why Nayib Bukele’s successful campaign against the gangs of El Salvador is a lesson for both Mexico and the United States. Nayib Bukele

Dinesh D'Souza

458,707 просмотров • 3 лет назад

"At some point it's going to boil over..." Richard Sherman thinks the Packers should name a WR1 Kay Adams | Richard Sherman
3:03

"At some point it's going to boil over..." Richard Sherman thinks the Packers should name a WR1 Kay Adams | Richard Sherman

Up & Adams

288,761 просмотров • 10 месяцев назад

Bonnie Critchley, the Media Party candidate who ran against Pierre Poilievre and was crushed, is a bitter election denier. She actually, truly thinks the by-election was stolen from her. She’s been radicalized by the CBC. What a kook.
3:46

Bonnie Critchley, the Media Party candidate who ran against Pierre Poilievre and was crushed, is a bitter election denier. She actually, truly thinks the by-election was stolen from her. She’s been radicalized by the CBC. What a kook.

Ezra Levant 🍁🚛

194,124 просмотров • 11 месяцев назад