正在加载视频...

视频加载失败

返回首页

Almost all animals sleep. Why don’t LMs? Introducing our new work on language model sleep. tl;dr : A periodic, recurrent “sleep” phase allows LMs to digest their context and transfer it into their weights, improving recall and reasoning on challenging tasks.

sang_yun_lee's profile picture

Sangyun Lee

1,518 subscribers

125,141 次观看 • 2 个月前 •via X (Twitter)

教育科学技术
LIVE

Anya Rossi• Live Now

Private livecam show

0 条评论

暂无评论

原始帖子的评论将显示在这里

相关视频

Elon Musk, Mark Zuckerberg, and many of your favorite athletes all sleep on an Eight Sleep. I loved the product so much, I begged Matteo and Alex to let me invest. Today they launch the latest version of their product. Sleep fitness improving lives.
9:09

Elon Musk, Mark Zuckerberg, and many of your favorite athletes all sleep on an Eight Sleep. I loved the product so much, I begged Matteo and Alex to let me invest. Today they launch the latest version of their product. Sleep fitness improving lives.

Anthony Pompliano 🌪

267,721 次观看 • 2 年前

The Co-sleeping mod is not live on my patreon,🙌 this is a mini mod that allows toddlers to sleep on the big bed with their parents. It includes two new custom animations and public release is on Oct 17th.
0:42

The Co-sleeping mod is not live on my patreon,🙌 this is a mini mod that allows toddlers to sleep on the big bed with their parents. It includes two new custom animations and public release is on Oct 17th.

PandaSama

163,922 次观看 • 10 个月前

The newest course on Peterson Academy, Dr. @balandjalal's seven-hour course: The Neuroscience of Dreams, is available now. In this course, we embark on a fascinating exploration of sleep and dreams, delving into the neurological processes, evolutionary theories, and practical implications of these essential human experiences. Dr. Jalal guides us through the stages of sleep, the neuroscience of dreaming, and various sleep disorders, while also examining the creative potential and cultural interpretations of dreams. The course highlights the importance of understanding sleep for both personal well-being and scientific inquiry, concluding with practical strategies for improving sleep quality and harnessing the power of dreams in our waking lives.
1:35

The newest course on Peterson Academy, Dr. @balandjalal's seven-hour course: The Neuroscience of Dreams, is available now. In this course, we embark on a fascinating exploration of sleep and dreams, delving into the neurological processes, evolutionary theories, and practical implications of these essential human experiences. Dr. Jalal guides us through the stages of sleep, the neuroscience of dreaming, and various sleep disorders, while also examining the creative potential and cultural interpretations of dreams. The course highlights the importance of understanding sleep for both personal well-being and scientific inquiry, concluding with practical strategies for improving sleep quality and harnessing the power of dreams in our waking lives.

Peterson Academy

277,247 次观看 • 1 年前

Today we are launching Autopilot 4.0, a new generation of Autopilot that acts as a sleep agent. Autopilot 4.0 uses data from your day and night to predict how you’re likely to sleep, automatically adjust your sleep environment through the Pod, and explain what happened by morning in plain language. This is the next step in what makes Eight Sleep different. We do not just surface data or generate sleep insights. We use that data to actively respond through the sleep environment itself. Members can connect Apple Health or Health Connect, or tag events directly in the app, giving the sleep agent more context from workouts, activity, stress, alcohol, meals, and other daily inputs. That context helps it predict what may happen during the night and make the right adjustments before and throughout sleep. Autopilot 4.0 is built on more than one billion hours of sleep data and is now available in the Eight Sleep app.
0:37

Today we are launching Autopilot 4.0, a new generation of Autopilot that acts as a sleep agent. Autopilot 4.0 uses data from your day and night to predict how you’re likely to sleep, automatically adjust your sleep environment through the Pod, and explain what happened by morning in plain language. This is the next step in what makes Eight Sleep different. We do not just surface data or generate sleep insights. We use that data to actively respond through the sleep environment itself. Members can connect Apple Health or Health Connect, or tag events directly in the app, giving the sleep agent more context from workouts, activity, stress, alcohol, meals, and other daily inputs. That context helps it predict what may happen during the night and make the right adjustments before and throughout sleep. Autopilot 4.0 is built on more than one billion hours of sleep data and is now available in the Eight Sleep app.

Eight Sleep

218,225 次观看 • 3 个月前

In Japan, a married couple was trying to put their baby and cat to sleep late at night, and it was captured on camera 🥹
0:28

In Japan, a married couple was trying to put their baby and cat to sleep late at night, and it was captured on camera 🥹

Antidepressant Content

61,060 次观看 • 3 个月前

Bill Maher: “I have this ring, the Oura ring. What? Is it bullsh*t?” Dr. Zeke Emanuel: “It just increases your anxiety. Did I get a good night’s sleep? Did I not get a good night’s sleep?” Bill Maher: “Sometimes it says I get a good night’s sleep, but I don’t feel so good. And sometimes I feel like I got a good night’s sleep, and it says I didn’t.” Dr. Zeke Emanuel: “That’s why I don’t recommend using the ring. Some people find it helpful. Some people are quantitative. They went to MIT. They actually think all those numbers mean something.” “I mostly don’t think that.” Bill Maher: “Exactly, when I don’t get enough sleep, I feel like sh*t.”
1:21

Bill Maher: “I have this ring, the Oura ring. What? Is it bullsh*t?” Dr. Zeke Emanuel: “It just increases your anxiety. Did I get a good night’s sleep? Did I not get a good night’s sleep?” Bill Maher: “Sometimes it says I get a good night’s sleep, but I don’t feel so good. And sometimes I feel like I got a good night’s sleep, and it says I didn’t.” Dr. Zeke Emanuel: “That’s why I don’t recommend using the ring. Some people find it helpful. Some people are quantitative. They went to MIT. They actually think all those numbers mean something.” “I mostly don’t think that.” Bill Maher: “Exactly, when I don’t get enough sleep, I feel like sh*t.”

RedWave Press

116,549 次观看 • 4 个月前

Sweet dreams. 💤 Did you know that your baby’s brain remains hard at work, even as they sleep? It’s during this time that your baby consolidates new learning and memories, reprocessing and categorizing all they have learned while awake and converting these recent experiences into knowledge. Research suggests that infants remember newly presented vocabulary better after napping - and that sleep aids in their subsequent ability to transfer use of these new words to similar objects. Babies sleep a lot. But it’s partly because they have lots to learn. This drowsy little one was shared to IG by ernhanatha24.
0:30

Sweet dreams. 💤 Did you know that your baby’s brain remains hard at work, even as they sleep? It’s during this time that your baby consolidates new learning and memories, reprocessing and categorizing all they have learned while awake and converting these recent experiences into knowledge. Research suggests that infants remember newly presented vocabulary better after napping - and that sleep aids in their subsequent ability to transfer use of these new words to similar objects. Babies sleep a lot. But it’s partly because they have lots to learn. This drowsy little one was shared to IG by ernhanatha24.

Dan Wuori

54,777 次观看 • 1 年前

Robot AI brains, aka Vision-Language-Action models, cannot adapt to new tasks as easily as LLMs like Gemini, ChatGPT, or Grok. LLMs can adapt quickly with their in-context learning (ICL) capabilities. But can we inject ICL abilities into a pre-trained VLA like pi0? Yes! Introducing RICL (Retraining for In-Context Learning), our Conference on Robot Learning (CoRL) 2025 paper. Our RICL-pi0 model can adapt to unseen objects, novel motions, and new scenes with just ICL and RAG (retrieval-augmented generation). RICL-pi0 also boosts performance on the long-tail of tasks. A quick 1 minute video summary:
1:03

Robot AI brains, aka Vision-Language-Action models, cannot adapt to new tasks as easily as LLMs like Gemini, ChatGPT, or Grok. LLMs can adapt quickly with their in-context learning (ICL) capabilities. But can we inject ICL abilities into a pre-trained VLA like pi0? Yes! Introducing RICL (Retraining for In-Context Learning), our Conference on Robot Learning (CoRL) 2025 paper. Our RICL-pi0 model can adapt to unseen objects, novel motions, and new scenes with just ICL and RAG (retrieval-augmented generation). RICL-pi0 also boosts performance on the long-tail of tasks. A quick 1 minute video summary:

Kaustubh Sridhar

52,158 次观看 • 1 年前

Joe Rogan on Newsom’s Viral Dance Clip “It’s all insanely mismanaged and then this guy is on television doing a dance in front of the burned down home that people used to sleep in, where their children would sleep. This is so disgusting.”
2:02

Joe Rogan on Newsom’s Viral Dance Clip “It’s all insanely mismanaged and then this guy is on television doing a dance in front of the burned down home that people used to sleep in, where their children would sleep. This is so disgusting.”

Chief Nerd

1,438,766 次观看 • 1 年前

About 1 in 4 men and 1 in 15 women have obstructive sleep apnea, yet most remain undiagnosed, untreated, and unaware of its impact on their brains and bodies. Untreated severe sleep apnea raises cognitive decline risk by 26%, impairs executive function and memory, and is recognized as a significant Alzheimer’s disease risk factor. It accelerates neuronal aging and neurodegeneration by: • Disrupting sleep architecture, reducing restorative deep (slow wave) and REM sleep, and causing lighter, fragmented sleep. • Triggering intermittent hypoxia, brief oxygen deprivation episodes that drive oxidative stress and inflammation. The good news? It’s treatable with CPAP therapy, mandibular devices, or lifestyle changes like targeted weight loss, which can reverse symptoms and protect cognitive health long-term. Listen to the latest FoundMyFitness episode with sleep expert Dr. Michael Grander (Dr. Michael Grandner). Available on all platforms. Links in the comments below.
2:41

About 1 in 4 men and 1 in 15 women have obstructive sleep apnea, yet most remain undiagnosed, untreated, and unaware of its impact on their brains and bodies. Untreated severe sleep apnea raises cognitive decline risk by 26%, impairs executive function and memory, and is recognized as a significant Alzheimer’s disease risk factor. It accelerates neuronal aging and neurodegeneration by: • Disrupting sleep architecture, reducing restorative deep (slow wave) and REM sleep, and causing lighter, fragmented sleep. • Triggering intermittent hypoxia, brief oxygen deprivation episodes that drive oxidative stress and inflammation. The good news? It’s treatable with CPAP therapy, mandibular devices, or lifestyle changes like targeted weight loss, which can reverse symptoms and protect cognitive health long-term. Listen to the latest FoundMyFitness episode with sleep expert Dr. Michael Grander (Dr. Michael Grandner). Available on all platforms. Links in the comments below.

Dr. Rhonda Patrick

89,706 次观看 • 10 个月前

Andrej Karpathy says when we sleep, our daily “context window” is distilled into the weights of the mind. AI doesn't dream like us yet. But as we teach machines to reflect and compress experience, we may find both humans and AI converging on the same cognitive architecture.
1:20

Andrej Karpathy says when we sleep, our daily “context window” is distilled into the weights of the mind. AI doesn't dream like us yet. But as we teach machines to reflect and compress experience, we may find both humans and AI converging on the same cognitive architecture.

vitrupo

592,891 次观看 • 9 个月前

New work with Alec Radford and David Duvenaud: Have you ever dreamed of talking to someone from the past? Introducing talkie, a 13B model trained only on pre-1931 text. Vintage models should help us to understand how LMs generalize (e.g., can we teach talkie to code?). Thread:
7:58

New work with Alec Radford and David Duvenaud: Have you ever dreamed of talking to someone from the past? Introducing talkie, a 13B model trained only on pre-1931 text. Vintage models should help us to understand how LMs generalize (e.g., can we teach talkie to code?). Thread:

Nick Levine

1,236,327 次观看 • 3 个月前

The Fitness Scientist: "Even A Little Alcohol Is Hurting Your Health!" Kristen Holmes In today's episode, I sit down with Kristen Holmes, Vice President of Performance Science at WHOOP & a pioneer in the field of human performance. Kristen shares invaluable insights on: - The profound impact of sleep-wake timing on our daily lives. - Debunking common myths about sleep duration and quality. - How sleep patterns can bolster immunity and muscle growth. - The significant effects of sunlight, stress, and technology on our sleep quality. - Practical tips for enhancing motivation and self-awareness. Kristen's expertise offers a clear path to improvement for anyone looking to take control of their health, sleep and performance. OUT NOW 👉🏽
1:30

The Fitness Scientist: "Even A Little Alcohol Is Hurting Your Health!" Kristen Holmes In today's episode, I sit down with Kristen Holmes, Vice President of Performance Science at WHOOP & a pioneer in the field of human performance. Kristen shares invaluable insights on: - The profound impact of sleep-wake timing on our daily lives. - Debunking common myths about sleep duration and quality. - How sleep patterns can bolster immunity and muscle growth. - The significant effects of sunlight, stress, and technology on our sleep quality. - Practical tips for enhancing motivation and self-awareness. Kristen's expertise offers a clear path to improvement for anyone looking to take control of their health, sleep and performance. OUT NOW 👉🏽

Steven Bartlett

40,053 次观看 • 2 年前

"It was all fun until they get you into this state where you trust them... and then they'll make you believe that it's okay to then sleep with their brother. 'If you love me, if you trust me, sleep with them.'" — Jade, grooming gang survivor. Watch her full episode on YouTube now.
0:37

"It was all fun until they get you into this state where you trust them... and then they'll make you believe that it's okay to then sleep with their brother. 'If you love me, if you trust me, sleep with them.'" — Jade, grooming gang survivor. Watch her full episode on YouTube now.

TRIGGERnometry

15,789 次观看 • 1 年前

☁️✨ Welcome to the world of Dreamers ✨☁️ A new constellation of Stars has arrived—Sunny, Mogu, Emuri, and Nova—bringing their own magic to the Glitch Stars universe! 🌙💫 Their journey begins February 15th at 6 PM EST—don’t sleep on it! Follow us for updates and step into the dream. 🌌✨ #Dreamers #GlitchStars #EnterTheDream
0:30

☁️✨ Welcome to the world of Dreamers ✨☁️ A new constellation of Stars has arrived—Sunny, Mogu, Emuri, and Nova—bringing their own magic to the Glitch Stars universe! 🌙💫 Their journey begins February 15th at 6 PM EST—don’t sleep on it! Follow us for updates and step into the dream. 🌌✨ #Dreamers #GlitchStars #EnterTheDream

Glitch Stars Official

245,915 次观看 • 1 年前

Manus AI released Scheduled Tasks 2.0, introducing web apps that can self-update their data on a schedule, task continuation, and new ways to observe ongoing tasks. > Scheduled Tasks is now available to all Manus users.
0:41

Manus AI released Scheduled Tasks 2.0, introducing web apps that can self-update their data on a schedule, task continuation, and new ways to observe ongoing tasks. > Scheduled Tasks is now available to all Manus users.

🚨 AI News | TestingCatalog

21,024 次观看 • 3 个月前

q. what do you do on nights when you can’t fall asleep? 🐰: on nights when i can’t sleep.. i actually don’t force myself to sleep. i just stay up and do something else. mess around on the computer, or watch tv 🐥: when you can’t sleep, no matter what you do, you just can’t, right? so thinking “ah, i have to sleep…” only makes it more stressful 🐰: yeah, so you have to do something instead 🐥: for example, if i can’t sleep even though i have work or something to do tomorrow? i just accept it and give up! 🐥: i’m like, “whatever, i’ll sleep tomorrow” ㅋㅋㅋ just give up! 🐰: i think it’s not a bad approach
0:28

q. what do you do on nights when you can’t fall asleep? 🐰: on nights when i can’t sleep.. i actually don’t force myself to sleep. i just stay up and do something else. mess around on the computer, or watch tv 🐥: when you can’t sleep, no matter what you do, you just can’t, right? so thinking “ah, i have to sleep…” only makes it more stressful 🐰: yeah, so you have to do something instead 🐥: for example, if i can’t sleep even though i have work or something to do tomorrow? i just accept it and give up! 🐥: i’m like, “whatever, i’ll sleep tomorrow” ㅋㅋㅋ just give up! 🐰: i think it’s not a bad approach

tim ✩

39,955 次观看 • 8 个月前

🤍​❤️‍🩹 Hello. 🤍❤️‍🩹 :Happy Thai New Year. 🗣 Things you want to do on Songkran day. 🤍 : Sleep 🤍 : Sleep and then work out 🤍 : and then take care of myself. On screen : Take care of myself. ❤️‍🩹 : The thing I want to do on Thai New Year day is sleep. On screen : The pair who loves sleep the most. ❤️‍🩹 : I want to rest as much as possible. 🤍: I want to sleep for revenge (make up for lost sleep). 🤍: I’d like to wish everyone well 🤍: Have a safe journey. 🤍: Whether you’re going to another province or abroad, 🤍: or going back to see your family, I hope you’re happy. 🤍: And please travel safely. ❤️‍🩹: I wish everyone to be healthy. ❤️‍🩹: May you have smiles every day from now on. ❤️‍🩹: And most importantly, live mindfully and don’t be careless, okay? 🤍: That's right. #NamtanFilm #น้ำตาลฟิล์ม #สงกรานต์2026
0:55

🤍​❤️‍🩹 Hello. 🤍❤️‍🩹 :Happy Thai New Year. 🗣 Things you want to do on Songkran day. 🤍 : Sleep 🤍 : Sleep and then work out 🤍 : and then take care of myself. On screen : Take care of myself. ❤️‍🩹 : The thing I want to do on Thai New Year day is sleep. On screen : The pair who loves sleep the most. ❤️‍🩹 : I want to rest as much as possible. 🤍: I want to sleep for revenge (make up for lost sleep). 🤍: I’d like to wish everyone well 🤍: Have a safe journey. 🤍: Whether you’re going to another province or abroad, 🤍: or going back to see your family, I hope you’re happy. 🤍: And please travel safely. ❤️‍🩹: I wish everyone to be healthy. ❤️‍🩹: May you have smiles every day from now on. ❤️‍🩹: And most importantly, live mindfully and don’t be careless, okay? 🤍: That's right. #NamtanFilm #น้ำตาลฟิล์ม #สงกรานต์2026

Belle

21,867 次观看 • 4 个月前

🚀 Meta FAIR is releasing several new research artifacts on our road to advanced machine intelligence (AMI). These latest advancements are transforming our understanding of perception. 1️⃣ Meta Perception Encoder: A large-scale vision encoder that excels across several image & video tasks. 2️⃣ Meta Perception Language Model: A fully open & reproducible vision-language model designed to tackle visual recognition tasks. 3️⃣ Meta Locate 3D: An end-to-end model for accurate object localization in 3D environments. 4️⃣ Releasing model weights for our 8B-parameter Dynamic Byte Latent Transformer, an alternative to traditional tokenization methods with the potential to redefine the standards for language model efficiency and reliability. 5️⃣Collaborative Reasoner: A framework for evaluating & improving collaborative reasoning skills in language models. Download the code, datasets, and research papers and learn more about how these artifacts are paving the way for more efficient and accurate AI systems.➡️
2:10

🚀 Meta FAIR is releasing several new research artifacts on our road to advanced machine intelligence (AMI). These latest advancements are transforming our understanding of perception. 1️⃣ Meta Perception Encoder: A large-scale vision encoder that excels across several image & video tasks. 2️⃣ Meta Perception Language Model: A fully open & reproducible vision-language model designed to tackle visual recognition tasks. 3️⃣ Meta Locate 3D: An end-to-end model for accurate object localization in 3D environments. 4️⃣ Releasing model weights for our 8B-parameter Dynamic Byte Latent Transformer, an alternative to traditional tokenization methods with the potential to redefine the standards for language model efficiency and reliability. 5️⃣Collaborative Reasoner: A framework for evaluating & improving collaborative reasoning skills in language models. Download the code, datasets, and research papers and learn more about how these artifacts are paving the way for more efficient and accurate AI systems.➡️

AI at Meta

163,374 次观看 • 1 年前

Do you know why dogs want to sleep in our beds? Well listen in and find out . Or do you have a different thought on it? Credit: We aregoodpets. com
0:45

Do you know why dogs want to sleep in our beds? Well listen in and find out . Or do you have a different thought on it? Credit: We aregoodpets. com

Stellar

53,914 次观看 • 4 个月前