Loading video...

Video Failed to Load

There was a problem loading this video. This could be due to a temporary network issue or the video might be unavailable.

Language following is a tough problem for VLAs: while these models can follow complex language, in practice getting datasets that enable language following is hard. We developed a method to counterfactually and automatically label data to improve language following! 🧵👇

Sergey Levine

130,388 subscribers

44,207 views • 10 months ago •via X (Twitter)

Science & Technology Education

Anya Rossi• Live Now

Private livecam show

0 Comments

No comments available

Comments from the original post will appear here

Related Videos

Chain-of-thought reasoning is a powerful tool to enable language models to work through complex problems. Can we use this with robots? With embodied chain-of-thought, vision-language-action (VLA) models can think through perception and planning! A 🧵👇

Chain-of-thought reasoning is a powerful tool to enable language models to work through complex problems. Can we use this with robots? With embodied chain-of-thought, vision-language-action (VLA) models can think through perception and planning! A 🧵👇

Sergey Levine

30,388 views • 2 years ago

Vision-language models can control robots, but what if the prompt is too complex for the robot to follow directly? We developed a way to get robots to “think through” complex instructions, feedback, and interjections. We call it the Hierarchical Interactive Robot (Hi Robot).

Vision-language models can control robots, but what if the prompt is too complex for the robot to follow directly? We developed a way to get robots to “think through” complex instructions, feedback, and interjections. We call it the Hierarchical Interactive Robot (Hi Robot).

Physical Intelligence

116,845 views • 1 year ago

Goal-conditioned RL (GCRL) is great - unsupervised, can use data (in offline mode), flexibility to define tasks at test time. But can we run GCRL on *language data*?? In our new work we show that language GCRL enables sophisticated test-time reasoning for interactive tasks! 🧵👇

Goal-conditioned RL (GCRL) is great - unsupervised, can use data (in offline mode), flexibility to define tasks at test time. But can we run GCRL on language data?? In our new work we show that language GCRL enables sophisticated test-time reasoning for interactive tasks! 🧵👇

Sergey Levine

18,782 views • 1 year ago

Two weeks ago, Figure's CEO announced the end of their partnership with OpenAI and promised to show the in-house AI development – here we are: Helix is a model that unifies perception, language and learned control to execute humanoid tasks by following natural language prompts.

Two weeks ago, Figure's CEO announced the end of their partnership with OpenAI and promised to show the in-house AI development – here we are: Helix is a model that unifies perception, language and learned control to execute humanoid tasks by following natural language prompts.

The Humanoid Hub

69,415 views • 1 year ago

Practice what you preach - Adviced to CM Vijay by our Annamalai ji. CM Vijay runs a school known as Vijay Vidyashram Three language system is practiced as part of CBSE curriculam So - 3 language for your children but two language for TVK Karyakartas !! Why Bro? So why is he denying right to study three language to children of TN!? DMK has injected a poison in minds of TN people saying 3 language means - imposition of Hindi In reality - No its only asking you to study any three language of your preference Just following #DMK foot steps - I guess !

Practice what you preach - Adviced to CM Vijay by our Annamalai ji. CM Vijay runs a school known as Vijay Vidyashram Three language system is practiced as part of CBSE curriculam So - 3 language for your children but two language for TVK Karyakartas !! Why Bro? So why is he denying right to study three language to children of TN!? DMK has injected a poison in minds of TN people saying 3 language means - imposition of Hindi In reality - No its only asking you to study any three language of your preference Just following #DMK foot steps - I guess !

RajeIyer

221,121 views • 1 month ago

Hard - Learning a 2nd language Harder - Giving a talk in a 2nd language Hardcore - Live coding while speaking a 2nd language This is for all of you who have to focus on English just to speak at conferences.

Hard - Learning a 2nd language Harder - Giving a talk in a 2nd language Hardcore - Live coding while speaking a 2nd language This is for all of you who have to focus on English just to speak at conferences.

David East

28,576 views • 2 years ago

Irish language activists are holding a protest at the new Belfast Grand Central Station after failure to erect dual-language signage following its opening.

Irish language activists are holding a protest at the new Belfast Grand Central Station after failure to erect dual-language signage following its opening.

Andersonstown News

211,096 views • 1 year ago

Annamalai- "Language is an opportunity to communicate. Language can only unite people, language can never divide people...."

Annamalai- "Language is an opportunity to communicate. Language can only unite people, language can never divide people...."

Megh Updates 🚨™

422,256 views • 2 years ago

Serious concern is mounting following remarks reportedly made by a Syrian army commander that use hostile and dehumanizing language toward the Kurdish population.

Serious concern is mounting following remarks reportedly made by a Syrian army commander that use hostile and dehumanizing language toward the Kurdish population.

Rania Hamzeh 🇸🇨🧉

10,228 views • 5 months ago

6. Learn the language of money The reason most stay poor is that they think money is complicated. But wealth speaks a simple language: - Make offers - Close deals - Buy assets - Repeat To learn a language, you have to practice.

6. Learn the language of money The reason most stay poor is that they think money is complicated. But wealth speaks a simple language: - Make offers - Close deals - Buy assets - Repeat To learn a language, you have to practice.

Codie Sanchez

20,440 views • 1 year ago

How can the language of twelve Chiefs who speaks the same Ibani language evolve and completely wiped out against the language of one single man whose language is Igbo? What magic is that? Follow TheTribes

How can the language of twelve Chiefs who speaks the same Ibani language evolve and completely wiped out against the language of one single man whose language is Igbo? What magic is that? Follow TheTribes

TheTribes

15,995 views • 11 months ago

Prostate Enlargement in Igbo language via YouTube Prostate Enlargement in Igbo Language. Prostate Enlargement is a condition that can affect your ability to urinate. In this video in Igbo language; I’ve define what the prostate is.

Prostate Enlargement in Igbo language via YouTube Prostate Enlargement in Igbo Language. Prostate Enlargement is a condition that can affect your ability to urinate. In this video in Igbo language; I’ve define what the prostate is.

Sylvia

55,849 views • 3 years ago

🚀 Excited to announce the first release of a novel open source programming language and platform for language model interaction! Combining prompts, constraints & scripting, LMQL elevates the capabilities of large language models. 🧵1/6 A quick tour.

🚀 Excited to announce the first release of a novel open source programming language and platform for language model interaction! Combining prompts, constraints & scripting, LMQL elevates the capabilities of large language models. 🧵1/6 A quick tour.

LMQL (Language Model Query Language)

198,966 views • 3 years ago

MotionGPT: Human Motion as a Foreign Language paper page: Though the advancement of pre-trained large language models unfolds, the exploration of building a unified model for language and other multi-modal data, such as motion, remains challenging and untouched so far. Fortunately, human motion displays a semantic coupling akin to human language, often perceived as a form of body language. By fusing language data with large-scale motion models, motion-language pre-training that can enhance the performance of motion-related tasks becomes feasible. Driven by this insight, we propose MotionGPT, a unified, versatile, and user-friendly motion-language model to handle multiple motion-relevant tasks. Specifically, we employ the discrete vector quantization for human motion and transfer 3D motion into motion tokens, similar to the generation process of word tokens. Building upon this "motion vocabulary", we perform language modeling on both motion and text in a unified manner, treating human motion as a specific language. Moreover, inspired by prompt learning, we pre-train MotionGPT with a mixture of motion-language data and fine-tune it on prompt-based question-and-answer tasks. Extensive experiments demonstrate that MotionGPT achieves state-of-the-art performances on multiple motion tasks including text-driven motion generation, motion captioning, motion prediction, and motion in-between.

MotionGPT: Human Motion as a Foreign Language paper page: Though the advancement of pre-trained large language models unfolds, the exploration of building a unified model for language and other multi-modal data, such as motion, remains challenging and untouched so far. Fortunately, human motion displays a semantic coupling akin to human language, often perceived as a form of body language. By fusing language data with large-scale motion models, motion-language pre-training that can enhance the performance of motion-related tasks becomes feasible. Driven by this insight, we propose MotionGPT, a unified, versatile, and user-friendly motion-language model to handle multiple motion-relevant tasks. Specifically, we employ the discrete vector quantization for human motion and transfer 3D motion into motion tokens, similar to the generation process of word tokens. Building upon this "motion vocabulary", we perform language modeling on both motion and text in a unified manner, treating human motion as a specific language. Moreover, inspired by prompt learning, we pre-train MotionGPT with a mixture of motion-language data and fine-tune it on prompt-based question-and-answer tasks. Extensive experiments demonstrate that MotionGPT achieves state-of-the-art performances on multiple motion tasks including text-driven motion generation, motion captioning, motion prediction, and motion in-between.

AK

125,319 views • 3 years ago

A sound and logical answer to the language chauvinists. "Hinthi is a national language saar".

A sound and logical answer to the language chauvinists. "Hinthi is a national language saar".

Dr Prisha Sargam

20,973 views • 11 months ago

We figured out how to train VLAs with diffusion outputs much faster (7.5x faster), inheriting better language following from the VLM, and leading to better results. The key: protect the VLM backbone during training with knowledge insulation. Let’s talk about what we learned👇

We figured out how to train VLAs with diffusion outputs much faster (7.5x faster), inheriting better language following from the VLM, and leading to better results. The key: protect the VLM backbone during training with knowledge insulation. Let’s talk about what we learned👇

Physical Intelligence

100,142 views • 1 year ago

As kindness is a language that can be understood by anybody, it makes sense that it is the language to which this cat responds🤍

As kindness is a language that can be understood by anybody, it makes sense that it is the language to which this cat responds🤍

Tansu Yegen

647,197 views • 3 years ago

I was an English-as-Second-Language learner when I moved to Canada with my family many years ago. I remember doing endless fill-in-the-blank exercises to practice English. Deep Learning Math is also a language. So I thought: why not use the same method to practice this math language? See more 👉

I was an English-as-Second-Language learner when I moved to Canada with my family many years ago. I remember doing endless fill-in-the-blank exercises to practice English. Deep Learning Math is also a language. So I thought: why not use the same method to practice this math language? See more 👉

Tom Yeh

87,885 views • 7 months ago

A Nigerian lady from a minority ethnic group in Bayelsa state who couldn’t speak her language decided to learn Yoruba so that she can at least speak one Nigerian language and pass it down. Yoruba language is the standard!!!

A Nigerian lady from a minority ethnic group in Bayelsa state who couldn’t speak her language decided to learn Yoruba so that she can at least speak one Nigerian language and pass it down. Yoruba language is the standard!!!

🇨🇦 Ademola🇨🇭

25,841 views • 1 month ago