正在加载视频...

视频加载失败

加载此视频时出现问题。这可能是由于临时网络问题，或视频可能不可用。

Vision-language-action models (VLAs) need to REASON, but more importantly, they need to know WHEN to reason (or not)! Thrilled to introduce OneTwoVLA, a single, unified model that combines acting (System One) ⚡ and reasoning (System Two) 🤔, and can adaptively switch between these modes. Get ready for some serious... show more

Yang Gao

1,777 subscribers

22,477 次观看 • 1 年前 •via X (Twitter)

Anya Rossi• Live Now

Private livecam show

10 条评论

Yang Gao 的头像

Yang Gao1 年前

💡 How does it work? OneTwoVLA only engages in reasoning at key steps – like completing a subtask or detecting an error. This reasoning includes scene descriptions, task plans, historical summaries, and more. At other times, OneTwoVLA generates actions based on its most recent reasoning. This cool capability comes from our specially designed adaptive inference framework and curated robot data with embodied reasoning.

Yang Gao 的头像

Yang Gao1 年前

🏞️ We've also developed a scalable pipeline for synthesizing embodied reasoning-centric vision-language data. This data is used for co-training with robot data, significantly enhancing the model's reasoning and generalization abilities!

Yang Gao 的头像

Yang Gao1 年前

OneTwoVLA packs diverse capabilities into a single model. First off, it excels at handling long-horizon manipulation tasks. Check out the video below where OneTwoVLA successfully tackles a super challenging task: hotpot cooking! 🔥🍲

Yang Gao 的头像

Yang Gao1 年前

Through co-training with vision-language data, OneTwoVLA can understand and complete task instructions it has never seen in its robot data (e.g., "Give me an icy cola." 🥤).

Yang Gao 的头像

Yang Gao1 年前

🔧 Error detection on the fly! OneTwoVLA can spot errors in real-time, rapidly reason about recovery strategies, and then generate corrective actions.

Yang Gao 的头像

Yang Gao1 年前

🤝 OneTwoVLA can also engage with humans naturally – seamlessly handling interventions and proactively seeking clarification when faced with ambiguities. It's a team player!

Yang Gao 的头像

Yang Gao1 年前

Finally, we've found that OneTwoVLA exhibits strong visual grounding capabilities. It understands spatial relationships, object attributes, and semantic features, even generalizing to objects unseen in its robot training data (e.g., GoPro 📷, Sprite 🥤, Starbucks Coffee ☕)!

Yang Gao 的头像

Yang Gao1 年前

Project website: Paper: Code: Data: Amazing work done with @lfqirrrrr, @RuiqianNai, @yingdong_hu99, @YouJiacheng, Junming Zhao

عبد العزيز الرفاعي 的头像

عبد العزيز الرفاعي1 年前

@Presidentlin

Aisha 的头像

Aisha1 年前

Do you think you can build it on your own to peel and chop onions? (prepare the ingredients to cook with?)

相关视频

Large language models reason through text. Vision‑language‑action models reason through the real world. By fusing perception, context, and action from live video, VLAs deliver the awareness physical AI needs for next‑gen robotics and edge systems.

Large language models reason through text. Vision‑language‑action models reason through the real world. By fusing perception, context, and action from live video, VLAs deliver the awareness physical AI needs for next‑gen robotics and edge systems.

Intel

15,931 次观看 • 4 个月前

President Trump: "The 2024 election is our one shot to save our country, and we need a leader who is ready to do that on day one... To change the whole system, you need a president that can take on the whole system."

President Trump: "The 2024 election is our one shot to save our country, and we need a leader who is ready to do that on day one... To change the whole system, you need a president that can take on the whole system."

Trump War Room

386,609 次观看 • 3 年前

Labour's changes to welfare are unjust, uncaring, and will create a two-tier benefits system. Cutting vital support for disabled people who need help to get washed and dressed will not help a single person into work, but it will cause more pain and misery for the most vulnerable

Labour's changes to welfare are unjust, uncaring, and will create a two-tier benefits system. Cutting vital support for disabled people who need help to get washed and dressed will not help a single person into work, but it will cause more pain and misery for the most vulnerable

Tim Farron

21,916 次观看 • 1 年前

When I say CV, I’m not just talking about academic qualifications. Wallahi, I value skills, hard work, dedication and willingness to grow more than anything. People like Elma are proof that being organized, committed and genuinely passionate about what you do can take you very far. I need people that are ready to work, ready to sacrifice, ready to believe in the vision and help bring it to life. Degrees are good, yes. But character, consistency and competence? Those matter to me even more.

When I say CV, I’m not just talking about academic qualifications. Wallahi, I value skills, hard work, dedication and willingness to grow more than anything. People like Elma are proof that being organized, committed and genuinely passionate about what you do can take you very far. I need people that are ready to work, ready to sacrifice, ready to believe in the vision and help bring it to life. Degrees are good, yes. But character, consistency and competence? Those matter to me even more.

Sarkin Mota

103,152 次观看 • 1 个月前

I really need to hire a design engineer who can help beautify our vision for a consumer-first healthcare system come to life Can offer $15k referral bonus if you know anybody – DMs open!

I really need to hire a design engineer who can help beautify our vision for a consumer-first healthcare system come to life Can offer $15k referral bonus if you know anybody – DMs open!

Hannah Ahn

57,321 次观看 • 5 个月前

You hate her but like it or not, she’s the reason #RHOC is great again. We watch these shows for the drama and every interesting storyline can be traced back to Tamra. Pearl clutching fans need to get over it and remember this is a TV show and not reality

You hate her but like it or not, she’s the reason #RHOC is great again. We watch these shows for the drama and every interesting storyline can be traced back to Tamra. Pearl clutching fans need to get over it and remember this is a TV show and not reality

Sam Stirling

94,603 次观看 • 1 年前

Chain-of-thought reasoning is a powerful tool to enable language models to work through complex problems. Can we use this with robots? With embodied chain-of-thought, vision-language-action (VLA) models can think through perception and planning! A 🧵👇

Chain-of-thought reasoning is a powerful tool to enable language models to work through complex problems. Can we use this with robots? With embodied chain-of-thought, vision-language-action (VLA) models can think through perception and planning! A 🧵👇

Sergey Levine

30,388 次观看 • 2 年前

Loving my trip to Aegean Macedonia, but hoping my Greek fans can help me here! Need to know in what language these Greeks in Greek Edessa and under the Greek flag are singing and dancing to? 🤔🤔 #Macedonians #Vodensko #AegeanMacedonia

Loving my trip to Aegean Macedonia, but hoping my Greek fans can help me here! Need to know in what language these Greeks in Greek Edessa and under the Greek flag are singing and dancing to? 🤔🤔 #Macedonians #Vodensko #AegeanMacedonia

Mario’s History Talks 🇲🇰

20,183 次观看 • 1 年前

Computer vision can see what happened — agentic AI explains why it matters and what to do next. Here’s how teams are upgrading video analytics with vision language models: 🔍 Turn video into searchable intelligence 🧠 Add context and reasoning to system alerts ⚡ Summarize complex scenes and answer questions automatically Read the blog to see 3 real-world ways to bring agentic AI to computer vision →

Computer vision can see what happened — agentic AI explains why it matters and what to do next. Here’s how teams are upgrading video analytics with vision language models: 🔍 Turn video into searchable intelligence 🧠 Add context and reasoning to system alerts ⚡ Summarize complex scenes and answer questions automatically Read the blog to see 3 real-world ways to bring agentic AI to computer vision →

NVIDIA AI

14,273 次观看 • 5 个月前

🚨 REP. ANNA PAULINA LUNA NAILS IT: "There is NO reason we need to be taking in people that - A, don't want to assimilate; and B, I don't even know if they can CONTRIBUTE to the society we have." "We need to pause EVERYTHING."

🚨 REP. ANNA PAULINA LUNA NAILS IT: "There is NO reason we need to be taking in people that - A, don't want to assimilate; and B, I don't even know if they can CONTRIBUTE to the society we have." "We need to pause EVERYTHING."

Eric Daugherty

164,763 次观看 • 7 个月前

One reason the End of Eva is so good. Every character has been traumatized repeatedly, the world is coming to an end, the characters don't know if they will or can find happiness, but that possibility and hope is all they need to make life worth living.

One reason the End of Eva is so good. Every character has been traumatized repeatedly, the world is coming to an end, the characters don't know if they will or can find happiness, but that possibility and hope is all they need to make life worth living.

🎮𝙆𝙖𝙞𝙮𝙖🎮

68,030 次观看 • 4 个月前

PLEASE come to Ukraine! The ladies in Lviv need YOUR HELP. Every single day, they volunteer to support Ukraine, and the only thing they are waiting for is you. Two more hands can literally mean the difference between life and death. We hope to see you soon. Slava Ukraini! 🇺🇦

PLEASE come to Ukraine! The ladies in Lviv need YOUR HELP. Every single day, they volunteer to support Ukraine, and the only thing they are waiting for is you. Two more hands can literally mean the difference between life and death. We hope to see you soon. Slava Ukraini! 🇺🇦

Richard Woodruff 🇺🇦

22,493 次观看 • 9 个月前

It's time to have a serious conversation about migration. This #InternationalMigrantsDay we teamed up with Zoe Gardner to call for a fairer asylum system. People move. And we need a system that works, not one built to deter. Watch and share. #RefugeesWelcome #ad

It's time to have a serious conversation about migration. This #InternationalMigrantsDay we teamed up with Zoe Gardner to call for a fairer asylum system. People move. And we need a system that works, not one built to deter. Watch and share. #RefugeesWelcome #ad

Amnesty UK

53,560 次观看 • 1 年前

Currently, high school students can get AP credits in subjects like Biology, Calculus, and even Art classes. But for some reason, we don't elevate Shop Class to that same level — even though it's where you strengthen hands-on skills foundational to a career in the trades. Students should get dual enrollment credits in those classes, and I'm working to make that a reality.

Currently, high school students can get AP credits in subjects like Biology, Calculus, and even Art classes. But for some reason, we don't elevate Shop Class to that same level — even though it's where you strengthen hands-on skills foundational to a career in the trades. Students should get dual enrollment credits in those classes, and I'm working to make that a reality.

Rep. Marie Gluesenkamp Perez

17,141 次观看 • 9 个月前

You need to listen to what Malcolm Guite says here about the “meaning crisis.” Postmodernism taught us to distrust and deconstruct the “old stories.” But culture held on to these stories for centuries for a reason. No one can live “story-less.”

You need to listen to what Malcolm Guite says here about the “meaning crisis.” Postmodernism taught us to distrust and deconstruct the “old stories.” But culture held on to these stories for centuries for a reason. No one can live “story-less.”

Paul Anleitner

26,141 次观看 • 1 个月前

I have told you before that this government has one tried and true modus operandi. And that is - invent a crisis or need. And then - propose a solution that makes you money. Not solve the invented crisis. In Bomet - a county with a 50% poverty rate - because much of the money spent at the county level goes to 1% of the county - there is an urgent need for an airport. These compatriots cannot afford two meals a day. Have nightmares for schools. But you know what they need more? More than anything, they need an airport. An airport. Billions will be spent. And you know when they need it? Now. Ni ujinga, ama ni ujeuri? UPSIDE DOWN PRIORITIES. Pray for our country. But even more important: Register to vote. Think and Interrogate Candidates. Then, let's get ready to clean house. Fagia wote. The County Government of Bomet

I have told you before that this government has one tried and true modus operandi. And that is - invent a crisis or need. And then - propose a solution that makes you money. Not solve the invented crisis. In Bomet - a county with a 50% poverty rate - because much of the money spent at the county level goes to 1% of the county - there is an urgent need for an airport. These compatriots cannot afford two meals a day. Have nightmares for schools. But you know what they need more? More than anything, they need an airport. An airport. Billions will be spent. And you know when they need it? Now. Ni ujinga, ama ni ujeuri? UPSIDE DOWN PRIORITIES. Pray for our country. But even more important: Register to vote. Think and Interrogate Candidates. Then, let's get ready to clean house. Fagia wote. The County Government of Bomet

Bonnie Mwangi, CPA, LLM, MBA

23,274 次观看 • 2 个月前

For some reason, many people will hate you for even trying to make the future better. Stay focused on your vision, and don’t focus on comments or articles about you. Find good people around you that can give you valuable input instead.

For some reason, many people will hate you for even trying to make the future better. Stay focused on your vision, and don’t focus on comments or articles about you. Find good people around you that can give you valuable input instead.

Brian Armstrong

219,342 次观看 • 18 天前