Loading video...

Video Failed to Load

There was a problem loading this video. This could be due to a temporary network issue or the video might be unavailable.

Appreciate Jitendra's takes on world models/VLMs. His word below is why back in 2019-2021, instead of VLAs for simple pick-and-place, we chose assembly. Dexterity = mutual info between your intent and forces/torques on objects via contacts.

Shane Gu

50,744 subscribers

49,717 views • 3 months ago •via X (Twitter)

Anya Rossi• Live Now

Private livecam show

0 Comments

No comments available

Comments from the original post will appear here

Related Videos

This is how large language models turn objects to vector representations. In this video, we explore how large language models (LLMs) convert objects into internal representations, especially when translating between languages like English and Hindi. Using real-world examples, we highlight the challenges of gender inference, grammatical structure, and why direct word-to-word translations often fail. If you're curious about how LLMs deal with multilingual contexts and what it takes to improve translation quality across languages, this video is for you. #LLMs #Vectors #LCM

This is how large language models turn objects to vector representations. In this video, we explore how large language models (LLMs) convert objects into internal representations, especially when translating between languages like English and Hindi. Using real-world examples, we highlight the challenges of gender inference, grammatical structure, and why direct word-to-word translations often fail. If you're curious about how LLMs deal with multilingual contexts and what it takes to improve translation quality across languages, this video is for you. #LLMs #Vectors #LCM

Gaurav Sen

27,368 views • 1 year ago

Excited to finally share Generative Value Learning (GVL), my Google DeepMind project on extracting universal value functions from long-context VLMs via in-context learning! We discovered a simple method to generate zero-shot and few-shot values for 300+ robot tasks and 50+ datasets using SOTA VLMs like Gemini (Try out the demo on our website on your robot video today!) I worked a lot on leveraging foundation models as guidance for robots in my PhD, and to me, this result forges a new frontier in how we can use foundation models for robot learning, given its broad applicability independent of embodiment and task types. Quite excited about how we can build on this work as a community!

Excited to finally share Generative Value Learning (GVL), my Google DeepMind project on extracting universal value functions from long-context VLMs via in-context learning! We discovered a simple method to generate zero-shot and few-shot values for 300+ robot tasks and 50+ datasets using SOTA VLMs like Gemini (Try out the demo on our website on your robot video today!) I worked a lot on leveraging foundation models as guidance for robots in my PhD, and to me, this result forges a new frontier in how we can use foundation models for robot learning, given its broad applicability independent of embodiment and task types. Quite excited about how we can build on this work as a community!

Jason Ma

98,270 views • 1 year ago

Combinatorial complexity is often the bane of imitation learning - including VLA models! Jesse Zhang and Marius Memmel proposed a way around this, using VLMs to perform problem reduction for imitation. The insight is simple - 1) High-level VLM takes a complex scene/task and reducing it a minimal representation (via masking and path prediction) that is needed to act in the world. 2) A low-level policy then takes this reduced representation and generates actions to be executed in the world. The high-level policy absorbs all the combinatorial complexity of the problem, leaving the low-level to focus on dexterity and geometric reasoning. Super simple, works really well across policy classes and problem settings! - 41.4× sim2real improvement (3DDA) and 2–3.5× boosts for π₀ and ACT in the real world. Paper: Website: Demo: Fun collaboration led by Jesse Zhang Marius Memmel with lots of collaborators! Let us know what you think 😀

Combinatorial complexity is often the bane of imitation learning - including VLA models! Jesse Zhang and Marius Memmel proposed a way around this, using VLMs to perform problem reduction for imitation. The insight is simple - 1) High-level VLM takes a complex scene/task and reducing it a minimal representation (via masking and path prediction) that is needed to act in the world. 2) A low-level policy then takes this reduced representation and generates actions to be executed in the world. The high-level policy absorbs all the combinatorial complexity of the problem, leaving the low-level to focus on dexterity and geometric reasoning. Super simple, works really well across policy classes and problem settings! - 41.4× sim2real improvement (3DDA) and 2–3.5× boosts for π₀ and ACT in the real world. Paper: Website: Demo: Fun collaboration led by Jesse Zhang Marius Memmel with lots of collaborators! Let us know what you think 😀

Abhishek Gupta

22,354 views • 10 months ago

President Trump seems intent on building a “tripolar world” between the US, Russia and China, former Secy. of State Antony Blinken told me. In part 1 of our conversation, Blinken warned why this is “not a recipe for peace."

President Trump seems intent on building a “tripolar world” between the US, Russia and China, former Secy. of State Antony Blinken told me. In part 1 of our conversation, Blinken warned why this is “not a recipe for peace."

Fareed Zakaria

239,388 views • 8 months ago

"If Ramchandra marries once, Rahim is also expected to marry just once. Today there are different set of rules for Hindus and Muslims. Why we have different rules for both? We will implement UCC in Assembly." - MP CM Yadav on his government's plan to introduce a bill on UCC in coming session of assembly

"If Ramchandra marries once, Rahim is also expected to marry just once. Today there are different set of rules for Hindus and Muslims. Why we have different rules for both? We will implement UCC in Assembly." - MP CM Yadav on his government's plan to introduce a bill on UCC in coming session of assembly

News Arena India

26,059 views • 1 month ago

Church, why are we celebrating or partaking in ANYTHING on October 31st? Ask yourself, how is anything you are doing on that day honoring God? We are in this world church, not of it. We are commanded to know our enemy and know what he is doing in this evil world. Unfortunately ALL of our “holidays” have pagan roots because satan is the god of this world and it is his desire- every single second of every single day- to drive you and your family away from Christ and away from the Word.

Church, why are we celebrating or partaking in ANYTHING on October 31st? Ask yourself, how is anything you are doing on that day honoring God? We are in this world church, not of it. We are commanded to know our enemy and know what he is doing in this evil world. Unfortunately ALL of our “holidays” have pagan roots because satan is the god of this world and it is his desire- every single second of every single day- to drive you and your family away from Christ and away from the Word.

Ashley Hays

31,169 views • 10 months ago

Instead of bringing solutions or exercising leadership, Deni chooses to expose his country’s problems to the world! He literally takes his grievances to foreign ambassadors and turns them into intermediaries between himself and the federal government. What makes it even worse is that he didn't host these discussions in Garowe, the capital of the state he governs. Instead, he chose to meet foreign officials in a neighboring foreign country, Kenya, to discuss the affairs of his own country. This kind of shameful behavior is exactly why no one takes Somalia seriously, and one of the reasons the world feels comfortable attacking Somalia and the Somali people.

Instead of bringing solutions or exercising leadership, Deni chooses to expose his country’s problems to the world! He literally takes his grievances to foreign ambassadors and turns them into intermediaries between himself and the federal government. What makes it even worse is that he didn't host these discussions in Garowe, the capital of the state he governs. Instead, he chose to meet foreign officials in a neighboring foreign country, Kenya, to discuss the affairs of his own country. This kind of shameful behavior is exactly why no one takes Somalia seriously, and one of the reasons the world feels comfortable attacking Somalia and the Somali people.

Deeqa 🇸🇴

21,736 views • 7 months ago

Noah Wyle hints at what Robby is doing when we pick up S3 of The Pitt and teases that with his time off he’s doing something “very interesting” for his mental health instead of being on his motorcycle OR at home.. (Via The Awards Circuit Podcast)

Noah Wyle hints at what Robby is doing when we pick up S3 of The Pitt and teases that with his time off he’s doing something “very interesting” for his mental health instead of being on his motorcycle OR at home.. (Via The Awards Circuit Podcast)

🖤ViVi🤍

86,508 views • 1 month ago

Why haven't we picked up a commit yet? Patience #iubb, Coach DeVries has words for you: - We can't cheat the process - The majority of your winning takes place on the very front end, your coaching staff and players - We're not making exceptions to what we believe is important

Why haven't we picked up a commit yet? Patience #iubb, Coach DeVries has words for you: - We can't cheat the process - The majority of your winning takes place on the very front end, your coaching staff and players - We're not making exceptions to what we believe is important

Hoosier Review

148,975 views • 1 year ago

I made Oliver Tree, ive been a huge fan of his ever since I saw him on Ethan Klein back in 2019. He was one of my favourite artists and I loved everything he did. The world lost a real one, but I'll appreciate him & his music for the rest of my life. Thanks #OliverTree RIP

I made Oliver Tree, ive been a huge fan of his ever since I saw him on Ethan Klein back in 2019. He was one of my favourite artists and I loved everything he did. The world lost a real one, but I'll appreciate him & his music for the rest of my life. Thanks #OliverTree RIP

ClayDabbler

12,739 views • 2 months ago

.Karoline Leavitt on Iranian uranium enrichment: "This is on the top of the priority list for President Donald J. Trump and his negotiating team... That is a red line that President Donald J. Trump is not going to back away from, and he is committed to ensuring that that takes place. We hope it will be through diplomacy."

.Karoline Leavitt on Iranian uranium enrichment: "This is on the top of the priority list for President Donald J. Trump and his negotiating team... That is a red line that President Donald J. Trump is not going to back away from, and he is committed to ensuring that that takes place. We hope it will be through diplomacy."

Rapid Response 47

62,309 views • 4 months ago

Tony Khan's exact words on Hangman Page not being able to challenge for the AEW World Championship anymore: “Same thing with Cody. A gentleman’s handshake. He's somebody that is known for being a man of his word. We made a verbal agreement, so it's a verbal contract.” MEANING HANGER CAN ABSOLUTELY GO BACK ON HIS WORD AND BREAK THE STIPULATION.

Tony Khan's exact words on Hangman Page not being able to challenge for the AEW World Championship anymore: “Same thing with Cody. A gentleman’s handshake. He's somebody that is known for being a man of his word. We made a verbal agreement, so it's a verbal contract.” MEANING HANGER CAN ABSOLUTELY GO BACK ON HIS WORD AND BREAK THE STIPULATION.

Drainmaker

179,194 views • 5 months ago

We truly have to unlearn everything we have been taught. Satan runs this world and it is his goal-every single moment of every single day-to drive people away from God… and away from the truth found in the Word. Flat earth is biblical, and it is very evident when you seek the Word on this topic. “The earth takes shape like clay under a seal”. “The earth cannot be moved”. Full video on my YouTube ❤️

We truly have to unlearn everything we have been taught. Satan runs this world and it is his goal-every single moment of every single day-to drive people away from God… and away from the truth found in the Word. Flat earth is biblical, and it is very evident when you seek the Word on this topic. “The earth takes shape like clay under a seal”. “The earth cannot be moved”. Full video on my YouTube ❤️

Ashley Hays

38,762 views • 8 months ago

.KidRock is here for AI, and AI songwriting. We sat down with Kid Rock at his steak house in Nashville. And we came away with a contest. Make your best Kid Rock song with @SunoMusic, drop the link below, and we'll let KidRock pick the winner. LFG Full interview 👇 on YouTube

.KidRock is here for AI, and AI songwriting. We sat down with Kid Rock at his steak house in Nashville. And we came away with a contest. Make your best Kid Rock song with @SunoMusic, drop the link below, and we'll let KidRock pick the winner. LFG Full interview 👇 on YouTube

Ashlee Vance

78,063 views • 11 months ago

If you live in lower Manhattan and housing affordability is your top issue, vote Ryder Kessler for Assembly. He's the only candidate on the right side of solving the housing crisis. His opponent Jeannine Kiely is misleading you about her record. Receipts below. 🧵

If you live in lower Manhattan and housing affordability is your top issue, vote Ryder Kessler for Assembly. He's the only candidate on the right side of solving the housing crisis. His opponent Jeannine Kiely is misleading you about her record. Receipts below. 🧵

Open New York

18,890 views • 2 months ago