Loading video...

Video Failed to Load

There was a problem loading this video. This could be due to a temporary network issue or the video might be unavailable.

Talk2Move Reinforcement Learning for Text-Instructed Object-Level Geometric Transformation in Scenes

AK

529,476 subscribers

10,801 views • 9 months ago •via X (Twitter)

Anya Rossi• Live Now

Private livecam show

3 Comments

AK9 months ago

discuss:

Shamim Hossain9 months ago

That's impressive

Sam Gao9 months ago

Evolving speed in this area is lightspeed

Related Videos

Google announces InseRF Text-Driven Generative Object Insertion in Neural 3D Scenes paper page: InseRF generates an object in a 3D scene via a text prompt and one 2D bounding box

Google announces InseRF Text-Driven Generative Object Insertion in Neural 3D Scenes paper page: InseRF generates an object in a 3D scene via a text prompt and one 2D bounding box

AK

205,987 views • 2 years ago

Getting Cyn ready for reinforcement learning >:3

Getting Cyn ready for reinforcement learning >:3

DT

14,557 views • 1 year ago

Reinforcement learning

Reinforcement learning

Massimo

3,407,939 views • 2 years ago

FirePlace Geometric Refinements of LLM Common Sense Reasoning for 3D Object Placement

FirePlace Geometric Refinements of LLM Common Sense Reasoning for 3D Object Placement

AK

50,023 views • 1 year ago

This is a demonstration video of in-hand object rotation with new Torobo Hand. By leveraging large-scale parallel reinforcement learning in NVIDIA Isaac Sim, the learned policy can perform object manipulation in MuJoCo and on the real robot without any additional training.

This is a demonstration video of in-hand object rotation with new Torobo Hand. By leveraging large-scale parallel reinforcement learning in NVIDIA Isaac Sim, the learned policy can perform object manipulation in MuJoCo and on the real robot without any additional training.

東京ロボティクス株式会社

10,951 views • 1 year ago

notes on my reinforcement learning for rocket league side quest so far: i’m in awe that — we live in a time where i can train a reinforcement learning model that is learning to play rocket league and at the same time, test community made rocket league models. where, both processes can run in parallel & locally on my hardware. in the game window — i’m playing against a reinforcement learning ppo model that’s running locally. and in the vscode window — i’m training my own reinforcement learning model (just a dummy example script for now). also, the rocket league botting ecosystem has incredible tooling where you can test out different reinforcement learning ideas against other algorithms + it has great documentation for linux and windows. it’s honestly a beautiful hidden gem of a rabbit hole :)

notes on my reinforcement learning for rocket league side quest so far: i’m in awe that — we live in a time where i can train a reinforcement learning model that is learning to play rocket league and at the same time, test community made rocket league models. where, both processes can run in parallel & locally on my hardware. in the game window — i’m playing against a reinforcement learning ppo model that’s running locally. and in the vscode window — i’m training my own reinforcement learning model (just a dummy example script for now). also, the rocket league botting ecosystem has incredible tooling where you can test out different reinforcement learning ideas against other algorithms + it has great documentation for linux and windows. it’s honestly a beautiful hidden gem of a rabbit hole :)

naklecha

46,795 views • 1 year ago

AI quality has reached human level. These transformation scenes are flawless.

AI quality has reached human level. These transformation scenes are flawless.

nachos2d

22,939 views • 6 months ago

Redwood AI | Mobility Reinforcement Learning

Redwood AI | Mobility Reinforcement Learning

1X

1,326,424 views • 1 year ago

Train your avatars to interact with 3D scenes. We use adversarial imitation learning and reinforcement learning to train physically-simulated characters that perform scene interaction tasks in a natural and life-like manner. Today at #SIGGRAPH2023.

Train your avatars to interact with 3D scenes. We use adversarial imitation learning and reinforcement learning to train physically-simulated characters that perform scene interaction tasks in a natural and life-like manner. Today at #SIGGRAPH2023.

Michael Black

46,237 views • 3 years ago

An interesting example of reinforcement learning.

An interesting example of reinforcement learning.

Historic Vids

1,564,042 views • 3 years ago

Learning Agile Soccer Skills for a Bipedal Robot with Deep Reinforcement Learning investigated the application of Deep Reinforcement Learning (Deep RL) for low-cost, miniature humanoid hardware in a dynamic environment, showing the method can synthesize sophisticated and safe movement skills making up complex behavioral strategies in a simplified one-versus-one (1v1) soccer game abs: project page:

Learning Agile Soccer Skills for a Bipedal Robot with Deep Reinforcement Learning investigated the application of Deep Reinforcement Learning (Deep RL) for low-cost, miniature humanoid hardware in a dynamic environment, showing the method can synthesize sophisticated and safe movement skills making up complex behavioral strategies in a simplified one-versus-one (1v1) soccer game abs: project page:

AK

293,474 views • 3 years ago

Major milestone in Reinforcement Learning 🚀 In under just 1 hour of training, our AI Agent can now automate tasks requiring complex physics and object interactions. Done for the first time on 100$ robot arms. Watch as it recovers when the cube gets stuck 🤯

Major milestone in Reinforcement Learning 🚀 In under just 1 hour of training, our AI Agent can now automate tasks requiring complex physics and object interactions. Done for the first time on 100$ robot arms. Watch as it recovers when the cube gets stuck 🤯

Remi Cadene

62,536 views • 1 year ago

Object Cutter Create high-quality HD background removal for ANY object in your image with a text prompt or bounding boxes!

Object Cutter Create high-quality HD background removal for ANY object in your image with a text prompt or bounding boxes!

Gradio

136,153 views • 2 years ago

An Interesting example of Reinforcement learning!! 🐓

An Interesting example of Reinforcement learning!! 🐓

OpenMoon

7,059,191 views • 2 years ago

Can robots practice tasks on their own? We introduce a method for improving autonomy in robotic reinforcement learning. A thread 🧵

Can robots practice tasks on their own? We introduce a method for improving autonomy in robotic reinforcement learning. A thread 🧵

Chelsea Finn

63,823 views • 3 years ago

🔥 DreamEngine revolutionizes image generation with its text-guided object fusion capabilities! The demo and code for Text Guided Object Fustion are released! Let's unlock the Imaginations! Run it locally now in: Paper:

🔥 DreamEngine revolutionizes image generation with its text-guided object fusion capabilities! The demo and code for Text Guided Object Fustion are released! Let's unlock the Imaginations! Run it locally now in: Paper:

Liang Chen

11,376 views • 1 year ago

Baby steps towards physically based animation with reinforcement learning...

Baby steps towards physically based animation with reinforcement learning...

Dennis Gustafsson

33,418 views • 1 year ago

Robot policies must be both reliable and highly capable to be useful; the best way to achieve this level of performance is with reinforcement learning. However, for reinforcement learning you are usually stuck between two difficult options: reinforcement in the real world is often risky and expensive, while reinforcement learning in a traditional simulator takes a lot of engineering work and has a persistent sim-to-real gap. What if instead you could train your robot purely in a world model? RISE by Jiazhi Yang et al. uses a compositional world model to predict the future and evaluate progress. This allows for a self-improving pipeline, which learns a world model from real data and then learns how the robot should perform different tasks. This pipeline results in a data-driven way to improve policy performance from real data but without real-world reinforcement learning. Watch Episode #86 of RoboPapers, with Chris Paxton and Jiafei Duan, to learn more!

Robot policies must be both reliable and highly capable to be useful; the best way to achieve this level of performance is with reinforcement learning. However, for reinforcement learning you are usually stuck between two difficult options: reinforcement in the real world is often risky and expensive, while reinforcement learning in a traditional simulator takes a lot of engineering work and has a persistent sim-to-real gap. What if instead you could train your robot purely in a world model? RISE by Jiazhi Yang et al. uses a compositional world model to predict the future and evaluate progress. This allows for a self-improving pipeline, which learns a world model from real data and then learns how the robot should perform different tasks. This pipeline results in a data-driven way to improve policy performance from real data but without real-world reinforcement learning. Watch Episode #86 of RoboPapers, with Chris Paxton and Jiafei Duan, to learn more!

RoboPapers

38,867 views • 4 months ago

Thinking in Boxes- 3D editing for images with simple box interface. - FLUX-Kontext + LoRA - precise translation, rotation, scaling - good object preservation - geometric fidelity ideal for virtual staging and e-commerce.

Thinking in Boxes- 3D editing for images with simple box interface. - FLUX-Kontext + LoRA - precise translation, rotation, scaling - good object preservation - geometric fidelity ideal for virtual staging and e-commerce.

Wildminder

15,556 views • 4 months ago