Loading video...

Video Failed to Load

Go Home

Talk2Move Reinforcement Learning for Text-Instructed Object-Level Geometric Transformation in Scenes

_akhaliq's profile picture

AK

515,439 subscribers

10,780 views • 8 months ago •via X (Twitter)

LIVE

Anya Rossi• Live Now

Private livecam show

0 Comments

No comments available

Comments from the original post will appear here

Related Videos

Google announces InseRF Text-Driven Generative Object Insertion in Neural 3D Scenes paper page: InseRF generates an object in a 3D scene via a text prompt and one 2D bounding box
1:35

Google announces InseRF Text-Driven Generative Object Insertion in Neural 3D Scenes paper page: InseRF generates an object in a 3D scene via a text prompt and one 2D bounding box

AK

205,987 views • 2 years ago

Getting Cyn ready for reinforcement learning >:3
0:47

Getting Cyn ready for reinforcement learning >:3

DT

14,557 views • 10 months ago

FirePlace Geometric Refinements of LLM Common Sense Reasoning for 3D Object Placement
0:45

FirePlace Geometric Refinements of LLM Common Sense Reasoning for 3D Object Placement

AK

50,023 views • 1 year ago

This is a demonstration video of in-hand object rotation with new Torobo Hand. By leveraging large-scale parallel reinforcement learning in NVIDIA Isaac Sim, the learned policy can perform object manipulation in MuJoCo and on the real robot without any additional training.
1:09

This is a demonstration video of in-hand object rotation with new Torobo Hand. By leveraging large-scale parallel reinforcement learning in NVIDIA Isaac Sim, the learned policy can perform object manipulation in MuJoCo and on the real robot without any additional training.

東京ロボティクス株式会社

10,909 views • 1 year ago

notes on my reinforcement learning for rocket league side quest so far: i’m in awe that — we live in a time where i can train a reinforcement learning model that is learning to play rocket league and at the same time, test community made rocket league models. where, both processes can run in parallel & locally on my hardware. in the game window — i’m playing against a reinforcement learning ppo model that’s running locally. and in the vscode window — i’m training my own reinforcement learning model (just a dummy example script for now). also, the rocket league botting ecosystem has incredible tooling where you can test out different reinforcement learning ideas against other algorithms + it has great documentation for linux and windows. it’s honestly a beautiful hidden gem of a rabbit hole :)
0:24

notes on my reinforcement learning for rocket league side quest so far: i’m in awe that — we live in a time where i can train a reinforcement learning model that is learning to play rocket league and at the same time, test community made rocket league models. where, both processes can run in parallel & locally on my hardware. in the game window — i’m playing against a reinforcement learning ppo model that’s running locally. and in the vscode window — i’m training my own reinforcement learning model (just a dummy example script for now). also, the rocket league botting ecosystem has incredible tooling where you can test out different reinforcement learning ideas against other algorithms + it has great documentation for linux and windows. it’s honestly a beautiful hidden gem of a rabbit hole :)

naklecha

46,795 views • 1 year ago

AI quality has reached human level. These transformation scenes are flawless.
1:52

AI quality has reached human level. These transformation scenes are flawless.

nachos2d

22,939 views • 5 months ago

Train your avatars to interact with 3D scenes. We use adversarial imitation learning and reinforcement learning to train physically-simulated characters that perform scene interaction tasks in a natural and life-like manner. Today at #SIGGRAPH2023.
0:21

Train your avatars to interact with 3D scenes. We use adversarial imitation learning and reinforcement learning to train physically-simulated characters that perform scene interaction tasks in a natural and life-like manner. Today at #SIGGRAPH2023.

Michael Black

46,237 views • 3 years ago

Learning Agile Soccer Skills for a Bipedal Robot with Deep Reinforcement Learning investigated the application of Deep Reinforcement Learning (Deep RL) for low-cost, miniature humanoid hardware in a dynamic environment, showing the method can synthesize sophisticated and safe movement skills making up complex behavioral strategies in a simplified one-versus-one (1v1) soccer game abs: project page:
4:28

Learning Agile Soccer Skills for a Bipedal Robot with Deep Reinforcement Learning investigated the application of Deep Reinforcement Learning (Deep RL) for low-cost, miniature humanoid hardware in a dynamic environment, showing the method can synthesize sophisticated and safe movement skills making up complex behavioral strategies in a simplified one-versus-one (1v1) soccer game abs: project page:

AK

293,450 views • 3 years ago

Object Cutter Create high-quality HD background removal for ANY object in your image with a text prompt or bounding boxes!
0:24

Object Cutter Create high-quality HD background removal for ANY object in your image with a text prompt or bounding boxes!

Gradio

136,042 views • 2 years ago

Major milestone in Reinforcement Learning 🚀 In under just 1 hour of training, our AI Agent can now automate tasks requiring complex physics and object interactions. Done for the first time on 100$ robot arms. Watch as it recovers when the cube gets stuck 🤯
0:25

Major milestone in Reinforcement Learning 🚀 In under just 1 hour of training, our AI Agent can now automate tasks requiring complex physics and object interactions. Done for the first time on 100$ robot arms. Watch as it recovers when the cube gets stuck 🤯

Remi Cadene

62,536 views • 1 year ago

🔥 DreamEngine revolutionizes image generation with its text-guided object fusion capabilities! The demo and code for Text Guided Object Fustion are released! Let's unlock the Imaginations! Run it locally now in: Paper:
0:27

🔥 DreamEngine revolutionizes image generation with its text-guided object fusion capabilities! The demo and code for Text Guided Object Fustion are released! Let's unlock the Imaginations! Run it locally now in: Paper:

Liang Chen

11,376 views • 1 year ago

Robot policies must be both reliable and highly capable to be useful; the best way to achieve this level of performance is with reinforcement learning. However, for reinforcement learning you are usually stuck between two difficult options: reinforcement in the real world is often risky and expensive, while reinforcement learning in a traditional simulator takes a lot of engineering work and has a persistent sim-to-real gap. What if instead you could train your robot purely in a world model? RISE by Jiazhi Yang et al. uses a compositional world model to predict the future and evaluate progress. This allows for a self-improving pipeline, which learns a world model from real data and then learns how the robot should perform different tasks. This pipeline results in a data-driven way to improve policy performance from real data but without real-world reinforcement learning. Watch Episode #86 of RoboPapers, with Chris Paxton and Jiafei Duan, to learn more!
53:45

Robot policies must be both reliable and highly capable to be useful; the best way to achieve this level of performance is with reinforcement learning. However, for reinforcement learning you are usually stuck between two difficult options: reinforcement in the real world is often risky and expensive, while reinforcement learning in a traditional simulator takes a lot of engineering work and has a persistent sim-to-real gap. What if instead you could train your robot purely in a world model? RISE by Jiazhi Yang et al. uses a compositional world model to predict the future and evaluate progress. This allows for a self-improving pipeline, which learns a world model from real data and then learns how the robot should perform different tasks. This pipeline results in a data-driven way to improve policy performance from real data but without real-world reinforcement learning. Watch Episode #86 of RoboPapers, with Chris Paxton and Jiafei Duan, to learn more!

RoboPapers

38,772 views • 2 months ago

i trained a reinforcement learning agent to play diablo 1 in a few hours with pufferlib
0:50

i trained a reinforcement learning agent to play diablo 1 in a few hours with pufferlib

Dan Advantage

41,954 views • 9 months ago

Thinking in Boxes- 3D editing for images with simple box interface. - FLUX-Kontext + LoRA - precise translation, rotation, scaling - good object preservation - geometric fidelity ideal for virtual staging and e-commerce.
0:43

Thinking in Boxes- 3D editing for images with simple box interface. - FLUX-Kontext + LoRA - precise translation, rotation, scaling - good object preservation - geometric fidelity ideal for virtual staging and e-commerce.

Wildminder

15,556 views • 2 months ago

Years of reinforcement learning in one clip: Atlas pulls off a cartwheel-to-backflip combo with perfect balance.
0:20

Years of reinforcement learning in one clip: Atlas pulls off a cartwheel-to-backflip combo with perfect balance.

Big Brain AI

91,653 views • 4 months ago

Transformation doesn’t come from motivation. It comes from discipline, structure, and learning how to move with purpose. Walk the path GSP built and step into your next level. Link in bio.
0:24

Transformation doesn’t come from motivation. It comes from discipline, structure, and learning how to move with purpose. Walk the path GSP built and step into your next level. Link in bio.

Georges St-Pierre

26,546 views • 9 months ago

today we are teaching a machine to exploit object detection models using swarm drones + reinforcement learning after only 5,000 steps on my Mac Air M3, the policy brought down detection from 90% to 32%, allowing 20+ drones to fly undetected
0:23

today we are teaching a machine to exploit object detection models using swarm drones + reinforcement learning after only 5,000 steps on my Mac Air M3, the policy brought down detection from 90% to 32%, allowing 20+ drones to fly undetected

chester

180,750 views • 1 year ago

🚨 Seedance 2.5 in fantasy action scenes is insane 😱 Behold this transformation > minute details hold on the character the entire time > her eyes change mid transformation, watch them > this is straight venom level shit when this lands on higgsfield soon it's the default model for everyone 100%
0:30

🚨 Seedance 2.5 in fantasy action scenes is insane 😱 Behold this transformation > minute details hold on the character the entire time > her eyes change mid transformation, watch them > this is straight venom level shit when this lands on higgsfield soon it's the default model for everyone 100%

Chetaslua

23,953 views • 1 month ago