正在加载视频...

视频加载失败

加载此视频时出现问题。这可能是由于临时网络问题，或视频可能不可用。

Talk2Move Reinforcement Learning for Text-Instructed Object-Level Geometric Transformation in Scenes

AK

507,607 subscribers

10,719 次观看 • 6 个月前 •via X (Twitter)

Anya Rossi• Live Now

Private livecam show

0 条评论

暂无评论

原始帖子的评论将显示在这里

相关视频

Google announces InseRF Text-Driven Generative Object Insertion in Neural 3D Scenes paper page: InseRF generates an object in a 3D scene via a text prompt and one 2D bounding box

Google announces InseRF Text-Driven Generative Object Insertion in Neural 3D Scenes paper page: InseRF generates an object in a 3D scene via a text prompt and one 2D bounding box

AK

205,987 次观看 • 2 年前

Getting Cyn ready for reinforcement learning >:3

Getting Cyn ready for reinforcement learning >:3

DT

14,557 次观看 • 9 个月前

FirePlace Geometric Refinements of LLM Common Sense Reasoning for 3D Object Placement

FirePlace Geometric Refinements of LLM Common Sense Reasoning for 3D Object Placement

AK

49,980 次观看 • 1 年前

This is a demonstration video of in-hand object rotation with new Torobo Hand. By leveraging large-scale parallel reinforcement learning in NVIDIA Isaac Sim, the learned policy can perform object manipulation in MuJoCo and on the real robot without any additional training.

This is a demonstration video of in-hand object rotation with new Torobo Hand. By leveraging large-scale parallel reinforcement learning in NVIDIA Isaac Sim, the learned policy can perform object manipulation in MuJoCo and on the real robot without any additional training.

東京ロボティクス株式会社

10,860 次观看 • 1 年前

AI quality has reached human level. These transformation scenes are flawless.

AI quality has reached human level. These transformation scenes are flawless.

nachos2d

22,939 次观看 • 3 个月前

notes on my reinforcement learning for rocket league side quest so far: i’m in awe that — we live in a time where i can train a reinforcement learning model that is learning to play rocket league and at the same time, test community made rocket league models. where, both processes can run in parallel & locally on my hardware. in the game window — i’m playing against a reinforcement learning ppo model that’s running locally. and in the vscode window — i’m training my own reinforcement learning model (just a dummy example script for now). also, the rocket league botting ecosystem has incredible tooling where you can test out different reinforcement learning ideas against other algorithms + it has great documentation for linux and windows. it’s honestly a beautiful hidden gem of a rabbit hole :)

notes on my reinforcement learning for rocket league side quest so far: i’m in awe that — we live in a time where i can train a reinforcement learning model that is learning to play rocket league and at the same time, test community made rocket league models. where, both processes can run in parallel & locally on my hardware. in the game window — i’m playing against a reinforcement learning ppo model that’s running locally. and in the vscode window — i’m training my own reinforcement learning model (just a dummy example script for now). also, the rocket league botting ecosystem has incredible tooling where you can test out different reinforcement learning ideas against other algorithms + it has great documentation for linux and windows. it’s honestly a beautiful hidden gem of a rabbit hole :)

naklecha

46,302 次观看 • 1 年前

Train your avatars to interact with 3D scenes. We use adversarial imitation learning and reinforcement learning to train physically-simulated characters that perform scene interaction tasks in a natural and life-like manner. Today at #SIGGRAPH2023.

Train your avatars to interact with 3D scenes. We use adversarial imitation learning and reinforcement learning to train physically-simulated characters that perform scene interaction tasks in a natural and life-like manner. Today at #SIGGRAPH2023.

Michael Black

46,237 次观看 • 2 年前

Learning Agile Soccer Skills for a Bipedal Robot with Deep Reinforcement Learning investigated the application of Deep Reinforcement Learning (Deep RL) for low-cost, miniature humanoid hardware in a dynamic environment, showing the method can synthesize sophisticated and safe movement skills making up complex behavioral strategies in a simplified one-versus-one (1v1) soccer game abs: project page:

Learning Agile Soccer Skills for a Bipedal Robot with Deep Reinforcement Learning investigated the application of Deep Reinforcement Learning (Deep RL) for low-cost, miniature humanoid hardware in a dynamic environment, showing the method can synthesize sophisticated and safe movement skills making up complex behavioral strategies in a simplified one-versus-one (1v1) soccer game abs: project page:

AK

293,352 次观看 • 3 年前

Object Cutter Create high-quality HD background removal for ANY object in your image with a text prompt or bounding boxes!

Object Cutter Create high-quality HD background removal for ANY object in your image with a text prompt or bounding boxes!

Gradio

136,042 次观看 • 1 年前

Major milestone in Reinforcement Learning 🚀 In under just 1 hour of training, our AI Agent can now automate tasks requiring complex physics and object interactions. Done for the first time on 100$ robot arms. Watch as it recovers when the cube gets stuck 🤯

Major milestone in Reinforcement Learning 🚀 In under just 1 hour of training, our AI Agent can now automate tasks requiring complex physics and object interactions. Done for the first time on 100$ robot arms. Watch as it recovers when the cube gets stuck 🤯

Remi Cadene

62,533 次观看 • 1 年前

🔥 DreamEngine revolutionizes image generation with its text-guided object fusion capabilities! The demo and code for Text Guided Object Fustion are released! Let's unlock the Imaginations! Run it locally now in: Paper:

🔥 DreamEngine revolutionizes image generation with its text-guided object fusion capabilities! The demo and code for Text Guided Object Fustion are released! Let's unlock the Imaginations! Run it locally now in: Paper:

Liang Chen

11,357 次观看 • 1 年前

Robot policies must be both reliable and highly capable to be useful; the best way to achieve this level of performance is with reinforcement learning. However, for reinforcement learning you are usually stuck between two difficult options: reinforcement in the real world is often risky and expensive, while reinforcement learning in a traditional simulator takes a lot of engineering work and has a persistent sim-to-real gap. What if instead you could train your robot purely in a world model? RISE by Jiazhi Yang et al. uses a compositional world model to predict the future and evaluate progress. This allows for a self-improving pipeline, which learns a world model from real data and then learns how the robot should perform different tasks. This pipeline results in a data-driven way to improve policy performance from real data but without real-world reinforcement learning. Watch Episode #86 of RoboPapers, with Chris Paxton and Jiafei Duan, to learn more!

Robot policies must be both reliable and highly capable to be useful; the best way to achieve this level of performance is with reinforcement learning. However, for reinforcement learning you are usually stuck between two difficult options: reinforcement in the real world is often risky and expensive, while reinforcement learning in a traditional simulator takes a lot of engineering work and has a persistent sim-to-real gap. What if instead you could train your robot purely in a world model? RISE by Jiazhi Yang et al. uses a compositional world model to predict the future and evaluate progress. This allows for a self-improving pipeline, which learns a world model from real data and then learns how the robot should perform different tasks. This pipeline results in a data-driven way to improve policy performance from real data but without real-world reinforcement learning. Watch Episode #86 of RoboPapers, with Chris Paxton and Jiafei Duan, to learn more!

RoboPapers

38,334 次观看 • 1 个月前

Boston Dynamics’ robot-behavior team lead highlights three core initiatives aimed at advancing Atlas’s dexterity: ⦿ Reinforcement learning in simulation ⦿ Whole-body teleoperation to collect data for imitation learning ⦿ Tactile sensing grippers

Boston Dynamics’ robot-behavior team lead highlights three core initiatives aimed at advancing Atlas’s dexterity: ⦿ Reinforcement learning in simulation ⦿ Whole-body teleoperation to collect data for imitation learning ⦿ Tactile sensing grippers

The Humanoid Hub

18,029 次观看 • 1 年前

i trained a reinforcement learning agent to play diablo 1 in a few hours with pufferlib

i trained a reinforcement learning agent to play diablo 1 in a few hours with pufferlib

Dan Advantage

41,954 次观看 • 7 个月前

Thinking in Boxes- 3D editing for images with simple box interface. - FLUX-Kontext + LoRA - precise translation, rotation, scaling - good object preservation - geometric fidelity ideal for virtual staging and e-commerce.

Thinking in Boxes- 3D editing for images with simple box interface. - FLUX-Kontext + LoRA - precise translation, rotation, scaling - good object preservation - geometric fidelity ideal for virtual staging and e-commerce.

Wildminder

15,451 次观看 • 1 个月前

Years of reinforcement learning in one clip: Atlas pulls off a cartwheel-to-backflip combo with perfect balance.

Years of reinforcement learning in one clip: Atlas pulls off a cartwheel-to-backflip combo with perfect balance.

Big Brain AI

91,525 次观看 • 2 个月前

today we are teaching a machine to exploit object detection models using swarm drones + reinforcement learning after only 5,000 steps on my Mac Air M3, the policy brought down detection from 90% to 32%, allowing 20+ drones to fly undetected

today we are teaching a machine to exploit object detection models using swarm drones + reinforcement learning after only 5,000 steps on my Mac Air M3, the policy brought down detection from 90% to 32%, allowing 20+ drones to fly undetected

chester

180,750 次观看 • 11 个月前

Transformation doesn’t come from motivation. It comes from discipline, structure, and learning how to move with purpose. Walk the path GSP built and step into your next level. Link in bio.

Transformation doesn’t come from motivation. It comes from discipline, structure, and learning how to move with purpose. Walk the path GSP built and step into your next level. Link in bio.

Georges St-Pierre

26,546 次观看 • 7 个月前

Introducing the Digital Twin Catalog: We believe it’s the world’s highest quality dataset for object reconstruction research. It consists of over 2,400 physical objects scanned with state-of-art hardware and hand-tuned to achieve sub-millimeter-level geometric accuracy and photorealism. Project Aria @Meta

Introducing the Digital Twin Catalog: We believe it’s the world’s highest quality dataset for object reconstruction research. It consists of over 2,400 physical objects scanned with state-of-art hardware and hand-tuned to achieve sub-millimeter-level geometric accuracy and photorealism. Project Aria @Meta

Reality Labs at Meta

27,757 次观看 • 1 年前