Video wird geladen...

Video konnte nicht geladen werden

Zur Startseite

Introducing Moto: Latent Motion Token as the Bridging Language for Robot Manipulation. Motion prior learned from videos can be seamlessly transferred to robot manipulation. Code and model released! Yi CHEN Yuying Ge Yixiao Ge Mingyu Ding Ying Shan

XihuiLiu's profile picture

Xihui Liu

2,015 subscribers

14,924 Aufrufe • vor 1 Jahr •via X (Twitter)

LIVE

Anya Rossi• Live Now

Private livecam show

0 Kommentare

Keine Kommentare verfügbar

Kommentare vom Original-Post werden hier angezeigt

Ähnliche Videos

🤖Why is robot manipulation still an open challenge? This video shows a kitting task -- packing multiple items into a single product. No robot today can do this autonomously. Big challenges = big opportunities for research and industry. #robotics #manipulation #automation
0:19

🤖Why is robot manipulation still an open challenge? This video shows a kitting task -- packing multiple items into a single product. No robot today can do this autonomously. Big challenges = big opportunities for research and industry. #robotics #manipulation #automation

Yu Xiang

21,222 Aufrufe • vor 1 Jahr

NVIDIA announces the first open humanoid robot reference design built for robotics research. The NVIDIA Isaac GR00T Reference Humanoid Robot combines the Unitree H2 humanoid robot, Sharpa Wave five-fingered hands for dexterous manipulation, Jetson Thor onboard compute, and Isaac GR00T open software and models, giving researchers a full-stack platform from data capture to model deployment. Read the #NVIDIAGTC Taipei announcement:
0:20

NVIDIA announces the first open humanoid robot reference design built for robotics research. The NVIDIA Isaac GR00T Reference Humanoid Robot combines the Unitree H2 humanoid robot, Sharpa Wave five-fingered hands for dexterous manipulation, Jetson Thor onboard compute, and Isaac GR00T open software and models, giving researchers a full-stack platform from data capture to model deployment. Read the #NVIDIAGTC Taipei announcement:

NVIDIA Robotics

166,011 Aufrufe • vor 1 Monat

Can we leverage VLMs for robot manipulation in the open world? Checkout our new work MOKA, a simple and effective visual prompting method!
0:16

Can we leverage VLMs for robot manipulation in the open world? Checkout our new work MOKA, a simple and effective visual prompting method!

Fangchen Liu

81,161 Aufrufe • vor 2 Jahren

Turns out you can train humanoid hands without any robot data. The idea in HUG is quite simple: (a) collect human data with smart glasses, (b) train a human manipulation model, (c) retarget to multi-fingered robot hands.
0:18

Turns out you can train humanoid hands without any robot data. The idea in HUG is quite simple: (a) collect human data with smart glasses, (b) train a human manipulation model, (c) retarget to multi-fingered robot hands.

Lerrel Pinto

31,143 Aufrufe • vor 21 Tagen

A Rerun Viewer for the DROID Dataset! DROID: A Large-Scale In-The-Wild Robot Manipulation Dataset is a robot manipulation dataset by Alexander Khazatsky et al. with 76k demonstration trajectories or 350h of interaction data, collected across 564 scenes and 86 tasks.
0:15

A Rerun Viewer for the DROID Dataset! DROID: A Large-Scale In-The-Wild Robot Manipulation Dataset is a robot manipulation dataset by Alexander Khazatsky et al. with 76k demonstration trajectories or 350h of interaction data, collected across 564 scenes and 86 tasks.

Rerun

21,760 Aufrufe • vor 2 Jahren

This also shows up in the representations learned by the model. We plot the model’s representations of human and robot images. As pre-training is scaled up, the representation of humans and robots become more aligned: to a scaled-up model, human videos "look" like robot demos.
0:10

This also shows up in the representations learned by the model. We plot the model’s representations of human and robot images. As pre-training is scaled up, the representation of humans and robots become more aligned: to a scaled-up model, human videos "look" like robot demos.

Physical Intelligence

120,595 Aufrufe • vor 6 Monaten

Evaluating policies on a real robot can be painful. Can we use a world model to get a rough estimate of how good a policy is? Checkout "Evaluating Robot Policies in a World Model". Paper: Demo: Code:
0:10

Evaluating policies on a real robot can be painful. Can we use a world model to get a rough estimate of how good a policy is? Checkout "Evaluating Robot Policies in a World Model". Paper: Demo: Code:

Sherry Yang

36,568 Aufrufe • vor 1 Jahr

Learn about how to make humanoid robot teleoperation work for humanoid *mobile* manipulation in this podcast. Really cool work by Siyuan Huang and yixuan_li!
0:12

Learn about how to make humanoid robot teleoperation work for humanoid *mobile* manipulation in this podcast. Really cool work by Siyuan Huang and yixuan_li!

Chris Paxton

25,060 Aufrufe • vor 11 Monaten

We’re releasing model weights for our 8B- parameter Dynamic Byte Latent Transformer, an alternative to traditional tokenization methods with the potential to redefine the standards for language model efficiency and reliability. Learn more about how Dynamic Byte Latent Transformer is paving the way for groundbreaking developments in the field of language modeling. Read the research paper, and download the model and code.
0:12

We’re releasing model weights for our 8B- parameter Dynamic Byte Latent Transformer, an alternative to traditional tokenization methods with the potential to redefine the standards for language model efficiency and reliability. Learn more about how Dynamic Byte Latent Transformer is paving the way for groundbreaking developments in the field of language modeling. Read the research paper, and download the model and code.

AI at Meta

195,546 Aufrufe • vor 1 Jahr

Ge gel bak bende ne var... 4K hemde süper slow motion
0:18

Ge gel bak bende ne var... 4K hemde süper slow motion

Korhan Çağla - 3D Football & Creativity

374,497 Aufrufe • vor 8 Monaten

Long-horizon visual goals remain surprisingly hard for robot manipulation. We introduce Act2Goal, a goal-conditioned policy that uses a visual world model to reason about progress toward a goal, and practice it autonomously in the real world.
0:20

Long-horizon visual goals remain surprisingly hard for robot manipulation. We introduce Act2Goal, a goal-conditioned policy that uses a visual world model to reason about progress toward a goal, and practice it autonomously in the real world.

Jianlan Luo

95,100 Aufrufe • vor 6 Monaten

Spent the past few weeks building a fully automated pipeline for egocentric manipulation data with Kyle Jiang. Any new manipulation task captured using our own wearable sensing platform can now be dropped into the same pipeline with minimal manual fix. Instead of raw videos and annotations, we transform human demonstrations into robot-ready training data. Next, we're bringing touch into the loop with tactile gloves.
0:11

Spent the past few weeks building a fully automated pipeline for egocentric manipulation data with Kyle Jiang. Any new manipulation task captured using our own wearable sensing platform can now be dropped into the same pipeline with minimal manual fix. Instead of raw videos and annotations, we transform human demonstrations into robot-ready training data. Next, we're bringing touch into the loop with tactile gloves.

Grace Zhang

23,081 Aufrufe • vor 6 Monaten

✨ Any static 3D assets ➡️ 4D dynamic worlds. Introducing CHORD, a universal framework for generating scene-level 4D dynamic motion from any static 3D inputs. It generalizes surprisingly well across a wide range of objects 🤯 and can even be used to learn robotics manipulation policy 🤖! Project page: Dive deeper in a 🧵: 1/n
0:12

✨ Any static 3D assets ➡️ 4D dynamic worlds. Introducing CHORD, a universal framework for generating scene-level 4D dynamic motion from any static 3D inputs. It generalizes surprisingly well across a wide range of objects 🤯 and can even be used to learn robotics manipulation policy 🤖! Project page: Dive deeper in a 🧵: 1/n

Chen Geng

43,132 Aufrufe • vor 5 Monaten

introducing Wan 2.1. this new model produces videos with incredible motion and understands complex prompts in great detail. try it for free!
0:12

introducing Wan 2.1. this new model produces videos with incredible motion and understands complex prompts in great detail. try it for free!

Krea

111,147 Aufrufe • vor 1 Jahr

Learning bimanual, contact-rich robot manipulation policies that generalize over diverse objects has long been a challenge. Excited to share our work: Planning-Guided Diffusion Policy Learning for Generalizable Contact-Rich Bimanual Manipulation! 🧵1/n
0:15

Learning bimanual, contact-rich robot manipulation policies that generalize over diverse objects has long been a challenge. Excited to share our work: Planning-Guided Diffusion Policy Learning for Generalizable Contact-Rich Bimanual Manipulation! 🧵1/n

Xuanlin Li (Simon)

20,911 Aufrufe • vor 1 Jahr

A moving model of Roz from ‘THE WILD ROBOT’ will be greeting attendees as they enter the BAFTAs today.
0:10

A moving model of Roz from ‘THE WILD ROBOT’ will be greeting attendees as they enter the BAFTAs today.

DiscussingFilm

1,005,762 Aufrufe • vor 1 Jahr

Demonstrating tethered debris capture in space using visual servoing, motion prediction, and a parallel end-effector for precise manipulation. 🚀 #SpaceTech #Robotics #ISRO
0:19

Demonstrating tethered debris capture in space using visual servoing, motion prediction, and a parallel end-effector for precise manipulation. 🚀 #SpaceTech #Robotics #ISRO

ISRO

152,286 Aufrufe • vor 1 Jahr

Ying yang is 2d representation of the cosmos. It has many perspectives by which it can be observed. Cosmos seems to be triquetra in nature, but dynamically multi-faceted. Ying yang has black, white, and spheres. Three. Motion, rotation, and recursion. And also fractality.
0:22

Ying yang is 2d representation of the cosmos. It has many perspectives by which it can be observed. Cosmos seems to be triquetra in nature, but dynamically multi-faceted. Ying yang has black, white, and spheres. Three. Motion, rotation, and recursion. And also fractality.

Cymatic Joule

51,894 Aufrufe • vor 3 Jahren

PaLM-E or GPT-4 can speak in many languages and understand images. What if they could speak robot actions? Introducing RT-2: our new model that uses a VLM (up to 55B params) backbone and fine-tunes it to directly output robot actions!
0:20

PaLM-E or GPT-4 can speak in many languages and understand images. What if they could speak robot actions? Introducing RT-2: our new model that uses a VLM (up to 55B params) backbone and fine-tunes it to directly output robot actions!

Karol Hausman

182,789 Aufrufe • vor 2 Jahren

🎃OPTIMUS PRACTICES FOR THE ROBOT APOCALYPSE Finally found a costume that makes sense... robot pretending to be undead human pretending to be a robot.
0:17

🎃OPTIMUS PRACTICES FOR THE ROBOT APOCALYPSE Finally found a costume that makes sense... robot pretending to be undead human pretending to be a robot.

Mario Nawfal

83,313 Aufrufe • vor 8 Monaten