Loading video...

Video Failed to Load

There was a problem loading this video. This could be due to a temporary network issue or the video might be unavailable.

Can we make Transformers better and more efficient for robot learning? Excited to introduce Body Transformer (BoT), an architecture that leverages robot embodiment in the attention mechanism, by treating it as a graph of sensors and actuators.

Carlo Sferrazza

2,511 subscribers

60,714 views • 2 years ago •via X (Twitter)

Education Science & Technology

Anya Rossi• Live Now

Private livecam show

0 Comments

No comments available

Comments from the original post will appear here

Related Videos

How can we more effectively leverage robot data from different embodiments for skill transfer? Excited to share that our new work, RoVi-Aug, has been accepted to Conference on Robot Learning as an oral paper！ WIth RoVi-Aug, you can augment an existing robot dataset into a different robot and different viewpoints. A policy trained on the augmented dataset can zero-shot deploy on the unseen target robot with significantly different camera angles! 🧵👇 🔗 Check out our paper:

How can we more effectively leverage robot data from different embodiments for skill transfer? Excited to share that our new work, RoVi-Aug, has been accepted to Conference on Robot Learning as an oral paper！ WIth RoVi-Aug, you can augment an existing robot dataset into a different robot and different viewpoints. A policy trained on the augmented dataset can zero-shot deploy on the unseen target robot with significantly different camera angles! 🧵👇 🔗 Check out our paper:

Chenfeng_X

28,321 views • 2 years ago

1/ 🤲 LeRobot has made low-cost robot learning widely accessible — but most policies are still blind to contact. Today we release LeFlexiTac: a tactile extension for the LeRobot platform using FlexiTac sensors. Make tactile robot learning as easy as possible. Project page: Code/docs:

1/ 🤲 LeRobot has made low-cost robot learning widely accessible — but most policies are still blind to contact. Today we release LeFlexiTac: a tactile extension for the LeRobot platform using FlexiTac sensors. Make tactile robot learning as easy as possible. Project page: Code/docs:

Binghao Huang

64,284 views • 4 months ago

One more robot abuse clip. We can hopefully share more info about this bot soon. What we can say is that it will be affordable, focused on teleoperation, imitation learning and AI. A new humanoid player maybe?? 🤔🤔🦾🤖

One more robot abuse clip. We can hopefully share more info about this bot soon. What we can say is that it will be affordable, focused on teleoperation, imitation learning and AI. A new humanoid player maybe?? 🤔🤔🦾🤖

SourceRobotics

31,209 views • 2 years ago

How can we leverage diverse human videos to improve robot manipulation? Excited to introduce EgoVLA — a Vision-Language-Action model trained on egocentric human videos by explicitly modeling wrist & hand motion. We build a shared action space between humans and robots, enabling seamless transfer. With some robot demos, EgoVLA becomes a powerful, generalizable robot policy.

How can we leverage diverse human videos to improve robot manipulation? Excited to introduce EgoVLA — a Vision-Language-Action model trained on egocentric human videos by explicitly modeling wrist & hand motion. We build a shared action space between humans and robots, enabling seamless transfer. With some robot demos, EgoVLA becomes a powerful, generalizable robot policy.

Ruihan Yang

58,854 views • 1 year ago

Robot paper of the day: RoboBallet: Planning for multirobot reaching with graph neural networks and reinforcement learning UCL + Google DeepMind + Intrinsic built an AI planner that choreographs teams of arms to work in tight spaces without collisions—planning in seconds, not days.

Robot paper of the day: RoboBallet: Planning for multirobot reaching with graph neural networks and reinforcement learning UCL + Google DeepMind + Intrinsic built an AI planner that choreographs teams of arms to work in tight spaces without collisions—planning in seconds, not days.

Jiafei Duan

15,084 views • 1 year ago

TESLA’S OPTIMUS BOT: COOKS, CLEANS, AND WILL CHANGE THE FUTURE FOR THE BETTER Tesla’s humanoid robot, Optimus, isn’t just walking—it’s working. Designed to handle chores like cooking, vacuuming, and folding laundry, Optimus is Tesla’s leap into domestic automation. With sensors, neural networks, and a frame built for agility, it can navigate cluttered homes and messy kitchens while improving its skills over time. More than a sci-fi showpiece, it’s being trained to adapt to household routines. Think of it as a second set of hands—unfazed by spills or socks. It’s here, and it’s learning to make dinner. Source: Nic Cruz Patane Tesla Optimus

TESLA’S OPTIMUS BOT: COOKS, CLEANS, AND WILL CHANGE THE FUTURE FOR THE BETTER Tesla’s humanoid robot, Optimus, isn’t just walking—it’s working. Designed to handle chores like cooking, vacuuming, and folding laundry, Optimus is Tesla’s leap into domestic automation. With sensors, neural networks, and a frame built for agility, it can navigate cluttered homes and messy kitchens while improving its skills over time. More than a sci-fi showpiece, it’s being trained to adapt to household routines. Think of it as a second set of hands—unfazed by spills or socks. It’s here, and it’s learning to make dinner. Source: Nic Cruz Patane Tesla Optimus

Mario Nawfal

476,909 views • 1 year ago

BaBot: A Ball-Balancing Robotics Kit BaBot is a do-it-yourself ball-balancing robot kit designed as a hands-on platform for learning robotics and control systems. It enables users to explore concepts such as PID control, sensors, actuators, and software integration through practical experimentation. The kit is intended for students, makers, and others interested in applied robotics without requiring a formal engineering background. Credit: Babot Project #arduino #ai #robotics #3dprint #engineering

BaBot: A Ball-Balancing Robotics Kit BaBot is a do-it-yourself ball-balancing robot kit designed as a hands-on platform for learning robotics and control systems. It enables users to explore concepts such as PID control, sensors, actuators, and software integration through practical experimentation. The kit is intended for students, makers, and others interested in applied robotics without requiring a formal engineering background. Credit: Babot Project #arduino #ai #robotics #3dprint #engineering

Wevolver

25,314 views • 7 months ago

Generalist robots need multimodal learning—fusing vision, touch, and body motion to handle unstructured worlds. 🦾 NVIDIA Isaac Lab is a GPU-accelerated, open-source simulation framework for robot learning that unifies physics, rendering, sensing, and parallel computing to train robot policies at scale. Learn more 🔗 #NVIDIAResearch

Generalist robots need multimodal learning—fusing vision, touch, and body motion to handle unstructured worlds. 🦾 NVIDIA Isaac Lab is a GPU-accelerated, open-source simulation framework for robot learning that unifies physics, rendering, sensing, and parallel computing to train robot policies at scale. Learn more 🔗 #NVIDIAResearch

NVIDIA Robotics

18,568 views • 7 months ago

Imagine having a ping pong robot! 🏓 Researchers and developers building physical AI: meet Reachy 2 from Pollen Robotics, an open-source, humanoid robot for real-world experimentation. It’s a bimanual mobile manipulator: each 7-DOF arm mimics human proportions and can lift up to 3 kg, giving dexterity for object handling. It can be controlled with Python and ROS2 Humble, or go straight into VR teleoperation, use a headset to move Reachy’s arms, hands, and head, and see through its cameras as if you’re in the robot’s own body. Want it to move around? A mobile base with three omnidirectional wheels, rich sensors, and LiDAR lets Reachy 2 navigate and explore its surroundings smoothly. 🗺️ Under the hood, it’s powered by a CPU system that’s ready for machine learning, perfect for loading AI frameworks and testing new models from Hugging Face directly on the robot. Keep making robots more, and more accessible Pollen team! ... and keep making more open source models to make robots more mainstream clem 🤗!

Imagine having a ping pong robot! 🏓 Researchers and developers building physical AI: meet Reachy 2 from Pollen Robotics, an open-source, humanoid robot for real-world experimentation. It’s a bimanual mobile manipulator: each 7-DOF arm mimics human proportions and can lift up to 3 kg, giving dexterity for object handling. It can be controlled with Python and ROS2 Humble, or go straight into VR teleoperation, use a headset to move Reachy’s arms, hands, and head, and see through its cameras as if you’re in the robot’s own body. Want it to move around? A mobile base with three omnidirectional wheels, rich sensors, and LiDAR lets Reachy 2 navigate and explore its surroundings smoothly. 🗺️ Under the hood, it’s powered by a CPU system that’s ready for machine learning, perfect for loading AI frameworks and testing new models from Hugging Face directly on the robot. Keep making robots more, and more accessible Pollen team! ... and keep making more open source models to make robots more mainstream clem 🤗!

Lukas Ziegler

37,221 views • 1 year ago

This also shows up in the representations learned by the model. We plot the model’s representations of human and robot images. As pre-training is scaled up, the representation of humans and robots become more aligned: to a scaled-up model, human videos "look" like robot demos.

This also shows up in the representations learned by the model. We plot the model’s representations of human and robot images. As pre-training is scaled up, the representation of humans and robots become more aligned: to a scaled-up model, human videos "look" like robot demos.

Physical Intelligence

120,595 views • 8 months ago

Check out the new interactive humanoid robot, Yogi, introduced by Cartwheel Robotics. Yogi is designed as a companion for everyday life, offering help and companionship in settings from hospitals to living rooms. It features soft silicone skin for safe touch, precision actuators for predictable movement, and simple, natural interaction. The robot continuously learns new abilities for greater utility. Cartwheel's founder, Scott LaValley, has a deep background, having developed over four humanoid systems. His expertise includes nearly a decade developing the Atlas robot at Boston Dynamics, followed by five years at Disney leading the team that created the Groot robot. This extensive, hands-on experience is key to Cartwheel Robotics' innovations.

Check out the new interactive humanoid robot, Yogi, introduced by Cartwheel Robotics. Yogi is designed as a companion for everyday life, offering help and companionship in settings from hospitals to living rooms. It features soft silicone skin for safe touch, precision actuators for predictable movement, and simple, natural interaction. The robot continuously learns new abilities for greater utility. Cartwheel's founder, Scott LaValley, has a deep background, having developed over four humanoid systems. His expertise includes nearly a decade developing the Atlas robot at Boston Dynamics, followed by five years at Disney leading the team that created the Groot robot. This extensive, hands-on experience is key to Cartwheel Robotics' innovations.

RoboHub🤖

15,243 views • 11 months ago

TESLA HALTED MODEL S AND MODEL X PRODUCTION TO BUILD AN ARMY OF OPTIMUS ROBOTS The Fremont assembly line was torn down in 46 days. In its place, Tesla is building a line for humanoid production, aiming for a million units a year A humanoid robot is a body shaped like a human. Physical AI is the intelligence that controls that body Walking and making coffee is often just imitation learning from a scripted routine. But once the environment shifts, the learned trick stops working Language models had the entire internet to train on. Robotics has nothing close to that scale of data, which is why one giant brain hasn't worked for anyone yet The industry is moving toward modularity instead - separate models for vision, movement, and planning, each improved on its own The real question is no longer whether a robot can move impressively. It's whether it can pull its sensors into one picture of the world and adapt to whatever wasn't scripted for it

TESLA HALTED MODEL S AND MODEL X PRODUCTION TO BUILD AN ARMY OF OPTIMUS ROBOTS The Fremont assembly line was torn down in 46 days. In its place, Tesla is building a line for humanoid production, aiming for a million units a year A humanoid robot is a body shaped like a human. Physical AI is the intelligence that controls that body Walking and making coffee is often just imitation learning from a scripted routine. But once the environment shifts, the learned trick stops working Language models had the entire internet to train on. Robotics has nothing close to that scale of data, which is why one giant brain hasn't worked for anyone yet The industry is moving toward modularity instead - separate models for vision, movement, and planning, each improved on its own The real question is no longer whether a robot can move impressively. It's whether it can pull its sensors into one picture of the world and adapt to whatever wasn't scripted for it

iamigorekk

22,205 views • 24 days ago

High school students built an autonomous ball-collecting robot! 🎾 A group of high school students built a robot that picks up balls and shoots them into a bin while moving without stopping, with impressive speed and accuracy. It combines mechanical design, sensors, and software making constant adjustments in real time while the robot is driving. When teenagers can build systems this sophisticated, the talent pipeline for the robotics industry is accelerating! ~~ ♻️ Join the weekly robotics newsletter, and never miss any news →

High school students built an autonomous ball-collecting robot! 🎾 A group of high school students built a robot that picks up balls and shoots them into a bin while moving without stopping, with impressive speed and accuracy. It combines mechanical design, sensors, and software making constant adjustments in real time while the robot is driving. When teenagers can build systems this sophisticated, the talent pipeline for the robotics industry is accelerating! ~~ ♻️ Join the weekly robotics newsletter, and never miss any news →

Lukas Ziegler

1,200,467 views • 5 months ago

Physical AI won't just be limited to controlling robots and spatial computing; it will usher in a new era of machine design. You will be able to "vibe design" a robot - or a part of a robot - or a machine that manufactures robot parts - using high-level specifications such as preferred architecture, material constraints, cost constraints, supply chain and geographic limitations and scalability. AI will provide preliminary designs that human experts can tweak and tune, corresponding supplier catalogs, and machining options. It will also project the talent and CAPEX required at various phases of hardware development.

Physical AI won't just be limited to controlling robots and spatial computing; it will usher in a new era of machine design. You will be able to "vibe design" a robot - or a part of a robot - or a machine that manufactures robot parts - using high-level specifications such as preferred architecture, material constraints, cost constraints, supply chain and geographic limitations and scalability. AI will provide preliminary designs that human experts can tweak and tune, corresponding supplier catalogs, and machining options. It will also project the talent and CAPEX required at various phases of hardware development.

The Humanoid Hub

48,715 views • 6 months ago

Teaching robots how to paint! 💅🏼 This painting robot, for example, mimics human movements with precision to handle repetitive, and tiring tasks. A special device memorizes points in 3D space, which are then sent to the robot's control. The result? A robot that, after a single demonstration, can perform a given action. Keep in mind that it's taught as 'fixed'. 👨🏻‍🔧 That is, it will not be able to react to an anomaly or changing environment. But ultimately, with fewer workers available and many avoiding tough, dirty jobs, robots are helping industries stay efficient and safe. ♻️ RT to help 1 robot find a new workplace!

Teaching robots how to paint! 💅🏼 This painting robot, for example, mimics human movements with precision to handle repetitive, and tiring tasks. A special device memorizes points in 3D space, which are then sent to the robot's control. The result? A robot that, after a single demonstration, can perform a given action. Keep in mind that it's taught as 'fixed'. 👨🏻‍🔧 That is, it will not be able to react to an anomaly or changing environment. But ultimately, with fewer workers available and many avoiding tough, dirty jobs, robots are helping industries stay efficient and safe. ♻️ RT to help 1 robot find a new workplace!

Lukas Ziegler

38,319 views • 1 year ago

NEW: New York City mayor Eric Adams has unveiled the Knightscope K5 security robot to patrol the subway station in Times Square. There’s no plan to solve the migrant crisis but at least you have a robot, NYC! The 400 pound robot, was leased by the NYPD for 6 months & will cost them $12,500. “We’re committed to exploring innovative tools to continue to make this city the safest big city in America, and this robot K5, it has the potential to serve as an important tool in our toolbox,” Adams said. In 2017, the city tried out a similar robot however it decided to take a swim in a fountain and drowned itself. Clown city.

NEW: New York City mayor Eric Adams has unveiled the Knightscope K5 security robot to patrol the subway station in Times Square. There’s no plan to solve the migrant crisis but at least you have a robot, NYC! The 400 pound robot, was leased by the NYPD for 6 months & will cost them $12,500. “We’re committed to exploring innovative tools to continue to make this city the safest big city in America, and this robot K5, it has the potential to serve as an important tool in our toolbox,” Adams said. In 2017, the city tried out a similar robot however it decided to take a swim in a fountain and drowned itself. Clown city.

Collin Rugg

4,663,748 views • 3 years ago