Video wird geladen...

Video konnte nicht geladen werden

Zur Startseite

Can we make Transformers better and more efficient for robot learning? Excited to introduce Body Transformer (BoT), an architecture that leverages robot embodiment in the attention mechanism, by treating it as a graph of sensors and actuators.

carlo_sferrazza's profile picture

Carlo Sferrazza

2,427 subscribers

60,663 Aufrufe • vor 1 Jahr •via X (Twitter)

BildungWissenschaft & Technologie
LIVE

Anya Rossi• Live Now

Private livecam show

0 Kommentare

Keine Kommentare verfügbar

Kommentare vom Original-Post werden hier angezeigt

Ähnliche Videos

How can we more effectively leverage robot data from different embodiments for skill transfer? Excited to share that our new work, RoVi-Aug, has been accepted to Conference on Robot Learning as an oral paper！ WIth RoVi-Aug, you can augment an existing robot dataset into a different robot and different viewpoints. A policy trained on the augmented dataset can zero-shot deploy on the unseen target robot with significantly different camera angles! 🧵👇 🔗 Check out our paper:
0:18

How can we more effectively leverage robot data from different embodiments for skill transfer? Excited to share that our new work, RoVi-Aug, has been accepted to Conference on Robot Learning as an oral paper！ WIth RoVi-Aug, you can augment an existing robot dataset into a different robot and different viewpoints. A policy trained on the augmented dataset can zero-shot deploy on the unseen target robot with significantly different camera angles! 🧵👇 🔗 Check out our paper:

Chenfeng_X

28,283 Aufrufe • vor 1 Jahr

1/ 🤲 LeRobot has made low-cost robot learning widely accessible — but most policies are still blind to contact. Today we release LeFlexiTac: a tactile extension for the LeRobot platform using FlexiTac sensors. Make tactile robot learning as easy as possible. Project page: Code/docs:
0:15

1/ 🤲 LeRobot has made low-cost robot learning widely accessible — but most policies are still blind to contact. Today we release LeFlexiTac: a tactile extension for the LeRobot platform using FlexiTac sensors. Make tactile robot learning as easy as possible. Project page: Code/docs:

Binghao Huang

62,507 Aufrufe • vor 1 Monat

Excited to release Minimalist Compliance Control! We achieve robust, compliant robot interaction across robot arms, dexterous hands, and humanoids, with NO force sensors or learning. If you’re wondering what remains, please see the thread below😉 Website:
0:19

Excited to release Minimalist Compliance Control! We achieve robust, compliant robot interaction across robot arms, dexterous hands, and humanoids, with NO force sensors or learning. If you’re wondering what remains, please see the thread below😉 Website:

Haochen Shi

30,684 Aufrufe • vor 3 Monaten

One more robot abuse clip. We can hopefully share more info about this bot soon. What we can say is that it will be affordable, focused on teleoperation, imitation learning and AI. A new humanoid player maybe?? 🤔🤔🦾🤖
0:16

One more robot abuse clip. We can hopefully share more info about this bot soon. What we can say is that it will be affordable, focused on teleoperation, imitation learning and AI. A new humanoid player maybe?? 🤔🤔🦾🤖

SourceRobotics

31,209 Aufrufe • vor 1 Jahr

Robot paper of the day: RoboBallet: Planning for multirobot reaching with graph neural networks and reinforcement learning UCL + Google DeepMind + Intrinsic built an AI planner that choreographs teams of arms to work in tight spaces without collisions—planning in seconds, not days.
0:10

Robot paper of the day: RoboBallet: Planning for multirobot reaching with graph neural networks and reinforcement learning UCL + Google DeepMind + Intrinsic built an AI planner that choreographs teams of arms to work in tight spaces without collisions—planning in seconds, not days.

Jiafei Duan

15,084 Aufrufe • vor 9 Monaten

How can we leverage diverse human videos to improve robot manipulation? Excited to introduce EgoVLA — a Vision-Language-Action model trained on egocentric human videos by explicitly modeling wrist & hand motion. We build a shared action space between humans and robots, enabling seamless transfer. With some robot demos, EgoVLA becomes a powerful, generalizable robot policy.
0:14

How can we leverage diverse human videos to improve robot manipulation? Excited to introduce EgoVLA — a Vision-Language-Action model trained on egocentric human videos by explicitly modeling wrist & hand motion. We build a shared action space between humans and robots, enabling seamless transfer. With some robot demos, EgoVLA becomes a powerful, generalizable robot policy.

Ruihan Yang

58,661 Aufrufe • vor 11 Monaten

TESLA’S OPTIMUS BOT: COOKS, CLEANS, AND WILL CHANGE THE FUTURE FOR THE BETTER Tesla’s humanoid robot, Optimus, isn’t just walking—it’s working. Designed to handle chores like cooking, vacuuming, and folding laundry, Optimus is Tesla’s leap into domestic automation. With sensors, neural networks, and a frame built for agility, it can navigate cluttered homes and messy kitchens while improving its skills over time. More than a sci-fi showpiece, it’s being trained to adapt to household routines. Think of it as a second set of hands—unfazed by spills or socks. It’s here, and it’s learning to make dinner. Source: Nic Cruz Patane Tesla Optimus
0:11

TESLA’S OPTIMUS BOT: COOKS, CLEANS, AND WILL CHANGE THE FUTURE FOR THE BETTER Tesla’s humanoid robot, Optimus, isn’t just walking—it’s working. Designed to handle chores like cooking, vacuuming, and folding laundry, Optimus is Tesla’s leap into domestic automation. With sensors, neural networks, and a frame built for agility, it can navigate cluttered homes and messy kitchens while improving its skills over time. More than a sci-fi showpiece, it’s being trained to adapt to household routines. Think of it as a second set of hands—unfazed by spills or socks. It’s here, and it’s learning to make dinner. Source: Nic Cruz Patane Tesla Optimus

Mario Nawfal

475,288 Aufrufe • vor 1 Jahr

BaBot: A Ball-Balancing Robotics Kit BaBot is a do-it-yourself ball-balancing robot kit designed as a hands-on platform for learning robotics and control systems. It enables users to explore concepts such as PID control, sensors, actuators, and software integration through practical experimentation. The kit is intended for students, makers, and others interested in applied robotics without requiring a formal engineering background. Credit: Babot Project #arduino #ai #robotics #3dprint #engineering
0:19

BaBot: A Ball-Balancing Robotics Kit BaBot is a do-it-yourself ball-balancing robot kit designed as a hands-on platform for learning robotics and control systems. It enables users to explore concepts such as PID control, sensors, actuators, and software integration through practical experimentation. The kit is intended for students, makers, and others interested in applied robotics without requiring a formal engineering background. Credit: Babot Project #arduino #ai #robotics #3dprint #engineering

Wevolver

25,314 Aufrufe • vor 4 Monaten

Generalist robots need multimodal learning—fusing vision, touch, and body motion to handle unstructured worlds. 🦾 NVIDIA Isaac Lab is a GPU-accelerated, open-source simulation framework for robot learning that unifies physics, rendering, sensing, and parallel computing to train robot policies at scale. Learn more 🔗 #NVIDIAResearch
0:11

Generalist robots need multimodal learning—fusing vision, touch, and body motion to handle unstructured worlds. 🦾 NVIDIA Isaac Lab is a GPU-accelerated, open-source simulation framework for robot learning that unifies physics, rendering, sensing, and parallel computing to train robot policies at scale. Learn more 🔗 #NVIDIAResearch

NVIDIA Robotics

18,568 Aufrufe • vor 4 Monaten

Imagine having a ping pong robot! 🏓 Researchers and developers building physical AI: meet Reachy 2 from Pollen Robotics, an open-source, humanoid robot for real-world experimentation. It’s a bimanual mobile manipulator: each 7-DOF arm mimics human proportions and can lift up to 3 kg, giving dexterity for object handling. It can be controlled with Python and ROS2 Humble, or go straight into VR teleoperation, use a headset to move Reachy’s arms, hands, and head, and see through its cameras as if you’re in the robot’s own body. Want it to move around? A mobile base with three omnidirectional wheels, rich sensors, and LiDAR lets Reachy 2 navigate and explore its surroundings smoothly. 🗺️ Under the hood, it’s powered by a CPU system that’s ready for machine learning, perfect for loading AI frameworks and testing new models from Hugging Face directly on the robot. Keep making robots more, and more accessible Pollen team! ... and keep making more open source models to make robots more mainstream clem 🤗!
0:18

Imagine having a ping pong robot! 🏓 Researchers and developers building physical AI: meet Reachy 2 from Pollen Robotics, an open-source, humanoid robot for real-world experimentation. It’s a bimanual mobile manipulator: each 7-DOF arm mimics human proportions and can lift up to 3 kg, giving dexterity for object handling. It can be controlled with Python and ROS2 Humble, or go straight into VR teleoperation, use a headset to move Reachy’s arms, hands, and head, and see through its cameras as if you’re in the robot’s own body. Want it to move around? A mobile base with three omnidirectional wheels, rich sensors, and LiDAR lets Reachy 2 navigate and explore its surroundings smoothly. 🗺️ Under the hood, it’s powered by a CPU system that’s ready for machine learning, perfect for loading AI frameworks and testing new models from Hugging Face directly on the robot. Keep making robots more, and more accessible Pollen team! ... and keep making more open source models to make robots more mainstream clem 🤗!

Lukas Ziegler

37,221 Aufrufe • vor 10 Monaten

China has created an antelope robot — but why? Chinese scientists have released a robot disguised as an antelope onto the Tibetan Plateau. Their goal is to study the animals’ lifestyle and the ecosystem. According to Xinhua, the experiment was a success — the antelopes accepted the robot as one of their own and were not afraid of it.
0:08

China has created an antelope robot — but why? Chinese scientists have released a robot disguised as an antelope onto the Tibetan Plateau. Their goal is to study the animals’ lifestyle and the ecosystem. According to Xinhua, the experiment was a success — the antelopes accepted the robot as one of their own and were not afraid of it.

NEXTA

37,735 Aufrufe • vor 10 Monaten

This also shows up in the representations learned by the model. We plot the model’s representations of human and robot images. As pre-training is scaled up, the representation of humans and robots become more aligned: to a scaled-up model, human videos "look" like robot demos.
0:10

This also shows up in the representations learned by the model. We plot the model’s representations of human and robot images. As pre-training is scaled up, the representation of humans and robots become more aligned: to a scaled-up model, human videos "look" like robot demos.

Physical Intelligence

120,595 Aufrufe • vor 6 Monaten

Check out the new interactive humanoid robot, Yogi, introduced by Cartwheel Robotics. Yogi is designed as a companion for everyday life, offering help and companionship in settings from hospitals to living rooms. It features soft silicone skin for safe touch, precision actuators for predictable movement, and simple, natural interaction. The robot continuously learns new abilities for greater utility. Cartwheel's founder, Scott LaValley, has a deep background, having developed over four humanoid systems. His expertise includes nearly a decade developing the Atlas robot at Boston Dynamics, followed by five years at Disney leading the team that created the Groot robot. This extensive, hands-on experience is key to Cartwheel Robotics' innovations.
0:15

Check out the new interactive humanoid robot, Yogi, introduced by Cartwheel Robotics. Yogi is designed as a companion for everyday life, offering help and companionship in settings from hospitals to living rooms. It features soft silicone skin for safe touch, precision actuators for predictable movement, and simple, natural interaction. The robot continuously learns new abilities for greater utility. Cartwheel's founder, Scott LaValley, has a deep background, having developed over four humanoid systems. His expertise includes nearly a decade developing the Atlas robot at Boston Dynamics, followed by five years at Disney leading the team that created the Groot robot. This extensive, hands-on experience is key to Cartwheel Robotics' innovations.

RoboHub🤖

15,243 Aufrufe • vor 8 Monaten

High school students built an autonomous ball-collecting robot! 🎾 A group of high school students built a robot that picks up balls and shoots them into a bin while moving without stopping, with impressive speed and accuracy. It combines mechanical design, sensors, and software making constant adjustments in real time while the robot is driving. When teenagers can build systems this sophisticated, the talent pipeline for the robotics industry is accelerating! ~~ ♻️ Join the weekly robotics newsletter, and never miss any news →
0:12

High school students built an autonomous ball-collecting robot! 🎾 A group of high school students built a robot that picks up balls and shoots them into a bin while moving without stopping, with impressive speed and accuracy. It combines mechanical design, sensors, and software making constant adjustments in real time while the robot is driving. When teenagers can build systems this sophisticated, the talent pipeline for the robotics industry is accelerating! ~~ ♻️ Join the weekly robotics newsletter, and never miss any news →

Lukas Ziegler

1,180,862 Aufrufe • vor 3 Monaten

Physical AI won't just be limited to controlling robots and spatial computing; it will usher in a new era of machine design. You will be able to "vibe design" a robot - or a part of a robot - or a machine that manufactures robot parts - using high-level specifications such as preferred architecture, material constraints, cost constraints, supply chain and geographic limitations and scalability. AI will provide preliminary designs that human experts can tweak and tune, corresponding supplier catalogs, and machining options. It will also project the talent and CAPEX required at various phases of hardware development.
0:11

Physical AI won't just be limited to controlling robots and spatial computing; it will usher in a new era of machine design. You will be able to "vibe design" a robot - or a part of a robot - or a machine that manufactures robot parts - using high-level specifications such as preferred architecture, material constraints, cost constraints, supply chain and geographic limitations and scalability. AI will provide preliminary designs that human experts can tweak and tune, corresponding supplier catalogs, and machining options. It will also project the talent and CAPEX required at various phases of hardware development.

The Humanoid Hub

48,625 Aufrufe • vor 4 Monaten

Well, a humanoid robot can move on two legs or wheels, depending on the environment it faces. AGIBOT (Zhiyuan) from Shanghai revealed that their new generation of humanoid robot "Nezha" can autonomously switch to two wheels for fast movement when walking on two legs. Imagine that in the airport hall, when he walks down the stairs and sees a fallen object not far away, it can transform into a wheeled robot and move quickly to pick it up. Or in elderly care, when it see an elderly person fall, it can quickly move and help the elderly person up, and quickly provide medical supplies to the caregiver.
0:10

Well, a humanoid robot can move on two legs or wheels, depending on the environment it faces. AGIBOT (Zhiyuan) from Shanghai revealed that their new generation of humanoid robot "Nezha" can autonomously switch to two wheels for fast movement when walking on two legs. Imagine that in the airport hall, when he walks down the stairs and sees a fallen object not far away, it can transform into a wheeled robot and move quickly to pick it up. Or in elderly care, when it see an elderly person fall, it can quickly move and help the elderly person up, and quickly provide medical supplies to the caregiver.

CyberRobo

40,245 Aufrufe • vor 1 Jahr

Teaching robots how to paint! 💅🏼 This painting robot, for example, mimics human movements with precision to handle repetitive, and tiring tasks. A special device memorizes points in 3D space, which are then sent to the robot's control. The result? A robot that, after a single demonstration, can perform a given action. Keep in mind that it's taught as 'fixed'. 👨🏻‍🔧 That is, it will not be able to react to an anomaly or changing environment. But ultimately, with fewer workers available and many avoiding tough, dirty jobs, robots are helping industries stay efficient and safe. ♻️ RT to help 1 robot find a new workplace!
0:15

Teaching robots how to paint! 💅🏼 This painting robot, for example, mimics human movements with precision to handle repetitive, and tiring tasks. A special device memorizes points in 3D space, which are then sent to the robot's control. The result? A robot that, after a single demonstration, can perform a given action. Keep in mind that it's taught as 'fixed'. 👨🏻‍🔧 That is, it will not be able to react to an anomaly or changing environment. But ultimately, with fewer workers available and many avoiding tough, dirty jobs, robots are helping industries stay efficient and safe. ♻️ RT to help 1 robot find a new workplace!

Lukas Ziegler

38,319 Aufrufe • vor 1 Jahr