Загрузка видео...

Не удалось загрузить видео

На главную

Can we make Transformers better and more efficient for robot learning? Excited to introduce Body Transformer (BoT), an architecture that leverages robot embodiment in the attention mechanism, by treating it as a graph of sensors and actuators.

carlo_sferrazza's profile picture

Carlo Sferrazza

2,427 subscribers

60,663 просмотров • 1 год назад •via X (Twitter)

ОбразованиеНаука и технологии
LIVE

Anya Rossi• Live Now

Private livecam show

Комментарии: 0

Нет доступных комментариев

Здесь появятся комментарии из оригинального поста

Похожие видео

How can we more effectively leverage robot data from different embodiments for skill transfer? Excited to share that our new work, RoVi-Aug, has been accepted to Conference on Robot Learning as an oral paper！ WIth RoVi-Aug, you can augment an existing robot dataset into a different robot and different viewpoints. A policy trained on the augmented dataset can zero-shot deploy on the unseen target robot with significantly different camera angles! 🧵👇 🔗 Check out our paper:
0:18

How can we more effectively leverage robot data from different embodiments for skill transfer? Excited to share that our new work, RoVi-Aug, has been accepted to Conference on Robot Learning as an oral paper！ WIth RoVi-Aug, you can augment an existing robot dataset into a different robot and different viewpoints. A policy trained on the augmented dataset can zero-shot deploy on the unseen target robot with significantly different camera angles! 🧵👇 🔗 Check out our paper:

Chenfeng_X

28,283 просмотров • 1 год назад

1/ 🤲 LeRobot has made low-cost robot learning widely accessible — but most policies are still blind to contact. Today we release LeFlexiTac: a tactile extension for the LeRobot platform using FlexiTac sensors. Make tactile robot learning as easy as possible. Project page: Code/docs:
0:15

1/ 🤲 LeRobot has made low-cost robot learning widely accessible — but most policies are still blind to contact. Today we release LeFlexiTac: a tactile extension for the LeRobot platform using FlexiTac sensors. Make tactile robot learning as easy as possible. Project page: Code/docs:

Binghao Huang

62,507 просмотров • 1 месяц назад

Excited to release Minimalist Compliance Control! We achieve robust, compliant robot interaction across robot arms, dexterous hands, and humanoids, with NO force sensors or learning. If you’re wondering what remains, please see the thread below😉 Website:
0:19

Excited to release Minimalist Compliance Control! We achieve robust, compliant robot interaction across robot arms, dexterous hands, and humanoids, with NO force sensors or learning. If you’re wondering what remains, please see the thread below😉 Website:

Haochen Shi

30,749 просмотров • 3 месяцев назад

One more robot abuse clip. We can hopefully share more info about this bot soon. What we can say is that it will be affordable, focused on teleoperation, imitation learning and AI. A new humanoid player maybe?? 🤔🤔🦾🤖
0:16

One more robot abuse clip. We can hopefully share more info about this bot soon. What we can say is that it will be affordable, focused on teleoperation, imitation learning and AI. A new humanoid player maybe?? 🤔🤔🦾🤖

SourceRobotics

31,209 просмотров • 1 год назад

How can we leverage diverse human videos to improve robot manipulation? Excited to introduce EgoVLA — a Vision-Language-Action model trained on egocentric human videos by explicitly modeling wrist & hand motion. We build a shared action space between humans and robots, enabling seamless transfer. With some robot demos, EgoVLA becomes a powerful, generalizable robot policy.
0:14

How can we leverage diverse human videos to improve robot manipulation? Excited to introduce EgoVLA — a Vision-Language-Action model trained on egocentric human videos by explicitly modeling wrist & hand motion. We build a shared action space between humans and robots, enabling seamless transfer. With some robot demos, EgoVLA becomes a powerful, generalizable robot policy.

Ruihan Yang

58,676 просмотров • 11 месяцев назад

Robot paper of the day: RoboBallet: Planning for multirobot reaching with graph neural networks and reinforcement learning UCL + Google DeepMind + Intrinsic built an AI planner that choreographs teams of arms to work in tight spaces without collisions—planning in seconds, not days.
0:10

Robot paper of the day: RoboBallet: Planning for multirobot reaching with graph neural networks and reinforcement learning UCL + Google DeepMind + Intrinsic built an AI planner that choreographs teams of arms to work in tight spaces without collisions—planning in seconds, not days.

Jiafei Duan

15,084 просмотров • 9 месяцев назад

BaBot: A Ball-Balancing Robotics Kit BaBot is a do-it-yourself ball-balancing robot kit designed as a hands-on platform for learning robotics and control systems. It enables users to explore concepts such as PID control, sensors, actuators, and software integration through practical experimentation. The kit is intended for students, makers, and others interested in applied robotics without requiring a formal engineering background. Credit: Babot Project #arduino #ai #robotics #3dprint #engineering
0:19

BaBot: A Ball-Balancing Robotics Kit BaBot is a do-it-yourself ball-balancing robot kit designed as a hands-on platform for learning robotics and control systems. It enables users to explore concepts such as PID control, sensors, actuators, and software integration through practical experimentation. The kit is intended for students, makers, and others interested in applied robotics without requiring a formal engineering background. Credit: Babot Project #arduino #ai #robotics #3dprint #engineering

Wevolver

25,314 просмотров • 4 месяцев назад

TESLA’S OPTIMUS BOT: COOKS, CLEANS, AND WILL CHANGE THE FUTURE FOR THE BETTER Tesla’s humanoid robot, Optimus, isn’t just walking—it’s working. Designed to handle chores like cooking, vacuuming, and folding laundry, Optimus is Tesla’s leap into domestic automation. With sensors, neural networks, and a frame built for agility, it can navigate cluttered homes and messy kitchens while improving its skills over time. More than a sci-fi showpiece, it’s being trained to adapt to household routines. Think of it as a second set of hands—unfazed by spills or socks. It’s here, and it’s learning to make dinner. Source: Nic Cruz Patane Tesla Optimus
0:11

TESLA’S OPTIMUS BOT: COOKS, CLEANS, AND WILL CHANGE THE FUTURE FOR THE BETTER Tesla’s humanoid robot, Optimus, isn’t just walking—it’s working. Designed to handle chores like cooking, vacuuming, and folding laundry, Optimus is Tesla’s leap into domestic automation. With sensors, neural networks, and a frame built for agility, it can navigate cluttered homes and messy kitchens while improving its skills over time. More than a sci-fi showpiece, it’s being trained to adapt to household routines. Think of it as a second set of hands—unfazed by spills or socks. It’s here, and it’s learning to make dinner. Source: Nic Cruz Patane Tesla Optimus

Mario Nawfal

475,288 просмотров • 1 год назад

Generalist robots need multimodal learning—fusing vision, touch, and body motion to handle unstructured worlds. 🦾 NVIDIA Isaac Lab is a GPU-accelerated, open-source simulation framework for robot learning that unifies physics, rendering, sensing, and parallel computing to train robot policies at scale. Learn more 🔗 #NVIDIAResearch
0:11

Generalist robots need multimodal learning—fusing vision, touch, and body motion to handle unstructured worlds. 🦾 NVIDIA Isaac Lab is a GPU-accelerated, open-source simulation framework for robot learning that unifies physics, rendering, sensing, and parallel computing to train robot policies at scale. Learn more 🔗 #NVIDIAResearch

NVIDIA Robotics

18,568 просмотров • 4 месяцев назад

Imagine having a ping pong robot! 🏓 Researchers and developers building physical AI: meet Reachy 2 from Pollen Robotics, an open-source, humanoid robot for real-world experimentation. It’s a bimanual mobile manipulator: each 7-DOF arm mimics human proportions and can lift up to 3 kg, giving dexterity for object handling. It can be controlled with Python and ROS2 Humble, or go straight into VR teleoperation, use a headset to move Reachy’s arms, hands, and head, and see through its cameras as if you’re in the robot’s own body. Want it to move around? A mobile base with three omnidirectional wheels, rich sensors, and LiDAR lets Reachy 2 navigate and explore its surroundings smoothly. 🗺️ Under the hood, it’s powered by a CPU system that’s ready for machine learning, perfect for loading AI frameworks and testing new models from Hugging Face directly on the robot. Keep making robots more, and more accessible Pollen team! ... and keep making more open source models to make robots more mainstream clem 🤗!
0:18

Imagine having a ping pong robot! 🏓 Researchers and developers building physical AI: meet Reachy 2 from Pollen Robotics, an open-source, humanoid robot for real-world experimentation. It’s a bimanual mobile manipulator: each 7-DOF arm mimics human proportions and can lift up to 3 kg, giving dexterity for object handling. It can be controlled with Python and ROS2 Humble, or go straight into VR teleoperation, use a headset to move Reachy’s arms, hands, and head, and see through its cameras as if you’re in the robot’s own body. Want it to move around? A mobile base with three omnidirectional wheels, rich sensors, and LiDAR lets Reachy 2 navigate and explore its surroundings smoothly. 🗺️ Under the hood, it’s powered by a CPU system that’s ready for machine learning, perfect for loading AI frameworks and testing new models from Hugging Face directly on the robot. Keep making robots more, and more accessible Pollen team! ... and keep making more open source models to make robots more mainstream clem 🤗!

Lukas Ziegler

37,221 просмотров • 10 месяцев назад

China has created an antelope robot — but why? Chinese scientists have released a robot disguised as an antelope onto the Tibetan Plateau. Their goal is to study the animals’ lifestyle and the ecosystem. According to Xinhua, the experiment was a success — the antelopes accepted the robot as one of their own and were not afraid of it.
0:08

China has created an antelope robot — but why? Chinese scientists have released a robot disguised as an antelope onto the Tibetan Plateau. Their goal is to study the animals’ lifestyle and the ecosystem. According to Xinhua, the experiment was a success — the antelopes accepted the robot as one of their own and were not afraid of it.

NEXTA

37,735 просмотров • 10 месяцев назад

This also shows up in the representations learned by the model. We plot the model’s representations of human and robot images. As pre-training is scaled up, the representation of humans and robots become more aligned: to a scaled-up model, human videos "look" like robot demos.
0:10

This also shows up in the representations learned by the model. We plot the model’s representations of human and robot images. As pre-training is scaled up, the representation of humans and robots become more aligned: to a scaled-up model, human videos "look" like robot demos.

Physical Intelligence

120,595 просмотров • 6 месяцев назад

Check out the new interactive humanoid robot, Yogi, introduced by Cartwheel Robotics. Yogi is designed as a companion for everyday life, offering help and companionship in settings from hospitals to living rooms. It features soft silicone skin for safe touch, precision actuators for predictable movement, and simple, natural interaction. The robot continuously learns new abilities for greater utility. Cartwheel's founder, Scott LaValley, has a deep background, having developed over four humanoid systems. His expertise includes nearly a decade developing the Atlas robot at Boston Dynamics, followed by five years at Disney leading the team that created the Groot robot. This extensive, hands-on experience is key to Cartwheel Robotics' innovations.
0:15

Check out the new interactive humanoid robot, Yogi, introduced by Cartwheel Robotics. Yogi is designed as a companion for everyday life, offering help and companionship in settings from hospitals to living rooms. It features soft silicone skin for safe touch, precision actuators for predictable movement, and simple, natural interaction. The robot continuously learns new abilities for greater utility. Cartwheel's founder, Scott LaValley, has a deep background, having developed over four humanoid systems. His expertise includes nearly a decade developing the Atlas robot at Boston Dynamics, followed by five years at Disney leading the team that created the Groot robot. This extensive, hands-on experience is key to Cartwheel Robotics' innovations.

RoboHub🤖

15,243 просмотров • 8 месяцев назад

High school students built an autonomous ball-collecting robot! 🎾 A group of high school students built a robot that picks up balls and shoots them into a bin while moving without stopping, with impressive speed and accuracy. It combines mechanical design, sensors, and software making constant adjustments in real time while the robot is driving. When teenagers can build systems this sophisticated, the talent pipeline for the robotics industry is accelerating! ~~ ♻️ Join the weekly robotics newsletter, and never miss any news →
0:12

High school students built an autonomous ball-collecting robot! 🎾 A group of high school students built a robot that picks up balls and shoots them into a bin while moving without stopping, with impressive speed and accuracy. It combines mechanical design, sensors, and software making constant adjustments in real time while the robot is driving. When teenagers can build systems this sophisticated, the talent pipeline for the robotics industry is accelerating! ~~ ♻️ Join the weekly robotics newsletter, and never miss any news →

Lukas Ziegler

1,180,922 просмотров • 3 месяцев назад

Physical AI won't just be limited to controlling robots and spatial computing; it will usher in a new era of machine design. You will be able to "vibe design" a robot - or a part of a robot - or a machine that manufactures robot parts - using high-level specifications such as preferred architecture, material constraints, cost constraints, supply chain and geographic limitations and scalability. AI will provide preliminary designs that human experts can tweak and tune, corresponding supplier catalogs, and machining options. It will also project the talent and CAPEX required at various phases of hardware development.
0:11

Physical AI won't just be limited to controlling robots and spatial computing; it will usher in a new era of machine design. You will be able to "vibe design" a robot - or a part of a robot - or a machine that manufactures robot parts - using high-level specifications such as preferred architecture, material constraints, cost constraints, supply chain and geographic limitations and scalability. AI will provide preliminary designs that human experts can tweak and tune, corresponding supplier catalogs, and machining options. It will also project the talent and CAPEX required at various phases of hardware development.

The Humanoid Hub

48,625 просмотров • 4 месяцев назад

Teaching robots how to paint! 💅🏼 This painting robot, for example, mimics human movements with precision to handle repetitive, and tiring tasks. A special device memorizes points in 3D space, which are then sent to the robot's control. The result? A robot that, after a single demonstration, can perform a given action. Keep in mind that it's taught as 'fixed'. 👨🏻‍🔧 That is, it will not be able to react to an anomaly or changing environment. But ultimately, with fewer workers available and many avoiding tough, dirty jobs, robots are helping industries stay efficient and safe. ♻️ RT to help 1 robot find a new workplace!
0:15

Teaching robots how to paint! 💅🏼 This painting robot, for example, mimics human movements with precision to handle repetitive, and tiring tasks. A special device memorizes points in 3D space, which are then sent to the robot's control. The result? A robot that, after a single demonstration, can perform a given action. Keep in mind that it's taught as 'fixed'. 👨🏻‍🔧 That is, it will not be able to react to an anomaly or changing environment. But ultimately, with fewer workers available and many avoiding tough, dirty jobs, robots are helping industries stay efficient and safe. ♻️ RT to help 1 robot find a new workplace!

Lukas Ziegler

38,319 просмотров • 1 год назад

NEW: New York City mayor Eric Adams has unveiled the Knightscope K5 security robot to patrol the subway station in Times Square. There’s no plan to solve the migrant crisis but at least you have a robot, NYC! The 400 pound robot, was leased by the NYPD for 6 months & will cost them $12,500. “We’re committed to exploring innovative tools to continue to make this city the safest big city in America, and this robot K5, it has the potential to serve as an important tool in our toolbox,” Adams said. In 2017, the city tried out a similar robot however it decided to take a swim in a fountain and drowned itself. Clown city.
0:12

NEW: New York City mayor Eric Adams has unveiled the Knightscope K5 security robot to patrol the subway station in Times Square. There’s no plan to solve the migrant crisis but at least you have a robot, NYC! The 400 pound robot, was leased by the NYPD for 6 months & will cost them $12,500. “We’re committed to exploring innovative tools to continue to make this city the safest big city in America, and this robot K5, it has the potential to serve as an important tool in our toolbox,” Adams said. In 2017, the city tried out a similar robot however it decided to take a swim in a fountain and drowned itself. Clown city.

Collin Rugg

4,663,510 просмотров • 2 лет назад