正在加载视频...

视频加载失败

The wait is finally over!!! 😁 We just dropped an in-depth tutorial on how to build your own robot! Teach it new skills by showing it a few moves with just a laptop. Then watch your homemade robot act autonomously 🤯 1/🧵👇

400,409 次观看 • 2 年前 •via X (Twitter)

11 条评论

Remi Cadene 的头像
Remi Cadene2 年前

2/ Find our tutorial through this link: Unlock the power of end-to-end learning — like LLMs for text, but designed for robotics! 🚀 You will learn how to train a neural network to directly predict the next motor rotations straight from camera images.

Remi Cadene 的头像
Remi Cadene2 年前

3/ We first guide you to our bill of materials to order your robot parts (in $, £ or €) through this github page: @JessMoss429864 designed a new version of @alexanderkoch arms to ease assembly, and she open sourced the 3D files ⭐️

Remi Cadene 的头像
Remi Cadene2 年前

4/ Jess also provided a guide to 3D print your parts. As soon as you gathered everything, you can start the assembly! We've made some detailed videos to make things easy for you: #1 #2 #3

Remi Cadene 的头像
Remi Cadene2 年前

5/ Next, you will record your first training set! You should start simple to validate your setup. For instance, we grasp the object at 5 locations and record 10 trajectories for each. @alibert_s made a video to show you how easy it is: #4

Remi Cadene 的头像
Remi Cadene2 年前

6/ You can also visualize any dataset with our custom tool, locally or online. For instance, here is the dataset we recorded for the tutorial:

Remi Cadene 的头像
Remi Cadene2 年前

7/ Next, you will train your neural network to control your robot. You only need a laptop for a few hours, PC or Mac. No need for simulation! After that, let's see what it learned! Check out the full video of our evaluation:

Remi Cadene 的头像
Remi Cadene2 年前

8/ A super cool feature of our code is that we also record a dataset when the neural network controls the robot. Thus, you can also view it locally or share it online! For instance, this is the recording of our eval:

Remi Cadene 的头像
Remi Cadene2 年前

9/ If we all record datasets and share them on the hub, everyone will be able to train an AI with unmatched abilities to perceive the world and act on it! This new technology might power the next societal and industrial revolution. Now you know 😘

Remi Cadene 的头像
Remi Cadene2 年前

10/ I forgot to mention one last thing... We are working on an even more affordable robot. It doesn't require 3D printing. It costs 150$ total (for the 2 arms). It's called Moss v1. Join our Discord for more 🫶

Kamal Gupta 的头像
Kamal Gupta2 年前

This is awesome work Rémi

Remi Cadene 的头像
Remi Cadene2 年前

Means a lot from you 🙏 Thanks Kamal

相关视频