Kevin Zakka's banner

Kevin Zakka

@kevin_zakka • 18,744 subscribers

phding @Berkeley_AI

Shorts

Ported over the getup tasks from playground to mjlab for my thesis defense. Will make them available in a separate repo so others can repro and build on top in the coming weeks.

Ported over the getup tasks from playground to mjlab for my thesis defense. Will make them available in a separate repo so others can repro and build on top in the coming weeks.

24,610 Aufrufe

Booster recovery controller from last night. Sim design, training and deployment on hardware took < 1 day. With Qiayuan Liao

Booster recovery controller from last night. Sim design, training and deployment on hardware took < 1 day. With Qiayuan Liao

104,475 Aufrufe

Proprioception only

Proprioception only

45,569 Aufrufe

Happy Monday! We just added raycast sensors to mjlab. They let a robot sample the scene with virtual rays, returning distances and surface geometry. Rays can use orthographic projection for terrain scanning or perspective projection for simulating a depth camera.

Happy Monday! We just added raycast sensors to mjlab. They let a robot sample the scene with virtual rays, returning distances and surface geometry. Rays can use orthographic projection for terrain scanning or perspective projection for simulating a depth camera.

19,870 Aufrufe

A lot of people have been asking so I made a repo to show how easy it is to setup a custom robot in mjlab. You don't need to clone and copy your robot into mjlab!

A lot of people have been asking so I made a repo to show how easy it is to setup a custom robot in mjlab. You don't need to clone and copy your robot into mjlab!

16,511 Aufrufe

MuJoCo 3.0 is out and it comes packed with amazing new features: TPU/GPU acceleration, non-convex geometries and deformable bodies!

MuJoCo 3.0 is out and it comes packed with amazing new features: TPU/GPU acceleration, non-convex geometries and deformable bodies!

56,953 Aufrufe

Demo starting in 10 minutes, come witness the magic of open-source sim2real!

Demo starting in 10 minutes, come witness the magic of open-source sim2real!

20,992 Aufrufe

MuJoCo 3.1.6 has just been released! MJX now comes with out-of-the-box support for height fields. Check out this joystick policy that Baruch Tabanpour trained (~2M steps per second on an A100). Colab to reproduce:

MuJoCo 3.1.6 has just been released! MJX now comes with out-of-the-box support for height fields. Check out this joystick policy that Baruch Tabanpour trained (~2M steps per second on an A100). Colab to reproduce:

30,887 Aufrufe

Whole body retargeting is dead simple with 𝗺𝗶𝗻𝗸 and runs much faster than real time. Here is an example of an AMASS sequence retargeted to Unitree's H1 humanoid. Kudos to Arthur Allshire for helping with this 🙂

Whole body retargeting is dead simple with 𝗺𝗶𝗻𝗸 and runs much faster than real time. Here is an example of an AMASS sequence retargeted to Unitree's H1 humanoid. Kudos to Arthur Allshire for helping with this 🙂

22,247 Aufrufe

Just released a MuJoCo implementation of end-effector control with differential inverse kinematics. It's blazing fast, super readable, has 0 external dependencies and best of all, it's just a few lines of code:

Just released a MuJoCo implementation of end-effector control with differential inverse kinematics. It's blazing fast, super readable, has 0 external dependencies and best of all, it's just a few lines of code:

26,427 Aufrufe

Videos

Anya Rossi

sweetdream.ai

SweetDream.ai•Sponsored•Livecam

Watch Anya Live

Anya is streaming live right now! Join her private show and enjoy exclusive content.

Exclusive private shows

1.2k viewers online

Private Show

Join now for exclusive access

Free preview available • Premium content

20 years ago

20 years ago

335,168 Aufrufe • vor 1 Jahr

I trained a grasping policy on objects of various shapes and sizes using the new mjlab feature and this really cool pivot grasp strategy emerges for large flat objects that are larger than the gripper aperture. So cool and beautiful to see!

I trained a grasping policy on objects of various shapes and sizes using the new mjlab feature and this really cool pivot grasp strategy emerges for large flat objects that are larger than the gripper aperture. So cool and beautiful to see!

20,073 Aufrufe • vor 1 Monat

I'm super excited to announce mjlab today! mjlab = Isaac Lab's APIs + best-in-class MuJoCo physics + massively parallel GPU acceleration Built directly on MuJoCo Warp with the abstractions you love.

I'm super excited to announce mjlab today! mjlab = Isaac Lab's APIs + best-in-class MuJoCo physics + massively parallel GPU acceleration Built directly on MuJoCo Warp with the abstractions you love.

91,583 Aufrufe • vor 8 Monaten

The ultimate test of any physics simulator is its ability to deliver real-world results. With MuJoCo Playground, we’ve combined the very best: MuJoCo’s rich and thriving ecosystem, massively parallel GPU-accelerated simulation, and real-world results across a diverse range of robot platforms: quadrupeds, humanoids, dexterous hands, and arms. Best of all? You can get started today with a single command: pip install playground

The ultimate test of any physics simulator is its ability to deliver real-world results. With MuJoCo Playground, we’ve combined the very best: MuJoCo’s rich and thriving ecosystem, massively parallel GPU-accelerated simulation, and real-world results across a diverse range of robot platforms: quadrupeds, humanoids, dexterous hands, and arms. Best of all? You can get started today with a single command: pip install playground

153,463 Aufrufe • vor 1 Jahr

Introducing 𝗥𝗼𝗯𝗼𝗣𝗶𝗮𝗻𝗶𝘀𝘁 🎹🤖, a new benchmark for high-dimensional robot control! Solving it requires mastering the piano with two anthropomorphic hands. This has been one year in the making, and I couldn’t be happier to release it today! Some highlights below:

Introducing 𝗥𝗼𝗯𝗼𝗣𝗶𝗮𝗻𝗶𝘀𝘁 🎹🤖, a new benchmark for high-dimensional robot control! Solving it requires mastering the piano with two anthropomorphic hands. This has been one year in the making, and I couldn’t be happier to release it today! Some highlights below:

259,859 Aufrufe • vor 3 Jahren

Coming to mjlab today! This is vanilla RL, no motion imitation/AMP. Natural gaits emerge from minimal rewards: velocity tracking, upright torso, speed-adaptive joint regularization, and contact quality (foot clearance, slip, soft landings). No reference trajectories or gait patterns. Walking, running, and arm swing emerge purely from optimizing these simple objectives. Oh and training time? Just 1 hour.

Coming to mjlab today! This is vanilla RL, no motion imitation/AMP. Natural gaits emerge from minimal rewards: velocity tracking, upright torso, speed-adaptive joint regularization, and contact quality (foot clearance, slip, soft landings). No reference trajectories or gait patterns. Walking, running, and arm swing emerge purely from optimizing these simple objectives. Oh and training time? Just 1 hour.

64,613 Aufrufe • vor 7 Monaten

Booster recovery controller from last night. Sim design, training and deployment on hardware took < 1 day. With Qiayuan Liao

Booster recovery controller from last night. Sim design, training and deployment on hardware took < 1 day. With Qiayuan Liao

104,475 Aufrufe • vor 1 Jahr

Really excited to release mjviser, a web-based MuJoCo viewer, powered by Viser. It has almost all the features of the native MuJoCo viewer, but runs in your browser. Load and simulate any MuJoCo model with a single uv command 👇 uvx mjviser

Really excited to release mjviser, a web-based MuJoCo viewer, powered by Viser. It has almost all the features of the native MuJoCo viewer, but runs in your browser. Load and simulate any MuJoCo model with a single uv command 👇 uvx mjviser

22,279 Aufrufe • vor 2 Monaten

Of course mjlab supports the native MuJoCo viewer. Makes it a breeze to pause, slow down, inspect contacts, perturb the robot, etc. There's also a brand new pane for reward visualization :)

31,579 Aufrufe • vor 8 Monaten

New in mjlab from the amazing Takahiro Miki: 8 new terrains and a viser-based terrain visualizer 😎

New in mjlab from the amazing Takahiro Miki: 8 new terrains and a viser-based terrain visualizer 😎

16,505 Aufrufe • vor 3 Monaten

Meet mjlab. Powered by MuJoCo Warp. Drops Monday.

Meet mjlab. Powered by MuJoCo Warp. Drops Monday.

24,981 Aufrufe • vor 8 Monaten

Coming soon to mjlab and a long time in the making: RGB-D camera rendering! We can solve cube lifting with the YAM arm from 32×32 RGB frames in about <5 minutes of wall-clock time. Here's a clip showing emergent "search" behavior along with our upcoming viser visualization.

Coming soon to mjlab and a long time in the making: RGB-D camera rendering! We can solve cube lifting with the YAM arm from 32×32 RGB frames in about <5 minutes of wall-clock time. Here's a clip showing emergent "search" behavior along with our upcoming viser visualization.

18,183 Aufrufe • vor 6 Monaten

Ever wanted to simulate an entire house in MuJoCo or a very cluttered kitchen? Well now you can with the newly introduced sleeping islands: groups of stationary bodies that drop out of the physics pipeline until disturbed. Check out Yuval's amazing video and documentation 👇

Ever wanted to simulate an entire house in MuJoCo or a very cluttered kitchen? Well now you can with the newly introduced sleeping islands: groups of stationary bodies that drop out of the physics pipeline until disturbed. Check out Yuval's amazing video and documentation 👇

18,577 Aufrufe • vor 6 Monaten

Just finished implementing collision avoidance in the diff IK solver as extra constraints in the QP. Really happy with the final result 😀

Just finished implementing collision avoidance in the diff IK solver as extra constraints in the QP. Really happy with the final result 😀

41,956 Aufrufe • vor 1 Jahr

We've just added the Booster Robotics T1 Humanoid to MuJoCo Playground, with code to train a joystick controller as well as a deployable ONNX file. A super fun weekend with Carlo Sferrazza and Qiayuan Liao :)

We've just added the Booster Robotics T1 Humanoid to MuJoCo Playground, with code to train a joystick controller as well as a deployable ONNX file. A super fun weekend with Carlo Sferrazza and Qiayuan Liao :)

29,927 Aufrufe • vor 1 Jahr

Differential inverse kinematics controller on a Go1 quadruped regulating the pose of the root body and the position of the feet.

Differential inverse kinematics controller on a Go1 quadruped regulating the pose of the root body and the position of the feet.

38,549 Aufrufe • vor 1 Jahr

Center-of-mass regulation + feet/hands on the G1 humanoid.

Center-of-mass regulation + feet/hands on the G1 humanoid.

30,054 Aufrufe • vor 1 Jahr

1957 robot teleop

1957 robot teleop

34,296 Aufrufe • vor 2 Jahren

I've updated the tutorial MuJoCo controller library with 3 examples on 3 different robots:

I've updated the tutorial MuJoCo controller library with 3 examples on 3 different robots:

27,128 Aufrufe • vor 2 Jahren

Safe bimanual control on ALOHA, powered by mink. Here I'm specifying collision avoidance between 1) left and right arm, 2) each arm and the 80/20 extrusions and 3) each arm and the table. (yes laptop hiccuped a bit due to the sheer amount of collision computation, but I can optimize to remove collisions that can never occur 🙂)

Safe bimanual control on ALOHA, powered by mink. Here I'm specifying collision avoidance between 1) left and right arm, 2) each arm and the 80/20 extrusions and 3) each arm and the table. (yes laptop hiccuped a bit due to the sheer amount of collision computation, but I can optimize to remove collisions that can never occur 🙂)

15,355 Aufrufe • vor 1 Jahr

Keine weiteren Inhalte verfügbar