Kevin Zakka's banner

Kevin Zakka

@kevin_zakka • 19,005 subscribers

phding @Berkeley_AI

Shorts

Booster recovery controller from last night. Sim design, training and deployment on hardware took < 1 day. With Qiayuan Liao

Booster recovery controller from last night. Sim design, training and deployment on hardware took < 1 day. With Qiayuan Liao

104,613 просмотров

Ported over the getup tasks from playground to mjlab for my thesis defense. Will make them available in a separate repo so others can repro and build on top in the coming weeks.

Ported over the getup tasks from playground to mjlab for my thesis defense. Will make them available in a separate repo so others can repro and build on top in the coming weeks.

24,836 просмотров

Proprioception only

Proprioception only

45,574 просмотров

Happy Monday! We just added raycast sensors to mjlab. They let a robot sample the scene with virtual rays, returning distances and surface geometry. Rays can use orthographic projection for terrain scanning or perspective projection for simulating a depth camera.

Happy Monday! We just added raycast sensors to mjlab. They let a robot sample the scene with virtual rays, returning distances and surface geometry. Rays can use orthographic projection for terrain scanning or perspective projection for simulating a depth camera.

19,965 просмотров

A lot of people have been asking so I made a repo to show how easy it is to setup a custom robot in mjlab. You don't need to clone and copy your robot into mjlab!

A lot of people have been asking so I made a repo to show how easy it is to setup a custom robot in mjlab. You don't need to clone and copy your robot into mjlab!

16,511 просмотров

MuJoCo 3.0 is out and it comes packed with amazing new features: TPU/GPU acceleration, non-convex geometries and deformable bodies!

MuJoCo 3.0 is out and it comes packed with amazing new features: TPU/GPU acceleration, non-convex geometries and deformable bodies!

56,953 просмотров

Demo starting in 10 minutes, come witness the magic of open-source sim2real!

Demo starting in 10 minutes, come witness the magic of open-source sim2real!

20,992 просмотров

MuJoCo 3.1.6 has just been released! MJX now comes with out-of-the-box support for height fields. Check out this joystick policy that Baruch Tabanpour trained (~2M steps per second on an A100). Colab to reproduce:

MuJoCo 3.1.6 has just been released! MJX now comes with out-of-the-box support for height fields. Check out this joystick policy that Baruch Tabanpour trained (~2M steps per second on an A100). Colab to reproduce:

30,916 просмотров

mink 1.0.0 is out! You can now enforce tasks as strict QP equalities. One neat application is "locking" certain DoFs. In this example, joints 1 & 2 of the Panda are locked when the cube is red and then unlocked when it turns green.

mink 1.0.0 is out! You can now enforce tasks as strict QP equalities. One neat application is "locking" certain DoFs. In this example, joints 1 & 2 of the Panda are locked when the cube is red and then unlocked when it turns green.

10,104 просмотров

Just released a MuJoCo implementation of end-effector control with differential inverse kinematics. It's blazing fast, super readable, has 0 external dependencies and best of all, it's just a few lines of code:

Just released a MuJoCo implementation of end-effector control with differential inverse kinematics. It's blazing fast, super readable, has 0 external dependencies and best of all, it's just a few lines of code:

26,427 просмотров

Just added an example of how to implement a simple gaze tracking task on the Apptronik robot in mink:

Just added an example of how to implement a simple gaze tracking task on the Apptronik robot in mink:

15,707 просмотров

Videos

Anya Rossi

sweetdream.ai

SweetDream.ai•Sponsored•Livecam

Watch Anya Live

Anya is streaming live right now! Join her private show and enjoy exclusive content.

Exclusive private shows

1.2k viewers online

Private Show

Join now for exclusive access

Free preview available • Premium content

IK alone can take you pretty far. I put together a really cute demo to demonstrate this. Watch this Panda robot CNC engrave the MuJoCo logo into a curved dome using mink.

25,024 просмотров • 28 дней назад

20 years ago

20 years ago

335,213 просмотров • 1 год назад

I'm super excited to announce mjlab today! mjlab = Isaac Lab's APIs + best-in-class MuJoCo physics + massively parallel GPU acceleration Built directly on MuJoCo Warp with the abstractions you love.

I'm super excited to announce mjlab today! mjlab = Isaac Lab's APIs + best-in-class MuJoCo physics + massively parallel GPU acceleration Built directly on MuJoCo Warp with the abstractions you love.

91,948 просмотров • 9 месяцев назад

The ultimate test of any physics simulator is its ability to deliver real-world results. With MuJoCo Playground, we’ve combined the very best: MuJoCo’s rich and thriving ecosystem, massively parallel GPU-accelerated simulation, and real-world results across a diverse range of robot platforms: quadrupeds, humanoids, dexterous hands, and arms. Best of all? You can get started today with a single command: pip install playground

The ultimate test of any physics simulator is its ability to deliver real-world results. With MuJoCo Playground, we’ve combined the very best: MuJoCo’s rich and thriving ecosystem, massively parallel GPU-accelerated simulation, and real-world results across a diverse range of robot platforms: quadrupeds, humanoids, dexterous hands, and arms. Best of all? You can get started today with a single command: pip install playground

153,699 просмотров • 1 год назад

Introducing 𝗥𝗼𝗯𝗼𝗣𝗶𝗮𝗻𝗶𝘀𝘁 🎹🤖, a new benchmark for high-dimensional robot control! Solving it requires mastering the piano with two anthropomorphic hands. This has been one year in the making, and I couldn’t be happier to release it today! Some highlights below:

Introducing 𝗥𝗼𝗯𝗼𝗣𝗶𝗮𝗻𝗶𝘀𝘁 🎹🤖, a new benchmark for high-dimensional robot control! Solving it requires mastering the piano with two anthropomorphic hands. This has been one year in the making, and I couldn’t be happier to release it today! Some highlights below:

259,974 просмотров • 3 лет назад

Coming to mjlab today! This is vanilla RL, no motion imitation/AMP. Natural gaits emerge from minimal rewards: velocity tracking, upright torso, speed-adaptive joint regularization, and contact quality (foot clearance, slip, soft landings). No reference trajectories or gait patterns. Walking, running, and arm swing emerge purely from optimizing these simple objectives. Oh and training time? Just 1 hour.

Coming to mjlab today! This is vanilla RL, no motion imitation/AMP. Natural gaits emerge from minimal rewards: velocity tracking, upright torso, speed-adaptive joint regularization, and contact quality (foot clearance, slip, soft landings). No reference trajectories or gait patterns. Walking, running, and arm swing emerge purely from optimizing these simple objectives. Oh and training time? Just 1 hour.

64,701 просмотров • 8 месяцев назад

Booster recovery controller from last night. Sim design, training and deployment on hardware took < 1 day. With Qiayuan Liao

Booster recovery controller from last night. Sim design, training and deployment on hardware took < 1 day. With Qiayuan Liao

104,613 просмотров • 1 год назад

I trained a grasping policy on objects of various shapes and sizes using the new mjlab feature and this really cool pivot grasp strategy emerges for large flat objects that are larger than the gripper aperture. So cool and beautiful to see!

I trained a grasping policy on objects of various shapes and sizes using the new mjlab feature and this really cool pivot grasp strategy emerges for large flat objects that are larger than the gripper aperture. So cool and beautiful to see!

20,458 просмотров • 2 месяцев назад

Really excited to release mjviser, a web-based MuJoCo viewer, powered by Viser. It has almost all the features of the native MuJoCo viewer, but runs in your browser. Load and simulate any MuJoCo model with a single uv command 👇 uvx mjviser

Really excited to release mjviser, a web-based MuJoCo viewer, powered by Viser. It has almost all the features of the native MuJoCo viewer, but runs in your browser. Load and simulate any MuJoCo model with a single uv command 👇 uvx mjviser

22,609 просмотров • 3 месяцев назад

Of course mjlab supports the native MuJoCo viewer. Makes it a breeze to pause, slow down, inspect contacts, perturb the robot, etc. There's also a brand new pane for reward visualization :)

32,318 просмотров • 9 месяцев назад

New in mjlab from the amazing Takahiro Miki: 8 new terrains and a viser-based terrain visualizer 😎

New in mjlab from the amazing Takahiro Miki: 8 new terrains and a viser-based terrain visualizer 😎

16,815 просмотров • 5 месяцев назад

Meet mjlab. Powered by MuJoCo Warp. Drops Monday.

Meet mjlab. Powered by MuJoCo Warp. Drops Monday.

25,017 просмотров • 9 месяцев назад

Coming soon to mjlab and a long time in the making: RGB-D camera rendering! We can solve cube lifting with the YAM arm from 32×32 RGB frames in about <5 minutes of wall-clock time. Here's a clip showing emergent "search" behavior along with our upcoming viser visualization.

Coming soon to mjlab and a long time in the making: RGB-D camera rendering! We can solve cube lifting with the YAM arm from 32×32 RGB frames in about <5 minutes of wall-clock time. Here's a clip showing emergent "search" behavior along with our upcoming viser visualization.

18,226 просмотров • 7 месяцев назад

Just finished implementing collision avoidance in the diff IK solver as extra constraints in the QP. Really happy with the final result 😀

Just finished implementing collision avoidance in the diff IK solver as extra constraints in the QP. Really happy with the final result 😀

41,968 просмотров • 2 лет назад

Ever wanted to simulate an entire house in MuJoCo or a very cluttered kitchen? Well now you can with the newly introduced sleeping islands: groups of stationary bodies that drop out of the physics pipeline until disturbed. Check out Yuval's amazing video and documentation 👇

Ever wanted to simulate an entire house in MuJoCo or a very cluttered kitchen? Well now you can with the newly introduced sleeping islands: groups of stationary bodies that drop out of the physics pipeline until disturbed. Check out Yuval's amazing video and documentation 👇

18,684 просмотров • 8 месяцев назад

The mink (MuJoCo inverse kinematics) doc revamp is finally live featuring a brand new tutorial section that starts from a minimal IK loop, shows exactly how and why it breaks (singularities, nullspace drift, etc.), and builds up to a robust formulation.

10,127 просмотров • 3 месяцев назад

Differential inverse kinematics controller on a Go1 quadruped regulating the pose of the root body and the position of the feet.

Differential inverse kinematics controller on a Go1 quadruped regulating the pose of the root body and the position of the feet.

38,567 просмотров • 2 лет назад

We've just added the Booster Robotics T1 Humanoid to MuJoCo Playground, with code to train a joystick controller as well as a deployable ONNX file. A super fun weekend with Carlo Sferrazza and Qiayuan Liao :)

We've just added the Booster Robotics T1 Humanoid to MuJoCo Playground, with code to train a joystick controller as well as a deployable ONNX file. A super fun weekend with Carlo Sferrazza and Qiayuan Liao :)

29,927 просмотров • 1 год назад

Center-of-mass regulation + feet/hands on the G1 humanoid.

Center-of-mass regulation + feet/hands on the G1 humanoid.

30,059 просмотров • 2 лет назад

1957 robot teleop

1957 robot teleop

34,312 просмотров • 3 лет назад