Skip navigation
๏ฟผ ๐Ÿค–Introducing ๐Ÿ“บ๐—ข๐—ฝ๐—ฒ๐—ป-๐—ง๐—ฒ๐—น๐—ฒ๐—ฉ๐—ถ๐˜€๐—ถ๐—ผ๐—ป: a web-based teleoperation software!
0:00 / 1:14

๏ฟผ ๐Ÿค–Introducing ๐Ÿ“บ๐—ข๐—ฝ๐—ฒ๐—ป-๐—ง๐—ฒ๐—น๐—ฒ๐—ฉ๐—ถ๐˜€๐—ถ๐—ผ๐—ป: a web-based teleoperation software!

Xuxin Cheng

@xuxin_cheng4.6K followers

Visit on X
373 likesDownloadOriginal post

128,885 views

๏ฟผ ๐Ÿค–Introducing ๐Ÿ“บ๐—ข๐—ฝ๐—ฒ๐—ป-๐—ง๐—ฒ๐—น๐—ฒ๐—ฉ๐—ถ๐˜€๐—ถ๐—ผ๐—ป: a web-based teleoperation software! ๏ฟผ ๐ŸŒOpen source, cross-platform (VisionPro & Quest) with real-time stereo vision feedback. ๏ฟผ ๐Ÿ•น๏ธEasy-to-use hand, wrist, head pose streaming. Code:

10 Comments

Comments from the original post on X (Twitter)

  • Xuxin Cheng's profile picture

    @xuxin_cheng

    Project co-led by Jialong_Li @AaronYANG2000 @EpisodeYang @xiaolonw

    5 likes

  • Stone Tao's profile picture

    @Stone_Tao

    cool work! Was wondering did you guys ever find a way to stream the simulation video to the headset? Or is controlling in sim done by looking through the headset at a display?

    2 likes

  • Xuxin Cheng's profile picture

    @xuxin_cheng

    Yes, as long as you can extract frames from your live video, it does not matter if it is sim or real.

    2 likes

  • Toru's profile picture

    @ToruO_O

    Congrats & excited to see your next steps!

    2 likes

  • Xuxin Cheng's profile picture

    @xuxin_cheng

    Thanks Toru!

    2 likes

  • Shivin Dass's profile picture

    @ShivinDass

    Great work! I especially like that the camera is controllable, something which hasn't been explored much in my opinion -- I wonder if you noticed it to cause any motion sickness to the users?

    2 likes

  • Xuxin Cheng's profile picture

    @xuxin_cheng

    From my personal perspective, there is some jittering due to network bandwidth but totally ok to me. This can be further improved in future versions, by adding vignetting effect for example.

    2 likes

  • Nathan Peterman's profile picture

    @NathanTylerP

    Is that a Unitree H1 with a wrist and gripper ๐Ÿ‘€๐Ÿ‘€๐Ÿ‘€

    1 like

  • Carlos GO VOTE! ๐Ÿ‡บ๐Ÿ‡ธ๐Ÿฆ…'s profile picture

    @fesshaye

    Through in kinect for lolz

    1 like

  • Abdoulaye Diack ๐Ÿฆ‹. Migrating to the butterfly app's profile picture

    @A__Diack

    @DaniDpx

    1 like