🤖Introducing 📺𝗢𝗽𝗲𝗻-𝗧𝗲𝗹𝗲𝗩𝗶𝘀𝗶𝗼𝗻: a web-based teleoperation software!  🌐Open source, cross-platform (VisionPro & Quest) with real-time stereo vision feedback.  🕹️Easy-to-use hand, wrist, head pose streaming. Code:

Project co-led by Jialong_Li @AaronYANG2000 @EpisodeYang @xiaolonw

cool work! Was wondering did you guys ever find a way to stream the simulation video to the headset? Or is controlling in sim done by looking through the headset at a display?

Yes, as long as you can extract frames from your live video, it does not matter if it is sim or real.

Congrats & excited to see your next steps!

Thanks Toru!

Great work! I especially like that the camera is controllable, something which hasn't been explored much in my opinion -- I wonder if you noticed it to cause any motion sickness to the users?

From my personal perspective, there is some jittering due to network bandwidth but totally ok to me. This can be further improved in future versions, by adding vignetting effect for example.

Is that a Unitree H1 with a wrist and gripper 👀👀👀

Through in kinect for lolz

@DaniDpx