started building an AR interface for the Dobot Robotics Rover X1 in Godot Engine, running on a Quest 3 still very early but this is already way too fun

@DobotRobotics @godotengine Awesome! Working on something like this for WebXR at the moment. How are you handling the initial alignment?

@DobotRobotics @godotengine ty! I took photos of the logo on the back and the X1 logo on the front, tracking both gives me position + orientation. then I adjust the floor manually since the quest floor calc sometimes comes out wrong in godot for some reason. ooh webxr, link me when its up

Interesting approach to directly track features on the robot so you don’t need to add a marker. The issue I found was that drift can only be corrected with the robot/marker in view. Experimenting with VPS (requiring pre-scanning the room) and some VIO based drift correction atm… it’s a really fun problem to work on imo

@DobotRobotics @godotengine Crazy!

@DobotRobotics @godotengine can you give the rover a destination by pointing at a spot in the room

@DobotRobotics @godotengine yes indeed! I'm currently working on controlling the rover using different hand gestures, but I'm trying to find the most natural and comfortable one

@DobotRobotics @godotengine Is the scene running on the Quest or streaming from the rover, and how much does the AR overlay drift when you move?

@DobotRobotics @godotengine all native on the quest 3, rover just streams state back, link sits around 8-20ms. drift is worst while it walks, working on that next!!

@DobotRobotics @godotengine Pretty dope! Here and I thought my app was neat. This actually controls real things lol

@DobotRobotics @godotengine This look really fun, cant wait to see the final result

@DobotRobotics @godotengine ty, more soon!

@DobotRobotics @godotengine This is sick!!

@DobotRobotics @godotengine thanks!!

@DobotRobotics @godotengine I didn’t even know about godot engine until now. Have you messed with touch designer?

@DobotRobotics @godotengine not yet but I would love to!

@Azadux @DobotRobotics @godotengine Really awesome. Maybe see if you can use the controller to calibrate the servo positions.

@Azadux @DobotRobotics @godotengine good idea, I'm focusing on hands for now cause of the ongoing meta event but def trying that after

@DobotRobotics @godotengine Fun! I’d spend way too long making obstacle courses for this 😂

@DobotRobotics @godotengine thats exactly what im currently planning to implement with gaussian splats!!

@DobotRobotics @godotengine Oh nice! So the robot would be navigating around virtual obstacles?

@DobotRobotics @godotengine That’s awesome

@DobotRobotics @godotengine SIGS FTW

@DobotRobotics @godotengine Nice stuff! Long been bullish on XR for robotics

@DobotRobotics @godotengine wow you’ve been on this since 2019, the past/present/future states bit is exactly it, my goto ray is the future state and the leg colors are live leg load. the ghost spot on the stairs with the path line is so close to mine, ever run it on a real one??

@DobotRobotics @godotengine Only ever done the arm for real rest was design only (those quad dogs weren’t as available back then haha) I’d love to try your demo. And if you start turning this into a company, hit me up ;)

@DobotRobotics @godotengine Love the UX design. Drift seems higher than I would have expected. What are some of the challenges you're having with that? I've been working with a Vision Pro and a small Vector bot, and I found a few ways to tighten up overlay drift.

@DobotRobotics @godotengine ty! drift is worst while it’s walking, the ghost lags the real body. leg odometry slip is my main suspect rn. what tightened it up for u on the vector?

I run a script for the overlay to position it and orientate it prior to movement which helps. I still get drift but not too bass in using Vision Pro so sensors seem to track well and it’s not moving nearly as fast as yours. Looking to upgrade next year to something bigger but will use the Apple api for tracking that they out out and try to build a few trackers which should kick it down pretty tight.

@DobotRobotics @godotengine Well damn son..

@DobotRobotics @godotengine Excellent work, and it's great to see this in Godot Engine ... it's very underrated for VR/AR and the like.