Loading video...

Video Failed to Load

Go Home

๐Ÿ† 1st place, Open Source Lenslist AR as an interface for robot navigation. Give move-to commands using hands or voice and the robot moves there autonomously. Works in a variety of environments and conditions. Stock firmware on the Unitree dog. Dimensional powers the entire navigation stack with dynamic pathing...

73,765 views โ€ข 2 months ago โ€ขvia X (Twitter)

56 Comments

Robert Scoble's profile picture
Robert Scoble2 months ago

@lenslist @UnitreeRobotics @dimensionalos This is why I say glasses and robots will eventually go together like peanut butter and jelly. So awesome! Will be at @dimensionalos tonight, will you be there?

Johannes Tscharn's profile picture
Johannes Tscharn2 months ago

@lenslist @UnitreeRobotics @dimensionalos Fully agree! I wish I was in SF, but say hi for me! ๐Ÿ™‚

Pasquale Dโ€™Silva's profile picture
Pasquale Dโ€™Silva2 months ago

@lenslist @UnitreeRobotics @dimensionalos would be rad to connect to @playbiscotti thanks for sharing source!

Johannes Tscharn's profile picture
Johannes Tscharn2 months ago

@lenslist @UnitreeRobotics @dimensionalos @playbiscotti For sure!

jamesckane's profile picture
jamesckane2 months ago

@lenslist @UnitreeRobotics @dimensionalos Probably the coolest SPECS app I've seen - congrats on the win! ๐Ÿ“ฃ

Johannes Tscharn's profile picture
Johannes Tscharn2 months ago

@lenslist @UnitreeRobotics @dimensionalos Canโ€™t wait to test it on the new specs when they come out, they have a wider FOV and better battery life afaik

John ๐Ÿ”ฎ๐ŸŒณ ๐ŸŒŽโ˜€๏ธ's profile picture
John ๐Ÿ”ฎ๐ŸŒณ ๐ŸŒŽโ˜€๏ธ2 months ago

@lenslist @UnitreeRobotics @dimensionalos Super cool! Thanks for proving out the hypothesis! XR and Robots are meant to go together

Johannes Tscharn's profile picture
Johannes Tscharn2 months ago

Great article and impressive body of work. Havenโ€™t come across a better formulation of what Iโ€™ve been thinking than this one here from the article: โ€œI see XR as able to break down the barriers of prior training and possible failures in the field, and instead working with robots becomes an enriching experience for both person and machine.โ€ Definitely going to watch the AWE talk when Iโ€™m home later - thanks for the reply! ๐Ÿ™‚

Steven Webster's profile picture
Steven Webster2 months ago

@lenslist @UnitreeRobotics @dimensionalos ๐Ÿ‘€@mehul โ€œI have an idea so cunning you could stick a tail on it and call it a fox.โ€

Shadnam Khan's profile picture
Shadnam Khan2 months ago

@lenslist @UnitreeRobotics @dimensionalos Cross modal, cross device shared maps FTW @multiset_ai

Johannes Tscharn's profile picture
Johannes Tscharn2 months ago

@lenslist @UnitreeRobotics @dimensionalos @multiset_ai More to come ๐Ÿ™‚

Harrison Kinsley's profile picture
Harrison Kinsley2 months ago

@lenslist @UnitreeRobotics @dimensionalos This is super cool! did you get the new specs already?

Johannes Tscharn's profile picture
Johannes Tscharn2 months ago

@lenslist @UnitreeRobotics @dimensionalos No not yet, but the release is soon and Iโ€™m going to run this immediately upon receiving them! ๐Ÿ™‚

Harrison Kinsley's profile picture
Harrison Kinsley2 months ago

@lenslist @UnitreeRobotics @dimensionalos cant wait to get them!

Rohan Rao's profile picture
Rohan Rao2 months ago

@lenslist @UnitreeRobotics @dimensionalos Super cool! I try to get my cat to follow me like this, but he never does ๐Ÿ˜‚๐Ÿ˜‚

Johannes Tscharn's profile picture
Johannes Tscharn2 months ago

@lenslist @UnitreeRobotics @dimensionalos Haha a man can try ๐Ÿ˜…๐Ÿ˜…๐Ÿ˜…

Morten Haulik แฏ…'s profile picture
Morten Haulik แฏ…2 months ago

@lenslist @UnitreeRobotics @dimensionalos Brilliantly made, as always! congrats

Johannes Tscharn's profile picture
Johannes Tscharn2 months ago

@lenslist @UnitreeRobotics @dimensionalos Thanks! To be honest, v2 is going to be quite a bit better!

Morten Haulik แฏ…'s profile picture
Morten Haulik แฏ…2 months ago

@lenslist @UnitreeRobotics @dimensionalos What a cliffhanger ; )

Johannes Tscharn's profile picture
Johannes Tscharn2 months ago

@lenslist @UnitreeRobotics @dimensionalos xD

Philippe Tremblay's profile picture
Philippe Tremblay2 months ago

@lenslist @UnitreeRobotics @dimensionalos this is going to be useful so you can see its intention before it tears you to pieces.

Johannes Tscharn's profile picture
Johannes Tscharn2 months ago

@lenslist @UnitreeRobotics @dimensionalos Anticipation is the greatest joy

๐•„๐”ธโ„๐•€๐•† ๐”ผ๐•Šโ„™๐•†๐•Š๐•€๐•‹๐•†'s profile picture
๐•„๐”ธโ„๐•€๐•† ๐”ผ๐•Šโ„™๐•†๐•Š๐•€๐•‹๐•†2 months ago

@lenslist @UnitreeRobotics @dimensionalos legend!!

Johannes Tscharn's profile picture
Johannes Tscharn2 months ago

@lenslist @UnitreeRobotics @dimensionalos Thank you!

Michael Wise's profile picture
Michael Wise2 months ago

@lenslist @UnitreeRobotics @dimensionalos @aelluswamy @Tesla longshot, but an idea for how to position cybercab parking using phone camera/AR.

Ajit Sadalagi's profile picture
Ajit Sadalagi2 months ago

@lenslist @UnitreeRobotics @dimensionalos Are there any US based robodogs capable of handling/using @specs ?

Johannes Tscharn's profile picture
Johannes Tscharn2 months ago

@lenslist @UnitreeRobotics @dimensionalos @specs Hmm you could probably adapt this to some of the smaller open source ones but it would be quite a bit of work and expensive

AiHowse's profile picture
AiHowse2 months ago

@lenslist @UnitreeRobotics @dimensionalos Been testing my model as well, working with the realwear glasses. Have you been coding this yourself?

Johannes Tscharn's profile picture
Johannes Tscharn2 months ago

@lenslist @UnitreeRobotics @dimensionalos Cool is that the pro version? And well Cursor/Claude wrote the code mostly

AiHowse's profile picture
AiHowse2 months ago

@lenslist @UnitreeRobotics @dimensionalos Go2-x and would be using grok super heavy, just got it a two weeks ago. About to start dropping my code layer on it after I get the additional computer add on kit

AiHowse's profile picture
AiHowse2 months ago

I just got the ally x to put on a mount system for the layer, brilliant idea throwing the vr googles on your platform. Go2 X --Cat6--> Ally X (ROS2 + SDK2) | Wi-Fi / VPN | Digital Chief laptop / \ RealWear HUD Meta Quest / OpenXR (yard, voice) (twin + point-and-go)

Pavlo Tkachenko's profile picture
Pavlo Tkachenko2 months ago

@Scobleizer @lenslist @UnitreeRobotics @dimensionalos Legendary! Congrats ๐Ÿ‘๐Ÿฅณ

Johannes Tscharn's profile picture
Johannes Tscharn2 months ago

@Scobleizer @lenslist @UnitreeRobotics @dimensionalos ๐Ÿซถ

AgroX's profile picture
AgroX2 months ago

@lenslist @UnitreeRobotics @dimensionalos very cool!

Johannes Tscharn's profile picture
Johannes Tscharn2 months ago

@lenslist @UnitreeRobotics @dimensionalos Glad to hear you like it! ๐Ÿซถ

Mourad's profile picture
Mourad2 months ago

@lenslist @UnitreeRobotics @dimensionalos Very cool!

Johannes Tscharn's profile picture
Johannes Tscharn2 months ago

@lenslist @UnitreeRobotics @dimensionalos Thank you! ๐Ÿ™

Oli Edis's profile picture
Oli Edis2 months ago

@lenslist @UnitreeRobotics @dimensionalos So cool, and great to see stuff being built on specs that isnโ€™t a game but has a wider real world application, shows the real potential. Congrats on the win my friend! ๐Ÿ‘๐Ÿป

Johannes Tscharn's profile picture
Johannes Tscharn2 months ago

@lenslist @UnitreeRobotics @dimensionalos Oli!!! There is definitely potential to use it for Physical AI in a lot of ways not explored yet

Oli Edis's profile picture
Oli Edis2 months ago

@lenslist @UnitreeRobotics @dimensionalos This is just the start!

Tulezao's profile picture
Tulezao2 months ago

@lenslist @UnitreeRobotics @dimensionalos so cool. Ccould you use this set up for drones? I guess you would need to replace the aruco tag with something else for drones?

Johannes Tscharn's profile picture
Johannes Tscharn2 months ago

@lenslist @UnitreeRobotics @dimensionalos If the movement data from the drone is reasonably accurate it would work with just an initial scan of the tag. Could also have some CV for detecting it in the air. What definitely works is doing this with manipulatorsโ€ฆ ๐Ÿ™‚

Tulezao's profile picture
Tulezao2 months ago

@lenslist @UnitreeRobotics @dimensionalos Aaaah I'll be waiting for that then ๐Ÿ˜‰

Johannes Tscharn's profile picture
Johannes Tscharn2 months ago

@lenslist @UnitreeRobotics @dimensionalos It may not be all that long ๐Ÿฆพ

ESchwaa's profile picture
ESchwaa2 months ago

@lenslist @UnitreeRobotics @dimensionalos Congrats on the win. This is an awesome interface.

Shaan's profile picture
Shaan2 months ago

@lenslist @UnitreeRobotics @dimensionalos AR as the primary UI for applications is going to be beautiful

Johannes Tscharn's profile picture
Johannes Tscharn2 months ago

@lenslist @UnitreeRobotics @dimensionalos Yes, tons of usecases for it

Tediddle's profile picture
Tediddle2 months ago

@lenslist @UnitreeRobotics @dimensionalos Brilliant! Can't wait to give it a try.

Shahvir Sarkary's profile picture
Shahvir Sarkary2 months ago

@lenslist @UnitreeRobotics @dimensionalos banger

Johannes Tscharn's profile picture
Johannes Tscharn2 months ago

@lenslist @UnitreeRobotics @dimensionalos ๐Ÿ”ฅ

Dredge's profile picture
Dredge2 months ago

@lenslist @UnitreeRobotics @dimensionalos Stock firmware = no G1 onboard nav, so VPS at 5m+ handles what the robot already can. Design choice?

Telixia's profile picture
Telixia2 months ago

@lenslist @UnitreeRobotics @dimensionalos Spatial AR overlays are the ultimate UI for field robotics. Pointing to raycast coordinates in physical space and letting local path planners compute the optimal route beats manual joystick teleoperation any day! @JohannesTscharn...Thanks for sharing

alexwang's profile picture
alexwang2 months ago

@lenslist @UnitreeRobotics @dimensionalos ๅพˆ้…ท

The Tech Buzz's profile picture
The Tech Buzz2 months ago

@lenslist @UnitreeRobotics @dimensionalos Innovative ... but looks stressful

lenne0816's profile picture
lenne08162 months ago

@lenslist @UnitreeRobotics @dimensionalos If this isnt considered magic i dont know what is.

Vijaykumar's profile picture
Vijaykumar2 months ago

@lenslist @UnitreeRobotics @dimensionalos Is it with Quest 3?

Related Videos