Johannes Tscharn's banner

Johannes Tscharn

@JohannesTscharn • 2,849 subscribers

Technical Lead (games) @LEGO_group Also building AR & Physical AI

Shorts

This replaces scrolling for me now 😅 Had to take one of those little devices for a spin after seeing them everywhere recently. Opus 5 wrote the renderer and sim in C to get the most out of the ESP32 S3. Will do something that leverages mic + speaker next…

This replaces scrolling for me now 😅 Had to take one of those little devices for a spin after seeing them everywhere recently. Opus 5 wrote the renderer and sim in C to get the most out of the ESP32 S3. Will do something that leverages mic + speaker next…

767,007 Aufrufe

As someone coming from gamedev, something as simple as planning and executing motion on the arm to this day gives me a feeling of wonder. It’s essentially just an IK solver from which the joint angles are computed and then applied to the motors. Nothing new. But it moves physically! (robotics people may now laugh at me haha)

As someone coming from gamedev, something as simple as planning and executing motion on the arm to this day gives me a feeling of wonder. It’s essentially just an IK solver from which the joint angles are computed and then applied to the motors. Nothing new. But it moves physically! (robotics people may now laugh at me haha)

16,716 Aufrufe

Object detection on 3D Gaussian Splats. Accurate bounding boxes per detection, runs locally. Nigel Hartman ᯅ really cooked here SensAI Hackademy is hosting a lecture with Ian Curtis from World Labs on the 8th on this:

Object detection on 3D Gaussian Splats. Accurate bounding boxes per detection, runs locally. Nigel Hartman ᯅ really cooked here SensAI Hackademy is hosting a lecture with Ian Curtis from World Labs on the 8th on this:

36,361 Aufrufe

AR and Robotics is such an amazing combination The video doesn’t do it justice but interacting natively in 3D space is intuitive and feels natural This is @Spectacles driving a Reachy Mini from Hugging Face and Pollen Robotics Thanks again to SensAI Hackademy 🙂

AR and Robotics is such an amazing combination The video doesn’t do it justice but interacting natively in 3D space is intuitive and feels natural This is @Spectacles driving a Reachy Mini from Hugging Face and Pollen Robotics Thanks again to SensAI Hackademy 🙂

54,715 Aufrufe

Giving a Unitree Go2 move-to commands in AR using Dimensional and @Spectacles Still need to improve the stability and overall UX, but the base tech works now: - DimOS for the robot controls via WebRTC - Websocket for communication with the glasses

Giving a Unitree Go2 move-to commands in AR using Dimensional and @Spectacles Still need to improve the stability and overall UX, but the base tech works now: - DimOS for the robot controls via WebRTC - Websocket for communication with the glasses

19,907 Aufrufe

Videos

Anya Rossi

sweetdream.ai

SweetDream.ai•Sponsored•Livecam

Watch Anya Live

Anya is streaming live right now! Join her private show and enjoy exclusive content.

Exclusive private shows

1.2k viewers online

Private Show

Join now for exclusive access

Free preview available • Premium content

Augmented Reality is the natural interface for robotics. Not only for giving commands, but also to visualise hardware data (like LiDAR) natively in 3D. SPECS AR glasses, Unitree Go2 Lite quadruped, Dimensional OS for the robot

Augmented Reality is the natural interface for robotics. Not only for giving commands, but also to visualise hardware data (like LiDAR) natively in 3D. SPECS AR glasses, Unitree Go2 Lite quadruped, Dimensional OS for the robot

Johannes Tscharn

398,409 Aufrufe • vor 2 Monaten

🏆 1st place, Open Source Lenslist AR as an interface for robot navigation. Give move-to commands using hands or voice and the robot moves there autonomously. Works in a variety of environments and conditions. Stock firmware on the Unitree dog. Dimensional powers the entire navigation stack with dynamic pathing and LiDAR streaming. UI and interactions on SPECS AR Glasses. I’m already working on v2.0 with VPS support (MultiSet AI) to reduce drift on longer distances (>5m) and cleaner DimOS integration. Gotta say, making this is a bit of a rollercoaster as it’s genuinely hard but also I just want it to exist and seeing it work is the most cool and rewarding thing ever. Repo:

🏆 1st place, Open Source Lenslist AR as an interface for robot navigation. Give move-to commands using hands or voice and the robot moves there autonomously. Works in a variety of environments and conditions. Stock firmware on the Unitree dog. Dimensional powers the entire navigation stack with dynamic pathing and LiDAR streaming. UI and interactions on SPECS AR Glasses. I’m already working on v2.0 with VPS support (MultiSet AI) to reduce drift on longer distances (>5m) and cleaner DimOS integration. Gotta say, making this is a bit of a rollercoaster as it’s genuinely hard but also I just want it to exist and seeing it work is the most cool and rewarding thing ever. Repo:

Johannes Tscharn

73,765 Aufrufe • vor 1 Monat

I’m giving an agent control over Reachy Mini from Hugging Face and letting it understand and share spatial data via Specs for Devs AR is the human interface for robotics and physical AI imo. It feels like absolute magic to interact with this, both in voice/agent and “puppeteering” mode. I’ll probably work on AR for either an arm (manipulation tasks) or some sort of drone (locomotion in 3D space) next… Project is fully open source btw: Thank you SensAI Hackademy for sending me the robot!

I’m giving an agent control over Reachy Mini from Hugging Face and letting it understand and share spatial data via Specs for Devs AR is the human interface for robotics and physical AI imo. It feels like absolute magic to interact with this, both in voice/agent and “puppeteering” mode. I’ll probably work on AR for either an arm (manipulation tasks) or some sort of drone (locomotion in 3D space) next… Project is fully open source btw: Thank you SensAI Hackademy for sending me the robot!

Johannes Tscharn

35,775 Aufrufe • vor 7 Monaten

The main issue with World Labs is that the worlds are empty, nothing to do there. The idea for our latest hackaton project is to detect objects in the players FOV and spawn interactables dynamically. Here, we use it to learn a foreign language in VR.

The main issue with World Labs is that the worlds are empty, nothing to do there. The idea for our latest hackaton project is to detect objects in the players FOV and spawn interactables dynamically. Here, we use it to learn a foreign language in VR.

Johannes Tscharn

24,951 Aufrufe • vor 10 Monaten

Reachy Mini x Spectacles won first place in the Open Source category at the Spectacles Community Challenge from Lenslist! Thank you @Spectacles for the awesome glasses and SensAI Hackademy for the awesome robot (by Hugging Face & Pollen Robotics)

Reachy Mini x Spectacles won first place in the Open Source category at the Spectacles Community Challenge from Lenslist! Thank you @Spectacles for the awesome glasses and SensAI Hackademy for the awesome robot (by Hugging Face & Pollen Robotics)

Johannes Tscharn

16,913 Aufrufe • vor 6 Monaten

Keine weiteren Inhalte verfügbar