Yu Xiang's banner

Yu Xiang

@YuXiang_IRVL • 6,845 subscribers

I do research in robotics and computer vision @IRVLUTD, Ex- research scientist @NVIDIA, postdoc @uwcse and @StanfordAILab, phd @UMich, all views my own.

Shorts

Temporal and spatial alignment between glove and camera data. It is not an easy task, but it’s coming together. Human data for robots. #Robotics

Temporal and spatial alignment between glove and camera data. It is not an easy task, but it’s coming together. Human data for robots. #Robotics

50,151 просмотров

Left: raw depth from the OAK-D Pro W camera Right: depth from FoundationStereo

Left: raw depth from the OAK-D Pro W camera Right: depth from FoundationStereo

32,598 просмотров

If you are interested in ego-centric data capture, no need to get a headset or smart glasses. Get a $10 head strap mount and put one of these cameras on it. You get RGB, stereo, depth, 3D point clouds, and camera trajectory. Visualization powered by Rerun. Pretty cool!

If you are interested in ego-centric data capture, no need to get a headset or smart glasses. Get a $10 head strap mount and put one of these cameras on it. You get RGB, stereo, depth, 3D point clouds, and camera trajectory. Visualization powered by Rerun. Pretty cool!

30,015 просмотров

Occlusion is still a challenge for SAM2. Video object segmentation is not solved yet

Occlusion is still a challenge for SAM2. Video object segmentation is not solved yet

53,676 просмотров

Excited to share that we contributed our SceneReplica work into ManipulationNet as a task for Grasping in Clutter! ManipulationNet is a community effort for benchmarking in robotics. Evaluate your grasping algorithms or policies here:

Excited to share that we contributed our SceneReplica work into ManipulationNet as a task for Grasping in Clutter! ManipulationNet is a community effort for benchmarking in robotics. Evaluate your grasping algorithms or policies here:

18,972 просмотров

🤖Why is robot manipulation still an open challenge? This video shows a kitting task -- packing multiple items into a single product. No robot today can do this autonomously. Big challenges = big opportunities for research and industry. #robotics #manipulation #automation

🤖Why is robot manipulation still an open challenge? This video shows a kitting task -- packing multiple items into a single product. No robot today can do this autonomously. Big challenges = big opportunities for research and industry. #robotics #manipulation #automation

21,236 просмотров

Videos

Anya Rossi

sweetdream.ai

SweetDream.ai•Sponsored•Livecam

Watch Anya Live

Anya is streaming live right now! Join her private show and enjoy exclusive content.

Exclusive private shows

1.2k viewers online

Private Show

Join now for exclusive access

Free preview available • Premium content

12 SO-101 robot arms for my robotics class 🤖 Last year, students built their SO-101s from scratch. This year, with help from our TA Qifan Zhang, we handed out 12 pre-built arms so they can jump straight into arm calibration! More time for robots!

12 SO-101 robot arms for my robotics class 🤖 Last year, students built their SO-101s from scratch. This year, with help from our TA Qifan Zhang, we handed out 12 pre-built arms so they can jump straight into arm calibration! More time for robots!

22,592 просмотров • 8 дней назад

Successfully running Ultralytics YOLOv8 on a Jetson Nano with an IMX219 camera. Real-time vision on the edge.

Successfully running Ultralytics YOLOv8 on a Jetson Nano with an IMX219 camera. Real-time vision on the edge.

193,979 просмотров • 8 месяцев назад

Our students are presenting their robotics projects this week! I’ll be sharing some of the coolest ones over the next few days. The first one is a dancing SO-101😄Turn on your volume, there’s music! #Robotics

Our students are presenting their robotics projects this week! I’ll be sharing some of the coolest ones over the next few days. The first one is a dancing SO-101😄Turn on your volume, there’s music! #Robotics

109,171 просмотров • 9 месяцев назад

If you’re considering a stereo camera for Jetson, I tested a ZED Mini Stereo camera. It’s about $400 (vs. $250 for Jetson Orin Nano), and Stereolabs says current lead time is 6 weeks. I ended up ordering from a third-party seller.

If you’re considering a stereo camera for Jetson, I tested a ZED Mini Stereo camera. It’s about $400 (vs. $250 for Jetson Orin Nano), and Stereolabs says current lead time is 6 weeks. I ended up ordering from a third-party seller.

93,321 просмотров • 8 месяцев назад

Handed out 21 NVIDIA Jetson Orin Nano kits to students today. I did not realize downloading the JetPack 6.2 image would take so long. Most of the time was spent just downloading or copying the image file😅Only a few teams managed to get the system set up today.

Handed out 21 NVIDIA Jetson Orin Nano kits to students today. I did not realize downloading the JetPack 6.2 image would take so long. Most of the time was spent just downloading or copying the image file😅Only a few teams managed to get the system set up today.

80,153 просмотров • 7 месяцев назад

I am really impressed by how easy Spectacular AI makes visual-inertial odometry with an OAK camera. Just "pip install spectacularAI" and run a Python script. Running VIO/SLAM used to be much harder in my opinion.

I am really impressed by how easy Spectacular AI makes visual-inertial odometry with an OAK camera. Just "pip install spectacularAI" and run a Python script. Running VIO/SLAM used to be much harder in my opinion.

70,785 просмотров • 8 месяцев назад

We (Luis Felipe Casas and I) handed out 21 NVIDIA #Jetson Orin Nano kits to students in my computer vision class this semester. All teams showcased their live Jetson-powered demos in the classroom at the end of the course! Here are a few sample projects👇 1. Hand gesture for control

We (Luis Felipe Casas and I) handed out 21 NVIDIA #Jetson Orin Nano kits to students in my computer vision class this semester. All teams showcased their live Jetson-powered demos in the classroom at the end of the course! Here are a few sample projects👇 1. Hand gesture for control

29,338 просмотров • 4 месяцев назад

From egocentric glove data to a MANO hand model, replayed in Rerun.

From egocentric glove data to a MANO hand model, replayed in Rerun.

41,223 просмотров • 8 месяцев назад

We noticed that DINOv3 was surprisingly strong at matching object features. This inspired L2G (Local Matches to Global Masks). With a few reference images, a robot can search a room for the target object. 🔗 Project: 💻 Code:

We noticed that DINOv3 was surprisingly strong at matching object features. This inspired L2G (Local Matches to Global Masks). With a few reference images, a robot can search a room for the target object. 🔗 Project: 💻 Code:

29,962 просмотров • 6 месяцев назад

Among the policies we evaluated so far (ACT, DiT, SmolVLA, pi0, pi0.5), fine-tuned pi0.5 achieves the best performance on VLA-REPLICA. The trend is consistent with recent simulation benchmarks such as RoboLab. The policy behaviors in the real world:

Among the policies we evaluated so far (ACT, DiT, SmolVLA, pi0, pi0.5), fine-tuned pi0.5 achieves the best performance on VLA-REPLICA. The trend is consistent with recent simulation benchmarks such as RoboLab. The policy behaviors in the real world:

19,066 просмотров • 3 месяцев назад

Introducing HO-Cap: A Capture System and Dataset for 3D Reconstruction and Pose Tracking of Hand-Object Interaction. We built a multi-camera system and a semi-automatic method for annotating the shape and pose of hands and objects Project page:

Introducing HO-Cap: A Capture System and Dataset for 3D Reconstruction and Pose Tracking of Hand-Object Interaction. We built a multi-camera system and a semi-automatic method for annotating the shape and pose of hands and objects Project page:

57,468 просмотров • 1 год назад

Big day in class today! With Luis Felipe Casas, we brought 14 SO-101 arms for students to assemble and take home for projects UT Dallas. Excited to see what they create by semester’s end! 🤖

Big day in class today! With Luis Felipe Casas, we brought 14 SO-101 arms for students to assemble and take home for projects UT Dallas. Excited to see what they create by semester’s end! 🤖

32,917 просмотров • 1 год назад

I was preparing a video to introduce our lab Intelligent Robotics and Vision Lab @ UTDallas for a meeting. Happy to share the video here! We are looking forward to collaborating with both academia and industry. Please feel free to reach out

I was preparing a video to introduce our lab Intelligent Robotics and Vision Lab @ UTDallas for a meeting. Happy to share the video here! We are looking forward to collaborating with both academia and industry. Please feel free to reach out

40,334 просмотров • 1 год назад

We can replay the HO-Cap data in #IsaacSim No physics enabled. It is setting the poses of hands and objects according to our annotations

We can replay the HO-Cap data in #IsaacSim No physics enabled. It is setting the poses of hands and objects according to our annotations

41,711 просмотров • 1 год назад

We Luis Felipe Casas have successfully deployed an in-hand manipulation policy to the LEAP hand following RL training in MuJoCo Playground. Sim-to-real isn’t as straightforward as it seems. Policy design and real-world tuning matter. Working on improving the policy further.

We Luis Felipe Casas have successfully deployed an in-hand manipulation policy to the LEAP hand following RL training in MuJoCo Playground. Sim-to-real isn’t as straightforward as it seems. Policy design and real-world tuning matter. Working on improving the policy further.

11,123 просмотров • 5 месяцев назад

Больше нет контента для загрузки