Loading video...

Video Failed to Load

There was a problem loading this video. This could be due to a temporary network issue or the video might be unavailable.

Train a TensorFlow object detection model – then deploy it on a robot 🤖 Iulia Feroli (Iulia Feroli) shows how to turn a notebook into a real-time object detection app. This tutorial works for any project – though we demonstrate the deployment on (and assisted by!) the #ReachyMini, an... show more

PyCharm, a JetBrains IDE

71,495 subscribers

34,908 views • 2 months ago •via X (Twitter)

Anya Rossi• Live Now

Private livecam show

0 Comments

No comments available

Comments from the original post will appear here

Related Videos

Yeah! Teleoperation on low-cost robot arm from Tau Robotics working natively at 200Hz with and a very simple code. We are working a video tutorial to make it easy for anyone to reproduce our setup (in simulation or with a real robot). Stay tuned 😋

Yeah! Teleoperation on low-cost robot arm from Tau Robotics working natively at 200Hz with and a very simple code. We are working a video tutorial to make it easy for anyone to reproduce our setup (in simulation or with a real robot). Stay tuned 😋

Remi Cadene

31,486 views • 2 years ago

NVIDIA finally released Neuralangelo's source code! The model can turn videos from any device into detailed 3D structures, fully replicating buildings, sculptures, or other real aworld objects or spaces virtually. Here's how it works: A model utilizes a 2D video with multiple angles of an object or scene. I selects frames from different viewpoints to understand depth, size, and shape. The AI creates an initial 3D representation, similar to a sculptor shaping a subject. The render is optimized to enhance details, like a sculptor refining texture. The outcome is a 3D object or scene suitable for virtual reality, digital twins, or robotics.

NVIDIA finally released Neuralangelo's source code! The model can turn videos from any device into detailed 3D structures, fully replicating buildings, sculptures, or other real aworld objects or spaces virtually. Here's how it works: A model utilizes a 2D video with multiple angles of an object or scene. I selects frames from different viewpoints to understand depth, size, and shape. The AI creates an initial 3D representation, similar to a sculptor shaping a subject. The render is optimized to enhance details, like a sculptor refining texture. The outcome is a 3D object or scene suitable for virtual reality, digital twins, or robotics.

Lior Alexander

478,025 views • 2 years ago

Pothole detection on the road in real time using Ultralytics YOLO26! 🕳️ Manual road inspections are slow, costly, and hard to scale. With object detection, potholes can be identified directly from street-level images or video feeds, enabling faster and more consistent road condition monitoring. How I built this demo: ✅ Trained a segmentation model on a custom dataset. ✅ Generated mask contours for each pothole. ✅ Leveraged the onnx-exported model for faster processing. #Pothole #RoadDamage #AI

Pothole detection on the road in real time using Ultralytics YOLO26! 🕳️ Manual road inspections are slow, costly, and hard to scale. With object detection, potholes can be identified directly from street-level images or video feeds, enabling faster and more consistent road condition monitoring. How I built this demo: ✅ Trained a segmentation model on a custom dataset. ✅ Generated mask contours for each pothole. ✅ Leveraged the onnx-exported model for faster processing. #Pothole #RoadDamage #AI

Muhammad Rizwan Munawar

30,677 views • 4 months ago

High school students built an autonomous ball-collecting robot! 🎾 A group of high school students built a robot that picks up balls and shoots them into a bin while moving without stopping, with impressive speed and accuracy. It combines mechanical design, sensors, and software making constant adjustments in real time while the robot is driving. When teenagers can build systems this sophisticated, the talent pipeline for the robotics industry is accelerating! ~~ ♻️ Join the weekly robotics newsletter, and never miss any news →

High school students built an autonomous ball-collecting robot! 🎾 A group of high school students built a robot that picks up balls and shoots them into a bin while moving without stopping, with impressive speed and accuracy. It combines mechanical design, sensors, and software making constant adjustments in real time while the robot is driving. When teenagers can build systems this sophisticated, the talent pipeline for the robotics industry is accelerating! ~~ ♻️ Join the weekly robotics newsletter, and never miss any news →

Lukas Ziegler

1,192,205 views • 4 months ago

Imagine having a ping pong robot! 🏓 Researchers and developers building physical AI: meet Reachy 2 from Pollen Robotics, an open-source, humanoid robot for real-world experimentation. It’s a bimanual mobile manipulator: each 7-DOF arm mimics human proportions and can lift up to 3 kg, giving dexterity for object handling. It can be controlled with Python and ROS2 Humble, or go straight into VR teleoperation, use a headset to move Reachy’s arms, hands, and head, and see through its cameras as if you’re in the robot’s own body. Want it to move around? A mobile base with three omnidirectional wheels, rich sensors, and LiDAR lets Reachy 2 navigate and explore its surroundings smoothly. 🗺️ Under the hood, it’s powered by a CPU system that’s ready for machine learning, perfect for loading AI frameworks and testing new models from Hugging Face directly on the robot. Keep making robots more, and more accessible Pollen team! ... and keep making more open source models to make robots more mainstream clem 🤗!

Imagine having a ping pong robot! 🏓 Researchers and developers building physical AI: meet Reachy 2 from Pollen Robotics, an open-source, humanoid robot for real-world experimentation. It’s a bimanual mobile manipulator: each 7-DOF arm mimics human proportions and can lift up to 3 kg, giving dexterity for object handling. It can be controlled with Python and ROS2 Humble, or go straight into VR teleoperation, use a headset to move Reachy’s arms, hands, and head, and see through its cameras as if you’re in the robot’s own body. Want it to move around? A mobile base with three omnidirectional wheels, rich sensors, and LiDAR lets Reachy 2 navigate and explore its surroundings smoothly. 🗺️ Under the hood, it’s powered by a CPU system that’s ready for machine learning, perfect for loading AI frameworks and testing new models from Hugging Face directly on the robot. Keep making robots more, and more accessible Pollen team! ... and keep making more open source models to make robots more mainstream clem 🤗!

Lukas Ziegler

37,221 views • 11 months ago

MolmoAct2 is landing in LeRobot! Ai2's open Action Reasoning Model combines a Molmo2-ER vision-language backbone with a flow-matching continuous action expert to predict robot action chunks from images, language instructions, and proprioceptive state. An open robot foundation model built for real-world control, with strong out-of-the-box performance and easy fine-tuning in LeRobot. Pick-and-place inference running on NVIDIA DGX Spark! Blog: Paper: Thanks to Ai2 Jiafei Duan Haoquan Fang

MolmoAct2 is landing in LeRobot! Ai2's open Action Reasoning Model combines a Molmo2-ER vision-language backbone with a flow-matching continuous action expert to predict robot action chunks from images, language instructions, and proprioceptive state. An open robot foundation model built for real-world control, with strong out-of-the-box performance and easy fine-tuning in LeRobot. Pick-and-place inference running on NVIDIA DGX Spark! Blog: Paper: Thanks to Ai2 Jiafei Duan Haoquan Fang

LeRobot

24,727 views • 1 month ago

Robot Utility Models (RUMs) enable basic tasks – door opening, drawer opening, object reorientation, etc. – at ~90% accuracy without ANY finetuning (i.e. zero-shot) in unseen new environments. Fully open source!!! models, data, code & hw. We think this is super exciting, why?👇 1. Unlocks many practical home utility tasks that often involve these basic tasks as part of an action chain. “Go get me a fork” involves opening the kitchen door and then opening the cutlery drawer. 2. This works well **zero-shot in unseen and new** environments, which is practically a huge deal. Turn the robot on, and get going. 3. The recipe for building a new model is fairly generic, and we think with a bit more refinement this can be a general recipe to build many more Utility models. More details and access 👇

Robot Utility Models (RUMs) enable basic tasks – door opening, drawer opening, object reorientation, etc. – at ~90% accuracy without ANY finetuning (i.e. zero-shot) in unseen new environments. Fully open source!!! models, data, code & hw. We think this is super exciting, why?👇 1. Unlocks many practical home utility tasks that often involve these basic tasks as part of an action chain. “Go get me a fork” involves opening the kitchen door and then opening the cutlery drawer. 2. This works well zero-shot in unseen and new environments, which is practically a huge deal. Turn the robot on, and get going. 3. The recipe for building a new model is fairly generic, and we think with a bit more refinement this can be a general recipe to build many more Utility models. More details and access 👇

Mahi Shafiullah 🏠🤖

89,535 views • 1 year ago

From simulation to reality 🤖 Robotics creator Skyentific built a walking bipedal robot using a simulation-first approach to design, test, and iterating in virtual environments before deploying in the real world. Powered by the NVIDIA Isaac platform and NVIDIA Jetson for on-device AI and control. 📖 #NationalRoboticsWeek

From simulation to reality 🤖 Robotics creator Skyentific built a walking bipedal robot using a simulation-first approach to design, test, and iterating in virtual environments before deploying in the real world. Powered by the NVIDIA Isaac platform and NVIDIA Jetson for on-device AI and control. 📖 #NationalRoboticsWeek

NVIDIA Robotics

21,774 views • 3 months ago

Hey #NeuraxonMini is literally out! , we manage to "transplant" a Neuraxon 2 bioinspired #AI brain to a physical robot the #SpheroMini moving from our last Scientific Paper (link bellow) by David Vivancos - e/acc & Jose Sánchez for Qubic #OpenScience hybridized with #Aigarth to the real World. First you need a Sphero Education Mini robot about 50$ Then you can try the first cool demos at Hugging Face: 1.- Neuraxon2MiniControl to drive the sphero robot 2.- Neuraxon2MiniWrite to write letters or words with physical moves of the sphero robot using Neuraxon Video Tutorials on youtube later today. Why this matters? Remember we are not building "dead" LLMs we are building #AliveAIs and for that we need to explore how it behaves in reality, from how it learns to how it fails, and what better way that in the emerging field of #robotics , time will tell if your next #HumanoidRobot have a #Neuraxon brain... Read the Paper: Explore the Neuraxon code here: Are you ready for #TrueAI ?

Hey #NeuraxonMini is literally out! , we manage to "transplant" a Neuraxon 2 bioinspired #AI brain to a physical robot the #SpheroMini moving from our last Scientific Paper (link bellow) by David Vivancos - e/acc & Jose Sánchez for Qubic #OpenScience hybridized with #Aigarth to the real World. First you need a Sphero Education Mini robot about 50$ Then you can try the first cool demos at Hugging Face: 1.- Neuraxon2MiniControl to drive the sphero robot 2.- Neuraxon2MiniWrite to write letters or words with physical moves of the sphero robot using Neuraxon Video Tutorials on youtube later today. Why this matters? Remember we are not building "dead" LLMs we are building #AliveAIs and for that we need to explore how it behaves in reality, from how it learns to how it fails, and what better way that in the emerging field of #robotics , time will tell if your next #HumanoidRobot have a #Neuraxon brain... Read the Paper: Explore the Neuraxon code here: Are you ready for #TrueAI ?

David Vivancos - e/acc

29,293 views • 4 months ago

Are we done with object detection? What about tiny objects beyond 200 meters? 🔎 Telescope 🔭 addresses long-range perception by explicitly tackling extreme scale imbalance ⚖️ in images. It hinges on a learnable hyperbolic foveation transform from a low-resolution image, magnifying distant regions 🔍 while compressing nearby ones - effectively normalizing object scales with minimal computational overhead. Objects are detected in the transformed (Riemannian) space using a novel bounding box parameterization and are then mapped back to the original image. Project:

Are we done with object detection? What about tiny objects beyond 200 meters? 🔎 Telescope 🔭 addresses long-range perception by explicitly tackling extreme scale imbalance ⚖️ in images. It hinges on a learnable hyperbolic foveation transform from a low-resolution image, magnifying distant regions 🔍 while compressing nearby ones - effectively normalizing object scales with minimal computational overhead. Objects are detected in the transformed (Riemannian) space using a novel bounding box parameterization and are then mapped back to the original image. Project:

Felix Heide

188,500 views • 2 months ago

Football players detection + tracking using Ultralytics YOLO26 ⚽️ It took me 30 minutes to train the YOLO26 model on a custom dataset using Ultralytics Platform. Later, I used the object tracker (Bytetrack) for tracking the players; tracking could be improved further, and I am working on it this week. More info 👇 #soccer #football #MachineLearning

Football players detection + tracking using Ultralytics YOLO26 ⚽️ It took me 30 minutes to train the YOLO26 model on a custom dataset using Ultralytics Platform. Later, I used the object tracker (Bytetrack) for tracking the players; tracking could be improved further, and I am working on it this week. More info 👇 #soccer #football #MachineLearning

Muhammad Rizwan Munawar

42,504 views • 2 months ago

How can we more effectively leverage robot data from different embodiments for skill transfer? Excited to share that our new work, RoVi-Aug, has been accepted to Conference on Robot Learning as an oral paper！ WIth RoVi-Aug, you can augment an existing robot dataset into a different robot and different viewpoints. A policy trained on the augmented dataset can zero-shot deploy on the unseen target robot with significantly different camera angles! 🧵👇 🔗 Check out our paper:

How can we more effectively leverage robot data from different embodiments for skill transfer? Excited to share that our new work, RoVi-Aug, has been accepted to Conference on Robot Learning as an oral paper！ WIth RoVi-Aug, you can augment an existing robot dataset into a different robot and different viewpoints. A policy trained on the augmented dataset can zero-shot deploy on the unseen target robot with significantly different camera angles! 🧵👇 🔗 Check out our paper:

Chenfeng_X

28,288 views • 1 year ago

you can play around with it here: (made in 45m on the 7 train!) how it works: each vertical line represents an instrument. a note is played when an object crosses the line, and where it crosses vertically determines pitch. ty Bobby Thakkar Replit ⠕ & team for such a fun day!

you can play around with it here: (made in 45m on the 7 train!) how it works: each vertical line represents an instrument. a note is played when an object crosses the line, and where it crosses vertically determines pitch. ty Bobby Thakkar Replit ⠕ & team for such a fun day!

melody kim

14,653 views • 24 days ago

Well, a humanoid robot can move on two legs or wheels, depending on the environment it faces. AGIBOT (Zhiyuan) from Shanghai revealed that their new generation of humanoid robot "Nezha" can autonomously switch to two wheels for fast movement when walking on two legs. Imagine that in the airport hall, when he walks down the stairs and sees a fallen object not far away, it can transform into a wheeled robot and move quickly to pick it up. Or in elderly care, when it see an elderly person fall, it can quickly move and help the elderly person up, and quickly provide medical supplies to the caregiver.

Well, a humanoid robot can move on two legs or wheels, depending on the environment it faces. AGIBOT (Zhiyuan) from Shanghai revealed that their new generation of humanoid robot "Nezha" can autonomously switch to two wheels for fast movement when walking on two legs. Imagine that in the airport hall, when he walks down the stairs and sees a fallen object not far away, it can transform into a wheeled robot and move quickly to pick it up. Or in elderly care, when it see an elderly person fall, it can quickly move and help the elderly person up, and quickly provide medical supplies to the caregiver.

CyberRobo

40,245 views • 1 year ago

From seeing → to understanding → now to following. In the previous video, we showed how the robot sees and navigates the world. This time, we’ve upgraded SR Agentic — it can now identify a designated person and autonomously follow them in real-time. Powered by perception + reasoning + adaptive navigation, the robot doesn’t just react - it tracks intent and moves with purpose.

From seeing → to understanding → now to following. In the previous video, we showed how the robot sees and navigates the world. This time, we’ve upgraded SR Agentic — it can now identify a designated person and autonomously follow them in real-time. Powered by perception + reasoning + adaptive navigation, the robot doesn’t just react - it tracks intent and moves with purpose.

Strike Robot

25,351 views • 3 months ago

BaBot: The Ball-Balancing Robot - Real-time PID control on a 2-axis platform, powered by a microcontroller using the same chip as an Arduino. - Precision servos and IR sensors track the ball with speed and accuracy. - Perfect for learning control systems, teaching robotics, or showing off your engineering skills. - Fully open-source & ready to build at Video Credit: Johan Link #engineering #technology #robots #robotics

BaBot: The Ball-Balancing Robot - Real-time PID control on a 2-axis platform, powered by a microcontroller using the same chip as an Arduino. - Precision servos and IR sensors track the ball with speed and accuracy. - Perfect for learning control systems, teaching robotics, or showing off your engineering skills. - Fully open-source & ready to build at Video Credit: Johan Link #engineering #technology #robots #robotics

Wevolver

48,877 views • 1 year ago

Okay this new model is insane. Generate an image, then give it to the model to turn it into a 3D model with matching texture in seconds. Creativity on Spielwerk will be endless with this

Okay this new model is insane. Generate an image, then give it to the model to turn it into a 3D model with matching texture in seconds. Creativity on Spielwerk will be endless with this

Eike Drescher

37,987 views • 8 months ago

You can't 3D reconstruct glass from images... ...WRONG! Thanks for video diffusion, now just about anything is possible! Introducing...Diffusion Knows Transparency (DKT) Transparent and reflective objects usually break robot vision and photogrammetry pipelines because they don't follow the "solid object" rules standard cameras expect. DKT is a new AI model that repurposes the "internal physics engine" found in video generation models to solve this problem. Researchers took a massive video diffusion model (WAN) and fine-tuned it using a custom-built synthetic dataset to turn it into a high-precision depth sensor. To train the AI, they built the first massive synthetic video library of transparent objects, 1.32 million frames of perfectly labeled glass and metal objects in motion. Without ever seeing a "real" labeled video of glass during training, the model (DKT) outperformed all previous specialized systems on real-world benchmarks (ClearPose, DREDS). They created a "lightweight" 1.3B parameter version that runs fast enough (0.17s per frame) to be used on actual robot hardware. Two reasons I find this project important: 1. It further proves that synthetic data will be essential for training the next generation vision models. 2. In real-world robotic tests, using DKT's depth maps nearly doubled the success rate of robot arms trying to pick up objects on tricky reflective or translucent surfaces. At home robots will need to interact with these types of objects on a daily basis. Check out the project page here: Code is LIVE! #Computervision #Robotics #AI

You can't 3D reconstruct glass from images... ...WRONG! Thanks for video diffusion, now just about anything is possible! Introducing...Diffusion Knows Transparency (DKT) Transparent and reflective objects usually break robot vision and photogrammetry pipelines because they don't follow the "solid object" rules standard cameras expect. DKT is a new AI model that repurposes the "internal physics engine" found in video generation models to solve this problem. Researchers took a massive video diffusion model (WAN) and fine-tuned it using a custom-built synthetic dataset to turn it into a high-precision depth sensor. To train the AI, they built the first massive synthetic video library of transparent objects, 1.32 million frames of perfectly labeled glass and metal objects in motion. Without ever seeing a "real" labeled video of glass during training, the model (DKT) outperformed all previous specialized systems on real-world benchmarks (ClearPose, DREDS). They created a "lightweight" 1.3B parameter version that runs fast enough (0.17s per frame) to be used on actual robot hardware. Two reasons I find this project important: 1. It further proves that synthetic data will be essential for training the next generation vision models. 2. In real-world robotic tests, using DKT's depth maps nearly doubled the success rate of robot arms trying to pick up objects on tricky reflective or translucent surfaces. At home robots will need to interact with these types of objects on a daily basis. Check out the project page here: Code is LIVE! #Computervision #Robotics #AI

Jonathan Stephens

17,712 views • 6 months ago

I genuinely don't understand why everyone isn't using this yet Andrej Karpathy, a co-founder of OpenAI, posted a simple idea that hit 16 million views: stop using AI to write code, use it to build a second brain. You point Claude Code at a folder, drop in any source, an article, a transcript, a PDF, and Claude reads it, links it, and files it into a living wiki of everything you know. It compounds like interest, the more you feed it, the smarter it gets. Here's the whole thing: > Install Obsidian, create a vault, open it in Claude Code > Paste Karpathy's wiki idea file and tell Claude to build it > Claude makes three folders: raw for sources, wiki for its pages, a CLAUDE.md that runs it > Drop any source into raw and say "ingest this" > Ask questions across everything, forever Five minutes to set up, and you never start from a blank chat again. Full step-by-step guide with Claude and Obsidian, link below. Bookmark this

I genuinely don't understand why everyone isn't using this yet Andrej Karpathy, a co-founder of OpenAI, posted a simple idea that hit 16 million views: stop using AI to write code, use it to build a second brain. You point Claude Code at a folder, drop in any source, an article, a transcript, a PDF, and Claude reads it, links it, and files it into a living wiki of everything you know. It compounds like interest, the more you feed it, the smarter it gets. Here's the whole thing: > Install Obsidian, create a vault, open it in Claude Code > Paste Karpathy's wiki idea file and tell Claude to build it > Claude makes three folders: raw for sources, wiki for its pages, a CLAUDE.md that runs it > Drop any source into raw and say "ingest this" > Ask questions across everything, forever Five minutes to set up, and you never start from a blank chat again. Full step-by-step guide with Claude and Obsidian, link below. Bookmark this

Ridark

6,847,706 views • 1 month ago

THIS GUY GOT SICK OF UK TRAIN STATIONS HIDING THE PLATFORM NUMBER UNTIL THE LAST SECOND, SO HE VIBE CODED AN APP THAT PREDICTS IT BEFORE THEY REVEAL IT if youve ever stood in a crowded station like london euston, you know the pain the platform stays hidden until 15 minutes before boarding, then it flashes up and hundreds of people sprint for the same gate so he built something that fixes this: > a clean departures and arrivals app pulling live data straight from the network rail apis > live train tracking so you can watch where your train actually is on the route and whether its running on time > the main feature is a predictive engine that guesses your platform before the station reveals it, and its right about 75% of the time heres how it predicts: every time a train finishes its journey, it logs which platform it actually pulled into and compares that to the platform network rail originally advertised it saves every one of those comparisons, and over time it builds up enough history to predict the platform with a real confidence score he built the whole thing with claude, mostly opus with some fable

THIS GUY GOT SICK OF UK TRAIN STATIONS HIDING THE PLATFORM NUMBER UNTIL THE LAST SECOND, SO HE VIBE CODED AN APP THAT PREDICTS IT BEFORE THEY REVEAL IT if youve ever stood in a crowded station like london euston, you know the pain the platform stays hidden until 15 minutes before boarding, then it flashes up and hundreds of people sprint for the same gate so he built something that fixes this: > a clean departures and arrivals app pulling live data straight from the network rail apis > live train tracking so you can watch where your train actually is on the route and whether its running on time > the main feature is a predictive engine that guesses your platform before the station reveals it, and its right about 75% of the time heres how it predicts: every time a train finishes its journey, it logs which platform it actually pulled into and compares that to the platform network rail originally advertised it saves every one of those comparisons, and over time it builds up enough history to predict the platform with a real confidence score he built the whole thing with claude, mostly opus with some fable

Om Patel

175,724 views • 16 days ago