Loading video...

Video Failed to Load

There was a problem loading this video. This could be due to a temporary network issue or the video might be unavailable.

Smart mapping for robots exploring huge areas! 🗺️ This is called Rolling-Bonxai. When a drone or ground robot maps a massive area, say a whole city or massive warehouse, storing the entire map in memory gets expensive fast. You run out of RAM. This solution is simple, only keep... the nearby map in memory. As the robot moves, old chunks save to disk and new chunks load. Like how video games only render what's close to the player. The system divides the map into chunks (imagine a 3D grid of boxes). As the robot explores, it keeps chunks around it loaded in memory. Chunks it's moving away from get saved to disk. When it comes back, they load again. Check the GH repo here 👉🏼 ~~ ♻️ Join the weekly robotics newsletter, and never miss any news →show more

Lukas Ziegler

60,652 subscribers

15,658 views • 2 months ago •via X (Twitter)

Anya Rossi• Live Now

Private livecam show

0 Comments

No comments available

Comments from the original post will appear here

Related Videos

Seat assembling robots! 💺 This robot from KUKA performs an incredibly technology-heavy process. 🦺 It assembles the seats in the car. And it's so hard? Well, when the car moves along with the production line, things get more complicated. The robot also moves on a special additional axis, so it synchronizes with the production line. ~~ ♻️ Join the weekly robotics newsletter, and never miss any news →

Seat assembling robots! 💺 This robot from KUKA performs an incredibly technology-heavy process. 🦺 It assembles the seats in the car. And it's so hard? Well, when the car moves along with the production line, things get more complicated. The robot also moves on a special additional axis, so it synchronizes with the production line. ~~ ♻️ Join the weekly robotics newsletter, and never miss any news →

Lukas Ziegler

10,554 views • 9 months ago

MICROSOFT QUIETLY SHIPPED THE RAG PIPELINE EVERYONE KEEPS TRYING TO BUILD FROM SCRATCH it is called Kernel Memory, and it turns any pile of files into an AI memory that answers with citations. drop your data in and Microsoft's pipeline does the rest: > ingest PDFs, Word, PPT, Excel, web pages, even images > extract the text, chunk it, embed it into vectors > store the vectors with metadata and keep the originals in blob storage > ask a question and it pulls the right chunks with semantic plus hybrid search then it hands the answer back grounded, with links to the exact source and full token usage. and it plugs into whatever you already run: > Azure OpenAI, OpenAI, Ollama, or Anthropic for the models > Qdrant, pgvector, Redis, or Azure AI Search for the vectors > every step is a swappable handler, so you can replace any part with your own one heads up: Microsoft archived the repo in June 2026 and ships it as a reference blueprint, not production. but as a map for how memory and RAG are actually built, nothing is cleaner. run it in one command: docker run kernelmemory/service bookmark this. Microsoft already drew the blueprint, you just build on it.

MICROSOFT QUIETLY SHIPPED THE RAG PIPELINE EVERYONE KEEPS TRYING TO BUILD FROM SCRATCH it is called Kernel Memory, and it turns any pile of files into an AI memory that answers with citations. drop your data in and Microsoft's pipeline does the rest: > ingest PDFs, Word, PPT, Excel, web pages, even images > extract the text, chunk it, embed it into vectors > store the vectors with metadata and keep the originals in blob storage > ask a question and it pulls the right chunks with semantic plus hybrid search then it hands the answer back grounded, with links to the exact source and full token usage. and it plugs into whatever you already run: > Azure OpenAI, OpenAI, Ollama, or Anthropic for the models > Qdrant, pgvector, Redis, or Azure AI Search for the vectors > every step is a swappable handler, so you can replace any part with your own one heads up: Microsoft archived the repo in June 2026 and ships it as a reference blueprint, not production. but as a map for how memory and RAG are actually built, nothing is cleaner. run it in one command: docker run kernelmemory/service bookmark this. Microsoft already drew the blueprint, you just build on it.

NO1ennn

84,668 views • 14 days ago

Rope climbing robots! 🪢 One objective, multiple approaches to achieve it. Back in 2017 undergraduates from Mechanical Science and Engineering at the University of Illinois utilized many mechanical strategies and tools to create a full menagerie of rope-climbing robots. Amazing creativity and uniqueness of each solution. Which robot is your favorite? Personally, I would say the one at the end dressed as a monkey! 🦍 ~~ ♻️ Join the weekly robotics newsletter, and never miss any news →

Rope climbing robots! 🪢 One objective, multiple approaches to achieve it. Back in 2017 undergraduates from Mechanical Science and Engineering at the University of Illinois utilized many mechanical strategies and tools to create a full menagerie of rope-climbing robots. Amazing creativity and uniqueness of each solution. Which robot is your favorite? Personally, I would say the one at the end dressed as a monkey! 🦍 ~~ ♻️ Join the weekly robotics newsletter, and never miss any news →

Lukas Ziegler

13,056 views • 7 months ago

Robotics doesn't need to be boring! 😴 Just imagine, you're an only child, you have no one to play football with. Then this fella comes in and you can train your dribbling skills as long as you want (or as long as the battery lasts). Anyway, pretty awesome robot for non-industrial use. Robots can be seen as companions! ~~ ♻️ Join the weekly robotics newsletter, and never miss any news →

Robotics doesn't need to be boring! 😴 Just imagine, you're an only child, you have no one to play football with. Then this fella comes in and you can train your dribbling skills as long as you want (or as long as the battery lasts). Anyway, pretty awesome robot for non-industrial use. Robots can be seen as companions! ~~ ♻️ Join the weekly robotics newsletter, and never miss any news →

Lukas Ziegler

263,015 views • 8 months ago

The robot is used to inspect the walls of ships. 🚢 The Magnet Crawler introduced by the University of Bremen is a lightweight and compact climbing robot for magnetic surfaces. The robot has two magnetic wheels driven by geared motors and an elastic tail to improve stability. In the front part of the robot, there is a miniature wireless camera. The robot is remotely teleoperated & the video signal from the camera is displayed to the operator on a portable screen. Let's wait and perhaps the robot will become more autonomous over time. Big fan of robots that make the world a safer place for humans. ~~ ♻️ Join the weekly robotics newsletter, and never miss any news →

The robot is used to inspect the walls of ships. 🚢 The Magnet Crawler introduced by the University of Bremen is a lightweight and compact climbing robot for magnetic surfaces. The robot has two magnetic wheels driven by geared motors and an elastic tail to improve stability. In the front part of the robot, there is a miniature wireless camera. The robot is remotely teleoperated & the video signal from the camera is displayed to the operator on a portable screen. Let's wait and perhaps the robot will become more autonomous over time. Big fan of robots that make the world a safer place for humans. ~~ ♻️ Join the weekly robotics newsletter, and never miss any news →

Lukas Ziegler

21,587 views • 3 months ago

Robotics is entering the mainstream! 👀 Let's accept this fact. Consumptionism – stonks. Possibilities (HW + SW) – stonks. Demographics - not stonks. Modern robots are often designed to interact with our legacy world, whether it's a household, a factory, or a shipyard. That means they often need to work with existing machines, tools, and spaces. In short: retrofitting. Improving old machines with new technologies without major interference in their operation. Modern way of integrating things. You don't have to change the entire environment to deploy a robot. The robot will adapt, just as human would when freshly hired. The promise is to have an army of robots to help with the world designed for us. I also believe that general purpose robots, are not a direct competition for single purpose machines (like a highly efficient specialized packaging machine, for example). It's like adding a robot to this carriage. Specialized machine could be a car ;) ~~ ♻️ Join the weekly robotics newsletter, and never miss any news →

Robotics is entering the mainstream! 👀 Let's accept this fact. Consumptionism – stonks. Possibilities (HW + SW) – stonks. Demographics - not stonks. Modern robots are often designed to interact with our legacy world, whether it's a household, a factory, or a shipyard. That means they often need to work with existing machines, tools, and spaces. In short: retrofitting. Improving old machines with new technologies without major interference in their operation. Modern way of integrating things. You don't have to change the entire environment to deploy a robot. The robot will adapt, just as human would when freshly hired. The promise is to have an army of robots to help with the world designed for us. I also believe that general purpose robots, are not a direct competition for single purpose machines (like a highly efficient specialized packaging machine, for example). It's like adding a robot to this carriage. Specialized machine could be a car ;) ~~ ♻️ Join the weekly robotics newsletter, and never miss any news →

Lukas Ziegler

14,396 views • 6 months ago

Ben Thompson says the memory makers are Iran, and by making the Strait of Hormuz mistake are inviting the whole industry to build around them "The other thing, the risk they run, is Apple. Apple's lobbying to get Chinese memory, right?" "And what is the number one focus of algorithmic changes? How can we use less memory?" "I think the memory makers probably screw themselves in the long run by creating such a massive target on their back." "I've analogized memory makers to Iran. The issue with the Strait of Hormuz is it's very effective. It's more effective if you don't use it, cuz then it's always hanging out there as something you could do. Now they did it. Turns out it worked." "But the UAE and Saudi Arabia, they're going to build pipelines. They're going to build new ports. They're not going to let this happen again." "It's very painful right now. But say Iran wants to close the Strait of Hormuz in 2035. It's not going to have any effect, because it will have been built around." "My concern for the memory makers is they might have done the same thing. No one's going to let themselves get in this situation again as far as memory goes."

Ben Thompson says the memory makers are Iran, and by making the Strait of Hormuz mistake are inviting the whole industry to build around them "The other thing, the risk they run, is Apple. Apple's lobbying to get Chinese memory, right?" "And what is the number one focus of algorithmic changes? How can we use less memory?" "I think the memory makers probably screw themselves in the long run by creating such a massive target on their back." "I've analogized memory makers to Iran. The issue with the Strait of Hormuz is it's very effective. It's more effective if you don't use it, cuz then it's always hanging out there as something you could do. Now they did it. Turns out it worked." "But the UAE and Saudi Arabia, they're going to build pipelines. They're going to build new ports. They're not going to let this happen again." "It's very painful right now. But say Iran wants to close the Strait of Hormuz in 2035. It's not going to have any effect, because it will have been built around." "My concern for the memory makers is they might have done the same thing. No one's going to let themselves get in this situation again as far as memory goes."

Fireside Alpha

157,042 views • 16 days ago

researchers gave a tiny local model human-style memory and its context limit basically stopped existing a team from MBZUAI, Princeton and Weizmann took a 1B model and rebuilt how it reads. instead of attending to everything at once, the model reads in 1,024 token chunks and passes the important stuff forward through an associative memory, the same way you carry the plot of a book between chapters without rereading them. the design mirrors human memory on purpose. full attention inside a chunk works as short-term memory. the module that carries information between chunks works as long-term memory. they even trained it like a person, starting with short easy texts and raising the difficulty gradually, because memory thrown into the deep end learns nothing. the numbers back it up. the normal model burns 40GB of GPU memory on a long document and collapses hard past its limit, dropping from 0.86 to 0.32 accuracy. the memory version holds 0.71 at double that length while using a flat 12GB no matter how long the input gets. it also needs about 30% fewer FLOPs. the part i keep thinking about is that nobody scaled anything here. they didn't build a bigger model, didn't stretch the window, didn't add compute. they looked at how a brain handles a long day and copied the architecture. a model small enough to run on a consumer gpu now survives documents its own architecture used to choke on. we keep treating intelligence as a compute problem. sometimes it's a memory problem.

researchers gave a tiny local model human-style memory and its context limit basically stopped existing a team from MBZUAI, Princeton and Weizmann took a 1B model and rebuilt how it reads. instead of attending to everything at once, the model reads in 1,024 token chunks and passes the important stuff forward through an associative memory, the same way you carry the plot of a book between chapters without rereading them. the design mirrors human memory on purpose. full attention inside a chunk works as short-term memory. the module that carries information between chunks works as long-term memory. they even trained it like a person, starting with short easy texts and raising the difficulty gradually, because memory thrown into the deep end learns nothing. the numbers back it up. the normal model burns 40GB of GPU memory on a long document and collapses hard past its limit, dropping from 0.86 to 0.32 accuracy. the memory version holds 0.71 at double that length while using a flat 12GB no matter how long the input gets. it also needs about 30% fewer FLOPs. the part i keep thinking about is that nobody scaled anything here. they didn't build a bigger model, didn't stretch the window, didn't add compute. they looked at how a brain handles a long day and copied the architecture. a model small enough to run on a consumer gpu now survives documents its own architecture used to choke on. we keep treating intelligence as a compute problem. sometimes it's a memory problem.

Alex Veremeyenko

16,147 views • 1 month ago

A pentagon robot! 🖐🏽 Compared to typical SCARA models, it delivers higher speed, improved stability, better space efficiency, and can operate smoothly in tight areas, even through singularity positions. These robots are a good fit for handling complex tasks in challenging environments where conventional robots often fall short. Have you ever seen a robot like this? 👀 ~~ ♻️ Join the weekly robotics newsletter, and never miss any news →

A pentagon robot! 🖐🏽 Compared to typical SCARA models, it delivers higher speed, improved stability, better space efficiency, and can operate smoothly in tight areas, even through singularity positions. These robots are a good fit for handling complex tasks in challenging environments where conventional robots often fall short. Have you ever seen a robot like this? 👀 ~~ ♻️ Join the weekly robotics newsletter, and never miss any news →

Lukas Ziegler

42,565 views • 5 months ago

Cache is back in CS2, and this is exactly how you make a Counter-Strike map. They completely remade the map from the ground up, absolutely nothing remains from the version from the workshop. Gameplay on the new cache is very clean and smooth without too much physical or visual clutter. Many of the more complicated props have been replaced with simple boxes, such as the box on forklift in A site. There are a few clipping issues with props and walls, but I imagine these will get sorted out over time. The visual fidelity is amazing without sacrificing performance. This will be a very easy map to learn and play, as there isn't very much complexity at all. Many of the features we all kinda hated are gone, such as the window at Z connector mid, new box, and the railing at highway. If they remove a map for this, it should be a simple 4 square map, otherwise the map pool is going to get too filled with easy maps. Remember when we got like... NO updates. Now I'm getting exhausted covering all of this week after week. THANK GOODNESS.

Cache is back in CS2, and this is exactly how you make a Counter-Strike map. They completely remade the map from the ground up, absolutely nothing remains from the version from the workshop. Gameplay on the new cache is very clean and smooth without too much physical or visual clutter. Many of the more complicated props have been replaced with simple boxes, such as the box on forklift in A site. There are a few clipping issues with props and walls, but I imagine these will get sorted out over time. The visual fidelity is amazing without sacrificing performance. This will be a very easy map to learn and play, as there isn't very much complexity at all. Many of the features we all kinda hated are gone, such as the window at Z connector mid, new box, and the railing at highway. If they remove a map for this, it should be a simple 4 square map, otherwise the map pool is going to get too filled with easy maps. Remember when we got like... NO updates. Now I'm getting exhausted covering all of this week after week. THANK GOODNESS.

WarOwl

366,217 views • 4 months ago

Your phone can build voxel world now! 👾 This is an open-source tool that converts phone video into 3D point clouds. You can run Depth Anything 3 locally. Basically just local GPU inference. The interesting part is how it handles messy input. Video windows overlap, scale gets converted to real meters, drift gets corrected after inference. The system stitches everything together even when footage is noisy. Objects far away might fail strict confidence filters but still show up as recognizable buildings. That's huge for small robots because perception becomes cheap and stays local. Obviously it wouldn't be a phone for robots, but it shows the potential of edge/local perception processing. A robot can understand its environment without offloading to the cloud. Real-world video has artifacts and occlusions. The system doesn't need perfect input to reconstruct scene structure. It works with what's there. For robotics, this means small platforms can build 3D maps autonomously using hardware they already have. Here's the repo: ~~ ♻️ Join the weekly robotics newsletter, and never miss any news →

Your phone can build voxel world now! 👾 This is an open-source tool that converts phone video into 3D point clouds. You can run Depth Anything 3 locally. Basically just local GPU inference. The interesting part is how it handles messy input. Video windows overlap, scale gets converted to real meters, drift gets corrected after inference. The system stitches everything together even when footage is noisy. Objects far away might fail strict confidence filters but still show up as recognizable buildings. That's huge for small robots because perception becomes cheap and stays local. Obviously it wouldn't be a phone for robots, but it shows the potential of edge/local perception processing. A robot can understand its environment without offloading to the cloud. Real-world video has artifacts and occlusions. The system doesn't need perfect input to reconstruct scene structure. It works with what's there. For robotics, this means small platforms can build 3D maps autonomously using hardware they already have. Here's the repo: ~~ ♻️ Join the weekly robotics newsletter, and never miss any news →

Lukas Ziegler

50,569 views • 1 month ago

SkildAI, which is developing a foundational AI model for robots, has released a new video of their humanoid robot walking over objects and exploring environments it had never seen before. The robot is using vision & adapts in real time. SkildAI: "From raw images and joint feedback, the model directly outputs low-level motor commands. This single neural network enables humanoid robots to seamlessly walk across flat ground, climb stairs, and step over obstacles without any planning, mapping, or manual switching between behaviors. For all of our testing in this video, we deployed the robot in each new environment without any prior planning or mapping. We took off the humanoid’s shoes so you can hear it.

SkildAI, which is developing a foundational AI model for robots, has released a new video of their humanoid robot walking over objects and exploring environments it had never seen before. The robot is using vision & adapts in real time. SkildAI: "From raw images and joint feedback, the model directly outputs low-level motor commands. This single neural network enables humanoid robots to seamlessly walk across flat ground, climb stairs, and step over obstacles without any planning, mapping, or manual switching between behaviors. For all of our testing in this video, we deployed the robot in each new environment without any prior planning or mapping. We took off the humanoid’s shoes so you can hear it.

Sawyer Merritt

69,381 views • 1 year ago

A robot snake for the rescue! 🛟 Mechanum wheels, reconfigurable shape, camera set. These robots were developed by researchers at The University of Manchester. This machine is called MIRRAX-150, and it performs inspections as well as explorations. To map 3D point clouds, this machine uses low-cost components, 3D printing, and LiDAR technology. 🧭 Soon, this robot will be deployed on the Sellafield nuclear power station. Basically, it's a snake that changes its body! P.S. What use cases would fit these robots? 🐍 ~~~ ♻️ RT to help 1 robot find a new workplace.

A robot snake for the rescue! 🛟 Mechanum wheels, reconfigurable shape, camera set. These robots were developed by researchers at The University of Manchester. This machine is called MIRRAX-150, and it performs inspections as well as explorations. To map 3D point clouds, this machine uses low-cost components, 3D printing, and LiDAR technology. 🧭 Soon, this robot will be deployed on the Sellafield nuclear power station. Basically, it's a snake that changes its body! P.S. What use cases would fit these robots? 🐍 ~~~ ♻️ RT to help 1 robot find a new workplace.

Lukas Ziegler

15,263 views • 1 year ago

STANFORD BUILT AN LLM MEMORY THAT WORKS LIKE A BRAIN AND IT MADE STANDARD RAG LOOK ANCIENT no fine-tuning. no bigger model. just a smarter way to remember the insight: the brain doesn't store memories as isolated notes. it indexes them and links them - so one cue pulls back the whole memory so HippoRAG stops treating documents as separate chunks. it builds a knowledge graph, then spreads activation across it (Personalized PageRank) to pull a full answer from a single cue - the brain calls this "pattern completion" the result: > up to 20% better on hard multi-hop questions > 10-30x cheaper and 6-13x faster than iterative retrieval > connects facts split across documents in a single step most RAG still encodes every passage in isolation - so it breaks the moment the answer is scattered more retrieval was never the answer. brain-like memory is bookmark this. the next leap in AI agents is how they remember, not how big they get

STANFORD BUILT AN LLM MEMORY THAT WORKS LIKE A BRAIN AND IT MADE STANDARD RAG LOOK ANCIENT no fine-tuning. no bigger model. just a smarter way to remember the insight: the brain doesn't store memories as isolated notes. it indexes them and links them - so one cue pulls back the whole memory so HippoRAG stops treating documents as separate chunks. it builds a knowledge graph, then spreads activation across it (Personalized PageRank) to pull a full answer from a single cue - the brain calls this "pattern completion" the result: > up to 20% better on hard multi-hop questions > 10-30x cheaper and 6-13x faster than iterative retrieval > connects facts split across documents in a single step most RAG still encodes every passage in isolation - so it breaks the moment the answer is scattered more retrieval was never the answer. brain-like memory is bookmark this. the next leap in AI agents is how they remember, not how big they get

NO1ennn

32,454 views • 27 days ago

THE WOVEN ROBOT! Wow! The woven robot hand is here and it is absolutely game-changing. Allonic just braided thousands of tendon-like fibers around a 3D-printed skeleton in minutes. No joints. No screws. No human assembly. Pure biomimetic tissue that flexes, grips, and lasts like biology itself. This isn’t incremental. This is the breakthrough that collapses robot hand costs from $30,000 to pennies. The old world of expensive, fragile robotic limbs is over. Now humanoid robots can build more of themselves scalable, replicable, anywhere. Robots building Robots building Robots, yeah you get it. In your freaking garage! Massive opportunities are about to explode as work as we know it fades. Rent one, have it build your fleet, send it back, repeat. Thousands if you want. The age of woven machines begins.

THE WOVEN ROBOT! Wow! The woven robot hand is here and it is absolutely game-changing. Allonic just braided thousands of tendon-like fibers around a 3D-printed skeleton in minutes. No joints. No screws. No human assembly. Pure biomimetic tissue that flexes, grips, and lasts like biology itself. This isn’t incremental. This is the breakthrough that collapses robot hand costs from $30,000 to pennies. The old world of expensive, fragile robotic limbs is over. Now humanoid robots can build more of themselves scalable, replicable, anywhere. Robots building Robots building Robots, yeah you get it. In your freaking garage! Massive opportunities are about to explode as work as we know it fades. Rent one, have it build your fleet, send it back, repeat. Thousands if you want. The age of woven machines begins.

Brian Roemmele

21,747 views • 5 months ago

Another win for open-source robotics! 🔥 Hugging Face just released a fully open-source humanoid robot, and you can build one for $2,500. I'm a huge advocate of open-source in robotics space. Why? Robotics is too hard to solve alone. So lowering the entry point is crucial. Also, ROS proved open ecosystems create lasting industry standards. So let's have a look at the new member of humanoids family! LeRobot Humanoid is a 3D-printed, bipedal humanoid platform designed for real robot learning experiments. It's a complete and, buildable robot Anddddd yes, it's a full stack release: → Hardware files, bill of materials and full assembly documentation → Simulation assets and training environments → Runtime tools for calibration and real-world control → Sim-to-real identification pipeline When a part breaks, reprint it. When a design choice doesn't work, modify it and test again. The whole point is fast iteration on real hardware, not treating the robot as a fixed artefact. The timing is not a coincidence. As foundation models for robotics mature, the field desperately needs open physical platforms to train, validate and deploy them on. clem 🤗 LET'S GO!!! Build it here: ~~ ♻️ Join the weekly robotics newsletter, and never miss any news →

Another win for open-source robotics! 🔥 Hugging Face just released a fully open-source humanoid robot, and you can build one for $2,500. I'm a huge advocate of open-source in robotics space. Why? Robotics is too hard to solve alone. So lowering the entry point is crucial. Also, ROS proved open ecosystems create lasting industry standards. So let's have a look at the new member of humanoids family! LeRobot Humanoid is a 3D-printed, bipedal humanoid platform designed for real robot learning experiments. It's a complete and, buildable robot Anddddd yes, it's a full stack release: → Hardware files, bill of materials and full assembly documentation → Simulation assets and training environments → Runtime tools for calibration and real-world control → Sim-to-real identification pipeline When a part breaks, reprint it. When a design choice doesn't work, modify it and test again. The whole point is fast iteration on real hardware, not treating the robot as a fixed artefact. The timing is not a coincidence. As foundation models for robotics mature, the field desperately needs open physical platforms to train, validate and deploy them on. clem 🤗 LET'S GO!!! Build it here: ~~ ♻️ Join the weekly robotics newsletter, and never miss any news →

Lukas Ziegler

20,457 views • 3 months ago

Turning video into humanoid robot motion! 🤳🏼 Training humanoid robots needs huge amounts of motion data, but real-world capture doesn’t scale. Mocap is expensive, dangerous edge cases are rare, and you can’t ask humans to repeatedly fall or crash. Video2Robot tackles this by converting videos into physics-grounded humanoid simulations. Motion is generated to respect balance, inertia, ground contact, and joint limits, then directly retargeted to robot simulators. One prompt can generate a full humanoid motion sequence, including multi-agent interactions and failure cases like falls or collisions, scenarios that are hard or impossible to capture safely in the real world. The pipeline is model-agnostic and works with existing video generators, making it a practical way to scale data for robots. If robots are going to operate in the real world, they need to be trained on the failures too, not just the perfect demos. Here's the GitHub: ~~ ♻️ Join the weekly robotics newsletter, and never miss any news →

Turning video into humanoid robot motion! 🤳🏼 Training humanoid robots needs huge amounts of motion data, but real-world capture doesn’t scale. Mocap is expensive, dangerous edge cases are rare, and you can’t ask humans to repeatedly fall or crash. Video2Robot tackles this by converting videos into physics-grounded humanoid simulations. Motion is generated to respect balance, inertia, ground contact, and joint limits, then directly retargeted to robot simulators. One prompt can generate a full humanoid motion sequence, including multi-agent interactions and failure cases like falls or collisions, scenarios that are hard or impossible to capture safely in the real world. The pipeline is model-agnostic and works with existing video generators, making it a practical way to scale data for robots. If robots are going to operate in the real world, they need to be trained on the failures too, not just the perfect demos. Here's the GitHub: ~~ ♻️ Join the weekly robotics newsletter, and never miss any news →

Lukas Ziegler

59,835 views • 8 months ago

🚨 Apple joins the robotics race! Researchers from Carnegie Mellon University and Apple have developed a robot collision avoidance system. They called it ARMOR and they implemented it on the Fourier GR-1 robot. What is ARMOR? 👘 ARMOR is a system that helps humanoid robots "see" their surroundings better by using small, smart depth sensors placed on their arms. It solves the problem of blind spots and occlusions in traditional robot perception, making robots much safer and more efficient. It uses Time-of-Flight (ToF) sensors to detect obstacles, providing a near-complete view of the robot’s environment. 🔭 A smart software powered by transformer-based AI learns from human movements to help robots plan their actions dynamically. ARMOR reduces collisions by an impressive 63.7%, making robots significantly better at navigating crowded or complex spaces. The system is fast as well! 💨 ARMOR-Policy cuts computational time by 26× compared to traditional planning methods, ensuring robots can act quickly. P.S. Thoughts on this? The research paper is in the comments! ~~~ ♻️ RT to help 1 robot find a new workplace.

🚨 Apple joins the robotics race! Researchers from Carnegie Mellon University and Apple have developed a robot collision avoidance system. They called it ARMOR and they implemented it on the Fourier GR-1 robot. What is ARMOR? 👘 ARMOR is a system that helps humanoid robots "see" their surroundings better by using small, smart depth sensors placed on their arms. It solves the problem of blind spots and occlusions in traditional robot perception, making robots much safer and more efficient. It uses Time-of-Flight (ToF) sensors to detect obstacles, providing a near-complete view of the robot’s environment. 🔭 A smart software powered by transformer-based AI learns from human movements to help robots plan their actions dynamically. ARMOR reduces collisions by an impressive 63.7%, making robots significantly better at navigating crowded or complex spaces. The system is fast as well! 💨 ARMOR-Policy cuts computational time by 26× compared to traditional planning methods, ensuring robots can act quickly. P.S. Thoughts on this? The research paper is in the comments! ~~~ ♻️ RT to help 1 robot find a new workplace.

Lukas Ziegler

169,472 views • 1 year ago

Tom Campbell: "The planets and the universe only render themselves when people are looking at them. It's like the video game 'No Man's Sky'. We are living in a simulation." Our reality computes on the fly whatever a player sees. Land on a planet and you get animals, shrubs, lakes and land features. Look away and it is no longer computed. Nothing is saved in memory. Only a set of values that can be regenerated if someone looks again. "It only computed what the person saw. As soon as you looked away, it wasn't computed anymore." "There is no tree. There is no forest. If nobody is there and it is not being observed, it is not being rendered." Stars are just little dots of light. They do not have to come from a sun 20 light years away. When the sun comes up or you go to sleep they stop being rendered for you. We are living in a simulation computed by consciousness.

Tom Campbell: "The planets and the universe only render themselves when people are looking at them. It's like the video game 'No Man's Sky'. We are living in a simulation." Our reality computes on the fly whatever a player sees. Land on a planet and you get animals, shrubs, lakes and land features. Look away and it is no longer computed. Nothing is saved in memory. Only a set of values that can be regenerated if someone looks again. "It only computed what the person saw. As soon as you looked away, it wasn't computed anymore." "There is no tree. There is no forest. If nobody is there and it is not being observed, it is not being rendered." Stars are just little dots of light. They do not have to come from a sun 20 light years away. When the sun comes up or you go to sleep they stop being rendered for you. We are living in a simulation computed by consciousness.

Interstellar

12,367 views • 7 days ago

The coolest part of Microduck might not be the robot. It's how it learns to move. This repo shows the full reinforcement learning pipeline behind Microduck. The robot learns in simulation using MuJoCo, PPO and GPU-based training, then the trained policy is exported to ONNX and deployed on the real robot. But the real challenge is sim-to-real. The simulation models things like actuator behavior, battery voltage, command delays, friction and even gear backlash. That helps make the learned policy work when it moves from simulation to the physical robot. The repo includes policies for walking, fall recovery, sitting, standing, kicking, ground picking and even roller skating. Train in simulation. Test the behavior. Export the policy. Run it on a real robot.

The coolest part of Microduck might not be the robot. It's how it learns to move. This repo shows the full reinforcement learning pipeline behind Microduck. The robot learns in simulation using MuJoCo, PPO and GPU-based training, then the trained policy is exported to ONNX and deployed on the real robot. But the real challenge is sim-to-real. The simulation models things like actuator behavior, battery voltage, command delays, friction and even gear backlash. That helps make the learned policy work when it moves from simulation to the physical robot. The repo includes policies for walking, fall recovery, sitting, standing, kicking, ground picking and even roller skating. Train in simulation. Test the behavior. Export the policy. Run it on a real robot.

Praveen Kumar Verma

133,238 views • 7 days ago