正在加载视频...

视频加载失败

返回首页

Your phone can build voxel world now! 👾 This is an open-source tool that converts phone video into 3D point clouds. You can run Depth Anything 3 locally. Basically just local GPU inference. The interesting part is how it handles messy input. Video windows overlap, scale gets converted to...

lukas_m_ziegler's profile picture

Lukas Ziegler

58,856 subscribers

50,427 次观看 • 1 个月前 •via X (Twitter)

LIVE

Anya Rossi• Live Now

Private livecam show

0 条评论

暂无评论

原始帖子的评论将显示在这里

相关视频

Turning video into humanoid robot motion! 🤳🏼 Training humanoid robots needs huge amounts of motion data, but real-world capture doesn’t scale. Mocap is expensive, dangerous edge cases are rare, and you can’t ask humans to repeatedly fall or crash. Video2Robot tackles this by converting videos into physics-grounded humanoid simulations. Motion is generated to respect balance, inertia, ground contact, and joint limits, then directly retargeted to robot simulators. One prompt can generate a full humanoid motion sequence, including multi-agent interactions and failure cases like falls or collisions, scenarios that are hard or impossible to capture safely in the real world. The pipeline is model-agnostic and works with existing video generators, making it a practical way to scale data for robots. If robots are going to operate in the real world, they need to be trained on the failures too, not just the perfect demos. Here's the GitHub: ~~ ♻️ Join the weekly robotics newsletter, and never miss any news →
0:26

Turning video into humanoid robot motion! 🤳🏼 Training humanoid robots needs huge amounts of motion data, but real-world capture doesn’t scale. Mocap is expensive, dangerous edge cases are rare, and you can’t ask humans to repeatedly fall or crash. Video2Robot tackles this by converting videos into physics-grounded humanoid simulations. Motion is generated to respect balance, inertia, ground contact, and joint limits, then directly retargeted to robot simulators. One prompt can generate a full humanoid motion sequence, including multi-agent interactions and failure cases like falls or collisions, scenarios that are hard or impossible to capture safely in the real world. The pipeline is model-agnostic and works with existing video generators, making it a practical way to scale data for robots. If robots are going to operate in the real world, they need to be trained on the failures too, not just the perfect demos. Here's the GitHub: ~~ ♻️ Join the weekly robotics newsletter, and never miss any news →

Lukas Ziegler

59,835 次观看 • 7 个月前

Another win for open-source robotics! 🔥 Hugging Face just released a fully open-source humanoid robot, and you can build one for $2,500. I'm a huge advocate of open-source in robotics space. Why? Robotics is too hard to solve alone. So lowering the entry point is crucial. Also, ROS proved open ecosystems create lasting industry standards. So let's have a look at the new member of humanoids family! LeRobot Humanoid is a 3D-printed, bipedal humanoid platform designed for real robot learning experiments. It's a complete and, buildable robot Anddddd yes, it's a full stack release: → Hardware files, bill of materials and full assembly documentation → Simulation assets and training environments → Runtime tools for calibration and real-world control → Sim-to-real identification pipeline When a part breaks, reprint it. When a design choice doesn't work, modify it and test again. The whole point is fast iteration on real hardware, not treating the robot as a fixed artefact. The timing is not a coincidence. As foundation models for robotics mature, the field desperately needs open physical platforms to train, validate and deploy them on. clem 🤗 LET'S GO!!! Build it here: ~~ ♻️ Join the weekly robotics newsletter, and never miss any news →
0:20

Another win for open-source robotics! 🔥 Hugging Face just released a fully open-source humanoid robot, and you can build one for $2,500. I'm a huge advocate of open-source in robotics space. Why? Robotics is too hard to solve alone. So lowering the entry point is crucial. Also, ROS proved open ecosystems create lasting industry standards. So let's have a look at the new member of humanoids family! LeRobot Humanoid is a 3D-printed, bipedal humanoid platform designed for real robot learning experiments. It's a complete and, buildable robot Anddddd yes, it's a full stack release: → Hardware files, bill of materials and full assembly documentation → Simulation assets and training environments → Runtime tools for calibration and real-world control → Sim-to-real identification pipeline When a part breaks, reprint it. When a design choice doesn't work, modify it and test again. The whole point is fast iteration on real hardware, not treating the robot as a fixed artefact. The timing is not a coincidence. As foundation models for robotics mature, the field desperately needs open physical platforms to train, validate and deploy them on. clem 🤗 LET'S GO!!! Build it here: ~~ ♻️ Join the weekly robotics newsletter, and never miss any news →

Lukas Ziegler

20,361 次观看 • 2 个月前

It's a 3D printer, and 3D assembly station! 🖨️ The Functgraph developed at Meiji University starts as a regular 3D printer but upgrades itself into a mini factory. It can print parts for its own tools, pick them up, clean them, and put them together, all by itself. Think of it like a robot that can 3D print a spatula, assemble it, and then use it to flip pancakes. 🥞 Instead of just printing objects, the Functgraph can actually perform physical tasks, like folding laundry or slicing vegetables, by using printed and assembled tools. It’s a step toward the idea of a robot that can download "apps" as physical skills, much like your phone downloads software! 👀 ~~ ♻️ Join the weekly robotics newsletter, and never miss any news →
1:00

It's a 3D printer, and 3D assembly station! 🖨️ The Functgraph developed at Meiji University starts as a regular 3D printer but upgrades itself into a mini factory. It can print parts for its own tools, pick them up, clean them, and put them together, all by itself. Think of it like a robot that can 3D print a spatula, assemble it, and then use it to flip pancakes. 🥞 Instead of just printing objects, the Functgraph can actually perform physical tasks, like folding laundry or slicing vegetables, by using printed and assembled tools. It’s a step toward the idea of a robot that can download "apps" as physical skills, much like your phone downloads software! 👀 ~~ ♻️ Join the weekly robotics newsletter, and never miss any news →

Lukas Ziegler

140,137 次观看 • 3 个月前

🚨 BREAKING: Big news in the computer vision world! 🎥 Luxonis | Robotic Vision just dropped its new OAK 4 line, and it’s a big upgrade for edge computer vision. Instead of being “just a stereo camera,” OAK 4 is a fully standalone vision computer with 52 TOPS of on-device AI. Models run locally, depth is computed locally, and no external PC or cloud pipeline is required. This is why robotics teams love it: lower latency, lower cost, fewer failure points in the field. The hardware is built for the real-world. IP67, shock-resistant, wide-FOV RGB + stereo pair, IR projection, IMU, audio, and a patent-pending calibration system that keeps depth accurate even when conditions change. But the real move is the platform. With Luxonis Hub, you can deploy models, grab telemetry, push OTA updates, or collect data when performance drifts, all from a unified interface. It turns a single device into an end-to-end edge CV system. Most customers today in robotics are groups who just want something that works: AMRs, bin-picking systems, trailer-loading robots, and ag-tech. 🤖 And they all say the same thing, the appeal isn’t raw TOPS, it’s the all-in-one simplicity that lets them scale without building custom infrastructure. Feels like the direction edge vision has been waiting for: rugged hardware + high-throughput on-device compute + a real management layer. A next step toward “plug-and-deploy” perception for robots. 🔗 Find out more here: ~~ ♻️ Join the weekly robotics newsletter, and never miss any news →
1:12

🚨 BREAKING: Big news in the computer vision world! 🎥 Luxonis | Robotic Vision just dropped its new OAK 4 line, and it’s a big upgrade for edge computer vision. Instead of being “just a stereo camera,” OAK 4 is a fully standalone vision computer with 52 TOPS of on-device AI. Models run locally, depth is computed locally, and no external PC or cloud pipeline is required. This is why robotics teams love it: lower latency, lower cost, fewer failure points in the field. The hardware is built for the real-world. IP67, shock-resistant, wide-FOV RGB + stereo pair, IR projection, IMU, audio, and a patent-pending calibration system that keeps depth accurate even when conditions change. But the real move is the platform. With Luxonis Hub, you can deploy models, grab telemetry, push OTA updates, or collect data when performance drifts, all from a unified interface. It turns a single device into an end-to-end edge CV system. Most customers today in robotics are groups who just want something that works: AMRs, bin-picking systems, trailer-loading robots, and ag-tech. 🤖 And they all say the same thing, the appeal isn’t raw TOPS, it’s the all-in-one simplicity that lets them scale without building custom infrastructure. Feels like the direction edge vision has been waiting for: rugged hardware + high-throughput on-device compute + a real management layer. A next step toward “plug-and-deploy” perception for robots. 🔗 Find out more here: ~~ ♻️ Join the weekly robotics newsletter, and never miss any news →

Lukas Ziegler

41,955 次观看 • 8 个月前

Smart mapping for robots exploring huge areas! 🗺️ This is called Rolling-Bonxai. When a drone or ground robot maps a massive area, say a whole city or massive warehouse, storing the entire map in memory gets expensive fast. You run out of RAM. This solution is simple, only keep the nearby map in memory. As the robot moves, old chunks save to disk and new chunks load. Like how video games only render what's close to the player. The system divides the map into chunks (imagine a 3D grid of boxes). As the robot explores, it keeps chunks around it loaded in memory. Chunks it's moving away from get saved to disk. When it comes back, they load again. Check the GH repo here 👉🏼 ~~ ♻️ Join the weekly robotics newsletter, and never miss any news →
0:35

Smart mapping for robots exploring huge areas! 🗺️ This is called Rolling-Bonxai. When a drone or ground robot maps a massive area, say a whole city or massive warehouse, storing the entire map in memory gets expensive fast. You run out of RAM. This solution is simple, only keep the nearby map in memory. As the robot moves, old chunks save to disk and new chunks load. Like how video games only render what's close to the player. The system divides the map into chunks (imagine a 3D grid of boxes). As the robot explores, it keeps chunks around it loaded in memory. Chunks it's moving away from get saved to disk. When it comes back, they load again. Check the GH repo here 👉🏼 ~~ ♻️ Join the weekly robotics newsletter, and never miss any news →

Lukas Ziegler

15,616 次观看 • 1 个月前

Something must change in robotics! 😖 As more billion-dollar players enter the space, more systems are closing off. APIs move behind paywalls, platforms lock down, and robots turn into black boxes. Pollen Robotics is taking the opposite route. With Reachy 2, everything is open: the code, the CAD files, the ROS 2 interfaces, the communication stack. If you want to swap the camera, redesign the gripper, or fork the whole system, you can, and that’s the point. It creates a culture where universities can run real experiments without licensing drama, and startups can prototype without waiting for vendor permission. Clone it on GitHub. Add behaviors. Share datasets. Fork the models. Push improvements upstream. The Hugging Face influence is real. It’s two open ecosystems aligning around the same idea: robotics should be built by more than a handful of companies. It was so cool to meet the team behind Reachy 2 in Bordeaux! 🔥 ~~ ♻️ Join the weekly robotics newsletter, and never miss any news →
1:16

Something must change in robotics! 😖 As more billion-dollar players enter the space, more systems are closing off. APIs move behind paywalls, platforms lock down, and robots turn into black boxes. Pollen Robotics is taking the opposite route. With Reachy 2, everything is open: the code, the CAD files, the ROS 2 interfaces, the communication stack. If you want to swap the camera, redesign the gripper, or fork the whole system, you can, and that’s the point. It creates a culture where universities can run real experiments without licensing drama, and startups can prototype without waiting for vendor permission. Clone it on GitHub. Add behaviors. Share datasets. Fork the models. Push improvements upstream. The Hugging Face influence is real. It’s two open ecosystems aligning around the same idea: robotics should be built by more than a handful of companies. It was so cool to meet the team behind Reachy 2 in Bordeaux! 🔥 ~~ ♻️ Join the weekly robotics newsletter, and never miss any news →

Lukas Ziegler

21,046 次观看 • 8 个月前

Robot simulation is getting a big upgrade! 🔥 Normally, building a simulation environment, a kitchen, warehouse, office takes days or weeks. You have to model the geometry, add textures, set lighting, generate collision meshes… all before a robot can even interact with it. Marble by World Labs removes most of that work. You type a text prompt or give it an image, and it generates a full 3D scene with depth, lighting, and a collider mesh you can export into engines like MuJoCo. That means researchers can quickly create lots of different environments to train robots on, which is exactly what domain randomization needs. If we want robots to learn faster, we need to create worlds faster. ~~ ♻️ Join the weekly robotics newsletter, and never miss any news →
0:59

Robot simulation is getting a big upgrade! 🔥 Normally, building a simulation environment, a kitchen, warehouse, office takes days or weeks. You have to model the geometry, add textures, set lighting, generate collision meshes… all before a robot can even interact with it. Marble by World Labs removes most of that work. You type a text prompt or give it an image, and it generates a full 3D scene with depth, lighting, and a collider mesh you can export into engines like MuJoCo. That means researchers can quickly create lots of different environments to train robots on, which is exactly what domain randomization needs. If we want robots to learn faster, we need to create worlds faster. ~~ ♻️ Join the weekly robotics newsletter, and never miss any news →

Lukas Ziegler

15,498 次观看 • 8 个月前

Robots might learn better from video than from language! 📼 Most Vision-Language-Action (VLA) models learn what to do from text, but still struggle with how things move in the real world. That makes them data-hungry and slow to train. mimic video takes a different route. Instead of grounding robot control in text, it grounds it in video, using large pre-trained video models that already capture physical motion and dynamics. The idea is straightforward: let the video model handle “what will happen next,” and let a smaller control model focus only on turning that visual plan into robot actions. The result is big gains in practice. Robots trained this way need 10× less data, converge twice as fast, and perform better on both simulated benchmarks and real bimanual manipulation tasks. If robots can “imagine” motion using video, control becomes a much simpler problem. Shoutout to Jonas Pai, Liam Achenbach, Oier Mees, Elvis Nava and the rest of the team! Here's the project page: ~~ ♻️ Join the weekly robotics newsletter, and never miss any news →
0:47

Robots might learn better from video than from language! 📼 Most Vision-Language-Action (VLA) models learn what to do from text, but still struggle with how things move in the real world. That makes them data-hungry and slow to train. mimic video takes a different route. Instead of grounding robot control in text, it grounds it in video, using large pre-trained video models that already capture physical motion and dynamics. The idea is straightforward: let the video model handle “what will happen next,” and let a smaller control model focus only on turning that visual plan into robot actions. The result is big gains in practice. Robots trained this way need 10× less data, converge twice as fast, and perform better on both simulated benchmarks and real bimanual manipulation tasks. If robots can “imagine” motion using video, control becomes a much simpler problem. Shoutout to Jonas Pai, Liam Achenbach, Oier Mees, Elvis Nava and the rest of the team! Here's the project page: ~~ ♻️ Join the weekly robotics newsletter, and never miss any news →

Lukas Ziegler

50,063 次观看 • 7 个月前

This is what open robotics actually looks like! 🔓 I was in Bordeaux, sitting inside Pollen Robotics, and had a chance to play around with their humanoid robot Reachy 2. It’s expressive, modular, and can even bring you coffee, and of course runs Python or Rust. I was talking with Reachy in 3 different languages, tele-operating it and manipulating kitchen stuff, and make it even mimic my gestures. The best part is that there are no locked APIs, or hidden stuff, just an open platform that you can build upon. The connection with Hugging Face makes it super easy to start, as the open source approach allows everyone to contribute, experiment and add their own things. I already ordered his little brother Reachy Mini, let's see what a robotics rookie can do with that robot! 👀 ~~ ♻️ Join the weekly robotics newsletter, and never miss any news →
1:36

This is what open robotics actually looks like! 🔓 I was in Bordeaux, sitting inside Pollen Robotics, and had a chance to play around with their humanoid robot Reachy 2. It’s expressive, modular, and can even bring you coffee, and of course runs Python or Rust. I was talking with Reachy in 3 different languages, tele-operating it and manipulating kitchen stuff, and make it even mimic my gestures. The best part is that there are no locked APIs, or hidden stuff, just an open platform that you can build upon. The connection with Hugging Face makes it super easy to start, as the open source approach allows everyone to contribute, experiment and add their own things. I already ordered his little brother Reachy Mini, let's see what a robotics rookie can do with that robot! 👀 ~~ ♻️ Join the weekly robotics newsletter, and never miss any news →

Lukas Ziegler

19,433 次观看 • 7 个月前

Brain-controlled exoskeletons to train humanoid robots! 🧠 Fourier just presented human tele-operators using brain control interfaces and exoskeletal arms to train humanoid robots on home tasks. The brain control interface is the interesting part. Instead of using a controller or joystick to teleoperate, the operator's movements and intentions are captured more naturally through the exoskeleton and BCI. This means the demonstrations are more fluid, more human-like, and better suited for training robots to perform delicate home tasks. Multiple tele-operators are simultaneously generating training data across multiple robots. This is how you build the dataset needed for eventual full autonomy, without waiting years for it to arrive. This might be the bridge between "robots that work in controlled environments" and "robots that work in homes." Not full autonomy right away, but trusted human intelligence operating through a robot body, getting better with every task completed. ~~ ♻️ Join the weekly robotics newsletter, and never miss any news →
0:56

Brain-controlled exoskeletons to train humanoid robots! 🧠 Fourier just presented human tele-operators using brain control interfaces and exoskeletal arms to train humanoid robots on home tasks. The brain control interface is the interesting part. Instead of using a controller or joystick to teleoperate, the operator's movements and intentions are captured more naturally through the exoskeleton and BCI. This means the demonstrations are more fluid, more human-like, and better suited for training robots to perform delicate home tasks. Multiple tele-operators are simultaneously generating training data across multiple robots. This is how you build the dataset needed for eventual full autonomy, without waiting years for it to arrive. This might be the bridge between "robots that work in controlled environments" and "robots that work in homes." Not full autonomy right away, but trusted human intelligence operating through a robot body, getting better with every task completed. ~~ ♻️ Join the weekly robotics newsletter, and never miss any news →

Lukas Ziegler

20,898 次观看 • 6 个月前

Built something with the goal of not leaving anyone behind. Now need some testers for this soft-launch. Check it out at Build whatever you can think of. Don't have any ideas? Just talk with your new team. Designed to get you away from the screens, not glued to them. Works great on mobile. Full real world capabilities. The free tier is perfect for people looking to get into AI and learn what its all about. The 'Empir3 Bridge' is for more advanced users and can power the whole empir3 team with your AI subscriptions... Grok, Claude, OpenAI, Google, or your local LLM. Everything runs local making it TOS friendly. Make them all work together in that same session. Fully opensource on GitHub You can use it with or without empir3. Full MCP, just point your AI at that repo and it will set it up. MIT license. New features weekly. *limited space and time until providers give me more channels.
2:00

Built something with the goal of not leaving anyone behind. Now need some testers for this soft-launch. Check it out at Build whatever you can think of. Don't have any ideas? Just talk with your new team. Designed to get you away from the screens, not glued to them. Works great on mobile. Full real world capabilities. The free tier is perfect for people looking to get into AI and learn what its all about. The 'Empir3 Bridge' is for more advanced users and can power the whole empir3 team with your AI subscriptions... Grok, Claude, OpenAI, Google, or your local LLM. Everything runs local making it TOS friendly. Make them all work together in that same session. Fully opensource on GitHub You can use it with or without empir3. Full MCP, just point your AI at that repo and it will set it up. MIT license. New features weekly. *limited space and time until providers give me more channels.

Z®

22,447 次观看 • 6 天前

Take any Python code and build a dynamic GUI on top of it by dragging and dropping components. Python is already the most popular language in the world. This makes it even better! The attached video is only 45 seconds. It will show you how it works. Here is the important part: You can now build an interface for your Python code without learning HTML, JavaScript, or CSS. Go to this link to try this: Remember to work smarter, not harder! Thanks to the team behind Taipy for partnering with me on this post.
0:45

Take any Python code and build a dynamic GUI on top of it by dragging and dropping components. Python is already the most popular language in the world. This makes it even better! The attached video is only 45 seconds. It will show you how it works. Here is the important part: You can now build an interface for your Python code without learning HTML, JavaScript, or CSS. Go to this link to try this: Remember to work smarter, not harder! Thanks to the team behind Taipy for partnering with me on this post.

Santiago

155,179 次观看 • 2 年前

Robots moving railcars! 🚃 Did you know that KUKA is also in the mobile robots business? Yes, you heard that right. And not just any robots. Robots that carry up to 56 tons! 🏋🏼 The railcar production process is highly complex, particularly when moving massive cars sideways within a plant. This challenge has been addressed at the Siemens facility in Germany using the OmniMove system from KUKA. The system allows for precise positioning, enabling the units to lift, move, and lower railcars with remarkable accuracy. With Mecanum wheels, the OmniMove units can move seamlessly in any direction, making the process incredibly efficient. Together, these units are capable of lifting up to 56 tons, streamlining heavy railcar production. This one is clearly tele-operated, but just looking at it makes me feel safer when I see a human in the loop. What a great use case for mobile robots! 😮‍💨 ~~ ♻️ Join the weekly robotics newsletter, and never miss any news →
0:38

Robots moving railcars! 🚃 Did you know that KUKA is also in the mobile robots business? Yes, you heard that right. And not just any robots. Robots that carry up to 56 tons! 🏋🏼 The railcar production process is highly complex, particularly when moving massive cars sideways within a plant. This challenge has been addressed at the Siemens facility in Germany using the OmniMove system from KUKA. The system allows for precise positioning, enabling the units to lift, move, and lower railcars with remarkable accuracy. With Mecanum wheels, the OmniMove units can move seamlessly in any direction, making the process incredibly efficient. Together, these units are capable of lifting up to 56 tons, streamlining heavy railcar production. This one is clearly tele-operated, but just looking at it makes me feel safer when I see a human in the loop. What a great use case for mobile robots! 😮‍💨 ~~ ♻️ Join the weekly robotics newsletter, and never miss any news →

Lukas Ziegler

19,148 次观看 • 1 个月前

Tired of teleoperation? One human video → 1,000s of robot demos. (📍GitHub ) Scaling Robot Data Without Dynamics Simulation or Robot Hardware Real2Render2Real (R2R2R) is a new way to scale robot data without physics simulation or hardware. You take a phone scan + a single monocular human demo. It tracks the motion, renders photorealistic scenes, and generates diverse, robot-agnostic trajectories ready for training. > No teleop, no sim, no robot, just a phone and a video > Train VLA models and diffusion policies directly on the output > Supports multiple robot embodiments with kinematic consistency > 1000s of demos in 1/27 the time of real-world collection Thank you, Max Fu, for sharing!! Project: Paper: Code coming soon: It shows that with the right pipeline, you can scale robot learning data without touching a robot. One of the most interesting directions in scalable robotics today. —— Weekly robotics and AI insights. Subscribe free:
0:29

Tired of teleoperation? One human video → 1,000s of robot demos. (📍GitHub ) Scaling Robot Data Without Dynamics Simulation or Robot Hardware Real2Render2Real (R2R2R) is a new way to scale robot data without physics simulation or hardware. You take a phone scan + a single monocular human demo. It tracks the motion, renders photorealistic scenes, and generates diverse, robot-agnostic trajectories ready for training. > No teleop, no sim, no robot, just a phone and a video > Train VLA models and diffusion policies directly on the output > Supports multiple robot embodiments with kinematic consistency > 1000s of demos in 1/27 the time of real-world collection Thank you, Max Fu, for sharing!! Project: Paper: Code coming soon: It shows that with the right pipeline, you can scale robot learning data without touching a robot. One of the most interesting directions in scalable robotics today. —— Weekly robotics and AI insights. Subscribe free:

Ilir Aliu

42,864 次观看 • 6 个月前

Magnetic levitation for surgical robots! 🧲 A research team working on minimally invasive surgery just introduced a remote magnetic levitation to move things inside our bodies. Their main goal is to control guidewires and catheters inside the body using magnetic fields. But levitation is unstable and extreme, it forces them to solve fundamental control problems they can't avoid. They have to handle strong magnetic field nonlinearities, develop real-time invertible models, and create control methods that work on any eMNS (electroMagnetic Navigation System) and any object. The real challenge is the position and orientation feedback. You can control a magnet outside the body, but once a catheter or drug-delivery robot is inside a patient, you can't see it. There's no vision, but just magnetic fields and current measurements. That's huge news coming out of ETH Zurich! Here's the paper: Mentioned all authors on Li, but coulnd't find them here! ~~ ♻️ Join the weekly robotics newsletter, and never miss any news →
0:20

Magnetic levitation for surgical robots! 🧲 A research team working on minimally invasive surgery just introduced a remote magnetic levitation to move things inside our bodies. Their main goal is to control guidewires and catheters inside the body using magnetic fields. But levitation is unstable and extreme, it forces them to solve fundamental control problems they can't avoid. They have to handle strong magnetic field nonlinearities, develop real-time invertible models, and create control methods that work on any eMNS (electroMagnetic Navigation System) and any object. The real challenge is the position and orientation feedback. You can control a magnet outside the body, but once a catheter or drug-delivery robot is inside a patient, you can't see it. There's no vision, but just magnetic fields and current measurements. That's huge news coming out of ETH Zurich! Here's the paper: Mentioned all authors on Li, but coulnd't find them here! ~~ ♻️ Join the weekly robotics newsletter, and never miss any news →

Lukas Ziegler

120,803 次观看 • 1 个月前

Simulation-first approach to robotic production lines! 👾 At Hannover Messe, Amazon Web Services (AWS) and SoftServe are demonstrating a fully autonomous, AI-powered manufacturing workflow. Design a product using generative AI, then watch it move through the entire process: engraving, inspection, and delivery, handled by a mix of robots working together powered by physical AI on AWS. The interesting part is how the system is built. Getting robots into production is usually where things fall apart. SoftServe takes a simulation-first approach using AWS. They build and test the entire system virtually: robot behavior, production flow, before deploying anything physically. This enables faster iteration, safe edge case testing, and significantly reduced sim-to-real gap. Their demo includes AMRs handling transport, cobots doing precise manipulation, AI-driven quality inspection, and humanoid interaction at the end. All connected through a unified, software-defined layer powered by AWS. It's about building a system where robots can adapt, coordinate, and scale without rebuilding everything from scratch every time. ~~ ♻️ Join the weekly robotics newsletter, and never miss any news →
1:38

Simulation-first approach to robotic production lines! 👾 At Hannover Messe, Amazon Web Services (AWS) and SoftServe are demonstrating a fully autonomous, AI-powered manufacturing workflow. Design a product using generative AI, then watch it move through the entire process: engraving, inspection, and delivery, handled by a mix of robots working together powered by physical AI on AWS. The interesting part is how the system is built. Getting robots into production is usually where things fall apart. SoftServe takes a simulation-first approach using AWS. They build and test the entire system virtually: robot behavior, production flow, before deploying anything physically. This enables faster iteration, safe edge case testing, and significantly reduced sim-to-real gap. Their demo includes AMRs handling transport, cobots doing precise manipulation, AI-driven quality inspection, and humanoid interaction at the end. All connected through a unified, software-defined layer powered by AWS. It's about building a system where robots can adapt, coordinate, and scale without rebuilding everything from scratch every time. ~~ ♻️ Join the weekly robotics newsletter, and never miss any news →

Lukas Ziegler

17,709 次观看 • 3 个月前

Robotics is entering the mainstream! 👀 Let's accept this fact. Consumptionism – stonks. Possibilities (HW + SW) – stonks. Demographics - not stonks. Modern robots are often designed to interact with our legacy world, whether it's a household, a factory, or a shipyard. That means they often need to work with existing machines, tools, and spaces. In short: retrofitting. Improving old machines with new technologies without major interference in their operation. Modern way of integrating things. You don't have to change the entire environment to deploy a robot. The robot will adapt, just as human would when freshly hired. The promise is to have an army of robots to help with the world designed for us. I also believe that general purpose robots, are not a direct competition for single purpose machines (like a highly efficient specialized packaging machine, for example). It's like adding a robot to this carriage. Specialized machine could be a car ;) ~~ ♻️ Join the weekly robotics newsletter, and never miss any news →
0:59

Robotics is entering the mainstream! 👀 Let's accept this fact. Consumptionism – stonks. Possibilities (HW + SW) – stonks. Demographics - not stonks. Modern robots are often designed to interact with our legacy world, whether it's a household, a factory, or a shipyard. That means they often need to work with existing machines, tools, and spaces. In short: retrofitting. Improving old machines with new technologies without major interference in their operation. Modern way of integrating things. You don't have to change the entire environment to deploy a robot. The robot will adapt, just as human would when freshly hired. The promise is to have an army of robots to help with the world designed for us. I also believe that general purpose robots, are not a direct competition for single purpose machines (like a highly efficient specialized packaging machine, for example). It's like adding a robot to this carriage. Specialized machine could be a car ;) ~~ ♻️ Join the weekly robotics newsletter, and never miss any news →

Lukas Ziegler

14,396 次观看 • 6 个月前

Awesome Robotics! 💾 Building your own robot just got a lot easier. MathWorks have released an open-source GitHub repository packed with robotics resources for anyone interested in getting hands-on. The repo includes examples for robot arms, ground vehicles, and drones, with projects that show how to connect with ROS and ROS2 or even deploy Simulink models directly as ROS nodes. There are also more advanced demos, like modeling off-road environments and testing navigation algorithms in photorealistic simulations. Everything is well-documented, with tutorials and links that make it easy to go from concept to prototype. 📑 Whether you’re a student, researcher, or just curious, there’s material here for every level. And since it’s an open community project, you can not only explore but also share your own contributions. For anyone looking to learn robotics by doing, this is a solid place to start! Here’s the link: ~~ ♻️ Join the weekly robotics newsletter, and never miss any news →
1:08

Awesome Robotics! 💾 Building your own robot just got a lot easier. MathWorks have released an open-source GitHub repository packed with robotics resources for anyone interested in getting hands-on. The repo includes examples for robot arms, ground vehicles, and drones, with projects that show how to connect with ROS and ROS2 or even deploy Simulink models directly as ROS nodes. There are also more advanced demos, like modeling off-road environments and testing navigation algorithms in photorealistic simulations. Everything is well-documented, with tutorials and links that make it easy to go from concept to prototype. 📑 Whether you’re a student, researcher, or just curious, there’s material here for every level. And since it’s an open community project, you can not only explore but also share your own contributions. For anyone looking to learn robotics by doing, this is a solid place to start! Here’s the link: ~~ ♻️ Join the weekly robotics newsletter, and never miss any news →

Lukas Ziegler

59,075 次观看 • 3 个月前

Building with AI gets easier every day. Here is an open-source library that makes integrating AI into an application extremely easy: Star the repository! This library alone can make React the best front-end framework out there! There are a bunch of cool things I like about CopilotKit. Here are 3 of them: 1. It allows you to take any -powered agent and bring it into your application. (This is a brand-new feature!) 2. You can build an AI-powered chatbot in your application. The chatbot will have access to your context and can act on the application. 3. You can build a RAG workflow to process and answer questions from a real-time knowledge base. I recorded a video to show you how simple it is to make some of this happen. A few lines of code, and you are in business. Here is a link to the sample application: CopilotKit is open-source. You can self-host it. You can use it with any LLM. Thanks to the team for showing me their tool and collaborating with me on this post!
5:59

Building with AI gets easier every day. Here is an open-source library that makes integrating AI into an application extremely easy: Star the repository! This library alone can make React the best front-end framework out there! There are a bunch of cool things I like about CopilotKit. Here are 3 of them: 1. It allows you to take any -powered agent and bring it into your application. (This is a brand-new feature!) 2. You can build an AI-powered chatbot in your application. The chatbot will have access to your context and can act on the application. 3. You can build a RAG workflow to process and answer questions from a real-time knowledge base. I recorded a video to show you how simple it is to make some of this happen. A few lines of code, and you are in business. Here is a link to the sample application: CopilotKit is open-source. You can self-host it. You can use it with any LLM. Thanks to the team for showing me their tool and collaborating with me on this post!

Santiago

108,835 次观看 • 2 年前