正在加载视频...

视频加载失败

加载此视频时出现问题。这可能是由于临时网络问题，或视频可能不可用。

Your phone can build voxel world now! 👾 This is an open-source tool that converts phone video into 3D point clouds. You can run Depth Anything 3 locally. Basically just local GPU inference. The interesting part is how it handles messy input. Video windows overlap, scale gets converted to... real meters, drift gets corrected after inference. The system stitches everything together even when footage is noisy. Objects far away might fail strict confidence filters but still show up as recognizable buildings. That's huge for small robots because perception becomes cheap and stays local. Obviously it wouldn't be a phone for robots, but it shows the potential of edge/local perception processing. A robot can understand its environment without offloading to the cloud. Real-world video has artifacts and occlusions. The system doesn't need perfect input to reconstruct scene structure. It works with what's there. For robotics, this means small platforms can build 3D maps autonomously using hardware they already have. Here's the repo: ~~ ♻️ Join the weekly robotics newsletter, and never miss any news →show more

Lukas Ziegler

62,628 subscribers

50,660 次观看 • 2 个月前 •via X (Twitter)

Anya Rossi• Live Now

Private livecam show

12 条评论

Ettore Di Giacinto 的头像

Ettore Di Giacinto2 个月前

@LocalAI_API @jichiep

Object Zero 的头像

Object Zero2 个月前

This is cool because I assume you can assign material properties and then infer structure. Did you make this?

Lukas Ziegler 的头像

Lukas Ziegler2 个月前

Found on Reddit, and tracked down the repo on gh

Object Zero 的头像

Object Zero2 个月前

Ah nice, needs an Octree function.

Lőrinc Bauer 的头像

Lőrinc Bauer2 个月前

😃

Jeffery M 的头像

Jeffery M2 个月前

Your high powered computer can convert video to voxel worlds... why mention phones?

Alejandro López 的头像

Alejandro López2 个月前

Depth estimation without Python or PyTorch, faster on CPU, quantization to q4_k. Exactly the kind of efficiency IoT edge devices need.

Mosaic_Systems 的头像

Mosaic_Systems2 个月前

If you wrap unreal engine 5.7 in to the code you can achieve much higher resolution, also when 6G ISAC is rolled out the mm waves can be used to map in 3D in real time with millimeter accuracy.

Tyler Niday 的头像

Tyler Niday2 个月前

@jnmacdnld

AI Mastery Guide 的头像

AI Mastery Guide2 个月前

Not needing perfect input to reconstruct the scene is the part that stands out most to me.

Gunhee Han 的头像

Gunhee Han2 个月前

Amazing👀

Mildo 🥽 的头像

Mildo 🥽2 个月前

@grok what are the hardware requirements?

相关视频

Turning video into humanoid robot motion! 🤳🏼 Training humanoid robots needs huge amounts of motion data, but real-world capture doesn’t scale. Mocap is expensive, dangerous edge cases are rare, and you can’t ask humans to repeatedly fall or crash. Video2Robot tackles this by converting videos into physics-grounded humanoid simulations. Motion is generated to respect balance, inertia, ground contact, and joint limits, then directly retargeted to robot simulators. One prompt can generate a full humanoid motion sequence, including multi-agent interactions and failure cases like falls or collisions, scenarios that are hard or impossible to capture safely in the real world. The pipeline is model-agnostic and works with existing video generators, making it a practical way to scale data for robots. If robots are going to operate in the real world, they need to be trained on the failures too, not just the perfect demos. Here's the GitHub: ~~ ♻️ Join the weekly robotics newsletter, and never miss any news →

Turning video into humanoid robot motion! 🤳🏼 Training humanoid robots needs huge amounts of motion data, but real-world capture doesn’t scale. Mocap is expensive, dangerous edge cases are rare, and you can’t ask humans to repeatedly fall or crash. Video2Robot tackles this by converting videos into physics-grounded humanoid simulations. Motion is generated to respect balance, inertia, ground contact, and joint limits, then directly retargeted to robot simulators. One prompt can generate a full humanoid motion sequence, including multi-agent interactions and failure cases like falls or collisions, scenarios that are hard or impossible to capture safely in the real world. The pipeline is model-agnostic and works with existing video generators, making it a practical way to scale data for robots. If robots are going to operate in the real world, they need to be trained on the failures too, not just the perfect demos. Here's the GitHub: ~~ ♻️ Join the weekly robotics newsletter, and never miss any news →

Lukas Ziegler

59,835 次观看 • 9 个月前

Another win for open-source robotics! 🔥 Hugging Face just released a fully open-source humanoid robot, and you can build one for $2,500. I'm a huge advocate of open-source in robotics space. Why? Robotics is too hard to solve alone. So lowering the entry point is crucial. Also, ROS proved open ecosystems create lasting industry standards. So let's have a look at the new member of humanoids family! LeRobot Humanoid is a 3D-printed, bipedal humanoid platform designed for real robot learning experiments. It's a complete and, buildable robot Anddddd yes, it's a full stack release: → Hardware files, bill of materials and full assembly documentation → Simulation assets and training environments → Runtime tools for calibration and real-world control → Sim-to-real identification pipeline When a part breaks, reprint it. When a design choice doesn't work, modify it and test again. The whole point is fast iteration on real hardware, not treating the robot as a fixed artefact. The timing is not a coincidence. As foundation models for robotics mature, the field desperately needs open physical platforms to train, validate and deploy them on. clem 🤗 LET'S GO!!! Build it here: ~~ ♻️ Join the weekly robotics newsletter, and never miss any news →

Another win for open-source robotics! 🔥 Hugging Face just released a fully open-source humanoid robot, and you can build one for $2,500. I'm a huge advocate of open-source in robotics space. Why? Robotics is too hard to solve alone. So lowering the entry point is crucial. Also, ROS proved open ecosystems create lasting industry standards. So let's have a look at the new member of humanoids family! LeRobot Humanoid is a 3D-printed, bipedal humanoid platform designed for real robot learning experiments. It's a complete and, buildable robot Anddddd yes, it's a full stack release: → Hardware files, bill of materials and full assembly documentation → Simulation assets and training environments → Runtime tools for calibration and real-world control → Sim-to-real identification pipeline When a part breaks, reprint it. When a design choice doesn't work, modify it and test again. The whole point is fast iteration on real hardware, not treating the robot as a fixed artefact. The timing is not a coincidence. As foundation models for robotics mature, the field desperately needs open physical platforms to train, validate and deploy them on. clem 🤗 LET'S GO!!! Build it here: ~~ ♻️ Join the weekly robotics newsletter, and never miss any news →

Lukas Ziegler

20,457 次观看 • 4 个月前

I don't know if you really understand what these people just did... They built an AI that looks at a few casual real-world videos or photos and instantly turns them into a full 3D playground. You can MOVE THE CAMERA HOWEVER YOU WANT, change the lighting, move objects around, and even let physics play out like in the real world. View events from impossible angles because Atlas knows what was there. This is massive! Let's take robotics. Until now training robots meant collecting tons of expensive real-world data. Now a handful of recordings can become thousands of different simulated situations. Robots can practice the same task in new rooms, with different objects and lighting without anyone having to film it all again. For the industry it means we can train robots way faster and cheaper. Home robots, warehouse robots, whatever... they can learn new environments at scale instead of staying stuck in the lab. This is one of the first real bridges between “cool AI video models” and actual physical machines that have to work in the real world. Blog: The team behind World Labs: Fei-Fei Li, Justin Johnson, Ben Mildenhall and Yunzhu Li. The video is from David Pantera. Follow for more insights into robotics and AI. —— Weekly robotics and AI insights. Subscribe free:

I don't know if you really understand what these people just did... They built an AI that looks at a few casual real-world videos or photos and instantly turns them into a full 3D playground. You can MOVE THE CAMERA HOWEVER YOU WANT, change the lighting, move objects around, and even let physics play out like in the real world. View events from impossible angles because Atlas knows what was there. This is massive! Let's take robotics. Until now training robots meant collecting tons of expensive real-world data. Now a handful of recordings can become thousands of different simulated situations. Robots can practice the same task in new rooms, with different objects and lighting without anyone having to film it all again. For the industry it means we can train robots way faster and cheaper. Home robots, warehouse robots, whatever... they can learn new environments at scale instead of staying stuck in the lab. This is one of the first real bridges between “cool AI video models” and actual physical machines that have to work in the real world. Blog: The team behind World Labs: Fei-Fei Li, Justin Johnson, Ben Mildenhall and Yunzhu Li. The video is from David Pantera. Follow for more insights into robotics and AI. —— Weekly robotics and AI insights. Subscribe free:

Ilir Aliu

273,166 次观看 • 27 天前

🚨 BREAKING: Big news in the computer vision world! 🎥 Luxonis | Robotic Vision just dropped its new OAK 4 line, and it’s a big upgrade for edge computer vision. Instead of being “just a stereo camera,” OAK 4 is a fully standalone vision computer with 52 TOPS of on-device AI. Models run locally, depth is computed locally, and no external PC or cloud pipeline is required. This is why robotics teams love it: lower latency, lower cost, fewer failure points in the field. The hardware is built for the real-world. IP67, shock-resistant, wide-FOV RGB + stereo pair, IR projection, IMU, audio, and a patent-pending calibration system that keeps depth accurate even when conditions change. But the real move is the platform. With Luxonis Hub, you can deploy models, grab telemetry, push OTA updates, or collect data when performance drifts, all from a unified interface. It turns a single device into an end-to-end edge CV system. Most customers today in robotics are groups who just want something that works: AMRs, bin-picking systems, trailer-loading robots, and ag-tech. 🤖 And they all say the same thing, the appeal isn’t raw TOPS, it’s the all-in-one simplicity that lets them scale without building custom infrastructure. Feels like the direction edge vision has been waiting for: rugged hardware + high-throughput on-device compute + a real management layer. A next step toward “plug-and-deploy” perception for robots. 🔗 Find out more here: ~~ ♻️ Join the weekly robotics newsletter, and never miss any news →

🚨 BREAKING: Big news in the computer vision world! 🎥 Luxonis | Robotic Vision just dropped its new OAK 4 line, and it’s a big upgrade for edge computer vision. Instead of being “just a stereo camera,” OAK 4 is a fully standalone vision computer with 52 TOPS of on-device AI. Models run locally, depth is computed locally, and no external PC or cloud pipeline is required. This is why robotics teams love it: lower latency, lower cost, fewer failure points in the field. The hardware is built for the real-world. IP67, shock-resistant, wide-FOV RGB + stereo pair, IR projection, IMU, audio, and a patent-pending calibration system that keeps depth accurate even when conditions change. But the real move is the platform. With Luxonis Hub, you can deploy models, grab telemetry, push OTA updates, or collect data when performance drifts, all from a unified interface. It turns a single device into an end-to-end edge CV system. Most customers today in robotics are groups who just want something that works: AMRs, bin-picking systems, trailer-loading robots, and ag-tech. 🤖 And they all say the same thing, the appeal isn’t raw TOPS, it’s the all-in-one simplicity that lets them scale without building custom infrastructure. Feels like the direction edge vision has been waiting for: rugged hardware + high-throughput on-device compute + a real management layer. A next step toward “plug-and-deploy” perception for robots. 🔗 Find out more here: ~~ ♻️ Join the weekly robotics newsletter, and never miss any news →

Lukas Ziegler

41,955 次观看 • 9 个月前

Smart mapping for robots exploring huge areas! 🗺️ This is called Rolling-Bonxai. When a drone or ground robot maps a massive area, say a whole city or massive warehouse, storing the entire map in memory gets expensive fast. You run out of RAM. This solution is simple, only keep the nearby map in memory. As the robot moves, old chunks save to disk and new chunks load. Like how video games only render what's close to the player. The system divides the map into chunks (imagine a 3D grid of boxes). As the robot explores, it keeps chunks around it loaded in memory. Chunks it's moving away from get saved to disk. When it comes back, they load again. Check the GH repo here 👉🏼 ~~ ♻️ Join the weekly robotics newsletter, and never miss any news →

Smart mapping for robots exploring huge areas! 🗺️ This is called Rolling-Bonxai. When a drone or ground robot maps a massive area, say a whole city or massive warehouse, storing the entire map in memory gets expensive fast. You run out of RAM. This solution is simple, only keep the nearby map in memory. As the robot moves, old chunks save to disk and new chunks load. Like how video games only render what's close to the player. The system divides the map into chunks (imagine a 3D grid of boxes). As the robot explores, it keeps chunks around it loaded in memory. Chunks it's moving away from get saved to disk. When it comes back, they load again. Check the GH repo here 👉🏼 ~~ ♻️ Join the weekly robotics newsletter, and never miss any news →

Lukas Ziegler

15,681 次观看 • 2 个月前

Robot simulation is getting a big upgrade! 🔥 Normally, building a simulation environment, a kitchen, warehouse, office takes days or weeks. You have to model the geometry, add textures, set lighting, generate collision meshes… all before a robot can even interact with it. Marble by World Labs removes most of that work. You type a text prompt or give it an image, and it generates a full 3D scene with depth, lighting, and a collider mesh you can export into engines like MuJoCo. That means researchers can quickly create lots of different environments to train robots on, which is exactly what domain randomization needs. If we want robots to learn faster, we need to create worlds faster. ~~ ♻️ Join the weekly robotics newsletter, and never miss any news →

Robot simulation is getting a big upgrade! 🔥 Normally, building a simulation environment, a kitchen, warehouse, office takes days or weeks. You have to model the geometry, add textures, set lighting, generate collision meshes… all before a robot can even interact with it. Marble by World Labs removes most of that work. You type a text prompt or give it an image, and it generates a full 3D scene with depth, lighting, and a collider mesh you can export into engines like MuJoCo. That means researchers can quickly create lots of different environments to train robots on, which is exactly what domain randomization needs. If we want robots to learn faster, we need to create worlds faster. ~~ ♻️ Join the weekly robotics newsletter, and never miss any news →

Lukas Ziegler

15,498 次观看 • 10 个月前

Build a humanoid robot yourself! 🪚 OpenArm is an open-source humanoid robot. It comes with full CAD, control code, firmware, and simulation tools, everything needed to build, modify, and operate it. The arms are designed to be compliant and backdrivable. Teleoperation is supported, with force feedback and real-time gravity compensation so operators can guide the arm naturally. Super important, on the simulation side, OpenArm works with platforms like MuJoCo and Isaac Sim, letting developers test policies in virtual environments before running on hardware. Assemble it yourself from a kit or get it prebuilt, the goal is accessibility for research labs, small teams, and enthusiasts. The project is run by Enactic in Tokyo, Japan, and aims to lower the barrier for experimenting with dexterous manipulation. Let's put robotics in mainstream! 🔥🔥 🔗 Find the link here: ~~ ♻️ Join the weekly robotics newsletter, and never miss any news →

Build a humanoid robot yourself! 🪚 OpenArm is an open-source humanoid robot. It comes with full CAD, control code, firmware, and simulation tools, everything needed to build, modify, and operate it. The arms are designed to be compliant and backdrivable. Teleoperation is supported, with force feedback and real-time gravity compensation so operators can guide the arm naturally. Super important, on the simulation side, OpenArm works with platforms like MuJoCo and Isaac Sim, letting developers test policies in virtual environments before running on hardware. Assemble it yourself from a kit or get it prebuilt, the goal is accessibility for research labs, small teams, and enthusiasts. The project is run by Enactic in Tokyo, Japan, and aims to lower the barrier for experimenting with dexterous manipulation. Let's put robotics in mainstream! 🔥🔥 🔗 Find the link here: ~~ ♻️ Join the weekly robotics newsletter, and never miss any news →

Lukas Ziegler

69,078 次观看 • 18 天前

OpenAI's thijs predicts robotics will have its own version of the 3D printing craze, with people buying cheap, open-source robot arms and connecting them to agents. "I can see a world quite soon where, similar to when everyone went and bought 3D printers and ran software, everyone's going to buy plastic, cheaper robot arms that you can clip onto a table, put stuff in front of, and plug them into agents." "The price of classic robotics equipment is thousands of dollars at the moment. This arm I'm using here is a Hugging Face SO-100 robot, which is open source, fully 3D printable, and around $200." "People can just pull up Codex and start controlling robots with it right now."

OpenAI's thijs predicts robotics will have its own version of the 3D printing craze, with people buying cheap, open-source robot arms and connecting them to agents. "I can see a world quite soon where, similar to when everyone went and bought 3D printers and ran software, everyone's going to buy plastic, cheaper robot arms that you can clip onto a table, put stuff in front of, and plug them into agents." "The price of classic robotics equipment is thousands of dollars at the moment. This arm I'm using here is a Hugging Face SO-100 robot, which is open source, fully 3D printable, and around $200." "People can just pull up Codex and start controlling robots with it right now."

TBPN

149,443 次观看 • 18 天前

World Labs co-founder Justin Johnson predicts a real-to-sim-to-real future where Atlas could train a robot for any new environment in minutes using just 5 photos from your phone: "One is this notion of fully in-context learning. Maybe I've got a robotics foundation model, then I can demonstrate the robot once how a task should be performed, and that's enough for the robot to figure out." "Another version is real to sim to real. Maybe I've got my pre-trained robotics foundation model, but I want to adapt it to this particular environment, like this studio, this table, moving this microphone around." "There's a version where you could come in here and take just a couple casual videos with your phone or a couple images with your phone, use Atlas to reconstruct the space, and now stage all kinds of robotics interactions in this studio space." "If you could lower the barrier to doing that, you could do it in five minutes to take five photos, upload it to Atlas, have it generate a simulation, maybe describe in natural language what kind of task you want the robot to do, have an agent go build that simulation for you, RL fine-tune your general purpose robotics foundation model, and now you've got a robot maybe in the span of a couple minutes that could come in and is perfectly adapted to this space." World Labs

World Labs co-founder Justin Johnson predicts a real-to-sim-to-real future where Atlas could train a robot for any new environment in minutes using just 5 photos from your phone: "One is this notion of fully in-context learning. Maybe I've got a robotics foundation model, then I can demonstrate the robot once how a task should be performed, and that's enough for the robot to figure out." "Another version is real to sim to real. Maybe I've got my pre-trained robotics foundation model, but I want to adapt it to this particular environment, like this studio, this table, moving this microphone around." "There's a version where you could come in here and take just a couple casual videos with your phone or a couple images with your phone, use Atlas to reconstruct the space, and now stage all kinds of robotics interactions in this studio space." "If you could lower the barrier to doing that, you could do it in five minutes to take five photos, upload it to Atlas, have it generate a simulation, maybe describe in natural language what kind of task you want the robot to do, have an agent go build that simulation for you, RL fine-tune your general purpose robotics foundation model, and now you've got a robot maybe in the span of a couple minutes that could come in and is perfectly adapted to this space." World Labs

MTS

25,204 次观看 • 27 天前

Robots might learn better from video than from language! 📼 Most Vision-Language-Action (VLA) models learn what to do from text, but still struggle with how things move in the real world. That makes them data-hungry and slow to train. mimic video takes a different route. Instead of grounding robot control in text, it grounds it in video, using large pre-trained video models that already capture physical motion and dynamics. The idea is straightforward: let the video model handle “what will happen next,” and let a smaller control model focus only on turning that visual plan into robot actions. The result is big gains in practice. Robots trained this way need 10× less data, converge twice as fast, and perform better on both simulated benchmarks and real bimanual manipulation tasks. If robots can “imagine” motion using video, control becomes a much simpler problem. Shoutout to Jonas Pai, Liam Achenbach, Oier Mees, Elvis Nava and the rest of the team! Here's the project page: ~~ ♻️ Join the weekly robotics newsletter, and never miss any news →

Robots might learn better from video than from language! 📼 Most Vision-Language-Action (VLA) models learn what to do from text, but still struggle with how things move in the real world. That makes them data-hungry and slow to train. mimic video takes a different route. Instead of grounding robot control in text, it grounds it in video, using large pre-trained video models that already capture physical motion and dynamics. The idea is straightforward: let the video model handle “what will happen next,” and let a smaller control model focus only on turning that visual plan into robot actions. The result is big gains in practice. Robots trained this way need 10× less data, converge twice as fast, and perform better on both simulated benchmarks and real bimanual manipulation tasks. If robots can “imagine” motion using video, control becomes a much simpler problem. Shoutout to Jonas Pai, Liam Achenbach, Oier Mees, Elvis Nava and the rest of the team! Here's the project page: ~~ ♻️ Join the weekly robotics newsletter, and never miss any news →

Lukas Ziegler

50,090 次观看 • 9 个月前

This is what open robotics actually looks like! 🔓 I was in Bordeaux, sitting inside Pollen Robotics, and had a chance to play around with their humanoid robot Reachy 2. It’s expressive, modular, and can even bring you coffee, and of course runs Python or Rust. I was talking with Reachy in 3 different languages, tele-operating it and manipulating kitchen stuff, and make it even mimic my gestures. The best part is that there are no locked APIs, or hidden stuff, just an open platform that you can build upon. The connection with Hugging Face makes it super easy to start, as the open source approach allows everyone to contribute, experiment and add their own things. I already ordered his little brother Reachy Mini, let's see what a robotics rookie can do with that robot! 👀 ~~ ♻️ Join the weekly robotics newsletter, and never miss any news →

This is what open robotics actually looks like! 🔓 I was in Bordeaux, sitting inside Pollen Robotics, and had a chance to play around with their humanoid robot Reachy 2. It’s expressive, modular, and can even bring you coffee, and of course runs Python or Rust. I was talking with Reachy in 3 different languages, tele-operating it and manipulating kitchen stuff, and make it even mimic my gestures. The best part is that there are no locked APIs, or hidden stuff, just an open platform that you can build upon. The connection with Hugging Face makes it super easy to start, as the open source approach allows everyone to contribute, experiment and add their own things. I already ordered his little brother Reachy Mini, let's see what a robotics rookie can do with that robot! 👀 ~~ ♻️ Join the weekly robotics newsletter, and never miss any news →

Lukas Ziegler

19,433 次观看 • 8 个月前

Brain-controlled exoskeletons to train humanoid robots! 🧠 Fourier just presented human tele-operators using brain control interfaces and exoskeletal arms to train humanoid robots on home tasks. The brain control interface is the interesting part. Instead of using a controller or joystick to teleoperate, the operator's movements and intentions are captured more naturally through the exoskeleton and BCI. This means the demonstrations are more fluid, more human-like, and better suited for training robots to perform delicate home tasks. Multiple tele-operators are simultaneously generating training data across multiple robots. This is how you build the dataset needed for eventual full autonomy, without waiting years for it to arrive. This might be the bridge between "robots that work in controlled environments" and "robots that work in homes." Not full autonomy right away, but trusted human intelligence operating through a robot body, getting better with every task completed. ~~ ♻️ Join the weekly robotics newsletter, and never miss any news →

Brain-controlled exoskeletons to train humanoid robots! 🧠 Fourier just presented human tele-operators using brain control interfaces and exoskeletal arms to train humanoid robots on home tasks. The brain control interface is the interesting part. Instead of using a controller or joystick to teleoperate, the operator's movements and intentions are captured more naturally through the exoskeleton and BCI. This means the demonstrations are more fluid, more human-like, and better suited for training robots to perform delicate home tasks. Multiple tele-operators are simultaneously generating training data across multiple robots. This is how you build the dataset needed for eventual full autonomy, without waiting years for it to arrive. This might be the bridge between "robots that work in controlled environments" and "robots that work in homes." Not full autonomy right away, but trusted human intelligence operating through a robot body, getting better with every task completed. ~~ ♻️ Join the weekly robotics newsletter, and never miss any news →

Lukas Ziegler

21,042 次观看 • 7 个月前

Built something with the goal of not leaving anyone behind. Now need some testers for this soft-launch. Check it out at Build whatever you can think of. Don't have any ideas? Just talk with your new team. Designed to get you away from the screens, not glued to them. Works great on mobile. Full real world capabilities. The free tier is perfect for people looking to get into AI and learn what its all about. The 'Empir3 Bridge' is for more advanced users and can power the whole empir3 team with your AI subscriptions... Grok, Claude, OpenAI, Google, or your local LLM. Everything runs local making it TOS friendly. Make them all work together in that same session. Fully opensource on GitHub You can use it with or without empir3. Full MCP, just point your AI at that repo and it will set it up. MIT license. New features weekly. *limited space and time until providers give me more channels.

Built something with the goal of not leaving anyone behind. Now need some testers for this soft-launch. Check it out at Build whatever you can think of. Don't have any ideas? Just talk with your new team. Designed to get you away from the screens, not glued to them. Works great on mobile. Full real world capabilities. The free tier is perfect for people looking to get into AI and learn what its all about. The 'Empir3 Bridge' is for more advanced users and can power the whole empir3 team with your AI subscriptions... Grok, Claude, OpenAI, Google, or your local LLM. Everything runs local making it TOS friendly. Make them all work together in that same session. Fully opensource on GitHub You can use it with or without empir3. Full MCP, just point your AI at that repo and it will set it up. MIT license. New features weekly. *limited space and time until providers give me more channels.

Z®

44,153 次观看 • 1 个月前

Take any Python code and build a dynamic GUI on top of it by dragging and dropping components. Python is already the most popular language in the world. This makes it even better! The attached video is only 45 seconds. It will show you how it works. Here is the important part: You can now build an interface for your Python code without learning HTML, JavaScript, or CSS. Go to this link to try this: Remember to work smarter, not harder! Thanks to the team behind Taipy for partnering with me on this post.

Take any Python code and build a dynamic GUI on top of it by dragging and dropping components. Python is already the most popular language in the world. This makes it even better! The attached video is only 45 seconds. It will show you how it works. Here is the important part: You can now build an interface for your Python code without learning HTML, JavaScript, or CSS. Go to this link to try this: Remember to work smarter, not harder! Thanks to the team behind Taipy for partnering with me on this post.

Santiago

155,254 次观看 • 2 年前

Robots moving railcars! 🚃 Did you know that KUKA is also in the mobile robots business? Yes, you heard that right. And not just any robots. Robots that carry up to 56 tons! 🏋🏼 The railcar production process is highly complex, particularly when moving massive cars sideways within a plant. This challenge has been addressed at the Siemens facility in Germany using the OmniMove system from KUKA. The system allows for precise positioning, enabling the units to lift, move, and lower railcars with remarkable accuracy. With Mecanum wheels, the OmniMove units can move seamlessly in any direction, making the process incredibly efficient. Together, these units are capable of lifting up to 56 tons, streamlining heavy railcar production. This one is clearly tele-operated, but just looking at it makes me feel safer when I see a human in the loop. What a great use case for mobile robots! 😮‍💨 ~~ ♻️ Join the weekly robotics newsletter, and never miss any news →

Robots moving railcars! 🚃 Did you know that KUKA is also in the mobile robots business? Yes, you heard that right. And not just any robots. Robots that carry up to 56 tons! 🏋🏼 The railcar production process is highly complex, particularly when moving massive cars sideways within a plant. This challenge has been addressed at the Siemens facility in Germany using the OmniMove system from KUKA. The system allows for precise positioning, enabling the units to lift, move, and lower railcars with remarkable accuracy. With Mecanum wheels, the OmniMove units can move seamlessly in any direction, making the process incredibly efficient. Together, these units are capable of lifting up to 56 tons, streamlining heavy railcar production. This one is clearly tele-operated, but just looking at it makes me feel safer when I see a human in the loop. What a great use case for mobile robots! 😮‍💨 ~~ ♻️ Join the weekly robotics newsletter, and never miss any news →

Lukas Ziegler

19,285 次观看 • 2 个月前

World Labs co-founder Justin Johnson on how five photos from your phone could teach a robot to work in a room it has never seen: "I think there's a couple different tech trees that people are working on. One is this notion of fully in-context learning. Maybe I've got a robotics foundation model, then I can demonstrate to the robot once how a task should be performed, and that's enough for the robot to figure out that task." "Another version is what we're calling real-to-sim-to-real. Maybe I've got my pre-trained robotics foundation model, but I want to adapt it to this particular environment." "Like this studio... You could come in here and take just a couple casual videos with your phone or a couple images with your phone, use Atlas to reconstruct the space, and now stage all kinds of robotics interactions in this studio space in particular." "Literally you could do it in five minutes. Take five photos, upload it to Atlas, have it generate a simulation, describe in natural language what kind of task you want the robot to do, have an agent go build that simulation for you, RL fine-tune your general purpose robotics foundation model, and now you've got a robot... that's perfectly adapted to this space." Justin Johnson on MTS

World Labs co-founder Justin Johnson on how five photos from your phone could teach a robot to work in a room it has never seen: "I think there's a couple different tech trees that people are working on. One is this notion of fully in-context learning. Maybe I've got a robotics foundation model, then I can demonstrate to the robot once how a task should be performed, and that's enough for the robot to figure out that task." "Another version is what we're calling real-to-sim-to-real. Maybe I've got my pre-trained robotics foundation model, but I want to adapt it to this particular environment." "Like this studio... You could come in here and take just a couple casual videos with your phone or a couple images with your phone, use Atlas to reconstruct the space, and now stage all kinds of robotics interactions in this studio space in particular." "Literally you could do it in five minutes. Take five photos, upload it to Atlas, have it generate a simulation, describe in natural language what kind of task you want the robot to do, have an agent go build that simulation for you, RL fine-tune your general purpose robotics foundation model, and now you've got a robot... that's perfectly adapted to this space." Justin Johnson on MTS

a16z

35,947 次观看 • 27 天前

Tired of teleoperation? One human video → 1,000s of robot demos. (📍GitHub ) Scaling Robot Data Without Dynamics Simulation or Robot Hardware Real2Render2Real (R2R2R) is a new way to scale robot data without physics simulation or hardware. You take a phone scan + a single monocular human demo. It tracks the motion, renders photorealistic scenes, and generates diverse, robot-agnostic trajectories ready for training. > No teleop, no sim, no robot, just a phone and a video > Train VLA models and diffusion policies directly on the output > Supports multiple robot embodiments with kinematic consistency > 1000s of demos in 1/27 the time of real-world collection Thank you, Max Fu, for sharing!! Project: Paper: Code coming soon: It shows that with the right pipeline, you can scale robot learning data without touching a robot. One of the most interesting directions in scalable robotics today. —— Weekly robotics and AI insights. Subscribe free:

Tired of teleoperation? One human video → 1,000s of robot demos. (📍GitHub ) Scaling Robot Data Without Dynamics Simulation or Robot Hardware Real2Render2Real (R2R2R) is a new way to scale robot data without physics simulation or hardware. You take a phone scan + a single monocular human demo. It tracks the motion, renders photorealistic scenes, and generates diverse, robot-agnostic trajectories ready for training. > No teleop, no sim, no robot, just a phone and a video > Train VLA models and diffusion policies directly on the output > Supports multiple robot embodiments with kinematic consistency > 1000s of demos in 1/27 the time of real-world collection Thank you, Max Fu, for sharing!! Project: Paper: Code coming soon: It shows that with the right pipeline, you can scale robot learning data without touching a robot. One of the most interesting directions in scalable robotics today. —— Weekly robotics and AI insights. Subscribe free:

Ilir Aliu

42,864 次观看 • 8 个月前

Magnetic levitation for surgical robots! 🧲 A research team working on minimally invasive surgery just introduced a remote magnetic levitation to move things inside our bodies. Their main goal is to control guidewires and catheters inside the body using magnetic fields. But levitation is unstable and extreme, it forces them to solve fundamental control problems they can't avoid. They have to handle strong magnetic field nonlinearities, develop real-time invertible models, and create control methods that work on any eMNS (electroMagnetic Navigation System) and any object. The real challenge is the position and orientation feedback. You can control a magnet outside the body, but once a catheter or drug-delivery robot is inside a patient, you can't see it. There's no vision, but just magnetic fields and current measurements. That's huge news coming out of ETH Zurich! Here's the paper: Mentioned all authors on Li, but coulnd't find them here! ~~ ♻️ Join the weekly robotics newsletter, and never miss any news →

Magnetic levitation for surgical robots! 🧲 A research team working on minimally invasive surgery just introduced a remote magnetic levitation to move things inside our bodies. Their main goal is to control guidewires and catheters inside the body using magnetic fields. But levitation is unstable and extreme, it forces them to solve fundamental control problems they can't avoid. They have to handle strong magnetic field nonlinearities, develop real-time invertible models, and create control methods that work on any eMNS (electroMagnetic Navigation System) and any object. The real challenge is the position and orientation feedback. You can control a magnet outside the body, but once a catheter or drug-delivery robot is inside a patient, you can't see it. There's no vision, but just magnetic fields and current measurements. That's huge news coming out of ETH Zurich! Here's the paper: Mentioned all authors on Li, but coulnd't find them here! ~~ ♻️ Join the weekly robotics newsletter, and never miss any news →

Lukas Ziegler

121,595 次观看 • 3 个月前