Loading video...

Video Failed to Load

Go Home

Using only box-forwarding speed as the reward, our Stackelberg PPO automatically evolves robots with arms for pushing and legs for moving. The key idea is a novel game-theoretic view of structure–control co-design, yielding more effective optimization and dramatically better designs. Come see our poster at ICLR 2026 on Apr...

51,765 views • 5 months ago •via X (Twitter)

0 Comments

No comments available

Comments from the original post will appear here

Related Videos

Model-Free Reinforcement Learning (MFRL) has been alluring, especially with supercharged compute with physics on GPU. However, the methods use 0-th order gradients, and are often not the best optimizers. Can we do better than PPO in continuous control for robotics? Turns out yes! 🥳 tl;dr: Faster, better RL than PPO in continuous control 💪 The answer lies in using more information from the simulation. We are juicing the simulation on GPU as it is, why not use it for gradients as well? This has been a driving question in a series of our works. We first studied this problem in ICLR 2022 paper on Short Horizon Actor Critic Naive gradient based methods are stuck in local minima and have exploding/vanishing gradients. SHAC solved this problem truncated rollouts and model based value estimation, where the model is Differentiable Sim. This boosted sample efficiency and wall-clock time immensely especially in high dimensional systems such as humanoids Yet, given enough compute PPO often caught up. Our follow up paper on on Adaptive Horizon Actor Critic at ICML 2024 discovers the cause and provides a fix. However, we find that even when given ground-truth dynamics, not all gradients are useful due to sample error. 1st-Order Model-Based Reinforcement Learning methods employing differentiable simulation provide gradients with reduced variance but are susceptible to bias in scenarios involving stiff dynamics, such as physical contact. We find that back-propagating through contact and long trajectories drastically reduces gradient accuracy. Using this insight, we propose AHAC to dynamically adapt its roll-out horizon to avoid differentiating through stiff contact. AHAC is a first-order model-based RL algorithm that learns high-dimensional tasks in minutes (wall clock) and outperforms PPO by 40%, even in the limit of data provided to PPO. This work is led by Ignat Georgiev alongside Krishnan Srinivasan, Jie Xu, Eric Heiden and ample assistance from warp team at NVIDIA Robotics (Miles Macklin)

Animesh Garg

52,308 views • 2 years ago

𝗥𝗼𝗯𝗼𝘁𝘀 𝗱𝗼𝗻’𝘁 𝗻𝗲𝗲𝗱 𝗺𝗼𝗿𝗲 𝗱𝗲𝗺𝗼𝗻𝘀𝘁𝗿𝗮𝘁𝗶𝗼𝗻𝘀. 𝗧𝗵𝗲𝘆 𝗻𝗲𝗲𝗱 𝘁𝗼 𝗹𝗲𝗮𝗿𝗻 𝗳𝗿𝗼𝗺 𝗳𝗮𝗶𝗹𝘂𝗿𝗲 — 𝗮𝗳𝘁𝗲𝗿 𝘄𝗮𝘁𝗰𝗵𝗶𝗻𝗴 𝗵𝘂𝗺𝗮𝗻𝘀. Most robot learning systems assume failure is the end of learning. In our new work, we study whether robots can improve after deployment by learning from their own failures, without any human intervention, teleoperation, or corrective labels. The key idea is simple: human videos contain structure about how the world works. We use them to learn cross-embodiment representations of action, dynamics, and value, enabling a shared predictive space between human behavior and robot experience. This allows a new learning loop: 👉 pretrain on human videos 👉 deploy robot policy 👉 observe failures 👉 reinterpret failures using human priors 👉 improve autonomously We evaluate this across 7 real-world manipulation tasks, showing: 📈 40% → 81% success rate 🏆 Strong improvements over π0.6 RECAP and RISE ✔️ Zero human intervention during post-deployment improvement 🧬 Generalizes across robot embodiments and policy backbones A key finding is that explicit failure repair significantly outperforms failure reweighting, yielding substantially larger gains under identical data conditions (+25 pts vs +5 pts on the same π0.5 base policy). Overall, the results suggest a shift in how we think about robot learning: Human videos are not only for pretraining policies. They can provide the structure needed for continual self-improvement after deployment. 📄 Paper: 🌐 Project: I am grateful for working with the fantastic leads Hanzhi Chen and Anran Zhang, and our collaborators Simon Schaefer, Kejia Chen, Shi Chen, Daniel Cremers. Special thanks to Stefan Leutenegger for co-advising this project with me. ETH Zürich TU München Microsoft Check out Hanzhi's 🧵 for more details

Oier Mees

12,732 views • 3 months ago

A look back at our mission to do /more. 🔥🛠️ Months ago, we entered a new growth phase for xLaunchpad, driven by a simple commitment: to do more. More exciting startups, more platform improvements, and a deeper, more meaningful connection with our community. /new We’ve introduced multiple initiatives to make participation in xLaunchpad more accessible, while still keeping EGLD stakers at the core of the experience: 🔸 Challenges Portal – Built in partnership with ᕈulsar Money, this platform allows users to earn lottery tickets by completing simple tasks. 🔸 Creators Program – A reward system for users who create valuable content about xLaunchpad and its projects. 🔸 xLaunchpad Users – Loyal participants from previous launches now have a chance to earn lottery tickets. 🔸 Project Users – Projects launching on xLaunchpad can distribute lottery tickets to eligible users based on set criteria. 🔸 EGLD Holders – Tickets can now be earned simply by holding EGLD in a wallet. Beyond these initiatives, we’ve also strengthened relationships with key community members, empowering them to write educational content about upcoming startups with full creative control on their side. And of course, we’ve introduced more projects and focused on accelerating launch timelines. /better The platform and lottery system have undergone continuous improvements, such as making participation more accessible as detailed above: 🔸 Faster EGLD Reclaims - Users now get their EGLD back more quickly after participation. 🔸 Improved Communication – Blog & X Articles covering both general topics and project-specific updates. Increased community discussions and more structured feedback collection. 🔸 Website Enhancements - Various UI/UX tweaks, with /more to come 👀. 🔸 Integrating AshSwap - Users could buy lottery tickets for the last project with any tokens. 🔸 KYC Improvements - Streamlined processes, with /more to come 👀. Additionally, we’ve successfully co-launched projects with other launchpads and supported startups in securing partnerships, listings, business deals, and legal guidance. xLaunchpad remains one of the most compliant launchpads, ensuring projects align with MiCA regulations and broader industry standards. /next Looking ahead, our main focus remains on the product and the community. Every improvement is guided by real user interactions and feedback, ensuring xLaunchpad continues to evolve. At its core, our mission revolves around two key goals: 1️⃣ Bringing exciting startups to life 2️⃣ Providing users with investment opportunities on the best terms For xLaunchpad and its community to thrive together, it’s essential to recognize these two pillars while understanding the platform’s bigger purpose: making something possible that wasn’t before - allowing retail users to participate in the early launch of promising projects and benefit through multiple avenues. From investments to early adoption, and from unlocking key benefits to shaping young startups. We cannot stress enough how much effort the team puts into achieving these key goals, and we’re grateful to have you by our side on this mission. /more

xLaunchpad

22,927 views • 1 year ago

It’s hard to believe we're on the final day of our campaign to save the farm and keep our special Esther Magic in Campbellville with Operation Angels. In just two short months, we've raised over half a million dollars to help bring this dream to life. Although we haven't hit our goal yet, what we've achieved is incredible. With over 6,100 contributors from 39 countries totaling over $560,000, this is a global affair in typical Esther fashion. This project is designed to generate revenue to support sanctuaries and rescue organizations and serve as a model for revenue-generating programs at existing facilities. What sets us apart is our approach to drawing revenue from a new demographic to ease the pressure on current donors and an educational program to better equip animal organizations for the challenges they face. This project represents everything Esther stood for: kindness, compassion, inclusion, and support. I can't think of a better way to honor her and the community of like-minded people who make our little corner of the internet unique. The campaign will remain active until 4 am ET on August 1st, so we have less than 17 hours to give it our best and finish strong. To anyone who hasn't contributed, I hope you’ll consider doing so today because we could certainly use your help. We may not reach our goal, and that’s okay. Don’t be discouraged. It just means we keep going because come hell or high water, we’re going back to Campbellville. Thank you to everyone who has contributed so far and to everyone who has liked, shared, and commented on campaign posts these last two months. You have all played a critical role, and I am eternally grateful for your support and encouragement. It is an honor and a privilege to be part of this project with all of you. It represents the end of an era and the start of a new and exciting one. We’re going to do amazing things together, and I can't wait to get back to work. See you all live tonight for our final campaign Garden Chat at 6:30 PM ET. xoxo Steve.

Esther TheWonder Pig

11,928 views • 2 years ago

A Letter to Our Community: The Road Ahead for Robotics To our Community and Partners, As we step into 2026, our mission at Axis is clearer than ever: Constructing the definitive End-to-End Scaling Layer for Robotics. Our goal is to accelerate the transfer of diverse human intelligence into Robotics General Intelligence (RGI). By owning the critical path of intelligence creation, we are turning the physical limitations of robotics into a scalable, software-driven future. Here is our strategic outlook and roadmap for the year ahead. The Core Thesis: Simulation is the Only Way Out The path to RGI is currently blocked by Data Scarcity, Generalization Fragility, and Hardware Fragmentation. At Axis, we believe Simulation is the only way out. Our Simulation Data Platform and Data Augmentation Engine transform raw data into "Synthetic Gold". Backed by academic milestones like Roboverse, Skill Blending, and GraspVLA, we have proven that pure simulation can achieve the generalization required for the real world. We don’t just collect data; we architect it. The Engine: Why Crypto? We believe RGI should come from all, not a few. Crypto is not just a feature; it is the primitive that powers our entire ecosystem flywheel: - Incentive Mechanism: Democratizing contribution and rewarding the trainers and developers. - Assetization: Turning proprietary data and refined models into liquid, ownable assets. - Verifiable Workflow: We are opening the "Black Box" of AI. By bringing total transparency to the Task Generation → Data Collection → Model Training pipeline, we ensure every byte of intelligence is verifiable, traceable, and secure. 2026 Strategic Deliverables This year, we are committed to delivering three foundational pillars: - The World's Largest Training Dataset for Robots: A robot training set—diverse, high-quality interaction data at an unprecedented scale. - A Robotics Foundation Model: A universal robotic brain trained on our pure simulation and synthetic data, capable of robust cross-embodiment transfer and open-world adaptability. - Evolvable Robot Hardware: Robots deployed with Axis models that autonomously evolve through continuous interaction, turning every deployment into a self-improving node within our RGI network. The Ultimate Vision We are building more than models; we are architecting the Distributed Machine Economy. A future where every dataset, model, and robotic embodiment is a verifiable asset in a global, autonomous network. Thank you for building the future of intelligence with us✌️📷

Axis Robotics

28,096 views • 9 months ago