Video yükleniyor...

Video Yüklenemedi

Ana Sayfaya Dön

Multi-robot learning is getting a serious boost! 📚 Researchers have extended Isaac Lab to train heterogeneous multi-agent robotic policies at scale. The new framework supports high-resolution physics, GPU-accelerated simulation, and both homogeneous and heterogeneous agents working together on coordination tasks. They benchmarked different approaches (MAPPO: Multi-Agent Proximal Policy Optimization...

lukas_m_ziegler's profile picture

Lukas Ziegler

55,149 subscribers

38,997 görüntüleme • 11 ay önce •via X (Twitter)

LIVE

Anya Rossi• Live Now

Private livecam show

0 Yorum

Yorum bulunmuyor

Orijinal gönderinin yorumları burada görünecek

Benzer Videolar

Generalist robots need multimodal learning—fusing vision, touch, and body motion to handle unstructured worlds. 🦾 NVIDIA Isaac Lab is a GPU-accelerated, open-source simulation framework for robot learning that unifies physics, rendering, sensing, and parallel computing to train robot policies at scale. Learn more 🔗 #NVIDIAResearch
0:11

Generalist robots need multimodal learning—fusing vision, touch, and body motion to handle unstructured worlds. 🦾 NVIDIA Isaac Lab is a GPU-accelerated, open-source simulation framework for robot learning that unifies physics, rendering, sensing, and parallel computing to train robot policies at scale. Learn more 🔗 #NVIDIAResearch

NVIDIA Robotics

18,568 görüntüleme • 8 ay önce

Generalist robot policies need a benchmark that works across any robot and any policy. 🦾 Introducing RoboLab, a high‑fidelity simulation benchmark built on NVIDIA Isaac and Omniverse to evaluate generalist robot policies in diverse, photoreal, physics‑based environments. Coming soon to the NVIDIA Isaac Lab‑Arena roadmap for large‑scale, robotic policy evaluation. 📖 #NationalRoboticsWeek
0:15

Generalist robot policies need a benchmark that works across any robot and any policy. 🦾 Introducing RoboLab, a high‑fidelity simulation benchmark built on NVIDIA Isaac and Omniverse to evaluate generalist robot policies in diverse, photoreal, physics‑based environments. Coming soon to the NVIDIA Isaac Lab‑Arena roadmap for large‑scale, robotic policy evaluation. 📖 #NationalRoboticsWeek

NVIDIA Robotics

24,097 görüntüleme • 6 ay önce

Robot policies can succeed in a demo and still fail as tasks, environments, and conditions change. With open-source Isaac Lab-Arena 0.3, developers can use an experimental agentic workflow to generate environments, evaluate policies at scale, and identify where and why failures occur.
0:14

Robot policies can succeed in a demo and still fail as tasks, environments, and conditions change. With open-source Isaac Lab-Arena 0.3, developers can use an experimental agentic workflow to generate environments, evaluate policies at scale, and identify where and why failures occur.

NVIDIA Robotics

15,633 görüntüleme • 1 ay önce

Newton 1.0 is now generally available. 🙌 Take robot learning to the next level with: 🤖 Stable Articulated & Complex Mechanism Simulation – accurate, reliable machine modeling. 🖐️ High-Fidelity Hydroelastic Contact Modeling – realistic soft contact and touch-based interactions. 🧵 Deformable Body Simulation – simulate cables, cloth, rubber, and other elastic materials with VBD. ⚡ Accelerated Robot Learning at Scale – seamless integration with open simulation and learning frameworks, NVIDIA Isaac Sim and Isaac Lab for scalable workflows. Learn how to integrate this open-source physics engine into your workflow: #NVIDIAGTC
0:10

Newton 1.0 is now generally available. 🙌 Take robot learning to the next level with: 🤖 Stable Articulated & Complex Mechanism Simulation – accurate, reliable machine modeling. 🖐️ High-Fidelity Hydroelastic Contact Modeling – realistic soft contact and touch-based interactions. 🧵 Deformable Body Simulation – simulate cables, cloth, rubber, and other elastic materials with VBD. ⚡ Accelerated Robot Learning at Scale – seamless integration with open simulation and learning frameworks, NVIDIA Isaac Sim and Isaac Lab for scalable workflows. Learn how to integrate this open-source physics engine into your workflow: #NVIDIAGTC

NVIDIA Robotics

82,939 görüntüleme • 7 ay önce

Building robots that can effectively operate alongside human workers is difficult. 🛠️ Advances in open-source physics, open foundation models, and frameworks are helping accelerate physical #AI deployment. ✔️ Newton Physics Engine, an open-source GPU-powered simulation built on OpenUSD, speeds up robot learning for advanced manipulation and mobility. ✔️ NVIDIA Cosmos Reason, an open reasoning vision language model, gives robots the ability to think like humans using prior knowledge, common sense and physics ✔️NVIDIA Isaac GR00T N1.6, an open robot foundation model, enables humanoids to understand ambiguous instructions Leading robotics developers including Agility Robotics, Lightwheel, Mentee Robotics, UniversalRobots, and Wandelbots are adopting simulation technologies and libraries to accelerate physical AI development and deployment. Omniverse Ambassador Dylan Tobin built an AI chatbot trained on Isaac Sim workflows, helping devs navigate Omniverse faster. Read the full blog 👉
0:13

Building robots that can effectively operate alongside human workers is difficult. 🛠️ Advances in open-source physics, open foundation models, and frameworks are helping accelerate physical #AI deployment. ✔️ Newton Physics Engine, an open-source GPU-powered simulation built on OpenUSD, speeds up robot learning for advanced manipulation and mobility. ✔️ NVIDIA Cosmos Reason, an open reasoning vision language model, gives robots the ability to think like humans using prior knowledge, common sense and physics ✔️NVIDIA Isaac GR00T N1.6, an open robot foundation model, enables humanoids to understand ambiguous instructions Leading robotics developers including Agility Robotics, Lightwheel, Mentee Robotics, UniversalRobots, and Wandelbots are adopting simulation technologies and libraries to accelerate physical AI development and deployment. Omniverse Ambassador Dylan Tobin built an AI chatbot trained on Isaac Sim workflows, helping devs navigate Omniverse faster. Read the full blog 👉

NVIDIA

48,500 görüntüleme • 1 yıl önce

A monowheel security robot from Estonia! 🇪🇪 Rollo Robotics just raised €3.7M pre-seed led by FoodLabs and PROTOTYPE to bring the world's first stable autonomous monowheel robot to market. Founded by Arno Kütt (the mind behind Cleveron) and Sander Sebastian Agur, this Estonian startup has cracked what they call the "stability paradox" of the monowheel. Instead of clunky multi-wheeled platforms, Rollo uses high-frequency sensor fusion and proprietary balance control to create a slim, agile robot that navigates tight urban spaces and industrial corridors where traditional robots simply can't fit. The application? Autonomous security patrolling. With hybrid threats to physical infrastructure growing, the demand for scalable robotic security is massive. The funding will go toward two things: hardening the tech for extreme weather and high-traffic environments, and scaling production to meet demand from early pilot programs. 💰 P.S. Monowheels have been sci-fi for decades. Excited to see if Rollo can make them practical at scale. ~~ ♻️ Join the weekly robotics newsletter, and never miss any news →
0:17

A monowheel security robot from Estonia! 🇪🇪 Rollo Robotics just raised €3.7M pre-seed led by FoodLabs and PROTOTYPE to bring the world's first stable autonomous monowheel robot to market. Founded by Arno Kütt (the mind behind Cleveron) and Sander Sebastian Agur, this Estonian startup has cracked what they call the "stability paradox" of the monowheel. Instead of clunky multi-wheeled platforms, Rollo uses high-frequency sensor fusion and proprietary balance control to create a slim, agile robot that navigates tight urban spaces and industrial corridors where traditional robots simply can't fit. The application? Autonomous security patrolling. With hybrid threats to physical infrastructure growing, the demand for scalable robotic security is massive. The funding will go toward two things: hardening the tech for extreme weather and high-traffic environments, and scaling production to meet demand from early pilot programs. 💰 P.S. Monowheels have been sci-fi for decades. Excited to see if Rollo can make them practical at scale. ~~ ♻️ Join the weekly robotics newsletter, and never miss any news →

Lukas Ziegler

18,863 görüntüleme • 9 ay önce

Microsoft presents Windows Agent Arena Evaluating Multi-Modal OS Agents at Scale discuss: Large language models (LLMs) show remarkable potential to act as computer agents, enhancing human productivity and software accessibility in multi-modal tasks that require planning and reasoning. However, measuring agent performance in realistic environments remains a challenge since: (i) most benchmarks are limited to specific modalities or domains (e.g. text-only, web navigation, Q&A, coding) and (ii) full benchmark evaluations are slow (on order of magnitude of days) given the multi-step sequential nature of tasks. To address these challenges, we introduce the Windows Agent Arena: a reproducible, general environment focusing exclusively on the Windows operating system (OS) where agents can operate freely within a real Windows OS and use the same wide range of applications, tools, and web browsers available to human users when solving tasks. We adapt the OSWorld framework (Xie et al., 2024) to create 150+ diverse Windows tasks across representative domains that require agent abilities in planning, screen understanding, and tool usage. Our benchmark is scalable and can be seamlessly parallelized in Azure for a full benchmark evaluation in as little as 20 minutes. To demonstrate Windows Agent Arena's capabilities, we also introduce a new multi-modal agent, Navi. Our agent achieves a success rate of 19.5% in the Windows domain, compared to 74.5% performance of an unassisted human. Navi also demonstrates strong performance on another popular web-based benchmark, Mind2Web. We offer extensive quantitative and qualitative analysis of Navi's performance, and provide insights into the opportunities for future research in agent development and data generation using Windows Agent Arena.
0:18

Microsoft presents Windows Agent Arena Evaluating Multi-Modal OS Agents at Scale discuss: Large language models (LLMs) show remarkable potential to act as computer agents, enhancing human productivity and software accessibility in multi-modal tasks that require planning and reasoning. However, measuring agent performance in realistic environments remains a challenge since: (i) most benchmarks are limited to specific modalities or domains (e.g. text-only, web navigation, Q&A, coding) and (ii) full benchmark evaluations are slow (on order of magnitude of days) given the multi-step sequential nature of tasks. To address these challenges, we introduce the Windows Agent Arena: a reproducible, general environment focusing exclusively on the Windows operating system (OS) where agents can operate freely within a real Windows OS and use the same wide range of applications, tools, and web browsers available to human users when solving tasks. We adapt the OSWorld framework (Xie et al., 2024) to create 150+ diverse Windows tasks across representative domains that require agent abilities in planning, screen understanding, and tool usage. Our benchmark is scalable and can be seamlessly parallelized in Azure for a full benchmark evaluation in as little as 20 minutes. To demonstrate Windows Agent Arena's capabilities, we also introduce a new multi-modal agent, Navi. Our agent achieves a success rate of 19.5% in the Windows domain, compared to 74.5% performance of an unassisted human. Navi also demonstrates strong performance on another popular web-based benchmark, Mind2Web. We offer extensive quantitative and qualitative analysis of Navi's performance, and provide insights into the opportunities for future research in agent development and data generation using Windows Agent Arena.

AK

19,684 görüntüleme • 2 yıl önce

Robora Sim: A PyBullet-Powered Environment for Learning Robotic Physical Intelligence We are currently building our Robora simulation environment setup for our sim based learning, leveraging PyBullet, an industry-standard physics engine widely used in AI-driven robotics research and development. The environment is optimized with GPU-accelerated learning algorithms, enabling high-speed imitation learning and reinforcement learning within a safe and controlled virtual setup before shipping out to real world. This simulation platform allows our models to learn, adapt, and generalize across different robot morphologies, terrain types and task objectives - all before deployment to the real world. At it's core, the system combines a VLA-powered high-level planner with low-level motion control algorithms, working cohesively to produce emergent, physically intelligent behaviors. This synergy between simulation, learning, and real-world transfer marks a major step forward in our pursuit of adaptive and intelligent robotic systems. Through advanced domain randomization and synthetic data generation, the Robora Simulation Environment ensures that policies trained in simulation transfer effectively to real-world robots, minimizing the sim-to-real gap. Moreover, users will be able to test and integrate their own hardware kits within selected simulation environments in the Robora Dapp, ensuring seamless compatibility and safer real-world implementation.
0:14

Robora Sim: A PyBullet-Powered Environment for Learning Robotic Physical Intelligence We are currently building our Robora simulation environment setup for our sim based learning, leveraging PyBullet, an industry-standard physics engine widely used in AI-driven robotics research and development. The environment is optimized with GPU-accelerated learning algorithms, enabling high-speed imitation learning and reinforcement learning within a safe and controlled virtual setup before shipping out to real world. This simulation platform allows our models to learn, adapt, and generalize across different robot morphologies, terrain types and task objectives - all before deployment to the real world. At it's core, the system combines a VLA-powered high-level planner with low-level motion control algorithms, working cohesively to produce emergent, physically intelligent behaviors. This synergy between simulation, learning, and real-world transfer marks a major step forward in our pursuit of adaptive and intelligent robotic systems. Through advanced domain randomization and synthetic data generation, the Robora Simulation Environment ensures that policies trained in simulation transfer effectively to real-world robots, minimizing the sim-to-real gap. Moreover, users will be able to test and integrate their own hardware kits within selected simulation environments in the Robora Dapp, ensuring seamless compatibility and safer real-world implementation.

Robora

23,540 görüntüleme • 1 yıl önce

Google just announced Instruct-Imagen Image Generation with Multi-modal Instruction paper page: Instruct-Imagen generalizes to heterogeneous and complex image generation tasks
0:17

Google just announced Instruct-Imagen Image Generation with Multi-modal Instruction paper page: Instruct-Imagen generalizes to heterogeneous and complex image generation tasks

AK

91,780 görüntüleme • 2 yıl önce

Announcing our commercial partnership with Booster Robotics Booster builds humanoid robot hardware, OS, and developer tools to make humanoid robots more affordable, reliable, and practical. The partnership centers on using simulation to multiply the value of real-robot data—expanding teleoperation demonstrations into scalable training data across diverse tasks and scenes. This joint effort powers sim-real co-training and foundation-model development, accelerating progress from hardware iteration to deployable robot policies. Together, we're building simulation‑powered data infrastructure for Physical AI — making scalable training data accessible to model developers and the broader robotics ecosystem.
0:12

Announcing our commercial partnership with Booster Robotics Booster builds humanoid robot hardware, OS, and developer tools to make humanoid robots more affordable, reliable, and practical. The partnership centers on using simulation to multiply the value of real-robot data—expanding teleoperation demonstrations into scalable training data across diverse tasks and scenes. This joint effort powers sim-real co-training and foundation-model development, accelerating progress from hardware iteration to deployable robot policies. Together, we're building simulation‑powered data infrastructure for Physical AI — making scalable training data accessible to model developers and the broader robotics ecosystem.

Axis Robotics

72,872 görüntüleme • 3 ay önce

Autonomous excavator building a wall! 🪨 This will blow your mind! 🤯 Researchers from ETH Zürich and Robotic Systems Lab have used an autonomous excavator to build a 65-meter-long, six-meter-high dry-stone wall. The autonomous system, called "Heap," precisely firstly scanned and then placed stones, forming a wall. Through computer-aided design and control, the robot was able to handle and position over 900 individual elements, some weighing over 1000 kilograms. Can we call it the Great Wall of Switzerland?! 🇨🇭 Here's the page of the project that was on from 2016 to 2025: ~~ ♻️ Join the weekly robotics newsletter, and never miss any news →
0:17

Autonomous excavator building a wall! 🪨 This will blow your mind! 🤯 Researchers from ETH Zürich and Robotic Systems Lab have used an autonomous excavator to build a 65-meter-long, six-meter-high dry-stone wall. The autonomous system, called "Heap," precisely firstly scanned and then placed stones, forming a wall. Through computer-aided design and control, the robot was able to handle and position over 900 individual elements, some weighing over 1000 kilograms. Can we call it the Great Wall of Switzerland?! 🇨🇭 Here's the page of the project that was on from 2016 to 2025: ~~ ♻️ Join the weekly robotics newsletter, and never miss any news →

Lukas Ziegler

57,245 görüntüleme • 1 ay önce

#NVIDIAIsaac Sim 5.0 and Isaac Lab 2.2 are now available in early developer preview on Github. 🎉 These releases give #Robotics developers early access to cutting-edge tools to simulate, train, and validate robots in a physics-based simulation environment. What’s new? ✅Open-source ✅Extensions for synthetic data generation ✅Robot models Read the tech blog to learn more ➡️ #GTCParis #VivaTech
0:18

#NVIDIAIsaac Sim 5.0 and Isaac Lab 2.2 are now available in early developer preview on Github. 🎉 These releases give #Robotics developers early access to cutting-edge tools to simulate, train, and validate robots in a physics-based simulation environment. What’s new? ✅Open-source ✅Extensions for synthetic data generation ✅Robot models Read the tech blog to learn more ➡️ #GTCParis #VivaTech

NVIDIA Robotics

13,662 görüntüleme • 1 yıl önce

NVIDIA announces new Isaac tools for agents as Agile Robots unveils Agile ONE SN, a reference humanoid for robotics research. 🦾 Built on NVIDIA Isaac GR00T and powered by Jetson Thor, Agile ONE SN gives researchers and developers an integrated platform to develop, train and validate humanoid skills. The Isaac expansion also introduces new datasets, a runtime, and robot learning framework updates to accelerate development from data to deployment. Read the #NVIDIAGTC announcement:
0:13

NVIDIA announces new Isaac tools for agents as Agile Robots unveils Agile ONE SN, a reference humanoid for robotics research. 🦾 Built on NVIDIA Isaac GR00T and powered by Jetson Thor, Agile ONE SN gives researchers and developers an integrated platform to develop, train and validate humanoid skills. The Isaac expansion also introduces new datasets, a runtime, and robot learning framework updates to accelerate development from data to deployment. Read the #NVIDIAGTC announcement:

NVIDIA Robotics

63,053 görüntüleme • 14 gün önce

this is f*cking gold. Google engineers and MIT researchers ran 260 controlled agent experiments across 6 benchmarks, 5 architectures, and the OpenAI, Gemini, and Claude model families to find out when Multi Agent systems actually help and when adding more agents quietly destroys performance the average result was brutal: −0.3%. best case: +80.8% worst case: −70.0% the key threshold was around a 45% single agent baseline. below it, extra agents can help. above it, coordination often becomes pure overhead. on parallel tasks, Multi Agent reached +80.8%. on sequential tasks, it collapsed by as much as 70%. 3 agents needed 26 to 44 interaction rounds. a single agent needed 7.2. error amplification also hit 17.2× in independent parallel systems. their final framework predicts the right architecture with 87% accuracy.
0:15

this is f*cking gold. Google engineers and MIT researchers ran 260 controlled agent experiments across 6 benchmarks, 5 architectures, and the OpenAI, Gemini, and Claude model families to find out when Multi Agent systems actually help and when adding more agents quietly destroys performance the average result was brutal: −0.3%. best case: +80.8% worst case: −70.0% the key threshold was around a 45% single agent baseline. below it, extra agents can help. above it, coordination often becomes pure overhead. on parallel tasks, Multi Agent reached +80.8%. on sequential tasks, it collapsed by as much as 70%. 3 agents needed 26 to 44 interaction rounds. a single agent needed 7.2. error amplification also hit 17.2× in independent parallel systems. their final framework predicts the right architecture with 87% accuracy.

NO1ennn

12,521 görüntüleme • 1 ay önce

Moving from individual proofs to large-scale autoformalization requires new tools. We introduce Choir, an open protocol for multi-agent autoformalization that decomposes projects into tasks, coordinates contributions through GitHub, and deterministically checks them before merging. Choir is modular, open source, and supports Lean 4, Isabelle, and Rocq. Repository: Preprint: Led by Yidi Qi. Supported by DARPA expMath.
0:11

Moving from individual proofs to large-scale autoformalization requires new tools. We introduce Choir, an open protocol for multi-agent autoformalization that decomposes projects into tasks, coordinates contributions through GitHub, and deterministically checks them before merging. Choir is modular, open source, and supports Lean 4, Isabelle, and Rocq. Repository: Preprint: Led by Yidi Qi. Supported by DARPA expMath.

Melanie Weber

38,734 görüntüleme • 1 ay önce

The future of robotics is something you have to experience hands-on. 🤲 Join us at #SIGGRAPH2026 for our physical AI labs covering NVIDIA Cosmos, robot learning with Isaac Lab and Newton, and more. Check the comments for the full lineup. ⬇️
0:11

The future of robotics is something you have to experience hands-on. 🤲 Join us at #SIGGRAPH2026 for our physical AI labs covering NVIDIA Cosmos, robot learning with Isaac Lab and Newton, and more. Check the comments for the full lineup. ⬇️

NVIDIA Robotics

20,295 görüntüleme • 3 ay önce

MasterBOT is officially integrating with NVIDIA Isaac Lab NVIDIA’s robotics simulation platform built for developing and training autonomous machines This brings $BOT one step closer to powering the future of decentralized Robotics AI
0:14

MasterBOT is officially integrating with NVIDIA Isaac Lab NVIDIA’s robotics simulation platform built for developing and training autonomous machines This brings $BOT one step closer to powering the future of decentralized Robotics AI

MasterBOT

103,999 görüntüleme • 1 yıl önce

MAKING AXIS TASKS FEEL EASY 👀🤖 I made a quick video showing how to complete an Axis Robotics task step by step. The task gives you a clear goal, steps, controls and camera views to guide you. In this one, the goal is simple, Open the trash bin, pick up the onion, and place it inside. 🧅 Just follow the instructions, control the robot arm and complete the task. What I like is that even beginners can understand what they need to do. But the interesting part is what happens with these interactions after we complete them. Each completed task can contribute valuable robot training data, helping Physical Ai systems learn how to handle different objects and environments. Small tasks from the community can become useful data for teaching robots how to interact with the real world. That’s what makes Axis interesting to me.
0:13

MAKING AXIS TASKS FEEL EASY 👀🤖 I made a quick video showing how to complete an Axis Robotics task step by step. The task gives you a clear goal, steps, controls and camera views to guide you. In this one, the goal is simple, Open the trash bin, pick up the onion, and place it inside. 🧅 Just follow the instructions, control the robot arm and complete the task. What I like is that even beginners can understand what they need to do. But the interesting part is what happens with these interactions after we complete them. Each completed task can contribute valuable robot training data, helping Physical Ai systems learn how to handle different objects and environments. Small tasks from the community can become useful data for teaching robots how to interact with the real world. That’s what makes Axis interesting to me.

SufianXFN

14,419 görüntüleme • 1 ay önce