Loading video...

Video Failed to Load

There was a problem loading this video. This could be due to a temporary network issue or the video might be unavailable.

ROSClaw Integration Update Read the text in the video carefully ⊙ Robot is present both physically can in Nvidia Isaac Sim simulation. ⊙ The agent’s initial goal set to explore any object it finds in its spatial view. ⊙ Think of it as if the physical robot is seeing... show more

Irvin (in Japan 🇯🇵)

14,531 subscribers

23,374 views • 4 months ago •via X (Twitter)

Anya Rossi• Live Now

Private livecam show

0 Comments

No comments available

Comments from the original post will appear here

Related Videos

This is a demonstration video of in-hand object rotation with new Torobo Hand. By leveraging large-scale parallel reinforcement learning in NVIDIA Isaac Sim, the learned policy can perform object manipulation in MuJoCo and on the real robot without any additional training.

This is a demonstration video of in-hand object rotation with new Torobo Hand. By leveraging large-scale parallel reinforcement learning in NVIDIA Isaac Sim, the learned policy can perform object manipulation in MuJoCo and on the real robot without any additional training.

東京ロボティクス株式会社

10,860 views • 1 year ago

Boston Dynamics has demonstrated its new Atlas humanoid robot lifting and carrying a 50-pound fridge. The robot uses its whole body to balance and move the heavy object in a natural, human-like way. Before doing it in the real world, Atlas practiced the task for millions of hours in a virtual simulation.

Boston Dynamics has demonstrated its new Atlas humanoid robot lifting and carrying a 50-pound fridge. The robot uses its whole body to balance and move the heavy object in a natural, human-like way. Before doing it in the real world, Atlas practiced the task for millions of hours in a virtual simulation.

Space and Technology

180,041 views • 1 month ago

Ever wanted your AI Agent to create its own tools on-the-fly? Well, you can do it quickly, safely and securely with Durable Object Facets! The app starts as nothing more than an interface to an LLM. The LLM is able to write its own tools to add to its capabilities per request

Ever wanted your AI Agent to create its own tools on-the-fly? Well, you can do it quickly, safely and securely with Durable Object Facets! The app starts as nothing more than an interface to an LLM. The LLM is able to write its own tools to add to its capabilities per request

Ashley Peacock

33,315 views • 3 months ago

$I made Physical AutoResearch sound simple (conceptually), but it took a village to pull off and lots of design thinking into the robot /loopcraft. The hardest part is everything we need to setup *before* pressing Enter. Here's a behind-the-scene tour: 1. Safety harness Letting 8 robots run unattended overnight means safety has to be more than a hint in the system prompt. ENPIRE hardwires it in 2 layers: (1) hard kinematic limit that trips an immediate task failure and auto-resets as soon as a robot leaves its safety envelope, and (2) a torque-limited compliant gripper so a bad contact or misaligned insertion ends in a safe stall, instead of crushing the robot or the object at hand. We make safety more conservative than usual so humans can sleep tight. In reality, we still need a few human operators to watch over the "robots of loving grace". 2. Definition of /done An agent that can edit its own reward will game it for sure. ENPIRE fixes the goalposts before the fleet can move them. Here's the recipe: Collect a few minutes of success & failure demos -> Ask agent to write code using computer vision tools to classify success and measure against groundtruth -> Agent hill-climbs on classifier until reliably good -> This classifier becomes the real-time reward function that directly computes on sensor streams -> *Freeze* the reward function before AutoResearch. It's sacred, enshrined in a Gym env that no one can touch. 3. System telemetry design Robot-seconds is by far the scarcest resource, followed by GPU-seconds, and finally tokens. We instrument all three and surface them to ENPIRE for live resource awareness rather than letting it hill-climb in a vacuum. We define: - Mean Robot Utilization ("MRU"): the fraction of wall-clock time when the robot is actively executing an experiment. Otherwise the hardware is sitting idle and waiting for the next code commit. - Mean Token Utilization ("MTU"): tokens consumed per minute, our proxy for how hard the agent is actually thinking. A low MTU means the agent is stalled, waiting on a robot rollout to finish instead of doing research. - GPU utilization: fraction of wall-clock time when GPU is active. ... and evaluate on two budget-to-outcome metrics: 1. Tokens-to-Success: token budget the fleet burns to complete /goal. 2. Time-to-Success: wall-clock time to /goal$

I made Physical AutoResearch sound simple (conceptually), but it took a village to pull off and lots of design thinking into the robot /loopcraft. The hardest part is everything we need to setup before pressing Enter. Here's a behind-the-scene tour: 1. Safety harness Letting 8 robots run unattended overnight means safety has to be more than a hint in the system prompt. ENPIRE hardwires it in 2 layers: (1) hard kinematic limit that trips an immediate task failure and auto-resets as soon as a robot leaves its safety envelope, and (2) a torque-limited compliant gripper so a bad contact or misaligned insertion ends in a safe stall, instead of crushing the robot or the object at hand. We make safety more conservative than usual so humans can sleep tight. In reality, we still need a few human operators to watch over the "robots of loving grace". 2. Definition of /done An agent that can edit its own reward will game it for sure. ENPIRE fixes the goalposts before the fleet can move them. Here's the recipe: Collect a few minutes of success & failure demos -> Ask agent to write code using computer vision tools to classify success and measure against groundtruth -> Agent hill-climbs on classifier until reliably good -> This classifier becomes the real-time reward function that directly computes on sensor streams -> Freeze the reward function before AutoResearch. It's sacred, enshrined in a Gym env that no one can touch. 3. System telemetry design Robot-seconds is by far the scarcest resource, followed by GPU-seconds, and finally tokens. We instrument all three and surface them to ENPIRE for live resource awareness rather than letting it hill-climb in a vacuum. We define: - Mean Robot Utilization ("MRU"): the fraction of wall-clock time when the robot is actively executing an experiment. Otherwise the hardware is sitting idle and waiting for the next code commit. - Mean Token Utilization ("MTU"): tokens consumed per minute, our proxy for how hard the agent is actually thinking. A low MTU means the agent is stalled, waiting on a robot rollout to finish instead of doing research. - GPU utilization: fraction of wall-clock time when GPU is active. ... and evaluate on two budget-to-outcome metrics: 1. Tokens-to-Success: token budget the fleet burns to complete /goal. 2. Time-to-Success: wall-clock time to /goal

Jim Fan

105,221 views • 1 month ago

I’m giving an agent control over Reachy Mini from Hugging Face and letting it understand and share spatial data via SPECS for Devs AR is the human interface for robotics and physical AI imo. It feels like absolute magic to interact with this, both in voice/agent and “puppeteering” mode. I’ll probably work on AR for either an arm (manipulation tasks) or some sort of drone (locomotion in 3D space) next… Project is fully open source btw: Thank you SensAI Hackademy for sending me the robot!

I’m giving an agent control over Reachy Mini from Hugging Face and letting it understand and share spatial data via SPECS for Devs AR is the human interface for robotics and physical AI imo. It feels like absolute magic to interact with this, both in voice/agent and “puppeteering” mode. I’ll probably work on AR for either an arm (manipulation tasks) or some sort of drone (locomotion in 3D space) next… Project is fully open source btw: Thank you SensAI Hackademy for sending me the robot!

Johannes Tscharn

35,341 views • 5 months ago

My agent is now paying for its own data. No API key. No account. No credit card. Check the video I recorded. This uses the x402 open protocol built by Coinbase, along with a simple skill. This is an open protocol governed by the Linux Foundation. To complete a goal, an agent can now search for an actor on the Apify Store, pay for it, and use it without any human intervention. The way it works is pretty simple: 1. Your agent finds an Actor it wants to use 2. It sends a request 3. The Actor sends back an HTTP 402 "Payment Required" response 4. Agent authorizes payment from a wallet in USDC on Base 5. The Actor runs 6. User receives the result The model is pay-as-you-go: the agent authorizes a spending ceiling, pays only for usage, and the remaining balance is automatically settled. This brings an entire marketplace of AI tools into the agentic economy. Here is the skill you need. Add it to your agent, and it will take care of everything for you: If you want to know how this works, including what you can do with $1, read this post: Thanks to the Apify team for partnering with me on this post.

My agent is now paying for its own data. No API key. No account. No credit card. Check the video I recorded. This uses the x402 open protocol built by Coinbase, along with a simple skill. This is an open protocol governed by the Linux Foundation. To complete a goal, an agent can now search for an actor on the Apify Store, pay for it, and use it without any human intervention. The way it works is pretty simple: 1. Your agent finds an Actor it wants to use 2. It sends a request 3. The Actor sends back an HTTP 402 "Payment Required" response 4. Agent authorizes payment from a wallet in USDC on Base 5. The Actor runs 6. User receives the result The model is pay-as-you-go: the agent authorizes a spending ceiling, pays only for usage, and the remaining balance is automatically settled. This brings an entire marketplace of AI tools into the agentic economy. Here is the skill you need. Add it to your agent, and it will take care of everything for you: If you want to know how this works, including what you can do with $1, read this post: Thanks to the Apify team for partnering with me on this post.

Santiago

26,589 views • 24 days ago

You are witnessing the first on-chain robot-to-robot commerce transaction through x402 on Base with USDC as the agent currency. > Our Unitree robot 3D-printed a model and put in a delivery request through ACP. > RICE AI ( ◉ - ◉ )'s rover arrived, collected the package, and moved it to the shipping point. > Flyby Robotics' drone picked it up from there and handled final mile delivery. All without any human coordination. We build infrastructure for agent commerce. Today it went physical.

You are witnessing the first on-chain robot-to-robot commerce transaction through x402 on Base with USDC as the agent currency. > Our Unitree robot 3D-printed a model and put in a delivery request through ACP. > RICE AI ( ◉ - ◉ )'s rover arrived, collected the package, and moved it to the shipping point. > Flyby Robotics' drone picked it up from there and handled final mile delivery. All without any human coordination. We build infrastructure for agent commerce. Today it went physical.

Virtuals Protocol

259,813 views • 3 months ago

Major milestone in Reinforcement Learning 🚀 In under just 1 hour of training, our AI Agent can now automate tasks requiring complex physics and object interactions. Done for the first time on 100$ robot arms. Watch as it recovers when the cube gets stuck 🤯

Major milestone in Reinforcement Learning 🚀 In under just 1 hour of training, our AI Agent can now automate tasks requiring complex physics and object interactions. Done for the first time on 100$ robot arms. Watch as it recovers when the cube gets stuck 🤯

Remi Cadene

62,536 views • 1 year ago

The teams shipping AI agents right now are bleeding money on the dumbest possible expense: teaching a 400B-parameter model to read a file name. Every time an AI agent needs to "see" something today, it routes an image through a frontier model. OCR, object detection, checking if a button exists on screen. You're paying GPT-4o or Claude pricing for tasks that require perception, not reasoning. One agent workflow processing a few thousand screenshots per day can burn through more on vision calls than on the actual thinking. Perceptron's Isaac is 2B parameters. Built by the team that created Meta's Chameleon multimodal models. On perceptive benchmarks, it matches or beats models 50x its size. The VQA, OCR, and object detection scores are competitive with models running on infrastructure that costs orders of magnitude more. The MCP wrapper is the distribution play. One install command and every Claude Code agent can offload vision tasks to a model that runs on a single consumer GPU. The agent keeps its reasoning in the frontier model and routes perception to a specialist. That split is how you get vision-heavy agent workflows from "technically possible but expensive" to "cheap enough to run on everything." This is the same pattern that won in every other compute-intensive stack. General-purpose handles orchestration. Specialists handle the heavy lifting. Graphics went through it. Audio went through it. Video encoding went through it. Vision in AI agents is next. The teams building agents that see 10,000 images a day will care about this before anyone else does.

The teams shipping AI agents right now are bleeding money on the dumbest possible expense: teaching a 400B-parameter model to read a file name. Every time an AI agent needs to "see" something today, it routes an image through a frontier model. OCR, object detection, checking if a button exists on screen. You're paying GPT-4o or Claude pricing for tasks that require perception, not reasoning. One agent workflow processing a few thousand screenshots per day can burn through more on vision calls than on the actual thinking. Perceptron's Isaac is 2B parameters. Built by the team that created Meta's Chameleon multimodal models. On perceptive benchmarks, it matches or beats models 50x its size. The VQA, OCR, and object detection scores are competitive with models running on infrastructure that costs orders of magnitude more. The MCP wrapper is the distribution play. One install command and every Claude Code agent can offload vision tasks to a model that runs on a single consumer GPU. The agent keeps its reasoning in the frontier model and routes perception to a specialist. That split is how you get vision-heavy agent workflows from "technically possible but expensive" to "cheap enough to run on everything." This is the same pattern that won in every other compute-intensive stack. General-purpose handles orchestration. Specialists handle the heavy lifting. Graphics went through it. Audio went through it. Video encoding went through it. Vision in AI agents is next. The teams building agents that see 10,000 images a day will care about this before anyone else does.

Aakash Gupta

55,978 views • 3 months ago

Domino’s Tests Pizza-Delivering Robot Dog in England In the UK, Domino’s is testing a robot dog named Domidog to deliver pizzas. On the way, little can threaten it — it scares off seagulls with barking and skillfully uses its robotic arm.

Domino’s Tests Pizza-Delivering Robot Dog in England In the UK, Domino’s is testing a robot dog named Domidog to deliver pizzas. On the way, little can threaten it — it scares off seagulls with barking and skillfully uses its robotic arm.

NEXTA

40,396 views • 1 year ago

AI excels in the virtual world, but acting in the physical world is a whole different challenge. Why is it so hard to get a robot to fetch an egg without freezing? 🤔 Check out our new explainer video on Embodied Intelligence. We discuss the gap between robot "Thinking" and "Acting,"

AI excels in the virtual world, but acting in the physical world is a whole different challenge. Why is it so hard to get a robot to fetch an egg without freezing? 🤔 Check out our new explainer video on Embodied Intelligence. We discuss the gap between robot "Thinking" and "Acting,"

Tongyi Lab

5,630,641 views • 1 month ago

Vision-language models can control robots, but what if the prompt is too complex for the robot to follow directly? We developed a way to get robots to “think through” complex instructions, feedback, and interjections. We call it the Hierarchical Interactive Robot (Hi Robot).

Vision-language models can control robots, but what if the prompt is too complex for the robot to follow directly? We developed a way to get robots to “think through” complex instructions, feedback, and interjections. We call it the Hierarchical Interactive Robot (Hi Robot).

Physical Intelligence

116,845 views • 1 year ago

Dr. Fei-Fei Li just called out the biggest blind spot in the entire AI industry. We have been building half of human intelligence. And calling it the finish line. Li: “If you look at human intelligence, it pretty much boils down to two buckets.” The first bucket is language. Symbolic reasoning. Communication. The ability to think in words and abstractions. That’s what every major AI lab has spent the last decade building. The second bucket is the one the industry has almost entirely ignored. Li: “We call that in AI spatial intelligence.” How humans and animals perceive, navigate, and interact with the three-dimensional physical world. How we reach for objects. How we move through space. How we build and manipulate physical reality. From painting masterpieces to constructing the pyramids, non-verbal spatial intelligence is what actually shapes the world. Language describes reality. Spatial intelligence acts on it. And the gap between those two things is the gap between a chatbot and a robot. Li: “When this technology is ready, the robotic revolution is gonna start. We’re already seeing that trend.” Every robot is a moving agent. Every moving agent requires spatial intelligence to function in the real world. The humanoid robots being deployed in factories right now are hitting the ceiling of what language models alone can power. Spatial intelligence is the unlock. But Li didn’t stop at robotics. Li: “From a geopolitics point of view, this is part of the technology that goes straight into weapons.” Autonomous drone swarms. Battlefield navigation. Physical target acquisition without human oversight. Every military application of AI that operates in the real world runs on spatial intelligence. The nation that masters the transition from static text to dynamic three-dimensional perception doesn’t just win the software race. It commands the physical battlefield. The AI arms race just broke out of the data center. It’s operating in three dimensions now.

Dr. Fei-Fei Li just called out the biggest blind spot in the entire AI industry. We have been building half of human intelligence. And calling it the finish line. Li: “If you look at human intelligence, it pretty much boils down to two buckets.” The first bucket is language. Symbolic reasoning. Communication. The ability to think in words and abstractions. That’s what every major AI lab has spent the last decade building. The second bucket is the one the industry has almost entirely ignored. Li: “We call that in AI spatial intelligence.” How humans and animals perceive, navigate, and interact with the three-dimensional physical world. How we reach for objects. How we move through space. How we build and manipulate physical reality. From painting masterpieces to constructing the pyramids, non-verbal spatial intelligence is what actually shapes the world. Language describes reality. Spatial intelligence acts on it. And the gap between those two things is the gap between a chatbot and a robot. Li: “When this technology is ready, the robotic revolution is gonna start. We’re already seeing that trend.” Every robot is a moving agent. Every moving agent requires spatial intelligence to function in the real world. The humanoid robots being deployed in factories right now are hitting the ceiling of what language models alone can power. Spatial intelligence is the unlock. But Li didn’t stop at robotics. Li: “From a geopolitics point of view, this is part of the technology that goes straight into weapons.” Autonomous drone swarms. Battlefield navigation. Physical target acquisition without human oversight. Every military application of AI that operates in the real world runs on spatial intelligence. The nation that masters the transition from static text to dynamic three-dimensional perception doesn’t just win the software race. It commands the physical battlefield. The AI arms race just broke out of the data center. It’s operating in three dimensions now.

Dustin

122,680 views • 4 months ago

Introducing MARS, the first Personal AI Robot. In technology, getting to the future we want starts with building it together. This is why we designed Mars. Inspired by early PCs, Mars is a powerful, complete, extendable robot. It runs BASIC, an open embodied AI agent we created for you to program with code, demonstrations, and prompts. This allows Mars to perform complex long-horizon tasks involving spatial memory, reasoning, manipulation and navigation. Pre-orders open now ⬇️ Demos & details in the thread

Introducing MARS, the first Personal AI Robot. In technology, getting to the future we want starts with building it together. This is why we designed Mars. Inspired by early PCs, Mars is a powerful, complete, extendable robot. It runs BASIC, an open embodied AI agent we created for you to program with code, demonstrations, and prompts. This allows Mars to perform complex long-horizon tasks involving spatial memory, reasoning, manipulation and navigation. Pre-orders open now ⬇️ Demos & details in the thread

Axel

313,836 views • 10 months ago

Shanghai-based iSAGE is teasing what it calls the world’s first “spatial heterogenous” six-armed humanoid robot. The Hexa-Arm Robot is designed for crowded factory workstations where several tasks must be completed quickly and precisely. Each of its arms can reportedly operate in its own area on different jobs. The system has 120 moving joints, force control on every arm, and advanced cameras for assembly tasks.

Shanghai-based iSAGE is teasing what it calls the world’s first “spatial heterogenous” six-armed humanoid robot. The Hexa-Arm Robot is designed for crowded factory workstations where several tasks must be completed quickly and precisely. Each of its arms can reportedly operate in its own area on different jobs. The system has 120 moving joints, force control on every arm, and advanced cameras for assembly tasks.

Mike Kalil

15,041 views • 29 days ago

THE NEW OPENCLAW UPDATE (3.22) IS INSANE It can now: > install skills from its own app store > switch reasoning modes per agent > run secure sandboxes on remote servers Copy paste into your OpenClaw agent to update it

THE NEW OPENCLAW UPDATE (3.22) IS INSANE It can now: > install skills from its own app store > switch reasoning modes per agent > run secure sandboxes on remote servers Copy paste into your OpenClaw agent to update it

0xMarioNawfal

92,529 views • 4 months ago

This is Atlas learning. Every fall. Every wobble. Every missed grab costs hundred of thousands of dollars Antioch Agent just made the training cost fall to near 0. Robotics companies can now break their robot 1,000 times in simulation before it ever touches the real world. Atlas is happy

This is Atlas learning. Every fall. Every wobble. Every missed grab costs hundred of thousands of dollars Antioch Agent just made the training cost fall to near 0. Robotics companies can now break their robot 1,000 times in simulation before it ever touches the real world. Atlas is happy

Chidanand Tripathi

87,761 views • 1 month ago

Another new humanoid robot is here. This headless humanoid robot is called Calvin-40. It is the first industrial humanoid robot developed by the French company Wandercraft. It is human-sized and voice-controlled. It is mainly used in manufacturing factories, but can also be used for medical care. It is worth mentioning that its hands can switch to end effectors such as suction cups, grippers, and dexterous hands to adapt to the needs.

Another new humanoid robot is here. This headless humanoid robot is called Calvin-40. It is the first industrial humanoid robot developed by the French company Wandercraft. It is human-sized and voice-controlled. It is mainly used in manufacturing factories, but can also be used for medical care. It is worth mentioning that its hands can switch to end effectors such as suction cups, grippers, and dexterous hands to adapt to the needs.

CyberRobo

27,262 views • 1 year ago

Hermes Agent is an INCREDIBLE AI agent It's better than OpenClaw in some key ways, but does it replace it? In this video I cover what Hermes agent is, how to use it, workflows that will explode your productivity, and if it's the OpenClaw killer:

Hermes Agent is an INCREDIBLE AI agent It's better than OpenClaw in some key ways, but does it replace it? In this video I cover what Hermes agent is, how to use it, workflows that will explode your productivity, and if it's the OpenClaw killer:

Alex Finn

136,809 views • 3 months ago

We trained a robot dog to balance and walk on top of a yoga ball purely in simulation, and then transfer zero-shot to the real world. No fine-tuning. Just works. I’m excited to announce DrEureka, an LLM agent that writes code to train robot skills in simulation, and writes more code to bridge the difficult simulation-reality gap. It fully automates the pipeline from new skill learning to real-world deployment. The Yoga ball task is particularly hard because it is not possible to accurately simulate the bouncy ball surface. Yet DrEureka has no trouble searching over a vast space of sim-to-real configurations, and enables the dog to steer the ball on various terrains, even walking sideways! Traditionally, the sim-to-real transfer is achieved by domain randomization, a tedious process that requires expert human roboticists to stare at every parameter and adjust by hand. Frontier LLMs like GPT-4 have tons of built-in physical intuition for friction, damping, stiffness, gravity, etc. We are (mildly) surprised to find that DrEureka can tune these parameters competently and explain its reasoning well. DrEureka builds on our prior work Eureka, the algorithm that teaches a 5-finger robot hand to do pen spinning. It takes one step further on our quest to automate the entire robot learning pipeline by an AI agent system. One model that outputs strings will supervise another model that outputs torque control. We open-source everything! Welcome you all to check out the paper, more videos, and try the codebase today: Code:

We trained a robot dog to balance and walk on top of a yoga ball purely in simulation, and then transfer zero-shot to the real world. No fine-tuning. Just works. I’m excited to announce DrEureka, an LLM agent that writes code to train robot skills in simulation, and writes more code to bridge the difficult simulation-reality gap. It fully automates the pipeline from new skill learning to real-world deployment. The Yoga ball task is particularly hard because it is not possible to accurately simulate the bouncy ball surface. Yet DrEureka has no trouble searching over a vast space of sim-to-real configurations, and enables the dog to steer the ball on various terrains, even walking sideways! Traditionally, the sim-to-real transfer is achieved by domain randomization, a tedious process that requires expert human roboticists to stare at every parameter and adjust by hand. Frontier LLMs like GPT-4 have tons of built-in physical intuition for friction, damping, stiffness, gravity, etc. We are (mildly) surprised to find that DrEureka can tune these parameters competently and explain its reasoning well. DrEureka builds on our prior work Eureka, the algorithm that teaches a 5-finger robot hand to do pen spinning. It takes one step further on our quest to automate the entire robot learning pipeline by an AI agent system. One model that outputs strings will supervise another model that outputs torque control. We open-source everything! Welcome you all to check out the paper, more videos, and try the codebase today: Code:

Jim Fan

908,799 views • 2 years ago