Loading video...

Video Failed to Load

There was a problem loading this video. This could be due to a temporary network issue or the video might be unavailable.

Introducing ManipGen: a sim2real agent for zero-shot manipulation. ManipGen handles complex tasks in the real world like organizing shelves, tidying cluttered tables, and more – all from text input and with on human demonstrations!

Deepak Pathak

24,905 subscribers

57,936 views • 1 year ago •via X (Twitter)

Education Science & Technology

Anya Rossi• Live Now

Private livecam show

5 Comments

Deepak Pathak1 year ago

Typo: **with no human demonstrations!

🅟🅛🅤🅣🅤🅢1 year ago

Let’s say I convince my neighbor to invest into a robotic arm. What would be a real life usecase for it that makes huge impact and won’t hesitate to invest?

atharva1 year ago

very cool

Nicolas Keller1 year ago

Congrats- looks great!

Cypress1 year ago

hi ，what is general robot operation system？ what does “general ” mean？ thx🎐

Related Videos

Can my robot cook my food, rearrange my dresser, tidy my messy table and do so much more without ANY demos or real-world training data? Introducing ManipGen: A generalist agent for manipulation that can solve long-horizon robotics tasks entirely zero shot, from text input! 1/N

Can my robot cook my food, rearrange my dresser, tidy my messy table and do so much more without ANY demos or real-world training data? Introducing ManipGen: A generalist agent for manipulation that can solve long-horizon robotics tasks entirely zero shot, from text input! 1/N

Murtaza Dalal

148,938 views • 1 year ago

Sim2Real RL for Vision-Based Dexterous Manipulation on Humanoids TLDR - we train a humanoid robot with two multifingered hands to perform a range of dexterous manipulation tasks robust generalization and high performance without human demonstration :D

Sim2Real RL for Vision-Based Dexterous Manipulation on Humanoids TLDR - we train a humanoid robot with two multifingered hands to perform a range of dexterous manipulation tasks robust generalization and high performance without human demonstration :D

Toru

49,425 views • 1 year ago

How to harness foundation models for *generalization in the wild* in robot manipulation? Introducing VoxPoser: use LLM+VLM to label affordances and constraints directly in 3D perceptual space for zero-shot robot manipulation in the real world! 🌐 🧵👇

How to harness foundation models for generalization in the wild in robot manipulation? Introducing VoxPoser: use LLM+VLM to label affordances and constraints directly in 3D perceptual space for zero-shot robot manipulation in the real world! 🌐 🧵👇

Wenlong Huang

293,865 views • 2 years ago

🚨 New drop from LimX Dynamics — TRON 1. Combining bipedal traversal, wheeled speed, and fine manipulation, it handles complex terrain with ease. Modular top, real-world usability, and smooth coordination with its twin, it is designed for real-world deployment.

🚨 New drop from LimX Dynamics — TRON 1. Combining bipedal traversal, wheeled speed, and fine manipulation, it handles complex terrain with ease. Modular top, real-world usability, and smooth coordination with its twin, it is designed for real-world deployment.

Reborn

55,097 views • 1 year ago

Introducing multi-agent orchestration in Oz, with support for Claude Code, Codex and the Warp Agent. Use /orchestrate to delegate complex tasks across a team of agents, locally or in the cloud.

Introducing multi-agent orchestration in Oz, with support for Claude Code, Codex and the Warp Agent. Use /orchestrate to delegate complex tasks across a team of agents, locally or in the cloud.

Warp

1,184,772 views • 26 days ago

Introducing Agent Mode: Agentic AI is now measured in the Arena. Agent Mode can do deep research, create reports, generate images, build websites, debug code, and more. It completes more complex tasks by using tools like web search, bash in a sandbox environment, image generation, file writing, and asking follow-up questions. Frontier models are waiting for you in Agent Mode to take on real-world tasks. GPT-5.5, Claude Opus 4.7, Gemini 3.1 Pro, and top open models. Test them yourself.

Introducing Agent Mode: Agentic AI is now measured in the Arena. Agent Mode can do deep research, create reports, generate images, build websites, debug code, and more. It completes more complex tasks by using tools like web search, bash in a sandbox environment, image generation, file writing, and asking follow-up questions. Frontier models are waiting for you in Agent Mode to take on real-world tasks. GPT-5.5, Claude Opus 4.7, Gemini 3.1 Pro, and top open models. Test them yourself.

Arena.ai

252,798 views • 10 days ago

Does your sim2real robot falter at critical moments 🤯? Want to help but unsure how, all you can do is reward tuning in sim 😮‍💨? Introduce 𝐓𝐑𝐀𝐍𝐒𝐈𝐂 for manipulation sim2real. Robots learned in sim can accomplish complex tasks in real, such as furniture assembly. 🤿🧵

Does your sim2real robot falter at critical moments 🤯? Want to help but unsure how, all you can do is reward tuning in sim 😮‍💨? Introduce 𝐓𝐑𝐀𝐍𝐒𝐈𝐂 for manipulation sim2real. Robots learned in sim can accomplish complex tasks in real, such as furniture assembly. 🤿🧵

Yunfan Jiang

42,906 views • 2 years ago

Introducing RL-100: Performant Robotic Manipulation with Real-World Reinforcement Learning. 7 real robot tasks, 900/900 successes. Up to 250 consecutive trials in one task, running 2 hours nonstop without failure. High success rate against physical disturbances, zero-shot, and few-shot adaptation Our first step toward a deployable robot learning system.

Introducing RL-100: Performant Robotic Manipulation with Real-World Reinforcement Learning. 7 real robot tasks, 900/900 successes. Up to 250 consecutive trials in one task, running 2 hours nonstop without failure. High success rate against physical disturbances, zero-shot, and few-shot adaptation Our first step toward a deployable robot learning system.

Kun Lei

80,768 views • 8 months ago

With the launch of GLM-5, introduces Agent Mode. - Agent Mode: Automatically breaks down tasks, orchestrates tools, drives execution, and delivers ready-to-use files. - Data Insights & Smart Writing: Upload data for instant visualizations. Go from outline to finished draft, all in one place. - AI Slides / Full-Stack upgraded: Now handles more complex instructions and multi-step workflows.

With the launch of GLM-5, introduces Agent Mode. - Agent Mode: Automatically breaks down tasks, orchestrates tools, drives execution, and delivers ready-to-use files. - Data Insights & Smart Writing: Upload data for instant visualizations. Go from outline to finished draft, all in one place. - AI Slides / Full-Stack upgraded: Now handles more complex instructions and multi-step workflows.

Z.ai

29,699 views • 4 months ago

Your customer support needs a voice agent built for the real world. Grok Voice Think Fast 1.0 handles complex workflows with speed and accuracy, even in hard-to-hear environments. From multi-step troubleshooting to high-volume tool calls, it keeps up.

Your customer support needs a voice agent built for the real world. Grok Voice Think Fast 1.0 handles complex workflows with speed and accuracy, even in hard-to-hear environments. From multi-step troubleshooting to high-volume tool calls, it keeps up.

xAI

77,023,950 views • 1 month ago

Two Reachy 2 setting and clearing the table, all in real time teleoperation! Shot in a single take with all the successes… and a small fail👀 One example of what Reachy 2 can do: efficient, versatile object manipulation, with the precision needed for delicate or fragile tasks

Two Reachy 2 setting and clearing the table, all in real time teleoperation! Shot in a single take with all the successes… and a small fail👀 One example of what Reachy 2 can do: efficient, versatile object manipulation, with the precision needed for delicate or fragile tasks

Pollen Robotics

27,200 views • 9 months ago

What is @Inteligant_? AI agents competing in real games - autonomously, on-chain, and without human input. Jayden 🐼 breaks down how GameFAI enables agent-vs-agent tournaments, starting with competitive poker. Pure logic. Zero emotion. Full automation.

What is @Inteligant_? AI agents competing in real games - autonomously, on-chain, and without human input. Jayden 🐼 breaks down how GameFAI enables agent-vs-agent tournaments, starting with competitive poker. Pure logic. Zero emotion. Full automation.

Genome

79,384 views • 1 year ago

Introducing Latent-X2 — AI-generated antibodies with drug-like developability and low immunogenicity in human panels, zero-shot. Technical report: Blog: Apply for access: partnerships@latentlabs.com

Introducing Latent-X2 — AI-generated antibodies with drug-like developability and low immunogenicity in human panels, zero-shot. Technical report: Blog: Apply for access: [email protected]

Simon Kohl

54,643 views • 6 months ago

5/ We're introducing Gemini Agent: It uses Gemini 3's advanced reasoning to break down complex tasks, like booking local services or organizing your inbox, into actionable steps. It can then propose actions like drafting your replies or archiving emails, all using deeper integrations with Google apps. Available on the web for Google AI Ultra subscribers in the US.

5/ We're introducing Gemini Agent: It uses Gemini 3's advanced reasoning to break down complex tasks, like booking local services or organizing your inbox, into actionable steps. It can then propose actions like drafting your replies or archiving emails, all using deeper integrations with Google apps. Available on the web for Google AI Ultra subscribers in the US.

Sundar Pichai

131,917 views • 6 months ago

Thrilled to share one of my favorite works this year: DexNDM! We bridge the Sim2Real gap for dexterous in-hand rotation, achieving a true "0-to-1" advancement. The key? DexNDM learns from biased, real-world data without needing any successful demonstrations. Now a general-purpose dexterous hand can stably rotate large books, long rods, & complex objects around any axis, from any wrist pose. This powerful primitive enables complex, long-horizon tasks like teleoperated screwing and furniture assembly. 📄 Paper: 🌐 Project Page:

Thrilled to share one of my favorite works this year: DexNDM! We bridge the Sim2Real gap for dexterous in-hand rotation, achieving a true "0-to-1" advancement. The key? DexNDM learns from biased, real-world data without needing any successful demonstrations. Now a general-purpose dexterous hand can stably rotate large books, long rods, & complex objects around any axis, from any wrist pose. This powerful primitive enables complex, long-horizon tasks like teleoperated screwing and furniture assembly. 📄 Paper: 🌐 Project Page:

Li Yi

38,466 views • 7 months ago

Meet Any2Track, a new two-stage RL framework designed to address a core challenge for humanoid robots: reliably tracking diverse, dynamic motions in the real world. The framework consists of two key components: AnyTracker, a general motion tracker, and AnyAdapter, a module that allows the robot to adapt to real-world disturbances like uneven terrain or external forces. This approach gives robots the stability needed for practical use. The system has been successfully deployed on a Unitree G1 humanoid robot with zero-shot sim2real transfer, performing exceptionally well in various motion tracking tasks under multiple real-world disturbances. Project: Codebase:

Meet Any2Track, a new two-stage RL framework designed to address a core challenge for humanoid robots: reliably tracking diverse, dynamic motions in the real world. The framework consists of two key components: AnyTracker, a general motion tracker, and AnyAdapter, a module that allows the robot to adapt to real-world disturbances like uneven terrain or external forces. This approach gives robots the stability needed for practical use. The system has been successfully deployed on a Unitree G1 humanoid robot with zero-shot sim2real transfer, performing exceptionally well in various motion tracking tasks under multiple real-world disturbances. Project: Codebase:

RoboHub🤖

61,378 views • 8 months ago

Introducing Kombai, the first AI agent built for frontend development. Kombai vastly outperforms SOTA models + generic agents in real-world benchmarks. Watch it add a complex new feature to an OSS codebase with 500K+ lines of code. More use cases and links in comments

Introducing Kombai, the first AI agent built for frontend development. Kombai vastly outperforms SOTA models + generic agents in real-world benchmarks. Watch it add a complex new feature to an OSS codebase with 500K+ lines of code. More use cases and links in comments

Dipanjan Dey

2,074,441 views • 10 months ago

What if robots could learn real-world tasks from your perspective… without ever touching a robot? This is a system that trains robot policies using nothing but human-first, egocentric video data from smart glasses. No robots, no teleop, no sensors, just humans doing real tasks in the real world. Why it matters ✅ Learns robot policies from 20 minutes of human video; zero robot demos ✅ Generalizes to new objects, views, and even robot morphologies ✅ Uses 3D points for interpretable, spatially grounded learning ✅ Deploys directly to real-world robots with strong zero-shot success Thank you, Vincent Liu, for sharing!!! Learn more here: 🔗 Paper: 🌐 Website: 📍 BOOKMARK FOR LATER

What if robots could learn real-world tasks from your perspective… without ever touching a robot? This is a system that trains robot policies using nothing but human-first, egocentric video data from smart glasses. No robots, no teleop, no sensors, just humans doing real tasks in the real world. Why it matters ✅ Learns robot policies from 20 minutes of human video; zero robot demos ✅ Generalizes to new objects, views, and even robot morphologies ✅ Uses 3D points for interpretable, spatially grounded learning ✅ Deploys directly to real-world robots with strong zero-shot success Thank you, Vincent Liu, for sharing!!! Learn more here: 🔗 Paper: 🌐 Website: 📍 BOOKMARK FOR LATER

Ilir Aliu - eu/acc

10,509 views • 1 year ago

Introducing Yell At Your Robot (YAY Robot!) 🗣️- a fun collaboration b/w Stanford University and UC Berkeley 🤖 We enable robots to improve on-the-fly from language corrections: robots rapidly adapt in real-time and continuously improve from human verbal feedback. YAY Robot enables long-horizon, dexterous manipulation tasks like preparing trail-mix, packing a ziploc bag, and cleaning dishes:

Introducing Yell At Your Robot (YAY Robot!) 🗣️- a fun collaboration b/w Stanford University and UC Berkeley 🤖 We enable robots to improve on-the-fly from language corrections: robots rapidly adapt in real-time and continuously improve from human verbal feedback. YAY Robot enables long-horizon, dexterous manipulation tasks like preparing trail-mix, packing a ziploc bag, and cleaning dishes:

Lucy Shi

122,774 views • 2 years ago

Tesla Self Driving v14.2.2 perfectly handles “The Snake,” a super famous tight and twisty canyon road. 20+ turns with multiple hairpin corners. Zero human input or intervention.

Tesla Self Driving v14.2.2 perfectly handles “The Snake,” a super famous tight and twisty canyon road. 20+ turns with multiple hairpin corners. Zero human input or intervention.

Zack

41,365 views • 5 months ago