Video wird geladen...

Video konnte nicht geladen werden

Zur Startseite

Introducing ManipGen: a sim2real agent for zero-shot manipulation. ManipGen handles complex tasks in the real world like organizing shelves, tidying cluttered tables, and more – all from text input and with on human demonstrations!

pathak2206's profile picture

Deepak Pathak

24,905 subscribers

57,936 Aufrufe • vor 1 Jahr •via X (Twitter)

BildungWissenschaft & Technologie
LIVE

Anya Rossi• Live Now

Private livecam show

5 Kommentare

Profilbild von Deepak Pathak
Deepak Pathakvor 1 Jahr

Typo: **with no human demonstrations!

Profilbild von 🅟🅛🅤🅣🅤🅢
🅟🅛🅤🅣🅤🅢vor 1 Jahr

Let’s say I convince my neighbor to invest into a robotic arm. What would be a real life usecase for it that makes huge impact and won’t hesitate to invest?

Profilbild von atharva
atharvavor 1 Jahr

very cool

Profilbild von Nicolas Keller
Nicolas Kellervor 1 Jahr

Congrats- looks great!

Profilbild von Cypress
Cypressvor 1 Jahr

hi ，what is general robot operation system？ what does “general ” mean？ thx🎐

Ähnliche Videos

Can my robot cook my food, rearrange my dresser, tidy my messy table and do so much more without ANY demos or real-world training data? Introducing ManipGen: A generalist agent for manipulation that can solve long-horizon robotics tasks entirely zero shot, from text input! 1/N
2:19

Can my robot cook my food, rearrange my dresser, tidy my messy table and do so much more without ANY demos or real-world training data? Introducing ManipGen: A generalist agent for manipulation that can solve long-horizon robotics tasks entirely zero shot, from text input! 1/N

Murtaza Dalal

149,003 Aufrufe • vor 1 Jahr

Sim2Real RL for Vision-Based Dexterous Manipulation on Humanoids TLDR - we train a humanoid robot with two multifingered hands to perform a range of dexterous manipulation tasks robust generalization and high performance without human demonstration :D
0:20

Sim2Real RL for Vision-Based Dexterous Manipulation on Humanoids TLDR - we train a humanoid robot with two multifingered hands to perform a range of dexterous manipulation tasks robust generalization and high performance without human demonstration :D

Toru

49,561 Aufrufe • vor 1 Jahr

How to harness foundation models for *generalization in the wild* in robot manipulation? Introducing VoxPoser: use LLM+VLM to label affordances and constraints directly in 3D perceptual space for zero-shot robot manipulation in the real world! 🌐 🧵👇
0:50

How to harness foundation models for *generalization in the wild* in robot manipulation? Introducing VoxPoser: use LLM+VLM to label affordances and constraints directly in 3D perceptual space for zero-shot robot manipulation in the real world! 🌐 🧵👇

Wenlong Huang

293,876 Aufrufe • vor 3 Jahren

Introducing multi-agent orchestration in Oz, with support for Claude Code, Codex and the Warp Agent. Use /orchestrate to delegate complex tasks across a team of agents, locally or in the cloud.
2:17

Introducing multi-agent orchestration in Oz, with support for Claude Code, Codex and the Warp Agent. Use /orchestrate to delegate complex tasks across a team of agents, locally or in the cloud.

Warp

1,192,646 Aufrufe • vor 1 Monat

🚨 New drop from LimX Dynamics — TRON 1. Combining bipedal traversal, wheeled speed, and fine manipulation, it handles complex terrain with ease. Modular top, real-world usability, and smooth coordination with its twin, it is designed for real-world deployment.
0:28

🚨 New drop from LimX Dynamics — TRON 1. Combining bipedal traversal, wheeled speed, and fine manipulation, it handles complex terrain with ease. Modular top, real-world usability, and smooth coordination with its twin, it is designed for real-world deployment.

Reborn

55,097 Aufrufe • vor 1 Jahr

Introducing Agent Mode: Agentic AI is now measured in the Arena. Agent Mode can do deep research, create reports, generate images, build websites, debug code, and more. It completes more complex tasks by using tools like web search, bash in a sandbox environment, image generation, file writing, and asking follow-up questions. Frontier models are waiting for you in Agent Mode to take on real-world tasks. GPT-5.5, Claude Opus 4.7, Gemini 3.1 Pro, and top open models. Test them yourself.
0:44

Introducing Agent Mode: Agentic AI is now measured in the Arena. Agent Mode can do deep research, create reports, generate images, build websites, debug code, and more. It completes more complex tasks by using tools like web search, bash in a sandbox environment, image generation, file writing, and asking follow-up questions. Frontier models are waiting for you in Agent Mode to take on real-world tasks. GPT-5.5, Claude Opus 4.7, Gemini 3.1 Pro, and top open models. Test them yourself.

Arena.ai

293,338 Aufrufe • vor 1 Monat

Does your sim2real robot falter at critical moments 🤯? Want to help but unsure how, all you can do is reward tuning in sim 😮‍💨? Introduce 𝐓𝐑𝐀𝐍𝐒𝐈𝐂 for manipulation sim2real. Robots learned in sim can accomplish complex tasks in real, such as furniture assembly. 🤿🧵
2:18

Does your sim2real robot falter at critical moments 🤯? Want to help but unsure how, all you can do is reward tuning in sim 😮‍💨? Introduce 𝐓𝐑𝐀𝐍𝐒𝐈𝐂 for manipulation sim2real. Robots learned in sim can accomplish complex tasks in real, such as furniture assembly. 🤿🧵

Yunfan Jiang

42,906 Aufrufe • vor 2 Jahren

Introducing RL-100: Performant Robotic Manipulation with Real-World Reinforcement Learning. 7 real robot tasks, 900/900 successes. Up to 250 consecutive trials in one task, running 2 hours nonstop without failure. High success rate against physical disturbances, zero-shot, and few-shot adaptation Our first step toward a deployable robot learning system.
3:26

Introducing RL-100: Performant Robotic Manipulation with Real-World Reinforcement Learning. 7 real robot tasks, 900/900 successes. Up to 250 consecutive trials in one task, running 2 hours nonstop without failure. High success rate against physical disturbances, zero-shot, and few-shot adaptation Our first step toward a deployable robot learning system.

Kun Lei

90,870 Aufrufe • vor 8 Monaten

With the launch of GLM-5, introduces Agent Mode. - Agent Mode: Automatically breaks down tasks, orchestrates tools, drives execution, and delivers ready-to-use files. - Data Insights & Smart Writing: Upload data for instant visualizations. Go from outline to finished draft, all in one place. - AI Slides / Full-Stack upgraded: Now handles more complex instructions and multi-step workflows.
0:44

With the launch of GLM-5, introduces Agent Mode. - Agent Mode: Automatically breaks down tasks, orchestrates tools, drives execution, and delivers ready-to-use files. - Data Insights & Smart Writing: Upload data for instant visualizations. Go from outline to finished draft, all in one place. - AI Slides / Full-Stack upgraded: Now handles more complex instructions and multi-step workflows.

Z.ai

29,781 Aufrufe • vor 4 Monaten

Your customer support needs a voice agent built for the real world. Grok Voice Think Fast 1.0 handles complex workflows with speed and accuracy, even in hard-to-hear environments. From multi-step troubleshooting to high-volume tool calls, it keeps up.
0:34

Your customer support needs a voice agent built for the real world. Grok Voice Think Fast 1.0 handles complex workflows with speed and accuracy, even in hard-to-hear environments. From multi-step troubleshooting to high-volume tool calls, it keeps up.

SpaceXAI

77,034,901 Aufrufe • vor 2 Monaten

Two Reachy 2 setting and clearing the table, all in real time teleoperation! Shot in a single take with all the successes… and a small fail👀 One example of what Reachy 2 can do: efficient, versatile object manipulation, with the precision needed for delicate or fragile tasks
1:09

Two Reachy 2 setting and clearing the table, all in real time teleoperation! Shot in a single take with all the successes… and a small fail👀 One example of what Reachy 2 can do: efficient, versatile object manipulation, with the precision needed for delicate or fragile tasks

Pollen Robotics

27,200 Aufrufe • vor 10 Monaten

What is @Inteligant_? AI agents competing in real games - autonomously, on-chain, and without human input. Jayden 🐼 breaks down how GameFAI enables agent-vs-agent tournaments, starting with competitive poker. Pure logic. Zero emotion. Full automation.
2:12

What is @Inteligant_? AI agents competing in real games - autonomously, on-chain, and without human input. Jayden 🐼 breaks down how GameFAI enables agent-vs-agent tournaments, starting with competitive poker. Pure logic. Zero emotion. Full automation.

Genome

79,384 Aufrufe • vor 1 Jahr

Introducing Latent-X2 — AI-generated antibodies with drug-like developability and low immunogenicity in human panels, zero-shot. Technical report: Blog: Apply for access: partnerships@latentlabs.com
0:35

Introducing Latent-X2 — AI-generated antibodies with drug-like developability and low immunogenicity in human panels, zero-shot. Technical report: Blog: Apply for access: [email protected]

Simon Kohl

54,679 Aufrufe • vor 6 Monaten

5/ We're introducing Gemini Agent: It uses Gemini 3's advanced reasoning to break down complex tasks, like booking local services or organizing your inbox, into actionable steps. It can then propose actions like drafting your replies or archiving emails, all using deeper integrations with Google apps. Available on the web for Google AI Ultra subscribers in the US.
0:57

5/ We're introducing Gemini Agent: It uses Gemini 3's advanced reasoning to break down complex tasks, like booking local services or organizing your inbox, into actionable steps. It can then propose actions like drafting your replies or archiving emails, all using deeper integrations with Google apps. Available on the web for Google AI Ultra subscribers in the US.

Sundar Pichai

131,961 Aufrufe • vor 7 Monaten

What if robots could learn real-world tasks from your perspective… without ever touching a robot? This is a system that trains robot policies using nothing but human-first, egocentric video data from smart glasses. No robots, no teleop, no sensors, just humans doing real tasks in the real world. Why it matters ✅ Learns robot policies from 20 minutes of human video; zero robot demos ✅ Generalizes to new objects, views, and even robot morphologies ✅ Uses 3D points for interpretable, spatially grounded learning ✅ Deploys directly to real-world robots with strong zero-shot success Thank you, Vincent Liu, for sharing!!! Learn more here: 🔗 Paper: 🌐 Website: 📍 BOOKMARK FOR LATER
0:30

What if robots could learn real-world tasks from your perspective… without ever touching a robot? This is a system that trains robot policies using nothing but human-first, egocentric video data from smart glasses. No robots, no teleop, no sensors, just humans doing real tasks in the real world. Why it matters ✅ Learns robot policies from 20 minutes of human video; zero robot demos ✅ Generalizes to new objects, views, and even robot morphologies ✅ Uses 3D points for interpretable, spatially grounded learning ✅ Deploys directly to real-world robots with strong zero-shot success Thank you, Vincent Liu, for sharing!!! Learn more here: 🔗 Paper: 🌐 Website: 📍 BOOKMARK FOR LATER

Ilir Aliu - eu/acc

10,509 Aufrufe • vor 1 Jahr

Thrilled to share one of my favorite works this year: DexNDM! We bridge the Sim2Real gap for dexterous in-hand rotation, achieving a true "0-to-1" advancement. The key? DexNDM learns from biased, real-world data without needing any successful demonstrations. Now a general-purpose dexterous hand can stably rotate large books, long rods, & complex objects around any axis, from any wrist pose. This powerful primitive enables complex, long-horizon tasks like teleoperated screwing and furniture assembly. 📄 Paper: 🌐 Project Page:
4:04

Thrilled to share one of my favorite works this year: DexNDM! We bridge the Sim2Real gap for dexterous in-hand rotation, achieving a true "0-to-1" advancement. The key? DexNDM learns from biased, real-world data without needing any successful demonstrations. Now a general-purpose dexterous hand can stably rotate large books, long rods, & complex objects around any axis, from any wrist pose. This powerful primitive enables complex, long-horizon tasks like teleoperated screwing and furniture assembly. 📄 Paper: 🌐 Project Page:

Li Yi

38,683 Aufrufe • vor 8 Monaten

Introducing @NanoClaw 2 with cofounder Gavriel Cohen. v2 brings agent-to-agent communication, human-in-the-loop-approvals, support for 15 messaging platforms, and more.
58:41

Introducing @NanoClaw 2 with cofounder Gavriel Cohen. v2 brings agent-to-agent communication, human-in-the-loop-approvals, support for 15 messaging platforms, and more.

Robert Scoble

21,396 Aufrufe • vor 2 Monaten

Introducing Yell At Your Robot (YAY Robot!) 🗣️- a fun collaboration b/w Stanford University and UC Berkeley 🤖 We enable robots to improve on-the-fly from language corrections: robots rapidly adapt in real-time and continuously improve from human verbal feedback. YAY Robot enables long-horizon, dexterous manipulation tasks like preparing trail-mix, packing a ziploc bag, and cleaning dishes:
2:58

Introducing Yell At Your Robot (YAY Robot!) 🗣️- a fun collaboration b/w Stanford University and UC Berkeley 🤖 We enable robots to improve on-the-fly from language corrections: robots rapidly adapt in real-time and continuously improve from human verbal feedback. YAY Robot enables long-horizon, dexterous manipulation tasks like preparing trail-mix, packing a ziploc bag, and cleaning dishes:

Lucy Shi

122,827 Aufrufe • vor 2 Jahren

Introducing Kombai, the first AI agent built for frontend development. Kombai vastly outperforms SOTA models + generic agents in real-world benchmarks. Watch it add a complex new feature to an OSS codebase with 500K+ lines of code. More use cases and links in comments
3:08

Introducing Kombai, the first AI agent built for frontend development. Kombai vastly outperforms SOTA models + generic agents in real-world benchmarks. Watch it add a complex new feature to an OSS codebase with 500K+ lines of code. More use cases and links in comments

Dipanjan Dey

2,074,645 Aufrufe • vor 11 Monaten

Meet Any2Track, a new two-stage RL framework designed to address a core challenge for humanoid robots: reliably tracking diverse, dynamic motions in the real world. The framework consists of two key components: AnyTracker, a general motion tracker, and AnyAdapter, a module that allows the robot to adapt to real-world disturbances like uneven terrain or external forces. This approach gives robots the stability needed for practical use. The system has been successfully deployed on a Unitree G1 humanoid robot with zero-shot sim2real transfer, performing exceptionally well in various motion tracking tasks under multiple real-world disturbances. Project: Codebase:
1:44

Meet Any2Track, a new two-stage RL framework designed to address a core challenge for humanoid robots: reliably tracking diverse, dynamic motions in the real world. The framework consists of two key components: AnyTracker, a general motion tracker, and AnyAdapter, a module that allows the robot to adapt to real-world disturbances like uneven terrain or external forces. This approach gives robots the stability needed for practical use. The system has been successfully deployed on a Unitree G1 humanoid robot with zero-shot sim2real transfer, performing exceptionally well in various motion tracking tasks under multiple real-world disturbances. Project: Codebase:

RoboHub🤖

61,378 Aufrufe • vor 9 Monaten