Video wird geladen...

Video konnte nicht geladen werden

Beim Laden dieses Videos ist ein Problem aufgetreten. Dies könnte an einem vorübergehenden Netzwerkproblem liegen oder das Video ist möglicherweise nicht verfügbar.

Introducing ForeHOI - One small step toward Physical AI! Accepted to #CVPR2026 🎉 It turns real human experiences — the natural way you touch, grab & use objects every day — into 3D instantly. This will equip robots to perform precise sequential actions in the physical world 🚀

Chongjie Ye

2,428 subscribers

18,878 Aufrufe • vor 4 Monaten •via X (Twitter)

Anya Rossi• Live Now

Private livecam show

0 Kommentare

Keine Kommentare verfügbar

Kommentare vom Original-Post werden hier angezeigt

Ähnliche Videos

Ray Kurzweil says AI models will exceed human verbal ability in a year or two and the next step is large event models that enable robots to perform physical tasks

Ray Kurzweil says AI models will exceed human verbal ability in a year or two and the next step is large event models that enable robots to perform physical tasks

Tsarathustra

71,501 Aufrufe • vor 2 Jahren

Today Mecka is announcing $60M in funding to become the data and deployment layer for physical AI This raise will allow us to scale our data infrastructure, invest into new verticals, and deploy robots into the real world

Today Mecka is announcing $60M in funding to become the data and deployment layer for physical AI This raise will allow us to scale our data infrastructure, invest into new verticals, and deploy robots into the real world

Josh

319,363 Aufrufe • vor 2 Monaten

Teaching robots real dexterity has always been a challenge. But what if they could handle tools like a human? DexterityGen (DexGen) is a new system that helps robots use their hands better. It improves how they grip, move, and handle objects… from holding a pen to using a screwdriver. DexGen learns in simulation and refines its skills in the real world, making robotic hands much more useful. What makes DexGen special? ✅ Smarter movements that refine rough actions into precise skills ✅ Trained on a massive collection of dexterous tasks for better learning ✅ Better teleoperation that makes robotic hand control easier and safer ✅ Handles real-world challenges like small objects, tricky angles, and gravity This moves robots closer to real dexterity. It makes tool use more natural, improves stability, and brings robotic hands one step closer to human-level skill. Seen at Zhao-Heng Yin 🫶 Github: Paper:

Teaching robots real dexterity has always been a challenge. But what if they could handle tools like a human? DexterityGen (DexGen) is a new system that helps robots use their hands better. It improves how they grip, move, and handle objects… from holding a pen to using a screwdriver. DexGen learns in simulation and refines its skills in the real world, making robotic hands much more useful. What makes DexGen special? ✅ Smarter movements that refine rough actions into precise skills ✅ Trained on a massive collection of dexterous tasks for better learning ✅ Better teleoperation that makes robotic hand control easier and safer ✅ Handles real-world challenges like small objects, tricky angles, and gravity This moves robots closer to real dexterity. It makes tool use more natural, improves stability, and brings robotic hands one step closer to human-level skill. Seen at Zhao-Heng Yin 🫶 Github: Paper:

Ilir Aliu

51,490 Aufrufe • vor 1 Jahr

the micro1 robotics lab: real world data for intelligent models that co-exist in the physical world. we’re in-the-wild across 75 countries in 6,000+ unique environments collecting data. diverse movements, objects, and settings. the future of AI is as human as you can imagine. join us to start training robots today (link in comments).

the micro1 robotics lab: real world data for intelligent models that co-exist in the physical world. we’re in-the-wild across 75 countries in 6,000+ unique environments collecting data. diverse movements, objects, and settings. the future of AI is as human as you can imagine. join us to start training robots today (link in comments).

Ali Ansari

208,125 Aufrufe • vor 4 Monaten

It’s time to go beyond language models. Introducing Odyssey-2 Max, our most powerful world model yet. It materially advances the SOTA in physical accuracy. This is a big step toward models that simulate and interact with the world in real time. A new intelligence entirely!

It’s time to go beyond language models. Introducing Odyssey-2 Max, our most powerful world model yet. It materially advances the SOTA in physical accuracy. This is a big step toward models that simulate and interact with the world in real time. A new intelligence entirely!

Odyssey

2,185,086 Aufrufe • vor 3 Monaten

How do you explain world models to your sibling? 🤖 NVIDIA Cosmos helps physical AI reason about real-world interactions and simulate possible futures before acting in the real world. Or, as they might put it, it teaches robots to dream. 💭

How do you explain world models to your sibling? 🤖 NVIDIA Cosmos helps physical AI reason about real-world interactions and simulate possible futures before acting in the real world. Or, as they might put it, it teaches robots to dream. 💭

NVIDIA

82,268 Aufrufe • vor 5 Tagen

World Simulator, reimagined — now alive with humans, robots, and their vibrant society unfolding in 3D real-world geospatial scenes across the globe! 🚀 One day soon, humans and robots will co-exist in the same world. To prepare, we must address: 1️⃣ How can robots cooperate or compete intelligently? 2️⃣ How do humans build social bonds and communities? 3️⃣ How can both co-exist in an open, dynamic world? Announcing Virtual Community Project — a social-physical world simulator, where human characters and robotic agents can interact, grow, and co-evolve within open-world societies, stretching from London to New York, and beyond! Key features include: ✅ Unified multi-agent physics simulations for rich social + physical interactions of humans and robots ✅ Massive auto-generated 3D scenes grounded with the rea-world geospatial data ✅ Agent communities populated by robots and LLM-driven human characters with rich appearances, personalities, and social ties. 🌍 Enter our Virtual Community, an open world to study embodied AI at scale— one social-physical world model at a time! 🔗 Project: 💻 Code: Paper: 1/n

World Simulator, reimagined — now alive with humans, robots, and their vibrant society unfolding in 3D real-world geospatial scenes across the globe! 🚀 One day soon, humans and robots will co-exist in the same world. To prepare, we must address: 1️⃣ How can robots cooperate or compete intelligently? 2️⃣ How do humans build social bonds and communities? 3️⃣ How can both co-exist in an open, dynamic world? Announcing Virtual Community Project — a social-physical world simulator, where human characters and robotic agents can interact, grow, and co-evolve within open-world societies, stretching from London to New York, and beyond! Key features include: ✅ Unified multi-agent physics simulations for rich social + physical interactions of humans and robots ✅ Massive auto-generated 3D scenes grounded with the rea-world geospatial data ✅ Agent communities populated by robots and LLM-driven human characters with rich appearances, personalities, and social ties. 🌍 Enter our Virtual Community, an open world to study embodied AI at scale— one social-physical world model at a time! 🔗 Project: 💻 Code: Paper: 1/n

Chuang Gan

90,349 Aufrufe • vor 1 Jahr

.Balaji says AI verification is much harder in the digital world than it is for the physical world: "AI for the physical world is very verifiable because the thing is, the digital world is fundamentally decentralized in a way the physical world isn't." "There's only one physical world. You can say: did the AI move this box from this pallet to that pallet? That is something where you can probably get it to 100% over time." "By contrast, in the digital world, there are all these people who live in their own constructed environments." "How do you know when you're done with your to-do list? That's harder. Those things are fuzzier."

.Balaji says AI verification is much harder in the digital world than it is for the physical world: "AI for the physical world is very verifiable because the thing is, the digital world is fundamentally decentralized in a way the physical world isn't." "There's only one physical world. You can say: did the AI move this box from this pallet to that pallet? That is something where you can probably get it to 100% over time." "By contrast, in the digital world, there are all these people who live in their own constructed environments." "How do you know when you're done with your to-do list? That's harder. Those things are fuzzier."

a16z

132,718 Aufrufe • vor 4 Monaten

Robots are gaining spatial awareness with Over the Reality. 🤖 Powered by the world’s largest 3D dataset, we enable robots to see, sense, and collaborate in real-world environments. This early test shows how a Unitree Go2 perceives its surroundings through OVER’s VPS — on the right, the real life robot; on the left, its real-time perception of the position inside one of OVER’s 3D maps. Robotic spatial awareness is here, living in 155,000+ mapped locations and expanding every day. One step closer to Physical AI. Stay tuned for our upcoming ROS 2 integration, unlocking a universal framework for robotic perception leveraging OVER's infrastructure!

Robots are gaining spatial awareness with Over the Reality. 🤖 Powered by the world’s largest 3D dataset, we enable robots to see, sense, and collaborate in real-world environments. This early test shows how a Unitree Go2 perceives its surroundings through OVER’s VPS — on the right, the real life robot; on the left, its real-time perception of the position inside one of OVER’s 3D maps. Robotic spatial awareness is here, living in 155,000+ mapped locations and expanding every day. One step closer to Physical AI. Stay tuned for our upcoming ROS 2 integration, unlocking a universal framework for robotic perception leveraging OVER's infrastructure!

Over the Reality 🌐

263,818 Aufrufe • vor 10 Monaten

The next AI revolution is not just happening on screens. It is happening in the physical world. Robots, drones, autonomous vehicles, and smart machines all need one thing before they can operate safely: Precise location. Traditional GPS can be off by several meters. For humans, that may be fine. For autonomous machines, it can be dangerous. GEODNET is building the spatial intelligence layer for Physical AI, using RTK positioning to improve accuracy from meters to within one centimeter. Over 20,000 base stations. 170+ countries. 11,000+ cities. 130+ enterprise customers. Physical AI needs real-world infrastructure. That infrastructure is being built now.

The next AI revolution is not just happening on screens. It is happening in the physical world. Robots, drones, autonomous vehicles, and smart machines all need one thing before they can operate safely: Precise location. Traditional GPS can be off by several meters. For humans, that may be fine. For autonomous machines, it can be dangerous. GEODNET is building the spatial intelligence layer for Physical AI, using RTK positioning to improve accuracy from meters to within one centimeter. Over 20,000 base stations. 170+ countries. 11,000+ cities. 130+ enterprise customers. Physical AI needs real-world infrastructure. That infrastructure is being built now.

GEODNET

142,594 Aufrufe • vor 1 Monat

Japan Shimizu Corporation is testing humanoid robots on live construction sites. Start with basic patrols… An upgraded Unitree H1 humanoid, equipped with a handheld camera, is autonomously patrolling the Torch Tower site at 1.0 m/s. It perceives the environment in real time, follows designated routes, and they plan to use multimodal LLMs to analyze footage for better site management. Long-term, Shimizu aims to build a construction-focused Physical AI ecosystem--covering data collection, simulation, model training, and deployment. The goal is to transfer skilled workers’ expertise to humanoids and tackle labor shortages. the first real step toward physical AGI is simply stepping into the real world.

Japan Shimizu Corporation is testing humanoid robots on live construction sites. Start with basic patrols… An upgraded Unitree H1 humanoid, equipped with a handheld camera, is autonomously patrolling the Torch Tower site at 1.0 m/s. It perceives the environment in real time, follows designated routes, and they plan to use multimodal LLMs to analyze footage for better site management. Long-term, Shimizu aims to build a construction-focused Physical AI ecosystem--covering data collection, simulation, model training, and deployment. The goal is to transfer skilled workers’ expertise to humanoids and tackle labor shortages. the first real step toward physical AGI is simply stepping into the real world.

CyberRobo

72,338 Aufrufe • vor 1 Monat

Turned my real world 360 images into 3d scenes with World Labs. You can use the built-in editing tools to stitch them together into large-scale 3d worlds - then use them as virtual set for your AI videos, games and VR experiences. The holodeck is much closer than you think.

Turned my real world 360 images into 3d scenes with World Labs. You can use the built-in editing tools to stitch them together into large-scale 3d worlds - then use them as virtual set for your AI videos, games and VR experiences. The holodeck is much closer than you think.

Bilawal Sidhu

27,928 Aufrufe • vor 8 Monaten

The Real-to-Sim part of R2S2R transforms physical robots, sensors, environments, objects, and interactions into simulations that preserve task-relevant observations and dynamics - not only how the world looks, but how it acts when the robot interacts with it. These results set a new bar for sim-real alignment in robot manipulation.

The Real-to-Sim part of R2S2R transforms physical robots, sensors, environments, objects, and interactions into simulations that preserve task-relevant observations and dynamics - not only how the world looks, but how it acts when the robot interacts with it. These results set a new bar for sim-real alignment in robot manipulation.

Fei-Fei Li

24,736 Aufrufe • vor 13 Tagen

Today we are launching Mireye (YCS26) with Y Combinator The easiest way to build agentic applications for the physical world. AI agents are starting to act in the real world, but they can't reliably understand it. Mireye is one API and MCP that connects agents to the physical world: data, enrichment, tools, and signals that power them to make decisions. One line of code to make your agents street smart.

Today we are launching Mireye (YCS26) with Y Combinator The easiest way to build agentic applications for the physical world. AI agents are starting to act in the real world, but they can't reliably understand it. Mireye is one API and MCP that connects agents to the physical world: data, enrichment, tools, and signals that power them to make decisions. One line of code to make your agents street smart.

Ansh

28,678 Aufrufe • vor 10 Tagen

🚀 Big news today with Google + Adobe joining forces! We're talking about 3D content anchored to the real world at insane scale🌐 And of course, AI had a role to play. I've got early access, and let's just say the physical & digital worlds are blurring 😎 Let's get into it!🧵

🚀 Big news today with Google + Adobe joining forces! We're talking about 3D content anchored to the real world at insane scale🌐 And of course, AI had a role to play. I've got early access, and let's just say the physical & digital worlds are blurring 😎 Let's get into it!🧵

Bilawal Sidhu

547,785 Aufrufe • vor 3 Jahren

Breaking news: Cosmos 3 is here. They are attempting to do something completely new 🤯 Why is Physical AI much harder than building a chatbot? Understanding the world is not enough, robots need to predict it and act inside it. That's the idea behind NVIDIA Cosmos 3: → Reasoning model understands what's happening from video, images, text, and actions. → World model generates future states of the environment. → Action model generates the actions needed to achieve a goal. Previous systems often stitched these capabilities together using separate models. Cosmos 3 combines them into a single architecture with two components: ▪️ Reasoner Tower Analyzes observations and builds an understanding of objects, motion, interactions, and physical context. ▪️ Generator Tower Uses that understanding to generate future videos and action sequences that obey physical constraints. So Cosmos 3 moves from: Perception → Model A Prediction → Model B Actions → Model C to: Perception + Prediction + Actions → One unified system. The goal is to make robots, autonomous vehicles, and smart environments better at answering three questions: 1. What is happening? 2. What will happen next? 3. What should I do? That's a big shift from today's AI, which mostly focuses on generating text. And check the benchmarks! Physical AI needs to generate decisions that survive contact with the real world. 🚗🤖

Breaking news: Cosmos 3 is here. They are attempting to do something completely new 🤯 Why is Physical AI much harder than building a chatbot? Understanding the world is not enough, robots need to predict it and act inside it. That's the idea behind NVIDIA Cosmos 3: → Reasoning model understands what's happening from video, images, text, and actions. → World model generates future states of the environment. → Action model generates the actions needed to achieve a goal. Previous systems often stitched these capabilities together using separate models. Cosmos 3 combines them into a single architecture with two components: ▪️ Reasoner Tower Analyzes observations and builds an understanding of objects, motion, interactions, and physical context. ▪️ Generator Tower Uses that understanding to generate future videos and action sequences that obey physical constraints. So Cosmos 3 moves from: Perception → Model A Prediction → Model B Actions → Model C to: Perception + Prediction + Actions → One unified system. The goal is to make robots, autonomous vehicles, and smart environments better at answering three questions: 1. What is happening? 2. What will happen next? 3. What should I do? That's a big shift from today's AI, which mostly focuses on generating text. And check the benchmarks! Physical AI needs to generate decisions that survive contact with the real world. 🚗🤖

Turing Post

13,836 Aufrufe • vor 2 Monaten

NVIDIA has published a paper on DREAMGEN – a powerful 4-step pipeline for generating synthetic data for humanoids that enables task and environment generalization. - Step 1: Fine-tune a video generation model using a small number of human teleoperation videos - Step 2: Prompt the fine-tuned model to turn a single real image into new AI-imagined videos - Step 3: Automatically label actions in the generated videos - Step 4: Train a robot AI model with the labeled synthetic dataset This enabled humanoid robots to perform 22 novel behaviors – such as pouring, opening/closing articulated objects, and manipulating a variety of tools. The original teleoperation dataset only included pick-and-place tasks. This takes task extensibility to another level without requiring human teleoperation for every single task. The pipeline will be made open-source soon. Project page:

NVIDIA has published a paper on DREAMGEN – a powerful 4-step pipeline for generating synthetic data for humanoids that enables task and environment generalization. - Step 1: Fine-tune a video generation model using a small number of human teleoperation videos - Step 2: Prompt the fine-tuned model to turn a single real image into new AI-imagined videos - Step 3: Automatically label actions in the generated videos - Step 4: Train a robot AI model with the labeled synthetic dataset This enabled humanoid robots to perform 22 novel behaviors – such as pouring, opening/closing articulated objects, and manipulating a variety of tools. The original teleoperation dataset only included pick-and-place tasks. This takes task extensibility to another level without requiring human teleoperation for every single task. The pipeline will be made open-source soon. Project page:

The Humanoid Hub

12,074 Aufrufe • vor 1 Jahr