Загрузка видео...

Не удалось загрузить видео

На главную

Introducing ForeHOI - One small step toward Physical AI! Accepted to #CVPR2026 🎉 It turns real human experiences — the natural way you touch, grab & use objects every day — into 3D instantly. This will equip robots to perform precise sequential actions in the physical world 🚀

ychngji6's profile picture

Chongjie Ye

2,428 subscribers

18,878 просмотров • 5 месяцев назад •via X (Twitter)

#CVPR2026
LIVE

Anya Rossi• Live Now

Private livecam show

Комментарии: 0

Нет доступных комментариев

Здесь появятся комментарии из оригинального поста

Похожие видео

Today Mecka is announcing $60M in funding to become the data and deployment layer for physical AI This raise will allow us to scale our data infrastructure, invest into new verticals, and deploy robots into the real world
1:31

Today Mecka is announcing $60M in funding to become the data and deployment layer for physical AI This raise will allow us to scale our data infrastructure, invest into new verticals, and deploy robots into the real world

Josh

329,169 просмотров • 2 месяцев назад

Teaching robots real dexterity has always been a challenge. But what if they could handle tools like a human? DexterityGen (DexGen) is a new system that helps robots use their hands better. It improves how they grip, move, and handle objects… from holding a pen to using a screwdriver. DexGen learns in simulation and refines its skills in the real world, making robotic hands much more useful. What makes DexGen special? ✅ Smarter movements that refine rough actions into precise skills ✅ Trained on a massive collection of dexterous tasks for better learning ✅ Better teleoperation that makes robotic hand control easier and safer ✅ Handles real-world challenges like small objects, tricky angles, and gravity This moves robots closer to real dexterity. It makes tool use more natural, improves stability, and brings robotic hands one step closer to human-level skill. Seen at Zhao-Heng Yin 🫶 Github: Paper:
1:52

Teaching robots real dexterity has always been a challenge. But what if they could handle tools like a human? DexterityGen (DexGen) is a new system that helps robots use their hands better. It improves how they grip, move, and handle objects… from holding a pen to using a screwdriver. DexGen learns in simulation and refines its skills in the real world, making robotic hands much more useful. What makes DexGen special? ✅ Smarter movements that refine rough actions into precise skills ✅ Trained on a massive collection of dexterous tasks for better learning ✅ Better teleoperation that makes robotic hand control easier and safer ✅ Handles real-world challenges like small objects, tricky angles, and gravity This moves robots closer to real dexterity. It makes tool use more natural, improves stability, and brings robotic hands one step closer to human-level skill. Seen at Zhao-Heng Yin 🫶 Github: Paper:

Ilir Aliu

51,490 просмотров • 1 год назад

the micro1 robotics lab: real world data for intelligent models that co-exist in the physical world. we’re in-the-wild across 75 countries in 6,000+ unique environments collecting data. diverse movements, objects, and settings. the future of AI is as human as you can imagine. join us to start training robots today (link in comments).
1:05

the micro1 robotics lab: real world data for intelligent models that co-exist in the physical world. we’re in-the-wild across 75 countries in 6,000+ unique environments collecting data. diverse movements, objects, and settings. the future of AI is as human as you can imagine. join us to start training robots today (link in comments).

Ali Ansari

208,233 просмотров • 5 месяцев назад

It’s time to go beyond language models. Introducing Odyssey-2 Max, our most powerful world model yet. It materially advances the SOTA in physical accuracy. This is a big step toward models that simulate and interact with the world in real time. A new intelligence entirely!
1:08

It’s time to go beyond language models. Introducing Odyssey-2 Max, our most powerful world model yet. It materially advances the SOTA in physical accuracy. This is a big step toward models that simulate and interact with the world in real time. A new intelligence entirely!

Odyssey

2,185,494 просмотров • 3 месяцев назад

How do you explain world models to your sibling? 🤖 NVIDIA Cosmos helps physical AI reason about real-world interactions and simulate possible futures before acting in the real world. Or, as they might put it, it teaches robots to dream. 💭
1:14

How do you explain world models to your sibling? 🤖 NVIDIA Cosmos helps physical AI reason about real-world interactions and simulate possible futures before acting in the real world. Or, as they might put it, it teaches robots to dream. 💭

NVIDIA

89,292 просмотров • 13 дней назад

World Simulator, reimagined — now alive with humans, robots, and their vibrant society unfolding in 3D real-world geospatial scenes across the globe! 🚀 One day soon, humans and robots will co-exist in the same world. To prepare, we must address: 1️⃣ How can robots cooperate or compete intelligently? 2️⃣ How do humans build social bonds and communities? 3️⃣ How can both co-exist in an open, dynamic world? Announcing Virtual Community Project — a social-physical world simulator, where human characters and robotic agents can interact, grow, and co-evolve within open-world societies, stretching from London to New York, and beyond! Key features include: ✅ Unified multi-agent physics simulations for rich social + physical interactions of humans and robots ✅ Massive auto-generated 3D scenes grounded with the rea-world geospatial data ✅ Agent communities populated by robots and LLM-driven human characters with rich appearances, personalities, and social ties. 🌍 Enter our Virtual Community, an open world to study embodied AI at scale— one social-physical world model at a time! 🔗 Project: 💻 Code: Paper: 1/n
0:53

World Simulator, reimagined — now alive with humans, robots, and their vibrant society unfolding in 3D real-world geospatial scenes across the globe! 🚀 One day soon, humans and robots will co-exist in the same world. To prepare, we must address: 1️⃣ How can robots cooperate or compete intelligently? 2️⃣ How do humans build social bonds and communities? 3️⃣ How can both co-exist in an open, dynamic world? Announcing Virtual Community Project — a social-physical world simulator, where human characters and robotic agents can interact, grow, and co-evolve within open-world societies, stretching from London to New York, and beyond! Key features include: ✅ Unified multi-agent physics simulations for rich social + physical interactions of humans and robots ✅ Massive auto-generated 3D scenes grounded with the rea-world geospatial data ✅ Agent communities populated by robots and LLM-driven human characters with rich appearances, personalities, and social ties. 🌍 Enter our Virtual Community, an open world to study embodied AI at scale— one social-physical world model at a time! 🔗 Project: 💻 Code: Paper: 1/n

Chuang Gan

90,349 просмотров • 1 год назад

.Balaji says AI verification is much harder in the digital world than it is for the physical world: "AI for the physical world is very verifiable because the thing is, the digital world is fundamentally decentralized in a way the physical world isn't." "There's only one physical world. You can say: did the AI move this box from this pallet to that pallet? That is something where you can probably get it to 100% over time." "By contrast, in the digital world, there are all these people who live in their own constructed environments." "How do you know when you're done with your to-do list? That's harder. Those things are fuzzier."
1:32

.Balaji says AI verification is much harder in the digital world than it is for the physical world: "AI for the physical world is very verifiable because the thing is, the digital world is fundamentally decentralized in a way the physical world isn't." "There's only one physical world. You can say: did the AI move this box from this pallet to that pallet? That is something where you can probably get it to 100% over time." "By contrast, in the digital world, there are all these people who live in their own constructed environments." "How do you know when you're done with your to-do list? That's harder. Those things are fuzzier."

a16z

132,718 просмотров • 4 месяцев назад

Robots are gaining spatial awareness with Over the Reality. 🤖 Powered by the world’s largest 3D dataset, we enable robots to see, sense, and collaborate in real-world environments. This early test shows how a Unitree Go2 perceives its surroundings through OVER’s VPS — on the right, the real life robot; on the left, its real-time perception of the position inside one of OVER’s 3D maps. Robotic spatial awareness is here, living in 155,000+ mapped locations and expanding every day. One step closer to Physical AI. Stay tuned for our upcoming ROS 2 integration, unlocking a universal framework for robotic perception leveraging OVER's infrastructure!
0:25

Robots are gaining spatial awareness with Over the Reality. 🤖 Powered by the world’s largest 3D dataset, we enable robots to see, sense, and collaborate in real-world environments. This early test shows how a Unitree Go2 perceives its surroundings through OVER’s VPS — on the right, the real life robot; on the left, its real-time perception of the position inside one of OVER’s 3D maps. Robotic spatial awareness is here, living in 155,000+ mapped locations and expanding every day. One step closer to Physical AI. Stay tuned for our upcoming ROS 2 integration, unlocking a universal framework for robotic perception leveraging OVER's infrastructure!

Over the Reality 🌐

263,827 просмотров • 10 месяцев назад

The next AI revolution is not just happening on screens. It is happening in the physical world. Robots, drones, autonomous vehicles, and smart machines all need one thing before they can operate safely: Precise location. Traditional GPS can be off by several meters. For humans, that may be fine. For autonomous machines, it can be dangerous. GEODNET is building the spatial intelligence layer for Physical AI, using RTK positioning to improve accuracy from meters to within one centimeter. Over 20,000 base stations. 170+ countries. 11,000+ cities. 130+ enterprise customers. Physical AI needs real-world infrastructure. That infrastructure is being built now.
1:56

The next AI revolution is not just happening on screens. It is happening in the physical world. Robots, drones, autonomous vehicles, and smart machines all need one thing before they can operate safely: Precise location. Traditional GPS can be off by several meters. For humans, that may be fine. For autonomous machines, it can be dangerous. GEODNET is building the spatial intelligence layer for Physical AI, using RTK positioning to improve accuracy from meters to within one centimeter. Over 20,000 base stations. 170+ countries. 11,000+ cities. 130+ enterprise customers. Physical AI needs real-world infrastructure. That infrastructure is being built now.

GEODNET

146,441 просмотров • 1 месяц назад

Japan Shimizu Corporation is testing humanoid robots on live construction sites. Start with basic patrols… An upgraded Unitree H1 humanoid, equipped with a handheld camera, is autonomously patrolling the Torch Tower site at 1.0 m/s. It perceives the environment in real time, follows designated routes, and they plan to use multimodal LLMs to analyze footage for better site management. Long-term, Shimizu aims to build a construction-focused Physical AI ecosystem--covering data collection, simulation, model training, and deployment. The goal is to transfer skilled workers’ expertise to humanoids and tackle labor shortages. the first real step toward physical AGI is simply stepping into the real world.
0:50

Japan Shimizu Corporation is testing humanoid robots on live construction sites. Start with basic patrols… An upgraded Unitree H1 humanoid, equipped with a handheld camera, is autonomously patrolling the Torch Tower site at 1.0 m/s. It perceives the environment in real time, follows designated routes, and they plan to use multimodal LLMs to analyze footage for better site management. Long-term, Shimizu aims to build a construction-focused Physical AI ecosystem--covering data collection, simulation, model training, and deployment. The goal is to transfer skilled workers’ expertise to humanoids and tackle labor shortages. the first real step toward physical AGI is simply stepping into the real world.

CyberRobo

72,338 просмотров • 1 месяц назад

Turned my real world 360 images into 3d scenes with World Labs. You can use the built-in editing tools to stitch them together into large-scale 3d worlds - then use them as virtual set for your AI videos, games and VR experiences. The holodeck is much closer than you think.
1:40

Turned my real world 360 images into 3d scenes with World Labs. You can use the built-in editing tools to stitch them together into large-scale 3d worlds - then use them as virtual set for your AI videos, games and VR experiences. The holodeck is much closer than you think.

Bilawal Sidhu

27,928 просмотров • 8 месяцев назад

The Real-to-Sim part of R2S2R transforms physical robots, sensors, environments, objects, and interactions into simulations that preserve task-relevant observations and dynamics - not only how the world looks, but how it acts when the robot interacts with it. These results set a new bar for sim-real alignment in robot manipulation.
0:25

The Real-to-Sim part of R2S2R transforms physical robots, sensors, environments, objects, and interactions into simulations that preserve task-relevant observations and dynamics - not only how the world looks, but how it acts when the robot interacts with it. These results set a new bar for sim-real alignment in robot manipulation.

Fei-Fei Li

25,119 просмотров • 21 дней назад

Today we are launching Mireye (YCS26) with Y Combinator The easiest way to build agentic applications for the physical world. AI agents are starting to act in the real world, but they can't reliably understand it. Mireye is one API and MCP that connects agents to the physical world: data, enrichment, tools, and signals that power them to make decisions. One line of code to make your agents street smart.
1:47

Today we are launching Mireye (YCS26) with Y Combinator The easiest way to build agentic applications for the physical world. AI agents are starting to act in the real world, but they can't reliably understand it. Mireye is one API and MCP that connects agents to the physical world: data, enrichment, tools, and signals that power them to make decisions. One line of code to make your agents street smart.

Ansh

29,202 просмотров • 18 дней назад

🚀 Big news today with Google + Adobe joining forces! We're talking about 3D content anchored to the real world at insane scale🌐 And of course, AI had a role to play. I've got early access, and let's just say the physical & digital worlds are blurring 😎 Let's get into it!🧵
0:59

🚀 Big news today with Google + Adobe joining forces! We're talking about 3D content anchored to the real world at insane scale🌐 And of course, AI had a role to play. I've got early access, and let's just say the physical & digital worlds are blurring 😎 Let's get into it!🧵

Bilawal Sidhu

547,804 просмотров • 3 лет назад

Breaking news: Cosmos 3 is here. They are attempting to do something completely new 🤯 Why is Physical AI much harder than building a chatbot? Understanding the world is not enough, robots need to predict it and act inside it. That's the idea behind NVIDIA Cosmos 3: → Reasoning model understands what's happening from video, images, text, and actions. → World model generates future states of the environment. → Action model generates the actions needed to achieve a goal. Previous systems often stitched these capabilities together using separate models. Cosmos 3 combines them into a single architecture with two components: ▪️ Reasoner Tower Analyzes observations and builds an understanding of objects, motion, interactions, and physical context. ▪️ Generator Tower Uses that understanding to generate future videos and action sequences that obey physical constraints. So Cosmos 3 moves from: Perception → Model A Prediction → Model B Actions → Model C to: Perception + Prediction + Actions → One unified system. The goal is to make robots, autonomous vehicles, and smart environments better at answering three questions: 1. What is happening? 2. What will happen next? 3. What should I do? That's a big shift from today's AI, which mostly focuses on generating text. And check the benchmarks! Physical AI needs to generate decisions that survive contact with the real world. 🚗🤖
0:33

Breaking news: Cosmos 3 is here. They are attempting to do something completely new 🤯 Why is Physical AI much harder than building a chatbot? Understanding the world is not enough, robots need to predict it and act inside it. That's the idea behind NVIDIA Cosmos 3: → Reasoning model understands what's happening from video, images, text, and actions. → World model generates future states of the environment. → Action model generates the actions needed to achieve a goal. Previous systems often stitched these capabilities together using separate models. Cosmos 3 combines them into a single architecture with two components: ▪️ Reasoner Tower Analyzes observations and builds an understanding of objects, motion, interactions, and physical context. ▪️ Generator Tower Uses that understanding to generate future videos and action sequences that obey physical constraints. So Cosmos 3 moves from: Perception → Model A Prediction → Model B Actions → Model C to: Perception + Prediction + Actions → One unified system. The goal is to make robots, autonomous vehicles, and smart environments better at answering three questions: 1. What is happening? 2. What will happen next? 3. What should I do? That's a big shift from today's AI, which mostly focuses on generating text. And check the benchmarks! Physical AI needs to generate decisions that survive contact with the real world. 🚗🤖

Turing Post

13,836 просмотров • 2 месяцев назад