Video yükleniyor...

Video Yüklenemedi

Ana Sayfaya Dön

Excited to share ESI-BENCH, a benchmark for Embodied Spatial Intelligence! Most spatial reasoning benchmarks assume an oracle observer: the agent is given the right image, view, or 3D scene. But in the real world, the observer is also an actor. To understand space, agents must decide where to look,...

yining_hong's profile picture

Yining Hong

4,229 subscribers

48,307 görüntüleme • 1 ay önce •via X (Twitter)

LIVE

Anya Rossi• Live Now

Private livecam show

0 Yorum

Yorum bulunmuyor

Orijinal gönderinin yorumları burada görünecek

Benzer Videolar

Spatial intelligence enables the next interface. World Labs co-founders Fei-Fei Li and Justin Johnson say that blending digital and physical worlds simplifies UX and brings agents to the 3D world.
1:16

Spatial intelligence enables the next interface. World Labs co-founders Fei-Fei Li and Justin Johnson say that blending digital and physical worlds simplifies UX and brings agents to the 3D world.

a16z

31,975 görüntüleme • 9 ay önce

Chatbots aren’t the revolution. They’re the distraction. Fei-Fei Li: “Language is a half-million-year-old luxury. Perception is a half-billion-year-old necessity.” Evolution didn’t optimize for conversation. It optimized for survival in three-dimensional space. Seeing threats, navigating obstacles, predicting what happens when you move. We’ve spent years celebrating AI that can write and summarize. But text processing is narrow. Spatial intelligence is fundamental. An agent that only reads prompts can’t function in a warehouse or a hospital. It needs to parse depth, understand physics, and act on what it sees in real time. We built AI that understands language. Now we’re building AI that understands space. Language models got the attention. Spatial intelligence gets the work done. The world runs on physics, not paragraphs. AI is learning to operate in it.
1:01

Chatbots aren’t the revolution. They’re the distraction. Fei-Fei Li: “Language is a half-million-year-old luxury. Perception is a half-billion-year-old necessity.” Evolution didn’t optimize for conversation. It optimized for survival in three-dimensional space. Seeing threats, navigating obstacles, predicting what happens when you move. We’ve spent years celebrating AI that can write and summarize. But text processing is narrow. Spatial intelligence is fundamental. An agent that only reads prompts can’t function in a warehouse or a hospital. It needs to parse depth, understand physics, and act on what it sees in real time. We built AI that understands language. Now we’re building AI that understands space. Language models got the attention. Spatial intelligence gets the work done. The world runs on physics, not paragraphs. AI is learning to operate in it.

Dustin

51,715 görüntüleme • 4 ay önce

Dr. Fei-Fei Li just called out the biggest blind spot in the entire AI industry. We have been building half of human intelligence. And calling it the finish line. Li: “If you look at human intelligence, it pretty much boils down to two buckets.” The first bucket is language. Symbolic reasoning. Communication. The ability to think in words and abstractions. That’s what every major AI lab has spent the last decade building. The second bucket is the one the industry has almost entirely ignored. Li: “We call that in AI spatial intelligence.” How humans and animals perceive, navigate, and interact with the three-dimensional physical world. How we reach for objects. How we move through space. How we build and manipulate physical reality. From painting masterpieces to constructing the pyramids, non-verbal spatial intelligence is what actually shapes the world. Language describes reality. Spatial intelligence acts on it. And the gap between those two things is the gap between a chatbot and a robot. Li: “When this technology is ready, the robotic revolution is gonna start. We’re already seeing that trend.” Every robot is a moving agent. Every moving agent requires spatial intelligence to function in the real world. The humanoid robots being deployed in factories right now are hitting the ceiling of what language models alone can power. Spatial intelligence is the unlock. But Li didn’t stop at robotics. Li: “From a geopolitics point of view, this is part of the technology that goes straight into weapons.” Autonomous drone swarms. Battlefield navigation. Physical target acquisition without human oversight. Every military application of AI that operates in the real world runs on spatial intelligence. The nation that masters the transition from static text to dynamic three-dimensional perception doesn’t just win the software race. It commands the physical battlefield. The AI arms race just broke out of the data center. It’s operating in three dimensions now.
3:08

Dr. Fei-Fei Li just called out the biggest blind spot in the entire AI industry. We have been building half of human intelligence. And calling it the finish line. Li: “If you look at human intelligence, it pretty much boils down to two buckets.” The first bucket is language. Symbolic reasoning. Communication. The ability to think in words and abstractions. That’s what every major AI lab has spent the last decade building. The second bucket is the one the industry has almost entirely ignored. Li: “We call that in AI spatial intelligence.” How humans and animals perceive, navigate, and interact with the three-dimensional physical world. How we reach for objects. How we move through space. How we build and manipulate physical reality. From painting masterpieces to constructing the pyramids, non-verbal spatial intelligence is what actually shapes the world. Language describes reality. Spatial intelligence acts on it. And the gap between those two things is the gap between a chatbot and a robot. Li: “When this technology is ready, the robotic revolution is gonna start. We’re already seeing that trend.” Every robot is a moving agent. Every moving agent requires spatial intelligence to function in the real world. The humanoid robots being deployed in factories right now are hitting the ceiling of what language models alone can power. Spatial intelligence is the unlock. But Li didn’t stop at robotics. Li: “From a geopolitics point of view, this is part of the technology that goes straight into weapons.” Autonomous drone swarms. Battlefield navigation. Physical target acquisition without human oversight. Every military application of AI that operates in the real world runs on spatial intelligence. The nation that masters the transition from static text to dynamic three-dimensional perception doesn’t just win the software race. It commands the physical battlefield. The AI arms race just broke out of the data center. It’s operating in three dimensions now.

Dustin

122,612 görüntüleme • 3 ay önce

📁 Fei-Fei Li founder of World Labs, says the next leap in AI is not language. Human intelligence does not just speak, it moves, perceives, and acts in the physical world. Spatial intelligence is the real core of intelligence. From text to space, from models to 3D and 4D worlds, from understanding words to interacting with reality. The next chapter is not read, it is inhabited.
1:41

📁 Fei-Fei Li founder of World Labs, says the next leap in AI is not language. Human intelligence does not just speak, it moves, perceives, and acts in the physical world. Spatial intelligence is the real core of intelligence. From text to space, from models to 3D and 4D worlds, from understanding words to interacting with reality. The next chapter is not read, it is inhabited.

Jon Hernandez

20,577 görüntüleme • 4 ay önce

Fei-Fei Li says real AI needs eyes. Not to look, but to move in 3D space. Spatial intelligence gave animals agency, and machines will need it too. And once AI can act in space, we can simulate limitless environments -- to train, explore, and create alongside them.
2:08

Fei-Fei Li says real AI needs eyes. Not to look, but to move in 3D space. Spatial intelligence gave animals agency, and machines will need it too. And once AI can act in space, we can simulate limitless environments -- to train, explore, and create alongside them.

vitrupo

171,579 görüntüleme • 1 yıl önce

📁 Fei-Fei Li, computer vision pioneer and Stanford professor, says the next frontier of AI is spatial intelligence. The ability to perceive, reason and act in the physical world. Not just see and talk. But do. Just as vision triggered the Cambrian explosion of life, spatial intelligence could trigger the next explosion of AI.
1:14

📁 Fei-Fei Li, computer vision pioneer and Stanford professor, says the next frontier of AI is spatial intelligence. The ability to perceive, reason and act in the physical world. Not just see and talk. But do. Just as vision triggered the Cambrian explosion of life, spatial intelligence could trigger the next explosion of AI.

Jon Hernandez

24,339 görüntüleme • 3 ay önce

The moment is right to push forward into a new frontier for AI — one that is as fundamental as language, says Fei-Fei Li. That frontier is visual spatial intelligence. With Justin Johnson (Justin Johnson), her cofounder at World Labs, and a16z's martin_casado, Fei-Fei explains what unlocking this technology could mean, and why we’re in the midst of a “Cambrian explosion”:
48:09

The moment is right to push forward into a new frontier for AI — one that is as fundamental as language, says Fei-Fei Li. That frontier is visual spatial intelligence. With Justin Johnson (Justin Johnson), her cofounder at World Labs, and a16z's martin_casado, Fei-Fei explains what unlocking this technology could mean, and why we’re in the midst of a “Cambrian explosion”:

a16z

476,523 görüntüleme • 1 yıl önce

The future belongs to proactive agents. But without real-time perception, they're stuck reacting. "World2Agent" isn't a product. It's an open protocol and an invitation — to build the perception layer for AI agents, together. We're open-sourcing everything: the protocol, the SDK, and first sensors. GITHUB + DEMO in comments.
0:27

The future belongs to proactive agents. But without real-time perception, they're stuck reacting. "World2Agent" isn't a product. It's an open protocol and an invitation — to build the perception layer for AI agents, together. We're open-sourcing everything: the protocol, the SDK, and first sensors. GITHUB + DEMO in comments.

LeahW

1,192,373 görüntüleme • 1 ay önce

On investing in World Modeling and Spatial Intelligence, "It will take time to invest, and it will also hopefully not take the hype..." World Labs' Fei-Fei Li. #BloombergTech Emily Chang ⏯️
1:01

On investing in World Modeling and Spatial Intelligence, "It will take time to invest, and it will also hopefully not take the hype..." World Labs' Fei-Fei Li. #BloombergTech Emily Chang ⏯️

Bloomberg Live

12,843 görüntüleme • 20 gün önce

World Labs CEO Dr. Fei-Fei Li explains says "world model" has become an overloaded term & explains what each kind of world model does: "Right now there are three ways of calling world models when it comes to spatial intelligence." "One is what I call a renderer, when the model puts beautiful pixels on the screen." "Another kind of world model is what we call a planner. That is more for machines, more for robots." "The third kind, which I think is the linchpin of the three, is a simulator." "A simulator could become a renderer. The simulator could become a planner. But this layer is a huge critical path to unlock spatial intelligence. And that's what World Labs is working on." Fei-Fei Li at Bloomberg Tech live with Emily Chang
2:08

World Labs CEO Dr. Fei-Fei Li explains says "world model" has become an overloaded term & explains what each kind of world model does: "Right now there are three ways of calling world models when it comes to spatial intelligence." "One is what I call a renderer, when the model puts beautiful pixels on the screen." "Another kind of world model is what we call a planner. That is more for machines, more for robots." "The third kind, which I think is the linchpin of the three, is a simulator." "A simulator could become a renderer. The simulator could become a planner. But this layer is a huge critical path to unlock spatial intelligence. And that's what World Labs is working on." Fei-Fei Li at Bloomberg Tech live with Emily Chang

a16z

111,193 görüntüleme • 16 gün önce

🔥In Magma, we talked a lot about spatial/temporal intelligence beyond verbal intelligencen as advocated by Dr. Fei-Fei Li. So how to interpret it? Today I am happy to announce a new demo Magma-Gaming: 👉 Rather than asking LLMs to write game code, we further ask the model to PLAY the game. A simple game like moving to the target in a 2D grid still requires precise action grounding and planning capability, yet challenges the most advanced VLMs and even GPT-4o-mini model. Magma, born with stronger spatial understanding and reasoning ability, significantly outperforms the counterparts and achieves much higher scores in zero-shot manner. This result pinpoints the huge potential of building multimodal agentic models endowed with both verbal and spatial inteligence! Also, I believe this simple demo gives you a better hints to understand what is spatial intelligence, and why it is important!
1:05

🔥In Magma, we talked a lot about spatial/temporal intelligence beyond verbal intelligencen as advocated by Dr. Fei-Fei Li. So how to interpret it? Today I am happy to announce a new demo Magma-Gaming: 👉 Rather than asking LLMs to write game code, we further ask the model to PLAY the game. A simple game like moving to the target in a 2D grid still requires precise action grounding and planning capability, yet challenges the most advanced VLMs and even GPT-4o-mini model. Magma, born with stronger spatial understanding and reasoning ability, significantly outperforms the counterparts and achieves much higher scores in zero-shot manner. This result pinpoints the huge potential of building multimodal agentic models endowed with both verbal and spatial inteligence! Also, I believe this simple demo gives you a better hints to understand what is spatial intelligence, and why it is important!

Jianwei Yang

17,940 görüntüleme • 1 yıl önce

Excited to share our latest work on 🎧spatial audio-driven human motion generation. We aim to tackle a largely underexplored yet important problem of enabling virtual humans to move naturally in response to spatial audio—capturing not just what is heard, but also where the sound is coming from. To this end, we introduce the Spatial Audio-Driven Human Motion (SAM) dataset—the first comprehensive dataset featuring paired high-quality human motion and spatial audio recordings. For benchmarking, we develop a generative framework for human MOtion generation driven by SPAtial audio, termed MOSPA, which learns to synthesize realistic and diverse human motions conditioned on spatial audio input. We hope this research could provide a foundation for future research in spatial perception, virtual characters, and embodied AI. The dataset and model will be open-sourced soon. A big thank you to our intern, Shuyang Xu, for the wonderful collaboration! Congratulations, Shuyang! Project page: Paper: Video: #Animation #CG #CV #AIGC #DL #Deeplearning #Motion #Graphics #AI #GenerativeAI
3:58

Excited to share our latest work on 🎧spatial audio-driven human motion generation. We aim to tackle a largely underexplored yet important problem of enabling virtual humans to move naturally in response to spatial audio—capturing not just what is heard, but also where the sound is coming from. To this end, we introduce the Spatial Audio-Driven Human Motion (SAM) dataset—the first comprehensive dataset featuring paired high-quality human motion and spatial audio recordings. For benchmarking, we develop a generative framework for human MOtion generation driven by SPAtial audio, termed MOSPA, which learns to synthesize realistic and diverse human motions conditioned on spatial audio input. We hope this research could provide a foundation for future research in spatial perception, virtual characters, and embodied AI. The dataset and model will be open-sourced soon. A big thank you to our intern, Shuyang Xu, for the wonderful collaboration! Congratulations, Shuyang! Project page: Paper: Video: #Animation #CG #CV #AIGC #DL #Deeplearning #Motion #Graphics #AI #GenerativeAI

Zhiyang (Frank) Dou

14,610 görüntüleme • 11 ay önce

"Visual-spatial intelligence is as fundamental as language." Fei-Fei Li says world models are the key to letting AI see the world, reason about it, interact with it, navigate it, and even 'build civilization upon it.' "It's very natural for me that World Labs' north star is to unlock spatial intelligence. The moment to me is right to do it." "We've got these ingredients—we've got compute, we've got a much deeper understanding of data, way deeper than [the ImageNet days]... and we've got some advancement of algorithms."
1:27

"Visual-spatial intelligence is as fundamental as language." Fei-Fei Li says world models are the key to letting AI see the world, reason about it, interact with it, navigate it, and even 'build civilization upon it.' "It's very natural for me that World Labs' north star is to unlock spatial intelligence. The moment to me is right to do it." "We've got these ingredients—we've got compute, we've got a much deeper understanding of data, way deeper than [the ImageNet days]... and we've got some advancement of algorithms."

a16z

31,675 görüntüleme • 4 ay önce

In their latest video, Boston Dynamics’s AI team explains how they make the Atlas humanoid perceive and interact with the world. Atlas uses an agile perception system to understand both the shape and context of objects in complex environments. Atlas combines 2D and 3D awareness, keypoint-based localization, and an object pose tracking system that fuses vision, kinematics, and object knowledge to handle occlusion and uncertainty. Accurate calibration ensures precise hand–eye coordination for reliable manipulation. The team is now working toward a unified model that merges perception and control – pushing beyond spatial AI toward physical intelligence.
6:34

In their latest video, Boston Dynamics’s AI team explains how they make the Atlas humanoid perceive and interact with the world. Atlas uses an agile perception system to understand both the shape and context of objects in complex environments. Atlas combines 2D and 3D awareness, keypoint-based localization, and an object pose tracking system that fuses vision, kinematics, and object knowledge to handle occlusion and uncertainty. Accurate calibration ensures precise hand–eye coordination for reliable manipulation. The team is now working toward a unified model that merges perception and control – pushing beyond spatial AI toward physical intelligence.

The Humanoid Hub

49,655 görüntüleme • 1 yıl önce

.Fei-Fei Li, aka The Godmother of AI, discusses her latest startup, World Labs, and why "Spatial" intelligence is a new foundational technology
1:31

.Fei-Fei Li, aka The Godmother of AI, discusses her latest startup, World Labs, and why "Spatial" intelligence is a new foundational technology

Bloomberg TV

34,491 görüntüleme • 1 yıl önce

Our paper “Learning Situated Awareness in the Real World” has been accepted to #ICML2026 as a Spotlight (top 2.2%)! Congrats to Chuhan Li ✈️ICML and the team! We introduce SAW-Bench, a real-world egocentric benchmark for evaluating situated (first-person) spatial reasoning in multimodal models, uncovering a large gap between humans and current systems. All videos recorded via Meta Ray-Ban 2 glasses!
1:25

Our paper “Learning Situated Awareness in the Real World” has been accepted to #ICML2026 as a Spotlight (top 2.2%)! Congrats to Chuhan Li ✈️ICML and the team! We introduce SAW-Bench, a real-world egocentric benchmark for evaluating situated (first-person) spatial reasoning in multimodal models, uncovering a large gap between humans and current systems. All videos recorded via Meta Ray-Ban 2 glasses!

Xin Eric Wang

11,494 görüntüleme • 1 ay önce

Language models process data as one-dimensional sequences of tokens — ideal for text, but limited for understanding the physical world. In contrast, spatial intelligence embraces a 3D representation, unlocking a deeper understanding of space and time. More from martin_casado's interview with Fei-Fei Li and Justin Johnson:
0:58

Language models process data as one-dimensional sequences of tokens — ideal for text, but limited for understanding the physical world. In contrast, spatial intelligence embraces a 3D representation, unlocking a deeper understanding of space and time. More from martin_casado's interview with Fei-Fei Li and Justin Johnson:

a16z

64,662 görüntüleme • 1 yıl önce

Robots are gaining spatial awareness with Over the Reality. 🤖 Powered by the world’s largest 3D dataset, we enable robots to see, sense, and collaborate in real-world environments. This early test shows how a Unitree Go2 perceives its surroundings through OVER’s VPS — on the right, the real life robot; on the left, its real-time perception of the position inside one of OVER’s 3D maps. Robotic spatial awareness is here, living in 155,000+ mapped locations and expanding every day. One step closer to Physical AI. Stay tuned for our upcoming ROS 2 integration, unlocking a universal framework for robotic perception leveraging OVER's infrastructure!
0:25

Robots are gaining spatial awareness with Over the Reality. 🤖 Powered by the world’s largest 3D dataset, we enable robots to see, sense, and collaborate in real-world environments. This early test shows how a Unitree Go2 perceives its surroundings through OVER’s VPS — on the right, the real life robot; on the left, its real-time perception of the position inside one of OVER’s 3D maps. Robotic spatial awareness is here, living in 155,000+ mapped locations and expanding every day. One step closer to Physical AI. Stay tuned for our upcoming ROS 2 integration, unlocking a universal framework for robotic perception leveraging OVER's infrastructure!

Over the Reality 🌐

263,788 görüntüleme • 8 ay önce

What would a World Model look like if we start from a real embodied agent acting in the real world? It has to have: 1) A real, physically grounded and complex action space—not just abstract control signals. 2) Diverse, real-life scenarios and activities. Or in short: It has to be annoyingly complex—in both the action and vision space—to even get close to real life. We did an initial attempt: Whole-Body Conditioned Egocentric Video Prediction. In collaboration with @dans_t123 , Amir Bar, Yann LeCun , trevordarrell and Jitendra MALIK. (For more details, check: What we did is very simple: Predict Egocentric Video from human Actions (PEVA) - Given the past video and a future action represented by relative 3D body pose, PEVA predicts how the world looks next—from the first-person view. By conditioning on kinematic pose trajectories, structured by the joint hierarchy of the body, it learns how physical actions shape perception.
3:12

What would a World Model look like if we start from a real embodied agent acting in the real world? It has to have: 1) A real, physically grounded and complex action space—not just abstract control signals. 2) Diverse, real-life scenarios and activities. Or in short: It has to be annoyingly complex—in both the action and vision space—to even get close to real life. We did an initial attempt: Whole-Body Conditioned Egocentric Video Prediction. In collaboration with @dans_t123 , Amir Bar, Yann LeCun , trevordarrell and Jitendra MALIK. (For more details, check: What we did is very simple: Predict Egocentric Video from human Actions (PEVA) - Given the past video and a future action represented by relative 3D body pose, PEVA predicts how the world looks next—from the first-person view. By conditioning on kinematic pose trajectories, structured by the joint hierarchy of the body, it learns how physical actions shape perception.

Yutong Bai

176,940 görüntüleme • 1 yıl önce

Dr. Fei-Fei Li (Fei-Fei Li), the Godmother of AI, on the origin of computer vision and why spatial intelligence is the next frontier. At AI Startup School in San Francisco. 01:00 - Origins of ImageNet 02:15 - The Dream to Make Machines See 03:28 - A paradigm shift in AI 05:50 - AlexNet and Deep Learning 08:00 - Evolving Computer Vision 12:20 - Building World Labs 13:00 - The next frontier in AI 14:20 - Why Spatial Intelligence Is Harder Than Language 18:40 - Technical Barriers for Vision-Based AI 20:00 - AI is more than LLMs 25:50 - Fei Fei’s Journey 29:30 - Mentoring some of the legends of AI 33:00 - Audience Q&A
44:21

Dr. Fei-Fei Li (Fei-Fei Li), the Godmother of AI, on the origin of computer vision and why spatial intelligence is the next frontier. At AI Startup School in San Francisco. 01:00 - Origins of ImageNet 02:15 - The Dream to Make Machines See 03:28 - A paradigm shift in AI 05:50 - AlexNet and Deep Learning 08:00 - Evolving Computer Vision 12:20 - Building World Labs 13:00 - The next frontier in AI 14:20 - Why Spatial Intelligence Is Harder Than Language 18:40 - Technical Barriers for Vision-Based AI 20:00 - AI is more than LLMs 25:50 - Fei Fei’s Journey 29:30 - Mentoring some of the legends of AI 33:00 - Audience Q&A

Y Combinator

194,393 görüntüleme • 11 ay önce