Loading video...

Video Failed to Load

There was a problem loading this video. This could be due to a temporary network issue or the video might be unavailable.

Spatial intelligence enables the next interface. World Labs co-founders Fei-Fei Li and Justin Johnson say that blending digital and physical worlds simplifies UX and brings agents to the 3D world.

a16z

1,104,841 subscribers

33,088 views • 1 year ago •via X (Twitter)

Science & Technology Education Arts

Anya Rossi• Live Now

Private livecam show

11 Comments

Pedro Gomez Meza1 year ago

@drfeifei @jcjohnss @grok explain the impact for e-commerce apps in the future!

Peyman Servati1 year ago

@drfeifei @jcjohnss Spatial intelligence also includes dynamic contact and force intelligence. Go @TexavieInc

Kevin Henrikson1 year ago

@drfeifei @jcjohnss so... are we saying that metaverse could actually be the next thing?

Ravinder1 year ago

@drfeifei @jcjohnss Autonomous cars are an example of spatial intelligence. They navigate real world so safely. Spatial intelligence required for controlled environments like factories, is comparatively more about Engineering decisions, is building core intelligence for this

kennyzoo1 year ago

@drfeifei @jcjohnss I mean, @AukiNetwork is already literally doing this, working product and everything 🤷‍♂️

Cyrus1 year ago

@drfeifei @jcjohnss ya this is one won’t be bigger than audio i predict

Sunil Ecologista1 year ago

@drfeifei @jcjohnss La inteligencia espacial está abriendo caminos para integrar tecnología, ciudades resilientes y experiencias humanas más naturales. Un salto esencial hacia sociedades y entornos sostenibles.

$MIA1 year ago

@drfeifei @jcjohnss spatial agents are the real game changer for AgentFi

ℤ𝔼ℕ ⚡️ the innovator 💡1 year ago

@drfeifei @jcjohnss Exciting Times !

ℤ𝔼ℕ ⚡️ the innovator 💡1 year ago

@drfeifei @jcjohnss

James Squire1 year ago

@drfeifei @jcjohnss

Related Videos

The moment is right to push forward into a new frontier for AI — one that is as fundamental as language, says Fei-Fei Li. That frontier is visual spatial intelligence. With Justin Johnson (Justin Johnson), her cofounder at World Labs, and a16z's martin_casado, Fei-Fei explains what unlocking this technology could mean, and why we’re in the midst of a “Cambrian explosion”:

The moment is right to push forward into a new frontier for AI — one that is as fundamental as language, says Fei-Fei Li. That frontier is visual spatial intelligence. With Justin Johnson (Justin Johnson), her cofounder at World Labs, and a16z's martin_casado, Fei-Fei explains what unlocking this technology could mean, and why we’re in the midst of a “Cambrian explosion”:

a16z

477,081 views • 2 years ago

Language models process data as one-dimensional sequences of tokens — ideal for text, but limited for understanding the physical world. In contrast, spatial intelligence embraces a 3D representation, unlocking a deeper understanding of space and time. More from martin_casado's interview with Fei-Fei Li and Justin Johnson:

Language models process data as one-dimensional sequences of tokens — ideal for text, but limited for understanding the physical world. In contrast, spatial intelligence embraces a 3D representation, unlocking a deeper understanding of space and time. More from martin_casado's interview with Fei-Fei Li and Justin Johnson:

a16z

64,679 views • 2 years ago

For all of history, humanity shared one 3D world. World Labs co-founder Fei-Fei Li says spatial intelligence now lets us generate and reconstruct infinite universes for creativity, travel, storytelling, even socialization. “It suddenly will enable us to live in a multiverse way.”

For all of history, humanity shared one 3D world. World Labs co-founder Fei-Fei Li says spatial intelligence now lets us generate and reconstruct infinite universes for creativity, travel, storytelling, even socialization. “It suddenly will enable us to live in a multiverse way.”

a16z

204,325 views • 1 year ago

📁 Fei-Fei Li founder of World Labs, says the next leap in AI is not language. Human intelligence does not just speak, it moves, perceives, and acts in the physical world. Spatial intelligence is the real core of intelligence. From text to space, from models to 3D and 4D worlds, from understanding words to interacting with reality. The next chapter is not read, it is inhabited.

📁 Fei-Fei Li founder of World Labs, says the next leap in AI is not language. Human intelligence does not just speak, it moves, perceives, and acts in the physical world. Spatial intelligence is the real core of intelligence. From text to space, from models to 3D and 4D worlds, from understanding words to interacting with reality. The next chapter is not read, it is inhabited.

Jon Hernandez

20,660 views • 9 months ago

.Fei-Fei Li, aka The Godmother of AI, discusses her latest startup, World Labs, and why "Spatial" intelligence is a new foundational technology

.Fei-Fei Li, aka The Godmother of AI, discusses her latest startup, World Labs, and why "Spatial" intelligence is a new foundational technology

Bloomberg TV

34,503 views • 2 years ago

On investing in World Modeling and Spatial Intelligence, "It will take time to invest, and it will also hopefully not take the hype..." World Labs' Fei-Fei Li. #BloombergTech Emily Chang ⏯️

On investing in World Modeling and Spatial Intelligence, "It will take time to invest, and it will also hopefully not take the hype..." World Labs' Fei-Fei Li. #BloombergTech Emily Chang ⏯️

Bloomberg Live

12,843 views • 5 months ago

World Labs co-founders Justin Johnson and Dr. Fei-Fei Li say LLMs use next-token prediction, but spatial intelligence has its own equivalent: Justin: "The soft definition of AI-completeness is there's this fundamental primitive that's an AI task. But if I could solve this AI task in its full, broadest generality, it would solve any intelligence problem." "The classic example in LLMs is that next-token prediction is AI-complete... I think from Ilya: there's a mystery novel, the thing has to read the whole novel, and the final sentence is, 'And the killer was.' Predict the next token. You could basically frame any kind of intelligence task in terms of that." "So clearly next-token prediction is something people believe is AI-complete." "New-view prediction, this primitive that we have in Atlas, especially generative new-view prediction, is also AI-complete." "I want to have a world where Martin is writing a proof of the Riemann hypothesis on the blackboard, and then the camera pans over to the next whiteboard." Fei-Fei: "Evolution had to solve new-viewpoint prediction by making animals move. Nature gave animals eyes, but nature didn't give trees eyes. Why? Because when you move, you see a new viewpoint... We do believe very strongly that next-viewpoint prediction is the equivalent of next-token prediction." Justin Johnson Fei-Fei Li martin_casado

World Labs co-founders Justin Johnson and Dr. Fei-Fei Li say LLMs use next-token prediction, but spatial intelligence has its own equivalent: Justin: "The soft definition of AI-completeness is there's this fundamental primitive that's an AI task. But if I could solve this AI task in its full, broadest generality, it would solve any intelligence problem." "The classic example in LLMs is that next-token prediction is AI-complete... I think from Ilya: there's a mystery novel, the thing has to read the whole novel, and the final sentence is, 'And the killer was.' Predict the next token. You could basically frame any kind of intelligence task in terms of that." "So clearly next-token prediction is something people believe is AI-complete." "New-view prediction, this primitive that we have in Atlas, especially generative new-view prediction, is also AI-complete." "I want to have a world where Martin is writing a proof of the Riemann hypothesis on the blackboard, and then the camera pans over to the next whiteboard." Fei-Fei: "Evolution had to solve new-viewpoint prediction by making animals move. Nature gave animals eyes, but nature didn't give trees eyes. Why? Because when you move, you see a new viewpoint... We do believe very strongly that next-viewpoint prediction is the equivalent of next-token prediction." Justin Johnson Fei-Fei Li martin_casado

a16z

89,108 views • 2 months ago

📁 Fei-Fei Li, computer vision pioneer and Stanford professor, says the next frontier of AI is spatial intelligence. The ability to perceive, reason and act in the physical world. Not just see and talk. But do. Just as vision triggered the Cambrian explosion of life, spatial intelligence could trigger the next explosion of AI.

📁 Fei-Fei Li, computer vision pioneer and Stanford professor, says the next frontier of AI is spatial intelligence. The ability to perceive, reason and act in the physical world. Not just see and talk. But do. Just as vision triggered the Cambrian explosion of life, spatial intelligence could trigger the next explosion of AI.

Jon Hernandez

24,408 views • 8 months ago

World Labs is pushing AI beyond words and into the physical world. CEO Fei-Fei Li tells @edludlow its new Atlas world model can generate and understand 3D environments, opening up applications across robotics, design, science and more

World Labs is pushing AI beyond words and into the physical world. CEO Fei-Fei Li tells @edludlow its new Atlas world model can generate and understand 3D environments, opening up applications across robotics, design, science and more

Bloomberg TV

15,428 views • 1 month ago

Fei-Fei Li: “There’s nothing artificial about AI. It’s inspired by people. It’s created by people. And most importantly, it impacts people.” Watch the full interview with World Labs CEO Fei-Fei Li on Lenny's Podcast (Lenny Rachitsky):

Fei-Fei Li: “There’s nothing artificial about AI. It’s inspired by people. It’s created by people. And most importantly, it impacts people.” Watch the full interview with World Labs CEO Fei-Fei Li on Lenny's Podcast (Lenny Rachitsky):

a16z

63,672 views • 11 months ago

World Labs CEO Dr. Fei-Fei Li explains says "world model" has become an overloaded term & explains what each kind of world model does: "Right now there are three ways of calling world models when it comes to spatial intelligence." "One is what I call a renderer, when the model puts beautiful pixels on the screen." "Another kind of world model is what we call a planner. That is more for machines, more for robots." "The third kind, which I think is the linchpin of the three, is a simulator." "A simulator could become a renderer. The simulator could become a planner. But this layer is a huge critical path to unlock spatial intelligence. And that's what World Labs is working on." Fei-Fei Li at Bloomberg Tech live with Emily Chang

World Labs CEO Dr. Fei-Fei Li explains says "world model" has become an overloaded term & explains what each kind of world model does: "Right now there are three ways of calling world models when it comes to spatial intelligence." "One is what I call a renderer, when the model puts beautiful pixels on the screen." "Another kind of world model is what we call a planner. That is more for machines, more for robots." "The third kind, which I think is the linchpin of the three, is a simulator." "A simulator could become a renderer. The simulator could become a planner. But this layer is a huge critical path to unlock spatial intelligence. And that's what World Labs is working on." Fei-Fei Li at Bloomberg Tech live with Emily Chang

a16z

112,217 views • 5 months ago

World Labs' Dr. Fei-Fei Li on why the 3D world and spatial intelligence are fundamentally different from language models: "Language is fundamentally a purely generated signal. There's no language out there. You don't go out in the nature and there's words written in the sky for you." "Whatever data you feed in, you pretty much can just somehow regurgitate with enough generalizability the same data out, and that's language to language." "But the 3D world is not. There is a 3D world out there that follows laws of physics, that has its own structures due to materials and many other things. And to fundamentally back that information out and be able to represent it and be able to generate it is just fundamentally quite a different problem." "We will be borrowing similar ideas or useful ideas from language and LLMs, but this is fundamentally philosophically, to me, a different problem." Fei-Fei Li

World Labs' Dr. Fei-Fei Li on why the 3D world and spatial intelligence are fundamentally different from language models: "Language is fundamentally a purely generated signal. There's no language out there. You don't go out in the nature and there's words written in the sky for you." "Whatever data you feed in, you pretty much can just somehow regurgitate with enough generalizability the same data out, and that's language to language." "But the 3D world is not. There is a 3D world out there that follows laws of physics, that has its own structures due to materials and many other things. And to fundamentally back that information out and be able to represent it and be able to generate it is just fundamentally quite a different problem." "We will be borrowing similar ideas or useful ideas from language and LLMs, but this is fundamentally philosophically, to me, a different problem." Fei-Fei Li

a16z

53,621 views • 1 month ago

"Visual-spatial intelligence is as fundamental as language." Fei-Fei Li says world models are the key to letting AI see the world, reason about it, interact with it, navigate it, and even 'build civilization upon it.' "It's very natural for me that World Labs' north star is to unlock spatial intelligence. The moment to me is right to do it." "We've got these ingredients—we've got compute, we've got a much deeper understanding of data, way deeper than [the ImageNet days]... and we've got some advancement of algorithms."

"Visual-spatial intelligence is as fundamental as language." Fei-Fei Li says world models are the key to letting AI see the world, reason about it, interact with it, navigate it, and even 'build civilization upon it.' "It's very natural for me that World Labs' north star is to unlock spatial intelligence. The moment to me is right to do it." "We've got these ingredients—we've got compute, we've got a much deeper understanding of data, way deeper than [the ImageNet days]... and we've got some advancement of algorithms."

a16z

32,387 views • 8 months ago

Thought experiment: If you were blindfolded in a room and someone only described what’s around you… could you complete a task? Now imagine seeing the room. Instantly, your brain reconstructs the space in 3D. That’s why language isn’t enough. martin_casado and Fei-Fei Li explain why spatial intelligence is the next frontier for AI — and why mastering the physical world matters more than language alone. Listen to the full conversation from the a16z LP Summit:

Thought experiment: If you were blindfolded in a room and someone only described what’s around you… could you complete a task? Now imagine seeing the room. Instantly, your brain reconstructs the space in 3D. That’s why language isn’t enough. martin_casado and Fei-Fei Li explain why spatial intelligence is the next frontier for AI — and why mastering the physical world matters more than language alone. Listen to the full conversation from the a16z LP Summit:

a16z

134,707 views • 1 year ago

BREAKING: $AMD AMD Acquires World Labs in $8.2 Billion Deal for AI Expertise. Stanford professor and World Labs founder Fei-Fei Li sits down with Jany Talk to break down what everyone gets wrong about AI - and why she still believes in people, not machines. Fei-Fei Li co-created ImageNet before most of the world understood why data would matter more than algorithms. She's spent a decade building computer vision and robotics from the ground up. Now, as the founder of World Labs, she's betting on spatial intelligence as the missing piece of AGI - and she's here to tell you why almost everyone is thinking about AI wrong. Fei-Fei Li: "AI Is a Tool, Not the World" - On Curiosity, AGI and Being Human. Full interview here:

BREAKING: $AMD AMD Acquires World Labs in $8.2 Billion Deal for AI Expertise. Stanford professor and World Labs founder Fei-Fei Li sits down with Jany Talk to break down what everyone gets wrong about AI - and why she still believes in people, not machines. Fei-Fei Li co-created ImageNet before most of the world understood why data would matter more than algorithms. She's spent a decade building computer vision and robotics from the ground up. Now, as the founder of World Labs, she's betting on spatial intelligence as the missing piece of AGI - and she's here to tell you why almost everyone is thinking about AI wrong. Fei-Fei Li: "AI Is a Tool, Not the World" - On Curiosity, AGI and Being Human. Full interview here:

NextFin

173,375 views • 1 month ago

World Labs co-founders Justin Johnson and Dr. Fei-Fei Li say Atlas unifies the two things computer vision has always kept apart: Justin: "Historically, reconstruction has been its own subfield in computer vision with its own specialized tasks and models. Generation is what all the text-to-video models are really good at." "Those are great for creative applications if I want to imagine something that's never been there before." "But now with Atlas, for the first time, we're putting these two different parts of visual intelligence together in one model. It can do both 3D reconstruction and generation together in one architecture." "We had to make it multimodal from the start. This thing natively works on text, images, videos, and camera poses as a native input to the model... It uses 3D as a native modality that it works on." Fei-Fei: "Computer vision has been around for more than half a century... Our field traditionally has multiple tracks. You go to a computer vision conference: you have the pixel generation track, you have some recognition track, and you have a 3D reconstruction track." "This is an elegant model that unifies the problem of reconstruction and generation by anchoring on viewpoints and viewpoint estimation. That's just incredibly powerful." Justin Johnson Fei-Fei Li

World Labs co-founders Justin Johnson and Dr. Fei-Fei Li say Atlas unifies the two things computer vision has always kept apart: Justin: "Historically, reconstruction has been its own subfield in computer vision with its own specialized tasks and models. Generation is what all the text-to-video models are really good at." "Those are great for creative applications if I want to imagine something that's never been there before." "But now with Atlas, for the first time, we're putting these two different parts of visual intelligence together in one model. It can do both 3D reconstruction and generation together in one architecture." "We had to make it multimodal from the start. This thing natively works on text, images, videos, and camera poses as a native input to the model... It uses 3D as a native modality that it works on." Fei-Fei: "Computer vision has been around for more than half a century... Our field traditionally has multiple tracks. You go to a computer vision conference: you have the pixel generation track, you have some recognition track, and you have a 3D reconstruction track." "This is an elegant model that unifies the problem of reconstruction and generation by anchoring on viewpoints and viewpoint estimation. That's just incredibly powerful." Justin Johnson Fei-Fei Li

a16z

40,937 views • 2 months ago

World Labs CEO Dr. Fei-Fei Li & SceniX Co-Founder Yunzhu Li on the data bottleneck in robotics and how world models help: "The lack of data in training, the lack of data in evaluation, this is very, very different from language models, where data is abundant on the internet." "And we know that in order for robotics to work, we have to somehow unlock the power of scaling law. But where does that come from?" "It's a profound problem that everybody's battling with in robotics." "We see a lot of unlock in being able to do this whole process through the modeling of the environments." "Being able to create these digital worlds... that's just going to unlock so much more potential for being able to replace all the costly and the unsafe data in the real environments with the data generated from the worlds for robots to be able to do scalable learning and evaluations." Fei-Fei Li Yunzhu Li martin_casado

World Labs CEO Dr. Fei-Fei Li & SceniX Co-Founder Yunzhu Li on the data bottleneck in robotics and how world models help: "The lack of data in training, the lack of data in evaluation, this is very, very different from language models, where data is abundant on the internet." "And we know that in order for robotics to work, we have to somehow unlock the power of scaling law. But where does that come from?" "It's a profound problem that everybody's battling with in robotics." "We see a lot of unlock in being able to do this whole process through the modeling of the environments." "Being able to create these digital worlds... that's just going to unlock so much more potential for being able to replace all the costly and the unsafe data in the real environments with the data generated from the worlds for robots to be able to do scalable learning and evaluations." Fei-Fei Li Yunzhu Li martin_casado

a16z

80,437 views • 3 months ago

"Building the right technology and product so that it can empower, enhance, augment humanity," Co-Founder & CEO World Labs' Fei-Fei Li tells Bloomberg Originals' Emily Chang. #BloombergTech ⏯️

"Building the right technology and product so that it can empower, enhance, augment humanity," Co-Founder & CEO World Labs' Fei-Fei Li tells Bloomberg Originals' Emily Chang. #BloombergTech ⏯️

Bloomberg Live

13,146 views • 5 months ago

We're hiring in robot learning at World Labs! Join me, Fei-Fei Li, and the team to define and scale the next generation of world models for robot learning! Atlas for Robotics: Real-to-Sim-to-Real: Apply:

We're hiring in robot learning at World Labs! Join me, Fei-Fei Li, and the team to define and scale the next generation of world models for robot learning! Atlas for Robotics: Real-to-Sim-to-Real: Apply:

Yunzhu Li

177,209 views • 1 month ago