Video wird geladen...

Video konnte nicht geladen werden

Beim Laden dieses Videos ist ein Problem aufgetreten. Dies könnte an einem vorübergehenden Netzwerkproblem liegen oder das Video ist möglicherweise nicht verfügbar.

Introducing General World Models. We believe the next major advancement in AI will come from systems that understand the visual world and its dynamics, which is why we’re starting a new long-term research effort around general world models. Learn more:

Runway

290,332 subscribers

714,491 Aufrufe • vor 2 Jahren •via X (Twitter)

Wissenschaft & Technologie

Anya Rossi• Live Now

Private livecam show

9 Kommentare

Profilbild von Everett World

Everett Worldvor 2 Jahren

It's great to see, that Gen-1 and Gen-2 are not the final vision of Runway, but there's ambition to achieve better understanding of the world. Fantastic video. Can't wait for 2024!

Profilbild von Theoretically Media

Theoretically Mediavor 2 Jahren

This is a great video. Also, Ruben is a good boy and needs more walks to the store with the good treats!

Profilbild von Blockade Labs

Blockade Labsvor 2 Jahren

👋 we should discuss joining the research team

Profilbild von Rufus

Rufusvor 2 Jahren

I am thrilled with this research, I hope we can achieve character consistency and realistic character movements with this. I hope RunwayML combines this with gaussian splatting a sort of MoE for video models, just my 2 cents though.

Profilbild von Battering Beats

Battering Beatsvor 2 Jahren

This is gonna be insane when the model is in testing phases. For those that wish to not read, they are looking for a team of researchers to help capture and build the real life model they just spoke of in this video.

Profilbild von Tom Blake

Tom Blakevor 2 Jahren

Good boy, Reuben!

Profilbild von Alex Patrascu

Alex Patrascuvor 2 Jahren

Such a good video and a perfect analogy.

Profilbild von Elie Messo

Elie Messovor 2 Jahren

Isn't that what Tesla FSD is already doing?

Profilbild von Filip Piekniewski🌻 🐘:@filippie509@techhub.social

Filip Piekniewski🌻 🐘:@[email protected]vor 2 Jahren

Please read this before you reinvent it:

Ähnliche Videos

The next frontier after language models is world models, and learning to predict the next state of a world. Hear from our researchers how these models really work at a low-level and the mountain we're climbing. A general-purpose world simulator (AKA sci-fi) is now in sight.

The next frontier after language models is world models, and learning to predict the next state of a world. Hear from our researchers how these models really work at a low-level and the mountain we're climbing. A general-purpose world simulator (AKA sci-fi) is now in sight.

Odyssey

25,890 Aufrufe • vor 9 Monaten

SITUATION EXPLAINED: A new generation of AI labs are betting that world models are the path to general intelligence that can interact with the real world. We had General Intuition CEO Pim de Witte on MTS to explain what world models are, and why intuitively world models offer a clearer path towards general intelligence than LLMs. For humans, text is a technology for compressing information about the unfolding, three-dimensional world around us and communicating it to other people. When LLMs reason about the world, they do so by reconstructing the world through text. World models work by modeling the three-dimensional world at the architecture level and then allowing agents to interact with that world. Unlike an LLM, which understands space and time through text, world models perform spatial and temporal reasoning natively. General Intuition hopes to use world models to create embodied AI—machines that can reason and act in the real world. But other companies are also pushing the frontier in this space. Odyssey ML today announced a multi-agent world model, Agora-1. Their launch video shows four participants interacting with a real-time world model simulation of GoldenEye, a first-person shooter for the N64. A playable preview of the GoldenEye simulation is available on their site.

SITUATION EXPLAINED: A new generation of AI labs are betting that world models are the path to general intelligence that can interact with the real world. We had General Intuition CEO Pim de Witte on MTS to explain what world models are, and why intuitively world models offer a clearer path towards general intelligence than LLMs. For humans, text is a technology for compressing information about the unfolding, three-dimensional world around us and communicating it to other people. When LLMs reason about the world, they do so by reconstructing the world through text. World models work by modeling the three-dimensional world at the architecture level and then allowing agents to interact with that world. Unlike an LLM, which understands space and time through text, world models perform spatial and temporal reasoning natively. General Intuition hopes to use world models to create embodied AI—machines that can reason and act in the real world. But other companies are also pushing the frontier in this space. Odyssey ML today announced a multi-agent world model, Agora-1. Their launch video shows four participants interacting with a real-time world model simulation of GoldenEye, a first-person shooter for the N64. A playable preview of the GoldenEye simulation is available on their site.

MTS

11,676 Aufrufe • vor 3 Monaten

We had a great time on TBPN yesterday sharing more about General Intuition's $133.7M Seed from Khosla Ventures, General Catalyst, and Raine. Here's our CEO, Pim de Witte, talking about the research and the future of world models.

We had a great time on TBPN yesterday sharing more about General Intuition's $133.7M Seed from Khosla Ventures, General Catalyst, and Raine. Here's our CEO, Pim de Witte, talking about the research and the future of world models.

General Intuition

32,776 Aufrufe • vor 10 Monaten

Yann LeCun (Chief AI Scientist, Meta, Yann LeCun), Pim de Witte (CEO, General Intuition), and Aude Durand (Kyutai, Aude Durand), talk about world models, embodied agents, Yann's new company, and the limitations of LLMs 0:00 - Introduction to World Models 5:00 - Why World Models, Intuition & Introducing Yann's new company 10:00 - Architectures + Merging Language & Interaction Data towards General Agents 20:00 - Open Source, Sovereign AI & kyutai Partnership Keynote for #aiPULSE2025 at Station F in Paris 🇫🇷

Yann LeCun (Chief AI Scientist, Meta, Yann LeCun), Pim de Witte (CEO, General Intuition), and Aude Durand (Kyutai, Aude Durand), talk about world models, embodied agents, Yann's new company, and the limitations of LLMs 0:00 - Introduction to World Models 5:00 - Why World Models, Intuition & Introducing Yann's new company 10:00 - Architectures + Merging Language & Interaction Data towards General Agents 20:00 - Open Source, Sovereign AI & kyutai Partnership Keynote for #aiPULSE2025 at Station F in Paris 🇫🇷

General Intuition

111,795 Aufrufe • vor 9 Monaten

Introducing 𝐃𝐫𝐞𝐚𝐦𝐆𝐞𝐧! We got humanoid robots to perform totally new 𝑣𝑒𝑟𝑏𝑠 in new environments through video world models. We believe video world models will solve the data problem in robotics. Bringing the paradigm of scaling human hours to GPU hours. Quick 🧵

Introducing 𝐃𝐫𝐞𝐚𝐦𝐆𝐞𝐧! We got humanoid robots to perform totally new 𝑣𝑒𝑟𝑏𝑠 in new environments through video world models. We believe video world models will solve the data problem in robotics. Bringing the paradigm of scaling human hours to GPU hours. Quick 🧵

Joel Jang

117,574 Aufrufe • vor 1 Jahr

Without World Models, There Is No AGI. Google Just Proved It. If AGI ever happens, it will not come from bigger chatbots alone. From the very start of this interview, one thing is crystal clear: without world models, we will never reach AGI. And right now, Google is leading with its world simulator Genie 3. Here is the core of what Demis Hassabis explains in this conversation: • World models are the missing core of AGI Hassabis says his deepest long term focus has always been world models and simulations. Not just language. Not just prediction. Actual internal simulations of reality. • LLMs are impressive, but incomplete Language models understand more about the world than expected because human language encodes a lot of reality. Still, language is only a shadow of the real thing. • What text can never fully teach Reality includes things text struggles to express: •3D space and spatial dynamics •Physical causality and mechanics •Sensorimotor experience like movement, force, smell, or balance • Experience beats description To close the gap, AI must learn from interaction and experience, not just static text. That is how you build an internal world simulator. • Why Genie 3 matters With Google DeepMind pushing systems like Genie 3, AI starts to model reality itself, not just talk about it. • Robots and real world assistants depend on this True robotics, smart glasses, and universal assistants require AI that understands the physical world you live in, not just your screen. Bottom line: AGI will not emerge from better text prediction. It will emerge from systems that can simulate, predict, and understand reality itself. Right now, Google is clearly ahead on that path. Curious what you think. Are world models the real AGI unlock, or just another stepping stone?

Without World Models, There Is No AGI. Google Just Proved It. If AGI ever happens, it will not come from bigger chatbots alone. From the very start of this interview, one thing is crystal clear: without world models, we will never reach AGI. And right now, Google is leading with its world simulator Genie 3. Here is the core of what Demis Hassabis explains in this conversation: • World models are the missing core of AGI Hassabis says his deepest long term focus has always been world models and simulations. Not just language. Not just prediction. Actual internal simulations of reality. • LLMs are impressive, but incomplete Language models understand more about the world than expected because human language encodes a lot of reality. Still, language is only a shadow of the real thing. • What text can never fully teach Reality includes things text struggles to express: •3D space and spatial dynamics •Physical causality and mechanics •Sensorimotor experience like movement, force, smell, or balance • Experience beats description To close the gap, AI must learn from interaction and experience, not just static text. That is how you build an internal world simulator. • Why Genie 3 matters With Google DeepMind pushing systems like Genie 3, AI starts to model reality itself, not just talk about it. • Robots and real world assistants depend on this True robotics, smart glasses, and universal assistants require AI that understands the physical world you live in, not just your screen. Bottom line: AGI will not emerge from better text prediction. It will emerge from systems that can simulate, predict, and understand reality itself. Right now, Google is clearly ahead on that path. Curious what you think. Are world models the real AGI unlock, or just another stepping stone?

VraserX e/acc

23,784 Aufrufe • vor 8 Monaten

Our vision is for AI that uses world models to adapt in new and dynamic environments and efficiently learn new skills. We’re sharing V-JEPA 2, a new world model with state-of-the-art performance in visual understanding and prediction. V-JEPA 2 is a 1.2 billion-parameter model, trained on video, that can enable zero-shot planning in robots—allowing them to plan and execute tasks in unfamiliar environments. Learn more about V-JEPA 2 ➡️ As we continue working toward our goal of achieving advanced machine intelligence (AMI), we’re also releasing three new benchmarks for evaluating how well existing models can reason about the physical world from video. Learn more and download the new benchmarks ➡️

Our vision is for AI that uses world models to adapt in new and dynamic environments and efficiently learn new skills. We’re sharing V-JEPA 2, a new world model with state-of-the-art performance in visual understanding and prediction. V-JEPA 2 is a 1.2 billion-parameter model, trained on video, that can enable zero-shot planning in robots—allowing them to plan and execute tasks in unfamiliar environments. Learn more about V-JEPA 2 ➡️ As we continue working toward our goal of achieving advanced machine intelligence (AMI), we’re also releasing three new benchmarks for evaluating how well existing models can reason about the physical world from video. Learn more and download the new benchmarks ➡️

AI at Meta

310,507 Aufrufe • vor 1 Jahr

Specialized AI models will outperform general purpose models long-term. That's the big bet our team is making with Silvia, the super-intelligent financial AI product we are personally using and building every day. Anthony Pompliano 🌪 explains why works.

Specialized AI models will outperform general purpose models long-term. That's the big bet our team is making with Silvia, the super-intelligent financial AI product we are personally using and building every day. Anthony Pompliano 🌪 explains why works.

Phil Rosen

23,691 Aufrufe • vor 1 Monat

Testing robot policies on hardware is slow, expensive and hard to scale. World models offer a promising path to accelerating robot policy development. We're sharing new research from the Runway Robotics team, in which we simulated 8 robot policies inside our General World Model and found 0.95 correlation with real-world results. Those early results point to world model simulation as a practical substitute for hardware evaluation, comparing favorably to existing real-to-sim approaches. Learn more at the link below.

Testing robot policies on hardware is slow, expensive and hard to scale. World models offer a promising path to accelerating robot policy development. We're sharing new research from the Runway Robotics team, in which we simulated 8 robot policies inside our General World Model and found 0.95 correlation with real-world results. Those early results point to world model simulation as a practical substitute for hardware evaluation, comparing favorably to existing real-to-sim approaches. Learn more at the link below.

Runway

13,464 Aufrufe • vor 6 Monaten

Yann LeCun says that within a year to 18 months, we'll have a general method for training hierarchical world models These models would learn from video and real-world data, then help plan actions in robotics, healthcare, and other areas "then scale them toward a universal world model"

Yann LeCun says that within a year to 18 months, we'll have a general method for training hierarchical world models These models would learn from video and real-world data, then help plan actions in robotics, healthcare, and other areas "then scale them toward a universal world model"

Haider.

201,384 Aufrufe • vor 3 Monaten

Today we are announcing Genie 3, a general purpose world model by Google DeepMind that can generate dynamic, interactive environments with a single text prompt. World models are AI that understand facets of the world (like Veo's knowledge of intuitive physics or Genie's mastery of new environments), and serve as a key stepping stone on the path to AGI. Genie 3 is our first world model to allow interaction in real-time, while also improving consistency and realism compared to Genie 2. Learn more ➡️

Today we are announcing Genie 3, a general purpose world model by Google DeepMind that can generate dynamic, interactive environments with a single text prompt. World models are AI that understand facets of the world (like Veo's knowledge of intuitive physics or Genie's mastery of new environments), and serve as a key stepping stone on the path to AGI. Genie 3 is our first world model to allow interaction in real-time, while also improving consistency and realism compared to Genie 2. Learn more ➡️

Google AI

102,711 Aufrufe • vor 1 Jahr

Project Genie is rolling out to Google AI Ultra subscribers in the U.S. (18+) With this prototype, we want to learn more about immersive user experiences to advance our research and help us better understand the future of world models. See the details →

Project Genie is rolling out to Google AI Ultra subscribers in the U.S. (18+) With this prototype, we want to learn more about immersive user experiences to advance our research and help us better understand the future of world models. See the details →

Google DeepMind

252,711 Aufrufe • vor 7 Monaten

With enough data, robots and AI can learn “world models” that let them predict the results of their actions. These models are a way to learn how embodied AI agents can perform a wide variety of useful tasks — but they require a huge amount of data. The team at General Intuition General Intuition has a solution: use data from video games! Games teach movement, problem solving, and complex spatial reasoning, and they come in a staggering diversity of forms, covering a wide variety of problems. What’s more, the captured data is high-quality, without the noise or annotation error that can come from We sat down with Pim de Witte and Adam Jelley from the General Intuition team to learn more about their history, their plans, and their philosophy.

With enough data, robots and AI can learn “world models” that let them predict the results of their actions. These models are a way to learn how embodied AI agents can perform a wide variety of useful tasks — but they require a huge amount of data. The team at General Intuition General Intuition has a solution: use data from video games! Games teach movement, problem solving, and complex spatial reasoning, and they come in a staggering diversity of forms, covering a wide variety of problems. What’s more, the captured data is high-quality, without the noise or annotation error that can come from We sat down with Pim de Witte and Adam Jelley from the General Intuition team to learn more about their history, their plans, and their philosophy.

RoboPapers

85,927 Aufrufe • vor 10 Monaten

Sam Altman says AI models are general-purpose reasoning engines with a huge world knowledge built into them The next milestone is letting a model see something totally new once, then use it reliably and learn it faster than humans "that doesn't feel very far away"

Sam Altman says AI models are general-purpose reasoning engines with a huge world knowledge built into them The next milestone is letting a model see something totally new once, then use it reliably and learn it faster than humans "that doesn't feel very far away"

Haider.

20,500 Aufrufe • vor 7 Monaten

Why LLMs are a dead end for human-level intelligence, and especially for Physical AI / Robotics. The next leap isn’t bigger language models. It’s World Models. I just dropped a full 1-hour presentation from Shanghai: “World Models: the ChatGPT moment for robotics?” → Why LLMs hit a wall → Why action-conditioned world models planning in latent space are the real path → Live World Forge demo with LeWorldModel + Hugging Face LeRobot Watch here. The future of intelligence is embodied, not just chatty.

Why LLMs are a dead end for human-level intelligence, and especially for Physical AI / Robotics. The next leap isn’t bigger language models. It’s World Models. I just dropped a full 1-hour presentation from Shanghai: “World Models: the ChatGPT moment for robotics?” → Why LLMs hit a wall → Why action-conditioned world models planning in latent space are the real path → Live World Forge demo with LeWorldModel + Hugging Face LeRobot Watch here. The future of intelligence is embodied, not just chatty.

abdel

38,919 Aufrufe • vor 3 Monaten

We’re introducing intrinsic discovery, a new learning method that allows models to explore and learn from open-ended environments without human supervision. Using intrinsic discovery, we trained a world model that surpasses GPT-5.6 Sol at simulating terminal environments.

We’re introducing intrinsic discovery, a new learning method that allows models to explore and learn from open-ended environments without human supervision. Using intrinsic discovery, we trained a world model that surpasses GPT-5.6 Sol at simulating terminal environments.

Induction Labs

68,065 Aufrufe • vor 15 Tagen

Explore where physical AI is headed next with the people shaping it. On Feb. 10 at 9 a.m. PT, join Ming‑Yu, Vice President of Research at NVIDIA, and Chubby♨️ from Superintelligence, for a conversation on how NVIDIA Cosmos reframes AI for a world of robots, AVs, and vision-driven systems. We'll dig into: ✅ Cosmos' origins and designing models for the physical world ✅ The scientific ideas and architectures behind Cosmos and its open models ✅ How open, reasoning-capable physical AI is changing how teams prototype, deploy, and iterate ✅ What a future of AI systems that understand space, time, and causality could unlock If you’re thinking into real‑world AI, this is the conversation to catch ➡️

Explore where physical AI is headed next with the people shaping it. On Feb. 10 at 9 a.m. PT, join Ming‑Yu, Vice President of Research at NVIDIA, and Chubby♨️ from Superintelligence, for a conversation on how NVIDIA Cosmos reframes AI for a world of robots, AVs, and vision-driven systems. We'll dig into: ✅ Cosmos' origins and designing models for the physical world ✅ The scientific ideas and architectures behind Cosmos and its open models ✅ How open, reasoning-capable physical AI is changing how teams prototype, deploy, and iterate ✅ What a future of AI systems that understand space, time, and causality could unlock If you’re thinking into real‑world AI, this is the conversation to catch ➡️

NVIDIA AI Developer

26,455 Aufrufe • vor 7 Monaten

on world models World Labs and AI VFX and how we are on the cusp of unprecedented visual communication at the speed of thought..like a shared lsd trip

on world models World Labs and AI VFX and how we are on the cusp of unprecedented visual communication at the speed of thought..like a shared lsd trip

ashe

92,337 Aufrufe • vor 9 Tagen