Video wird geladen...

Video konnte nicht geladen werden

Zur Startseite

Today, we're sharing new research on Solaris, our first Interface World Model. Solaris is a new kind of operating system that generates interactive interfaces frame by frame, in real time, with no code. We find that Solaris outperforms frontier LLMs when generating new interfaces, across structural similarity and information...

runwayml's profile picture

Runway

288,411 subscribers

245,516 Aufrufe • vor 7 Stunden •via X (Twitter)

Wissenschaft & TechnologieBildung
LIVE

Anya Rossi• Live Now

Private livecam show

0 Kommentare

Keine Kommentare verfügbar

Kommentare vom Original-Post werden hier angezeigt

Ähnliche Videos

A breakthrough in real-time video generation. As a research preview developed with NVIDIA and shared at NVIDIAGTC this week, we trained a new real-time video model running on Vera Rubin. HD videos generate instantly, with time-to-first-frame under 100ms. Unlocking an entirely new creative paradigm and bolstering the foundations of our General World Model, GWM-1. Real-time generation opens a fundamentally different design space for video models and world simulation. We're investing in co-designing our models alongside advances in hardware to keep pushing this frontier.
0:54

A breakthrough in real-time video generation. As a research preview developed with NVIDIA and shared at NVIDIAGTC this week, we trained a new real-time video model running on Vera Rubin. HD videos generate instantly, with time-to-first-frame under 100ms. Unlocking an entirely new creative paradigm and bolstering the foundations of our General World Model, GWM-1. Real-time generation opens a fundamentally different design space for video models and world simulation. We're investing in co-designing our models alongside advances in hardware to keep pushing this frontier.

Runway

1,164,245 Aufrufe • vor 5 Monaten

Today we're sharing the next milestone in our Seamless Communication research — a new family of AI translation models that preserve expression and deliver near-real time streaming translations. More on this new work ➡️ More on the individual models 🧵
2:53

Today we're sharing the next milestone in our Seamless Communication research — a new family of AI translation models that preserve expression and deliver near-real time streaming translations. More on this new work ➡️ More on the individual models 🧵

AI at Meta

728,765 Aufrufe • vor 2 Jahren

Introducing RTFM (Real-Time Frame Model): a highly efficient World Model that generates video frames in real time as you interact with it, powered by a single H100 GPU. RTFM renders persistent and 3D consistent worlds, both real and imaginary. Try our demo of RTFM today!
2:21

Introducing RTFM (Real-Time Frame Model): a highly efficient World Model that generates video frames in real time as you interact with it, powered by a single H100 GPU. RTFM renders persistent and 3D consistent worlds, both real and imaginary. Try our demo of RTFM today!

World Labs

340,986 Aufrufe • vor 10 Monaten

Runway has unveiled a massive breakthrough in AI video generation at NVIDIA's GTC event, showcasing a new model capable of generating high-definition video in genuine real-time. The new model boasts a "time-to-first-frame" of under 100 milliseconds. This means HD video begins generating and playing almost the instant a command is given. This research preview was co-developed with NVIDIA and runs on their newly announced Vera Rubin architecture. This real-time capability is a foundational step for Runway's General World Model (GWM-1). It pushes the technology beyond simple video generation and into the realm of live, interactive environments.
0:54

Runway has unveiled a massive breakthrough in AI video generation at NVIDIA's GTC event, showcasing a new model capable of generating high-definition video in genuine real-time. The new model boasts a "time-to-first-frame" of under 100 milliseconds. This means HD video begins generating and playing almost the instant a command is given. This research preview was co-developed with NVIDIA and runs on their newly announced Vera Rubin architecture. This real-time capability is a foundational step for Runway's General World Model (GWM-1). It pushes the technology beyond simple video generation and into the realm of live, interactive environments.

Wes Roth

82,506 Aufrufe • vor 5 Monaten

Today is a big day at Odyssey. We're sharing Explorer, our first generative world model. We think world models are the next frontier for AI, enabling wonderful new things. To help shape this, Ed Catmull, the iconic founder of Pixar, is joining our board and investing.
0:57

Today is a big day at Odyssey. We're sharing Explorer, our first generative world model. We think world models are the next frontier for AI, enabling wonderful new things. To help shape this, Ed Catmull, the iconic founder of Pixar, is joining our board and investing.

Odyssey

75,324 Aufrufe • vor 1 Jahr

Sharing our computer vision system design for TRON: Ares. We approached these shots from the perspective of the machine. The frame becomes a field of observation. Every pixel is potential information waiting to be interpreted. The process begins by squarepacking the live action plates, dividing the image into a computational lattice. Once the grid exists, the system begins to read. Targets emerge. Motion vectors form. Signals ripple through layers of analysis. Inside these overlays lives the source code of the system itself. Streams of logic, fragments of instruction, the internal language of the machine. At times the imagery dissolves directly into that code, as if the world itself is being rewritten from within. Visual information collapses into structure, then reconstructs again as data. Scanning pulses move across the frame. Timers react. Coordinates lock. Each layer is part of a larger ecosystem of perception, constantly processing, evaluating, and iterating. The goal was maximum detail and living systems. Interfaces that breathe, think, and evolve in real time.
1:44

Sharing our computer vision system design for TRON: Ares. We approached these shots from the perspective of the machine. The frame becomes a field of observation. Every pixel is potential information waiting to be interpreted. The process begins by squarepacking the live action plates, dividing the image into a computational lattice. Once the grid exists, the system begins to read. Targets emerge. Motion vectors form. Signals ripple through layers of analysis. Inside these overlays lives the source code of the system itself. Streams of logic, fragments of instruction, the internal language of the machine. At times the imagery dissolves directly into that code, as if the world itself is being rewritten from within. Visual information collapses into structure, then reconstructs again as data. Scanning pulses move across the frame. Timers react. Coordinates lock. Each layer is part of a larger ecosystem of perception, constantly processing, evaluating, and iterating. The goal was maximum detail and living systems. Interfaces that breathe, think, and evolve in real time.

GMUNK

37,625 Aufrufe • vor 5 Monaten

Testing robot policies on hardware is slow, expensive and hard to scale. World models offer a promising path to accelerating robot policy development. We're sharing new research from the Runway Robotics team, in which we simulated 8 robot policies inside our General World Model and found 0.95 correlation with real-world results. Those early results point to world model simulation as a practical substitute for hardware evaluation, comparing favorably to existing real-to-sim approaches. Learn more at the link below.
0:40

Testing robot policies on hardware is slow, expensive and hard to scale. World models offer a promising path to accelerating robot policy development. We're sharing new research from the Runway Robotics team, in which we simulated 8 robot policies inside our General World Model and found 0.95 correlation with real-world results. Those early results point to world model simulation as a practical substitute for hardware evaluation, comparing favorably to existing real-to-sim approaches. Learn more at the link below.

Runway

13,464 Aufrufe • vor 6 Monaten

🌟 Today we’re sharing the vision for a New Web3 — a more interconnected, human internet that drives new value systems and can lay the foundation for a new digital society. Here is the first of two articles, detailing the journey of our evolution and why we built new standards. This one is for the visionaries and dreamers of the initial Ethereum vision of a decentralised internet and shows how we can evolve it into a universal decentralized operating system, entailing the whole of web3. This one is slightly more technical. 👉 Read on Medium:
11:15

🌟 Today we’re sharing the vision for a New Web3 — a more interconnected, human internet that drives new value systems and can lay the foundation for a new digital society. Here is the first of two articles, detailing the journey of our evolution and why we built new standards. This one is for the visionaries and dreamers of the initial Ethereum vision of a decentralised internet and shows how we can evolve it into a universal decentralized operating system, entailing the whole of web3. This one is slightly more technical. 👉 Read on Medium:

LUKSO

93,954 Aufrufe • vor 1 Jahr

Today we are announcing Genie 3, a general purpose world model by Google DeepMind that can generate dynamic, interactive environments with a single text prompt. World models are AI that understand facets of the world (like Veo's knowledge of intuitive physics or Genie's mastery of new environments), and serve as a key stepping stone on the path to AGI. Genie 3 is our first world model to allow interaction in real-time, while also improving consistency and realism compared to Genie 2. Learn more ➡️
0:33

Today we are announcing Genie 3, a general purpose world model by Google DeepMind that can generate dynamic, interactive environments with a single text prompt. World models are AI that understand facets of the world (like Veo's knowledge of intuitive physics or Genie's mastery of new environments), and serve as a key stepping stone on the path to AGI. Genie 3 is our first world model to allow interaction in real-time, while also improving consistency and realism compared to Genie 2. Learn more ➡️

Google AI

102,711 Aufrufe • vor 1 Jahr

10 years of FAIR. 10 years of advancing the state of the art in AI through open research. We're celebrating the 10th anniversary of Meta's Fundamental AI Research team and continuing that legacy by sharing our work on three exciting new research projects today. Details below 🧵
1:12

10 years of FAIR. 10 years of advancing the state of the art in AI through open research. We're celebrating the 10th anniversary of Meta's Fundamental AI Research team and continuing that legacy by sharing our work on three exciting new research projects today. Details below 🧵

AI at Meta

450,416 Aufrufe • vor 2 Jahren

Today, we are releasing Stable Video Diffusion, our first foundation model for generative AI video based on the image model, Stable Diffusion. As part of this research preview, the code, weights, and research paper are now available. Additionally, today you can sign up for our waitlist to access a new upcoming web experience featuring a Text-To-Video interface. To access the model & sign up for our waitlist, visit our website here:
0:20

Today, we are releasing Stable Video Diffusion, our first foundation model for generative AI video based on the image model, Stable Diffusion. As part of this research preview, the code, weights, and research paper are now available. Additionally, today you can sign up for our waitlist to access a new upcoming web experience featuring a Text-To-Video interface. To access the model & sign up for our waitlist, visit our website here:

Stability AI

1,024,682 Aufrufe • vor 2 Jahren

Introducing LTX-2.5, the world model the world builds on. One of the biggest upgrades yet to the model already powering film, robotics, and real-time workflows. Higher pixel fidelity, multishot scenes that hold together across cuts, and a pretrained foundation built to be finetuned across domains. Plus: Diffusion Fidelity Rendering, a new rendering approach built for pixel quality that holds up frame by frame, even on a cinema screen. This isn't a tool you rent. It's a foundation you build on, open and yours.
2:03

Introducing LTX-2.5, the world model the world builds on. One of the biggest upgrades yet to the model already powering film, robotics, and real-time workflows. Higher pixel fidelity, multishot scenes that hold together across cuts, and a pretrained foundation built to be finetuned across domains. Plus: Diffusion Fidelity Rendering, a new rendering approach built for pixel quality that holds up frame by frame, even on a cinema screen. This isn't a tool you rent. It's a foundation you build on, open and yours.

LTX.io

13,722,515 Aufrufe • vor 20 Tagen

1/ The first big announcement: Google DeepMind has unveiled Genie 3 A new frontier for world models, the first AI that generates interactive 3D worlds in real time at 24 fps. The breakthrough: minutes of consistency at 720p using only text descriptions. No pre-built 3D models required. Let's break it down - with some examples:
0:56

1/ The first big announcement: Google DeepMind has unveiled Genie 3 A new frontier for world models, the first AI that generates interactive 3D worlds in real time at 24 fps. The breakthrough: minutes of consistency at 720p using only text descriptions. No pre-built 3D models required. Let's break it down - with some examples:

Chubby♨️

434,629 Aufrufe • vor 1 Jahr

Aleph 2.0 is here. Now you can edit a single frame in your video, preview the change and then Aleph 2.0 carries that edit across the rest of your video. Try it now in the new Edit Studio on web at the link below.
1:13

Aleph 2.0 is here. Now you can edit a single frame in your video, preview the change and then Aleph 2.0 carries that edit across the rest of your video. Try it now in the new Edit Studio on web at the link below.

Runway

4,952,299 Aufrufe • vor 3 Monaten

It's time to get out of stealth 👋 Today, we are launching Monogram and announcing our $40m seed round led by DST and Lux Capital. Monogram is the first AI app that was built around a visual interface, from the ground up. We created a technology that generates an entire user interface on the fly, in just a few seconds. Ask anything, and instead of staring at a wall of text, you get an interactive visual response.
4:08

It's time to get out of stealth 👋 Today, we are launching Monogram and announcing our $40m seed round led by DST and Lux Capital. Monogram is the first AI app that was built around a visual interface, from the ground up. We created a technology that generates an entire user interface on the fly, in just a few seconds. Ask anything, and instead of staring at a wall of text, you get an interactive visual response.

Eren Bali

1,337,408 Aufrufe • vor 1 Monat

We previously shared our research on Layer Skip, an end-to-end solution for accelerating LLMs from researchers at Meta FAIR. It achieves this by executing a subset of an LLM’s layers and utilizing subsequent layers for verification and correction. We’re now releasing inference code and fine-tuned checkpoints for this work. Model weights on Hugging Face ➡️ More details ➡️ We hope that releasing this work will open up new areas of experimentation and innovative new research in optimization and interpretability.
1:12

We previously shared our research on Layer Skip, an end-to-end solution for accelerating LLMs from researchers at Meta FAIR. It achieves this by executing a subset of an LLM’s layers and utilizing subsequent layers for verification and correction. We’re now releasing inference code and fine-tuned checkpoints for this work. Model weights on Hugging Face ➡️ More details ➡️ We hope that releasing this work will open up new areas of experimentation and innovative new research in optimization and interpretability.

AI at Meta

156,632 Aufrufe • vor 1 Jahr

Doug Ford’s legacy is an Ontario that’s harder and more expensive than ever to live in. But together, we can change all that. It’s time for a new Premier and a new government that is on your side, with real plans to get good things done for Ontarians. These are just a few of the new ideas we’re sharing with people all across the province. For more, check out:
1:12

Doug Ford’s legacy is an Ontario that’s harder and more expensive than ever to live in. But together, we can change all that. It’s time for a new Premier and a new government that is on your side, with real plans to get good things done for Ontarians. These are just a few of the new ideas we’re sharing with people all across the province. For more, check out:

Marit Stiles

22,179 Aufrufe • vor 1 Jahr

NEWS: Waymo has introduced the Waymo World Model, "a frontier generative model built on Google DeepMind’s Genie 3 that sets a new bar for large-scale, hyper-realistic autonomous driving simulation." "By simulating the “impossible”, we proactively prepare the Waymo Driver for some of the most rare and complex scenarios—from tornadoes to planes landing on freeways—long before it encounters them in the real world. The model’s architecture offers high controllability, allowing our engineers to modify simulations with simple language prompts, driving inputs, and scene layouts. Notably, the Waymo World Model generates high-fidelity, multi-sensor outputs that include both camera and lidar data. This combination of broad world knowledge, fine-grained controllability, and multi-modal realism enhances Waymo’s ability to safely scale our service across more places and new driving environments. In the following sections we showcase the Waymo World Model in action, featuring simulations of the Waymo Driver navigating diverse rare edge-case scenarios." More info below.
1:03

NEWS: Waymo has introduced the Waymo World Model, "a frontier generative model built on Google DeepMind’s Genie 3 that sets a new bar for large-scale, hyper-realistic autonomous driving simulation." "By simulating the “impossible”, we proactively prepare the Waymo Driver for some of the most rare and complex scenarios—from tornadoes to planes landing on freeways—long before it encounters them in the real world. The model’s architecture offers high controllability, allowing our engineers to modify simulations with simple language prompts, driving inputs, and scene layouts. Notably, the Waymo World Model generates high-fidelity, multi-sensor outputs that include both camera and lidar data. This combination of broad world knowledge, fine-grained controllability, and multi-modal realism enhances Waymo’s ability to safely scale our service across more places and new driving environments. In the following sections we showcase the Waymo World Model in action, featuring simulations of the Waymo Driver navigating diverse rare edge-case scenarios." More info below.

Sawyer Merritt

133,168 Aufrufe • vor 6 Monaten