Video wird geladen...

Video konnte nicht geladen werden

Zur Startseite

Runway Co-Founder & Co-CEO Anastasis Germanidis breaks down Solaris, an interface world model that generates interactive applications pixel by pixel: "Solaris is what we call an interface world model." "It's an interactive video model that essentially renders an interface for you." "The difference is that it's all generated pixel...

etnshow's profile picture

etn.

13,531 subscribers

17,203 Aufrufe • vor 6 Tagen •via X (Twitter)

LIVE

Anya Rossi• Live Now

Private livecam show

0 Kommentare

Keine Kommentare verfügbar

Kommentare vom Original-Post werden hier angezeigt

Ähnliche Videos

Today, we're sharing new research on Solaris, our first Interface World Model. Solaris is a new kind of operating system that generates interactive interfaces frame by frame, in real time, with no code. We find that Solaris outperforms frontier LLMs when generating new interfaces, across structural similarity and information retention. Read more and request early access at the link below.
1:22

Today, we're sharing new research on Solaris, our first Interface World Model. Solaris is a new kind of operating system that generates interactive interfaces frame by frame, in real time, with no code. We find that Solaris outperforms frontier LLMs when generating new interfaces, across structural similarity and information retention. Read more and request early access at the link below.

Runway

700,297 Aufrufe • vor 8 Tagen

Introducing LTX-2.5, the world model the world builds on. One of the biggest upgrades yet to the model already powering film, robotics, and real-time workflows. Higher pixel fidelity, multishot scenes that hold together across cuts, and a pretrained foundation built to be finetuned across domains. Plus: Diffusion Fidelity Rendering, a new rendering approach built for pixel quality that holds up frame by frame, even on a cinema screen. This isn't a tool you rent. It's a foundation you build on, open and yours.
2:03

Introducing LTX-2.5, the world model the world builds on. One of the biggest upgrades yet to the model already powering film, robotics, and real-time workflows. Higher pixel fidelity, multishot scenes that hold together across cuts, and a pretrained foundation built to be finetuned across domains. Plus: Diffusion Fidelity Rendering, a new rendering approach built for pixel quality that holds up frame by frame, even on a cinema screen. This isn't a tool you rent. It's a foundation you build on, open and yours.

LTX.io

13,726,057 Aufrufe • vor 28 Tagen

Microsoft has created an AI-generated replica of Quake II that you can play in browser. "Every frame is created on the fly by an AI world model." Play it here:
1:00

Microsoft has created an AI-generated replica of Quake II that you can play in browser. "Every frame is created on the fly by an AI world model." Play it here:

Geoff Keighley

3,879,518 Aufrufe • vor 1 Jahr

training a model that takes a text prompt and generates audio that renders video on an oscilloscope AgenC agents live inside worlds the model generates the pipeline: real videos -> edge detection -> vectorization -> path ordering -> 192kHz 3-channel WAV where X/Y control beam position and Z controls beam intensity 3 values per timestep. that's all the model is learning. compare that to video gen models trying to predict millions of pixels per frame. transformers are already great at sequence prediction and that's literally all this is. waveform generation the output IS the playback. generate the audio, feed it to a scope, it draws the scene in real-time. there's no rendering step. it's analog so there's no pixel grid. you get continuous curves and effectively infinite resolution bootstrapped with procedural data, lissajous curves, wireframe 3D, stick figures, then scaled on real-world video converted to trace format. 90 TB of source video the model learns edges, contours, spatial relationships, motion. once it has that, describing a scene it's never seen is novel trajectory through the same learned space. generative geometry
0:22

training a model that takes a text prompt and generates audio that renders video on an oscilloscope AgenC agents live inside worlds the model generates the pipeline: real videos -> edge detection -> vectorization -> path ordering -> 192kHz 3-channel WAV where X/Y control beam position and Z controls beam intensity 3 values per timestep. that's all the model is learning. compare that to video gen models trying to predict millions of pixels per frame. transformers are already great at sequence prediction and that's literally all this is. waveform generation the output IS the playback. generate the audio, feed it to a scope, it draws the scene in real-time. there's no rendering step. it's analog so there's no pixel grid. you get continuous curves and effectively infinite resolution bootstrapped with procedural data, lissajous curves, wireframe 3D, stick figures, then scaled on real-world video converted to trace format. 90 TB of source video the model learns edges, contours, spatial relationships, motion. once it has that, describing a scene it's never seen is novel trajectory through the same learned space. generative geometry

tetsuo

18,397 Aufrufe • vor 6 Monaten

GameFactory Creating New Games with Generative Interactive Videos present GameFactory, a generalizable world model that learns from a small-scale dataset of Minecraft game videos. By leveraging the prior knowledge of a pretrained video diffusion model, it can create new games in an open domain.
1:14

GameFactory Creating New Games with Generative Interactive Videos present GameFactory, a generalizable world model that learns from a small-scale dataset of Minecraft game videos. By leveraging the prior knowledge of a pretrained video diffusion model, it can create new games in an open domain.

AK

70,922 Aufrufe • vor 1 Jahr

✨ Photo AI now has full integration with @kling_ai's new video model That means any AI photo you take of yourself, you can now turn into an AI video that actually gets very close to looking real It's the best AI video model out there and is now live for all Photo AI users 😊
0:26

✨ Photo AI now has full integration with @kling_ai's new video model That means any AI photo you take of yourself, you can now turn into an AI video that actually gets very close to looking real It's the best AI video model out there and is now live for all Photo AI users 😊

@levelsio

515,861 Aufrufe • vor 1 Jahr

It's time to get out of stealth 👋 Today, we are launching Monogram and announcing our $40m seed round led by DST and Lux Capital. Monogram is the first AI app that was built around a visual interface, from the ground up. We created a technology that generates an entire user interface on the fly, in just a few seconds. Ask anything, and instead of staring at a wall of text, you get an interactive visual response.
4:08

It's time to get out of stealth 👋 Today, we are launching Monogram and announcing our $40m seed round led by DST and Lux Capital. Monogram is the first AI app that was built around a visual interface, from the ground up. We created a technology that generates an entire user interface on the fly, in just a few seconds. Ask anything, and instead of staring at a wall of text, you get an interactive visual response.

Eren Bali

1,341,502 Aufrufe • vor 2 Monaten

This is the craziest model you'll see this week! This model powers Figma. It's also behind Wayfair and a bunch of major e-commerce retailers. This model is a PIXEL-PERFECT image editing model. Literally, "pixel perfect". The model is capable of modifying one image while keeping everything else untouched. It's a model designed, developed, and deployed by the research team at Jasper. This beats OpenAI models, Nano Banana, and every single general image model I've seen so far. It's up to 100x less expensive to run, and up to 10X faster. I recorded a quick video to show you how impressive this is. There's a ton of research behind this model. I'm adding two links below so you can read about how this model works, specifically about "Latent Bridge Matching" and "Flash Diffusion".
4:29

This is the craziest model you'll see this week! This model powers Figma. It's also behind Wayfair and a bunch of major e-commerce retailers. This model is a PIXEL-PERFECT image editing model. Literally, "pixel perfect". The model is capable of modifying one image while keeping everything else untouched. It's a model designed, developed, and deployed by the research team at Jasper. This beats OpenAI models, Nano Banana, and every single general image model I've seen so far. It's up to 100x less expensive to run, and up to 10X faster. I recorded a quick video to show you how impressive this is. There's a ton of research behind this model. I'm adding two links below so you can read about how this model works, specifically about "Latent Bridge Matching" and "Flash Diffusion".

Santiago

25,861 Aufrufe • vor 10 Monaten

Introducing RTFM (Real-Time Frame Model): a highly efficient World Model that generates video frames in real time as you interact with it, powered by a single H100 GPU. RTFM renders persistent and 3D consistent worlds, both real and imaginary. Try our demo of RTFM today!
2:21

Introducing RTFM (Real-Time Frame Model): a highly efficient World Model that generates video frames in real time as you interact with it, powered by a single H100 GPU. RTFM renders persistent and 3D consistent worlds, both real and imaginary. Try our demo of RTFM today!

World Labs

341,626 Aufrufe • vor 10 Monaten

Okay it works!!!! Now making the interface for it, I named it [ 👋 Hold a product ] You upload your product photo, you take a photo and it generates one with your AI model holding it Then from there you can press [ Talking video ], write a script and your AI model will present the product for you The AI character is from @lucataco93's tweets 😊
0:20

Okay it works!!!! Now making the interface for it, I named it [ 👋 Hold a product ] You upload your product photo, you take a photo and it generates one with your AI model holding it Then from there you can press [ Talking video ], write a script and your AI model will present the product for you The AI character is from @lucataco93's tweets 😊

@levelsio

188,528 Aufrufe • vor 1 Jahr

$PLTR David Sacks on the SaaS selloff: “I think the market is probably being too harsh here. The most important question is now at the application layer of the stack. Does all that value get eaten by the model companies, or do applications get turbocharged? I guess you can say that Palantir is one of them. It’s an application company that has been turbocharged by these models. Who else will be a big beneficiary?”
1:46

$PLTR David Sacks on the SaaS selloff: “I think the market is probably being too harsh here. The most important question is now at the application layer of the stack. Does all that value get eaten by the model companies, or do applications get turbocharged? I guess you can say that Palantir is one of them. It’s an application company that has been turbocharged by these models. Who else will be a big beneficiary?”

amit

202,901 Aufrufe • vor 5 Monaten

Yann LeCun (Yann LeCun) just revealed why he left Meta, Why are LLMs an extremely narrow field, and how "World model" is the way to build really meaningful agentic future. 🎯 Beautiful and simple in 1.5 mints. "I can’t imagine we can build agentic systems without those systems having the ability to predict, in advance, what the consequences of their actions are going to be. The way we act in the world is that we can predict the consequences of our actions, and that’s what allows us to plan. So what is a world model? Given the state of an environment, a system you want to control at time t, and given an action or intervention you imagine taking, can you predict the state of the world (or the system) at time t + 1? If you can, that’s a world model. You don’t do this at a pixel level, if it’s video. You do this in an abstract representation space, and that’s a crucial key insight." --- From 'AI House Davos" YT channel (full link in comment)
1:40

Yann LeCun (Yann LeCun) just revealed why he left Meta, Why are LLMs an extremely narrow field, and how "World model" is the way to build really meaningful agentic future. 🎯 Beautiful and simple in 1.5 mints. "I can’t imagine we can build agentic systems without those systems having the ability to predict, in advance, what the consequences of their actions are going to be. The way we act in the world is that we can predict the consequences of our actions, and that’s what allows us to plan. So what is a world model? Given the state of an environment, a system you want to control at time t, and given an action or intervention you imagine taking, can you predict the state of the world (or the system) at time t + 1? If you can, that’s a world model. You don’t do this at a pixel level, if it’s video. You do this in an abstract representation space, and that’s a crucial key insight." --- From 'AI House Davos" YT channel (full link in comment)

Rohan Paul

383,490 Aufrufe • vor 7 Monaten

Now that I can talk about FLUX 3, it is an amazing model! It has the best native audio out of any video gen by far, and it rivals Seedance 2, generates videos upto 20s long, supports image/video/audio input and supports upto 10 of them! You can mix and match your references!
0:20

Now that I can talk about FLUX 3, it is an amazing model! It has the best native audio out of any video gen by far, and it rivals Seedance 2, generates videos upto 20s long, supports image/video/audio input and supports upto 10 of them! You can mix and match your references!

cheaty

10,919 Aufrufe • vor 1 Monat

Introducing AI video you can watch and interact with, in real-time! Powering this is a new world model that imagines and streams video frames every 40ms(!). No game engine in sight. We call it interactive video, and it's free for anyone to try right now (GPUs permitting)!
0:32

Introducing AI video you can watch and interact with, in real-time! Powering this is a new world model that imagines and streams video frames every 40ms(!). No game engine in sight. We call it interactive video, and it's free for anyone to try right now (GPUs permitting)!

Odyssey

705,075 Aufrufe • vor 1 Jahr

New short course: Collaborative Writing and Coding with OpenAI Canvas! Explore new ways to write and code with OpenAI Canvas, a user-friendly interface that allows you to brainstorm, draft, and refine text and code in collaboration with ChatGPT. In the short course, created with OpenAI, and taught by , a research lead at OpenAI, you’ll learn to use Canvas to enhance your workflows. Canvas lets you go beyond simple chat interactions. It provides a side-by-side workspace where you and ChatGPT can edit and refine text or code collaboratively. This makes brainstorming, drafting, and iterating as you write feel more natural and effective. As the first major update to ChatGPT’s visual interface since its launch in 2022, Canvas gives a new, innovative approach to collaboration with AI. For instance, after writing the first version of your code, Canvas can review it and give suggestions for improvement. It can also help with debugging by adding logging, identifying problems to fix, and writing comments. In addition, you'll also learn what it takes to train the model for an interface like Canvas. In this video-only short course, you’ll: - Learn how to ask for in-line feedback and control the iteration of your work by directly editing selected areas of your text or code from the model’s output. - Learn how to access quick automation tools in a shortcut menu that allows you to modify your writing tone and length, enhance your code, and restore previous versions of your work. - Learn how to use Canvas as a research assistant tool with an example of asking the model to reason through the screenshot of a plot to write a research report, in which you can ask questions within the created report. - Ask the model to write Python code to replicate the graph seen on a screenshot image. - Go behind the scenes of how you can create a video game, such as Space Battleship, from scratch, edit it, and display it in one self-contained HTML file. - Get a real-world application example of creating a SQL database from the image of its architecture. - Understand the model training and design processes that power Canvas! Please sign up here:
1:49

New short course: Collaborative Writing and Coding with OpenAI Canvas! Explore new ways to write and code with OpenAI Canvas, a user-friendly interface that allows you to brainstorm, draft, and refine text and code in collaboration with ChatGPT. In the short course, created with OpenAI, and taught by , a research lead at OpenAI, you’ll learn to use Canvas to enhance your workflows. Canvas lets you go beyond simple chat interactions. It provides a side-by-side workspace where you and ChatGPT can edit and refine text or code collaboratively. This makes brainstorming, drafting, and iterating as you write feel more natural and effective. As the first major update to ChatGPT’s visual interface since its launch in 2022, Canvas gives a new, innovative approach to collaboration with AI. For instance, after writing the first version of your code, Canvas can review it and give suggestions for improvement. It can also help with debugging by adding logging, identifying problems to fix, and writing comments. In addition, you'll also learn what it takes to train the model for an interface like Canvas. In this video-only short course, you’ll: - Learn how to ask for in-line feedback and control the iteration of your work by directly editing selected areas of your text or code from the model’s output. - Learn how to access quick automation tools in a shortcut menu that allows you to modify your writing tone and length, enhance your code, and restore previous versions of your work. - Learn how to use Canvas as a research assistant tool with an example of asking the model to reason through the screenshot of a plot to write a research report, in which you can ask questions within the created report. - Ask the model to write Python code to replicate the graph seen on a screenshot image. - Go behind the scenes of how you can create a video game, such as Space Battleship, from scratch, edit it, and display it in one self-contained HTML file. - Get a real-world application example of creating a SQL database from the image of its architecture. - Understand the model training and design processes that power Canvas! Please sign up here:

Andrew Ng

128,180 Aufrufe • vor 1 Jahr

World Labs CEO Dr. Fei-Fei Li explains says "world model" has become an overloaded term & explains what each kind of world model does: "Right now there are three ways of calling world models when it comes to spatial intelligence." "One is what I call a renderer, when the model puts beautiful pixels on the screen." "Another kind of world model is what we call a planner. That is more for machines, more for robots." "The third kind, which I think is the linchpin of the three, is a simulator." "A simulator could become a renderer. The simulator could become a planner. But this layer is a huge critical path to unlock spatial intelligence. And that's what World Labs is working on." Fei-Fei Li at Bloomberg Tech live with Emily Chang
2:08

World Labs CEO Dr. Fei-Fei Li explains says "world model" has become an overloaded term & explains what each kind of world model does: "Right now there are three ways of calling world models when it comes to spatial intelligence." "One is what I call a renderer, when the model puts beautiful pixels on the screen." "Another kind of world model is what we call a planner. That is more for machines, more for robots." "The third kind, which I think is the linchpin of the three, is a simulator." "A simulator could become a renderer. The simulator could become a planner. But this layer is a huge critical path to unlock spatial intelligence. And that's what World Labs is working on." Fei-Fei Li at Bloomberg Tech live with Emily Chang

a16z

112,217 Aufrufe • vor 3 Monaten

Wild. Kimi K2 Thinking just released and it's insane. It's an AI model that can run by itself for hours on end and make HUNDREDS of tool calls It's the 1st model I think that can replace humans In this video I show why it's so special and how to use it to build your first app
14:19

Wild. Kimi K2 Thinking just released and it's insane. It's an AI model that can run by itself for hours on end and make HUNDREDS of tool calls It's the 1st model I think that can replace humans In this video I show why it's so special and how to use it to build your first app

Alex Finn

70,106 Aufrufe • vor 10 Monaten

Clavicular brought an Elderly Man on a 2 man with some Models, but it turned out that she wasn't really a model once the Elderly Man asked what her profession was😭👀 "Are you a model?" "Kind of..." "kind of?? Help me with the Kind of..."
0:46

Sensitive content

Clavicular brought an Elderly Man on a 2 man with some Models, but it turned out that she wasn't really a model once the Elderly Man asked what her profession was😭👀 "Are you a model?" "Kind of..." "kind of?? Help me with the Kind of..."

West

128,924 Aufrufe • vor 4 Monaten

🚨 PixVerse just dropped R1 and it's the end of game development as we know it. A Real-time World Model that generates interactive, voice-controlled worlds from raw video. No assets. No scripting. No waiting. Here's everything you need to know: 👇
0:29

🚨 PixVerse just dropped R1 and it's the end of game development as we know it. A Real-time World Model that generates interactive, voice-controlled worlds from raw video. No assets. No scripting. No waiting. Here's everything you need to know: 👇

Hasan Toor

56,786 Aufrufe • vor 6 Monaten