正在加载视频...

视频加载失败

Systems like OpenAI's new Sora video model, just shows us that anyone can create a pretty video or a beautiful picture using nothing but a text prompt. But if we are to use the technology to create interesting art, thought-provoking cinema, and great games.. we need control of the...

52,888 次观看 • 2 年前 •via X (Twitter)

10 条评论

Tieguaili 3D | Commissions Open | 3D Artist 的头像
Tieguaili 3D | Commissions Open | 3D Artist2 年前

no, they just prove that people can find new ways to avoid learning how to actually do shit themselves, when you prompt the model you're asking it to make you something, you don't make shit yourself, that's why none of these promptjockeys are artists

Martin Nebelong 的头像
Martin Nebelong2 年前

You have a very narrow definition of what's art and what isn't. Did you build your phone from scratch? No? What about your shoes.. Did you make those? You're lazy if you didn't! Do you use the gradient tool in photoshop? Color correction? Lazy. I agree that if you write a single text prompt, get a picture and call it your artwork, that's stretching it a bit.. But anything that involves time and effort like any other medium? Why is that lazy?

O C E A N 的头像
O C E A N2 年前

Ya when I’m working on video and graphics I want the specifics of my work to be shape shifting into new faces with new features everytime I click. This is gonna rock

Martin Nebelong 的头像
Martin Nebelong2 年前

Haha.. it's just a matter of time before the temporal consistency is improved I'm sure. The point of my post is more about the underlying level of control a workflow like this offers. The AI layer will eventually be like a renderer that stays consistent as you work on or move around in the scene.

๏ώℓąţя๏ɲ 的头像
๏ώℓąţя๏ɲ2 年前

I'm hoping we can use AI models like we currently use shaders. Swapping training data sets, prompt and algorithms on a seed geometry/material level. With 3d positional data not image recognition. Making that temporal coherence simpler maybe.

Martin Nebelong 的头像
Martin Nebelong2 年前

Yeah I imagine something like that 😊

Andy ⤴️ 的头像
Andy ⤴️2 年前

Literally crafting narratives from the imagination of machines.. What an incredible time to be alive.

MΞntis 🇦🇺 的头像
MΞntis 🇦🇺2 年前

It’s much more than just a pretty face…

Iamfarzad🌎 的头像
Iamfarzad🌎2 年前

The novelty will wear off pretty quickly once out and Sora is a tool, not an artist. It can’t understand or create meaning from prompts. Art is more than visuals, it’s emotion and expression. Art takes passion and dedication, not just pixels. So I agree, granular control is 🔑

Ben Pielstick 的头像
Ben Pielstick2 年前

Canvas editors have been great for creating precise static images. I’m curious what that will look like for video. I think it will need some kind of timeline and motion inpainting and maybe a camera controller.

相关视频

For generative AI to become an interesting art tool, we need much more control over the output. The slot-machine-like nature of pure text-to-image leaves too much to chance. Using the "Real-time Latent Consistency Model" that I'm using in the example here, is the first time I truly got a glimpse of a future where we'll be able to use our artistic skills and sensibility, to get control over AI image gen. Systems like these will never be able to match the quality or originality of a skilled artist, it won't surprise us in the same way an artist can. Things are a mess in terms of the training data these models are based on, and the questions about copyright concerns and about a time when everything will look the same are very valid. At some point capabilities like these will be embedded in photoshop, and anyone will be able to generate a pretty picture. But to create interesting designs, to tell original stories and to surprise us, we need creatives and artists with something on their mind. We'll be able to create immersive worlds, by making brush-strokes and sculpt marks, without needing to worry about all the dials, plugins, wires of our 3d and 2d tools today. I love to sculpt, I love to draw, and I love to explore new mediums and new ways to create. The Gen AI tools we have today are far from perfect, and things need to be steered in a better direction. For that we need artists to help point the way. Gen AI isn't going away.. it's too powerful and has the potential to allow us to tell stories like never before. Like all other big technological shifts, tech like this will come at a cost, but it will also open up new opportunities and empower a new generation of storytellers. I might be naive, but I believe that human ingenuity and creativity will persevere in this new world ♥️ #art #ai

Martin Nebelong

1,660,426 次观看 • 2 年前

Richard Dolan, on our need for collective self-reflection as we face the alien presence. 👽 "Here's another scenario, because I love to speculate about this. So what if these beings have an IQ of like 500+. Like they’re orders of magnitude beyond us. And they're telepathic, so they can crawl inside your mind. And they're part of their own hive mind so that they have instant access to a complete like encyclopedia, a Galactica Encyclopedia of information. And they have an emotional disposition that makes it so that maybe they don't laugh at all of your jokes. And they look at you and they can see your naked soul before them. So does it matter if they look human or not? If you're sitting in a room across from one of them and they're just staring at you? Well, that would be very intimidating, I think. And that doesn't strike me as impossible a scenario. "So if they are like that, we are going to have to find our own center of being. I mean, some people might think this sounds very wishy washy, but I've really come to believe that it is probably essential that, for us to deal with them, we need to have a very much better understanding of ourselves. "For example, think of the kind of society that we create. Constant stimulation. Constant screen attachment. Screen addiction. Waiting for the notifications. Bing bing bing. The endorphins. And we're constantly chasing, chasing after whatever we're chasing in this world of ours. Like the hamster wheel that you never get off of. That's the world for many of us. That is not a society conducive to self-examination and self-exploration. When you are dealing with a series of intelligences that are probably leaps and bounds beyond our operational capacity to begin with. "So if we're going actually to deal with them in any way that's meaningful, we probably need to just stop and engage in some seriously deep self-reflection about what we are. And then maybe that means spirituality, like it probably does, to be honest. And the kind of system that we've developed in our world, I just, at this point in my life, I don't think is all that conducive to us being able to effectively, psychologically relate to these other beings."

David Windt

54,218 次观看 • 1 年前

Excited to show some surprising inventions on generative multiplayer games we made at Google with Stanford. We call the work MultiGen. I've always been inspired by early studios like id Software with Doom or Blizzard with Warcraft bringing networked video games to the next level. We are at the point in history where we can make strides like them, but for generative games. It's a strange feeling to be in the age of generative video games while still discovering how exactly to train the models and design the tools that make them useful. All of the tools that have been invented for classic game engines need to be redesigned for generative games. For example level and world design is not entirely possible with existing technology. We introduce editable memory to diffusion game engines that allow for design of new levels via a minimap. But we can easily imagine how this can be expanded with different creation tools. The end goal of this research direction is to allow game designers to be able to guide the generation process of their world, at the granularity that they prefer. Editable memory also allows us to add multiplayer to Generative Doom. We were amazed when we saw GameNGen some years ago, and now you can play it live with friends in real-time, on your couch or even online. Shared representations like our editable memory seem like the future for this type of experience. Models are, in some cases, expensive and approximate encoders but great interpolators and extrapolators. Leveraging their strengths lets you have completely new experiences that can be realized now and not in the distant future. This work was started at my previous team and continued in collaboration with Stanford. Congratulations to all for the discoveries.

Nataniel Ruiz

104,841 次观看 • 5 个月前

Sora animates with this wonderful wonky, sketchy dreamlike quality that perfectly captures the nostalgic atmosphere of a hazy 90's suburban summer afternoon. While Seedance is just as sophisticated and in some aspects superior, I will miss the quality of Sora. Sora feels like 35mm film, with the nuanced way it captures lighting, color, and perspective, while Seedance feels digital - a bit too clean. I am confident that I can replicate this sketchy quality in Seedance by tweaking my prompts, but Sora has a unique way of animating that really should be preserved. There are many more bugs and mistakes with Sora, but when it gets it right, it REALLY hits a level of artful magic that sets it above all other models. I am shocked that I still appear to be the only person who is creating AI-Generated 2D animation with original characters while developing a unique Western style. Practically no one is doing 2D AI-animation at all, and when they do, it is usually an attempt to mimic an Anime style. 2D really should be attempted more by AI Filmmakers!! Especially with a Western model like Sora, before it is terminated in the fall. Really, everyone should be taking advantage of the way this model so skillfully animates, with the heart and soul of a seasoned professional. I personally feel AI-generated animation is superior to 3D/realistic AI filmmaking. While AI-generated realism is an attempt to mimic real life through a lens, 2D animation IS what it is - not a replica of anything, just a cartoon. I love all my AI filmmaker bros and all of the cutting edge work going on, but I urge all of you to give 2D animation a chance. : ) I'm still not giving up hope that we can save Sora somehow. Now that I see that Seedance is able to animate 2D brilliantly and beautifully, I know that it's not some hidden secret, and we can replicate the weights and maths of Sora. If we can't preserve Sora, we can make a comparable model. It's not just in the interest of AI-Animators like me to preserve this model, but in the interest of the entire American AI community if they want Western AI to be superior. If not, Chinese video models will dominate. And while I am perfectly happy to use a Chinese model and I am just eternally grateful that this technology exists at all, I would love to see American audiovisual models continue to be developed! #AIAnimation #AIFilmmaking #AIArt #SaveSora #SummerofSora #WillStancilShow Elon Musk Marc Andreessen 🇺🇸 Sora Bill Peebles NVIDIA Sam Altman

Emily Youcis

18,940 次观看 • 3 个月前