Loading video...

Video Failed to Load

There was a problem loading this video. This could be due to a temporary network issue or the video might be unavailable.

Using SORA to generate and control an emotionally nuanced performance of a fully synthetic actor across several minutes of video. (Sound on)

Matt Zien (KNGMKR)

2,609 subscribers

24,598 views • 1 year ago •via X (Twitter)

Education Science & Technology Arts

Anya Rossi• Live Now

Private livecam show

10 Comments

Elon's My Hero — e/acc 🤖FALSC1 year ago

Who created the story and dialog?

Matt Zien (KNGMKR)1 year ago

I did! 😄

Baron de l’Agent1 year ago

In addition really amazed by the lipsync. Feels so much better than what I have seen so far.

Shine by Nous ✨1 year ago

Amazing job!! 🔥

Matt Zien (KNGMKR)1 year ago

Thank you Nous!

Guy Ben-Betzalel1 year ago

Amazing! Truly incredible!! What did you use for voice and lip syncing?

Jaycie | AI Creative Director1 year ago

Dammmmmmmn. I'm floored.

Matt Zien (KNGMKR)1 year ago

thanks Jaycie!!!

wdrivex1 year ago

Wow! With Act-One from Runway?

Matt Zien (KNGMKR)1 year ago

With @lipdubai

Related Videos

here's how to create consistent characters with sora 2: sora just dropped character cameos and nobody's using it right the trick is you need to generate your character INSIDE sora first here's the exact process: - generate a video of your character standing/talking on white background in sora - hit the 3 dots -> create character - trim to the exact length you want - boom, now you have a reusable cameo normally you can't upload real people as cameos, but if you generate them in sora first, the system lets you save them this means you can now use the same AI character across 100+ videos without consistency issues video guide below

here's how to create consistent characters with sora 2: sora just dropped character cameos and nobody's using it right the trick is you need to generate your character INSIDE sora first here's the exact process: - generate a video of your character standing/talking on white background in sora - hit the 3 dots -> create character - trim to the exact length you want - boom, now you have a reusable cameo normally you can't upload real people as cameos, but if you generate them in sora first, the system lets you save them this means you can now use the same AI character across 100+ videos without consistency issues video guide below

Miko

16,019 views • 8 months ago

Generate Sound Effects for your video using prompts and your voice (optional) in Adobe Firefly We just released a cool tool where you can direct sounds of your videos. I generated an AI video of a cat and made it sound like a lion. Took me less than 5 mins to make. So fun!

Generate Sound Effects for your video using prompts and your voice (optional) in Adobe Firefly We just released a cool tool where you can direct sounds of your videos. I generated an AI video of a cat and made it sound like a lion. Took me less than 5 mins to make. So fun!

Kris Kashtanova

54,861 views • 1 year ago

I made a Sora MCP 🎬 The server can generate, remix, check video status, and even download videos to a folder of your choice Repo on GitHub 👇

I made a Sora MCP 🎬 The server can generate, remix, check video status, and even download videos to a folder of your choice Repo on GitHub 👇

Pietro Schirano

83,457 views • 9 months ago

Quick tip for anyone generating videos with Hailuo 2 or Midjourney Video since they don't generate with any sound. You can generate sound effects for free using MMAUDIO via huggingface. I'm sure a lot of you are familiar with it. It's video to audio synthesis and it's FREE! - Go to this link - Upload your video - Type in a description for the sound - Choose a duration - Click on submit Your video now has sound 👍

Quick tip for anyone generating videos with Hailuo 2 or Midjourney Video since they don't generate with any sound. You can generate sound effects for free using MMAUDIO via huggingface. I'm sure a lot of you are familiar with it. It's video to audio synthesis and it's FREE! - Go to this link - Upload your video - Type in a description for the sound - Choose a duration - Click on submit Your video now has sound 👍

Travis Davids

30,113 views • 1 year ago

This is a powerful combination: 1) Directing an AI agent to generate characters, locations and all the angles I need for my dialogue shots 2) Using human actors to drive the performance of my characters The agent handles the technical side and I can focus on performance:

This is a powerful combination: 1) Directing an AI agent to generate characters, locations and all the angles I need for my dialogue shots 2) Using human actors to drive the performance of my characters The agent handles the technical side and I can focus on performance:

Halim Alrasihi

51,221 views • 4 months ago

As you know, my explorations of the Gen AI space is ultimately all about creative control. You should be able to shape the generative matter using all your artistic sensibilities and your aesthetic sense. OpenAI's Sora is a huge technological leap, but what excites me the most about it is the modalities where it depends on input other than text alone. Such as video to video. Here's an example of how Sora can change an input video. Base video🧵

As you know, my explorations of the Gen AI space is ultimately all about creative control. You should be able to shape the generative matter using all your artistic sensibilities and your aesthetic sense. OpenAI's Sora is a huge technological leap, but what excites me the most about it is the modalities where it depends on input other than text alone. Such as video to video. Here's an example of how Sora can change an input video. Base video🧵

Martin Nebelong

7,520,079 views • 2 years ago

A humanoid robot policy trained solely on synthetic data generated by a world model. Research Scientist Joel Jang presents NVIDIA's DreamGen pipeline: ⦿ Post-train the world model Cosmos-Predict2 with a small set of real teleoperation demos. ⦿ Prompt the world model to generate synthetic video data with verbs and scenarios not used in the world model’s post-training. ⦿ Auto-label synthetic video data with action sequences. ⦿ Train robot policies using only synthetic data. That's it. Deploy zero-shot to a real humanoid robot.

A humanoid robot policy trained solely on synthetic data generated by a world model. Research Scientist Joel Jang presents NVIDIA's DreamGen pipeline: ⦿ Post-train the world model Cosmos-Predict2 with a small set of real teleoperation demos. ⦿ Prompt the world model to generate synthetic video data with verbs and scenarios not used in the world model’s post-training. ⦿ Auto-label synthetic video data with action sequences. ⦿ Train robot policies using only synthetic data. That's it. Deploy zero-shot to a real humanoid robot.

The Humanoid Hub

20,968 views • 1 year ago

Video of Connor Storrie and Kathryn Hahn presenting the Actor Awards for Outstanding performance of a Female Actor in a Drama Series. #ConnorActorAwards

Video of Connor Storrie and Kathryn Hahn presenting the Actor Awards for Outstanding performance of a Female Actor in a Drama Series. #ConnorActorAwards

Connor Storrie Updates

116,001 views • 4 months ago

I just built and shipped my own personal Sora Video Studio using Replit ⠕ using the Sora API and launched to my own custom domain name. As the API evolves and improves I'll be able to have greater control of the videos made. It really feels like magic making software right now.

I just built and shipped my own personal Sora Video Studio using Replit ⠕ using the Sora API and launched to my own custom domain name. As the API evolves and improves I'll be able to have greater control of the videos made. It really feels like magic making software right now.

Levin Stanley

40,664 views • 9 months ago

SORA 2 AND SORA 2 PRO ARE LIVE! The next-gen video model has landed on ImagineArt — bringing hyper-realistic visuals, natural physics, and cinematic SFX to life. 💎 1 Month FREE on Creator Plan 💰 Generate a Sora 2 video & Win $11,000 in the SORA 2 Challenge! #ImagineArt #Sora2

SORA 2 AND SORA 2 PRO ARE LIVE! The next-gen video model has landed on ImagineArt — bringing hyper-realistic visuals, natural physics, and cinematic SFX to life. 💎 1 Month FREE on Creator Plan 💰 Generate a Sora 2 video & Win $11,000 in the SORA 2 Challenge! #ImagineArt #Sora2

ImagineArt

512,938 views • 9 months ago

OpenAI just dropped Sora 2 today it can generate videos with sound now, huge improvement on physics, realism, and control.. honestly no one can tell these are AI videos now here's everything you need to know:

OpenAI just dropped Sora 2 today it can generate videos with sound now, huge improvement on physics, realism, and control.. honestly no one can tell these are AI videos now here's everything you need to know:

el.cine

38,098 views • 9 months ago

AI can now help you create beautiful animations. Here’s one of my recent tests. Workflow: - Generate images using Midjourney. - Use Sora or Flux Kontext to create additional camera angles. - Animate the images using Kling AI and/or Midjourney’s new video generator. - Generate music with Suno AI. - Put everything together using your favorite video editing tool. The potential is huge. This took less than an hour to complete from start to finish. Imagine what you could do with more time and a story to tell.

AI can now help you create beautiful animations. Here’s one of my recent tests. Workflow: - Generate images using Midjourney. - Use Sora or Flux Kontext to create additional camera angles. - Animate the images using Kling AI and/or Midjourney’s new video generator. - Generate music with Suno AI. - Put everything together using your favorite video editing tool. The potential is huge. This took less than an hour to complete from start to finish. Imagine what you could do with more time and a story to tell.

Hashem Al-Ghaili

29,185 views • 1 year ago

Out of a 118 minute runtime, Anthony Hopkins appeared only for 16 minutes and 10 seconds. Yet his performance earned him an Oscar for Best Actor in a Leading Role.

Out of a 118 minute runtime, Anthony Hopkins appeared only for 16 minutes and 10 seconds. Yet his performance earned him an Oscar for Best Actor in a Leading Role.

Every Movie Plug

66,863 views • 17 days ago

Introducing Blue Dot, a short film by 3Lateral featuring renowned actor Radivoje Bukvić's monologue based on Mika Antic's poem. These nuanced results demonstrate the level of fidelity that artists and filmmakers can achieve when using #MetaHumanAnimator.

Introducing Blue Dot, a short film by 3Lateral featuring renowned actor Radivoje Bukvić's monologue based on Mika Antic's poem. These nuanced results demonstrate the level of fidelity that artists and filmmakers can achieve when using #MetaHumanAnimator.

Unreal Engine

71,784 views • 3 years ago

Using Stable Audio 3 to generate variations of an existing loop. Unconditional generation (no prompt), renoising the latents to 0.5, and just using different seeds seems to generate a nice neighbourhood around the original. Generally keeps the harmonic context and feel.

Using Stable Audio 3 to generate variations of an existing loop. Unconditional generation (no prompt), renoising the latents to 0.5, and just using different seeds seems to generate a nice neighbourhood around the original. Generally keeps the harmonic context and feel.

Tero Parviainen

10,779 views • 1 month ago

Full video of Connor Storrie and Kathryn Hahn presenting the Outstanding performance of a Female Actor in a Drama Series award to Keri Russell. #ConnorActorAwards

Full video of Connor Storrie and Kathryn Hahn presenting the Outstanding performance of a Female Actor in a Drama Series award to Keri Russell. #ConnorActorAwards

Connor Storrie Updates | Fansite

114,161 views • 4 months ago