Loading video...

Video Failed to Load

Go Home

✨ First AI talking video made from within Photo AI with the new [ 💬 Make talking video ] interface AI photo -> AI video -> AI lipsync -> AI captions Obviously not very passable yet, BUT it's a start and with voice and lipsync models improving so fast...

200,560 views • 1 year ago •via X (Twitter)

10 Comments

@levelsio's profile picture
@levelsio1 year ago

Comparison with HeyGen from a year ago HeyGen is lipsync based on a real video you record That has benefits of realism but a massive limitation of freedom, you can't change where you are, what you do, how you look With Photo AI you can!

V's profile picture
V1 year ago

Everybody wants to generate ai content, but nobody wants to consume ai content

@levelsio's profile picture
@levelsio1 year ago

I'm fine with consuming AI content I do it all day using ChatGPT for everything, Cursor for code etc

Hassan Sadeed Ali's profile picture
Hassan Sadeed Ali1 year ago

You being completely transparent about how you feel about it is something that other builders as well must learn 🫡

@levelsio's profile picture
@levelsio1 year ago

Yeah no need to present it as perfect because it definitely isn't yet! But that's the aim :D

Chris Brownridge's profile picture
Chris Brownridge1 year ago

Try this for subs. May need a bit of tinkering to get results you want but is pretty good

Fatih Tahta 🚀's profile picture
Fatih Tahta 🚀1 year ago

You turning it into a whole tool suite is impressing fr.

Ali's profile picture
Ali1 year ago

Hope everyone uses these so i can finally stand out by being human.

juan's profile picture
juan1 year ago

For captions you need forced alignment, I've used an open source tool called echogarden. Also, some TTS APIs come with timestamps for each word, which is a simpler way to solve captions.

@levelsio's profile picture
@levelsio1 year ago

What is this?

Related Videos

✨ I made a 100% AI video of a single night in 🇩🇪 Berlin's underground techno scene Doing an AI shoot is very much like a real life shoot, you have to prepare locations, settings, outfits and models, you can do the same: 1) First I generated photos with the [ 🇩🇪 Berlin nightlife ] photo pack on they're all non-existing AI people except me and my gf 2) Then I put the pics I liked in Kling AI to make them into 10 second videos (with Professional Mode), soon I'll have API access and it'll be one-click inside Photo AI to turn a photo into a 10-sec video, it then takes about 5 minutes to make a video. It's not always great, especially dancing is hard to get right! 3) Then I wanted to have a German narrator talking about Berlin's techno nights in a poetic way like a documentary, so I asked ChatGPT 4o: "write in the style of a cult German novelist about the Berlin techno scene" I then copied that text into Eleven Labs and selected a German AI voice 4) I then collected all the videos, the music and the audio narrator and edited them together in Final Cut Pro adding music from HÖR and adding audio effects 5) Then I added English captions with CapCut Time to make it: 3 hours for 1 minute of video I hope you like it! My dream is to have this entire pipeline in Photo AI at some point. Connecting to Kling AI's video API is the first step to that. Imagine just writing a prompt and you end up with a video like this without all the work Credits: Music: Asquith - Let Me (Rave Mix) [ASQ004] Barbax - Si Vis Pacem Para Bellum (Original Mix) Mixed by Ellen Allien @ HÖR Video: 100% AI characters and video by Photo AI Edited by me Narrator voice: 100% written by ChatGPT 4o 100% narrated by Eleven Labs AI voice

@levelsio

676,094 views • 1 year ago

All this talk about AGI destroying moats and everything made me want to ship again One of the conclusions from all of you was, if you can use AI to ship faster and better, you should just ship way more complex things, like things you could not imagine making before For me personally I'd never imagine making Adobe Premiere, Final Cut Pro or Capcut but on the web, it'd simply be too difficult for me, where do I even start? So today I just tried and vibecoded them into Photo AI! A fully functional video editor but the cool twist is this one can actually generate videos with you or your trained models in it directly in your video editor I'm personally less interested in the AI influencers etc, but more fun to make actual kinda cinematic short films with yourself and other people in it, so I made this Likeness in video models is now good enough so that gives lots of cool opportunities, but most AI platforms just let you generate 10 second clips but then you're stuck with that and have to put it together yourself in Final Cut Pro So now you can just [ Send to video editor ] inside Photo AI and you end up here And the next thing I'll add is the AI Agent sidebar I have in Photo AI's main app too, which lets an agent take control of the interface. In this case you'll be able to say "make a short film of me in Bangkok", it'll ask you some questions, then write a script of prompts, which are then generated as videos with you or other people as the actors in it and automatically edited into a short film on your time Then you can right click on any video you don't like (some videos just suck or have bad resemblance to you, shit happens), and click [ Regenerate], adjust the prompt a bit and the new video will show up in the same place on your video timeline In this case I did try to make a short film of me arriving in Bangkok as a digital nomad the first time and being dazed, lost and disillusioned as I am on the other side of the world 🤯 Featuring Lorn's song "The Slow Blade"

@levelsio

500,292 views • 10 days ago