正在加载视频...

视频加载失败

✨ First AI talking video made from within Photo AI with the new [ 💬 Make talking video ] interface AI photo -> AI video -> AI lipsync -> AI captions Obviously not very passable yet, BUT it's a start and with voice and lipsync models improving so fast...

200,560 次观看 • 1 年前 •via X (Twitter)

10 条评论

@levelsio 的头像
@levelsio1 年前

Comparison with HeyGen from a year ago HeyGen is lipsync based on a real video you record That has benefits of realism but a massive limitation of freedom, you can't change where you are, what you do, how you look With Photo AI you can!

V 的头像
V1 年前

Everybody wants to generate ai content, but nobody wants to consume ai content

@levelsio 的头像
@levelsio1 年前

I'm fine with consuming AI content I do it all day using ChatGPT for everything, Cursor for code etc

Hassan Sadeed Ali 的头像
Hassan Sadeed Ali1 年前

You being completely transparent about how you feel about it is something that other builders as well must learn 🫡

@levelsio 的头像
@levelsio1 年前

Yeah no need to present it as perfect because it definitely isn't yet! But that's the aim :D

Chris Brownridge 的头像
Chris Brownridge1 年前

Try this for subs. May need a bit of tinkering to get results you want but is pretty good

Fatih Tahta 🚀 的头像
Fatih Tahta 🚀1 年前

You turning it into a whole tool suite is impressing fr.

Ali 的头像
Ali1 年前

Hope everyone uses these so i can finally stand out by being human.

juan 的头像
juan1 年前

For captions you need forced alignment, I've used an open source tool called echogarden. Also, some TTS APIs come with timestamps for each word, which is a simpler way to solve captions.

@levelsio 的头像
@levelsio1 年前

What is this?

相关视频

✨ I made a 100% AI video of a single night in 🇩🇪 Berlin's underground techno scene Doing an AI shoot is very much like a real life shoot, you have to prepare locations, settings, outfits and models, you can do the same: 1) First I generated photos with the [ 🇩🇪 Berlin nightlife ] photo pack on they're all non-existing AI people except me and my gf 2) Then I put the pics I liked in Kling AI to make them into 10 second videos (with Professional Mode), soon I'll have API access and it'll be one-click inside Photo AI to turn a photo into a 10-sec video, it then takes about 5 minutes to make a video. It's not always great, especially dancing is hard to get right! 3) Then I wanted to have a German narrator talking about Berlin's techno nights in a poetic way like a documentary, so I asked ChatGPT 4o: "write in the style of a cult German novelist about the Berlin techno scene" I then copied that text into Eleven Labs and selected a German AI voice 4) I then collected all the videos, the music and the audio narrator and edited them together in Final Cut Pro adding music from HÖR and adding audio effects 5) Then I added English captions with CapCut Time to make it: 3 hours for 1 minute of video I hope you like it! My dream is to have this entire pipeline in Photo AI at some point. Connecting to Kling AI's video API is the first step to that. Imagine just writing a prompt and you end up with a video like this without all the work Credits: Music: Asquith - Let Me (Rave Mix) [ASQ004] Barbax - Si Vis Pacem Para Bellum (Original Mix) Mixed by Ellen Allien @ HÖR Video: 100% AI characters and video by Photo AI Edited by me Narrator voice: 100% written by ChatGPT 4o 100% narrated by Eleven Labs AI voice

@levelsio

676,094 次观看 • 1 年前

All this talk about AGI destroying moats and everything made me want to ship again One of the conclusions from all of you was, if you can use AI to ship faster and better, you should just ship way more complex things, like things you could not imagine making before For me personally I'd never imagine making Adobe Premiere, Final Cut Pro or Capcut but on the web, it'd simply be too difficult for me, where do I even start? So today I just tried and vibecoded them into Photo AI! A fully functional video editor but the cool twist is this one can actually generate videos with you or your trained models in it directly in your video editor I'm personally less interested in the AI influencers etc, but more fun to make actual kinda cinematic short films with yourself and other people in it, so I made this Likeness in video models is now good enough so that gives lots of cool opportunities, but most AI platforms just let you generate 10 second clips but then you're stuck with that and have to put it together yourself in Final Cut Pro So now you can just [ Send to video editor ] inside Photo AI and you end up here And the next thing I'll add is the AI Agent sidebar I have in Photo AI's main app too, which lets an agent take control of the interface. In this case you'll be able to say "make a short film of me in Bangkok", it'll ask you some questions, then write a script of prompts, which are then generated as videos with you or other people as the actors in it and automatically edited into a short film on your time Then you can right click on any video you don't like (some videos just suck or have bad resemblance to you, shit happens), and click [ Regenerate], adjust the prompt a bit and the new video will show up in the same place on your video timeline In this case I did try to make a short film of me arriving in Bangkok as a digital nomad the first time and being dazed, lost and disillusioned as I am on the other side of the world 🤯 Featuring Lorn's song "The Slow Blade"

@levelsio

514,210 次观看 • 11 天前