Loading video...

Video Failed to Load

Go Home

👩‍🎨 Announcing "Paint by Text" A web app that lets you edit your photos using written instructions, with the help of an AI.

292,102 views • 3 years ago •via X (Twitter)

10 Comments

Zeke Sikelianos's profile picture
Zeke Sikelianos3 years ago

Under the hood, Paint by Text is powered by a new ML model called InstructPix2Pix, which was trained on Stable Diffusion and GPT-3 to modify existing images using instructional text prompts. You can run this model yourself using Replicate's API:

Zeke Sikelianos's profile picture
Zeke Sikelianos3 years ago

This app was really fun and easy to make! It's amazing what you can build these days using @nextjs, @tailwindcss, @replicatehq, and @vercel. It's open-source, and a good starting point for building your own AI-powered apps. Check out the README:

Zeke Sikelianos's profile picture
Zeke Sikelianos3 years ago

🔜🍿 Stay tuned for a follow-up video showing how we built it!

Zeke Sikelianos's profile picture
Zeke Sikelianos3 years ago

Thanks to Tim Brooks, Aleksander Holynski, and Alexei A. Efros at UC Berkeley for creating the incredible new InstructPix2Pix model. 🙏🏼

🦆 SchizoDuckie 🦆's profile picture
🦆 SchizoDuckie 🦆3 years ago

Not too impressed yet sorry

Abi Raja's profile picture
Abi Raja3 years ago

if you're looking for an iphone version of this, check this out:

Max S's profile picture
Max S3 years ago

Nice!

Jeroen Van Goey's profile picture
Jeroen Van Goey3 years ago

Not entirely what I was expecting...

Stian Lie-Sveen's profile picture
Stian Lie-Sveen3 years ago

Slick 😀 very impressive. Maybe take a look at the dev guide later 👍

Zeke Sikelianos's profile picture
Zeke Sikelianos3 years ago

Wow those are some hypnotic pineapples. That Magritte image definitely goes off the rails when you try to change the apple. Pretty funny stuff!

Related Videos