Загрузка видео...

Не удалось загрузить видео

На главную

📚 Introducing Teach-O-Matic, an AI YouTuber that creates how-to videos about… anything. • Open source • Powered by Replicate OpenAI • Runs on Colaboratory - no dev env required Try it ➡️ "How to Make Spaghetti by Shakespeare"

70,252 просмотров • 3 лет назад •via X (Twitter)

Комментарии: 11

Фото профиля Charlie Holtz
Charlie Holtz3 лет назад

Teach-O-Matic uses: • 4️⃣ GPT4 to write a script • 🐕 Bark to create speech from the script • 🎥 Damo to create video from a text prompt • 🎵 Riffusion for background music • 🐎 Stable Diffusion for cover images • ⛓️LangChain to chain it all together

Фото профиля Charlie Holtz
Charlie Holtz3 лет назад

First, you give Teach-O-Matic a topic. What do you want to learn how to do? It then writes a script about your topic using GPT4:

Фото профиля Charlie Holtz
Charlie Holtz3 лет назад

Then, Suno AI's new Bark model reads the script. I used the "announcer" voice model.

Фото профиля Charlie Holtz
Charlie Holtz3 лет назад

Then comes damo-text-to-video, which creates videos from text descriptions. This model is where the "will smith eating spaghetti" meme came from. The outputs are hilarious and bizarre. eg "group of people playing ultimate frisbee"

Фото профиля Charlie Holtz
Charlie Holtz3 лет назад

The background music is made with @riffusionai, which creates music in a very interesting way — by generating spectrograms of your prompt with stable diffusion. Those spectrograms are then converted to audio. This is a spectrogram of "funky synth solo"

Фото профиля Charlie Holtz
Charlie Holtz3 лет назад

Another @LangChainAI chain writes an ending quote. Of course it adds a "and don't forget to like and subscribe!" Then the whole chain runs and everything is ready in about 2min.

Фото профиля Charlie Holtz
Charlie Holtz3 лет назад

One thing I love about Teach-O-Matic is that anyone can edit the final product with plain english. For example, let’s say you wanted the narrator to end with “and don’t forget to SMASH that like button!” No code change necessary — just edit the ending quote prompt!

Фото профиля Charlie Holtz
Charlie Holtz3 лет назад

Something I learned making this is that the open source LLM’s aren’t quite there... yet. GPT-4 was so much better at understanding the rule “create 6 paragraphs each separated by a \n\n” than dolly or stable-lm

Фото профиля Charlie Holtz
Charlie Holtz3 лет назад

I also got much more comfortable using @LangChainAI by the end of this. The TransformChain lets you run arbitrary code inside a chain which came in handy for running the narrator requests asynchronously.

Фото профиля Charlie Holtz
Charlie Holtz3 лет назад

Every day a script runs that creates new topics, runs the notebook, and uploads it to YouTube. But Teach-O-Matic can already teach you a lot. Everything from “How To Communicate With Aliens Using Interpretive Dance” to “How To Fly a Plane.”

Фото профиля Charlie Holtz
Charlie Holtz3 лет назад

Check out the YouTube channel to see other outputs. They’re all funny and weird. Send me your creations and I'll upload it to the channel. And of course, don’t forget to like and subscribe!

Похожие видео