Загрузка видео...
Не удалось загрузить видео
📚 Introducing Teach-O-Matic, an AI YouTuber that creates how-to videos about… anything. • Open source • Powered by Replicate OpenAI • Runs on Colaboratory - no dev env required Try it ➡️ "How to Make Spaghetti by Shakespeare"
70,252 просмотров • 3 лет назад •via X (Twitter)
Комментарии: 11

Teach-O-Matic uses: • 4️⃣ GPT4 to write a script • 🐕 Bark to create speech from the script • 🎥 Damo to create video from a text prompt • 🎵 Riffusion for background music • 🐎 Stable Diffusion for cover images • ⛓️LangChain to chain it all together

First, you give Teach-O-Matic a topic. What do you want to learn how to do? It then writes a script about your topic using GPT4:

Then, Suno AI's new Bark model reads the script. I used the "announcer" voice model.

Then comes damo-text-to-video, which creates videos from text descriptions. This model is where the "will smith eating spaghetti" meme came from. The outputs are hilarious and bizarre. eg "group of people playing ultimate frisbee"

The background music is made with @riffusionai, which creates music in a very interesting way — by generating spectrograms of your prompt with stable diffusion. Those spectrograms are then converted to audio. This is a spectrogram of "funky synth solo"

Another @LangChainAI chain writes an ending quote. Of course it adds a "and don't forget to like and subscribe!" Then the whole chain runs and everything is ready in about 2min.

One thing I love about Teach-O-Matic is that anyone can edit the final product with plain english. For example, let’s say you wanted the narrator to end with “and don’t forget to SMASH that like button!” No code change necessary — just edit the ending quote prompt!

Something I learned making this is that the open source LLM’s aren’t quite there... yet. GPT-4 was so much better at understanding the rule “create 6 paragraphs each separated by a \n\n” than dolly or stable-lm

I also got much more comfortable using @LangChainAI by the end of this. The TransformChain lets you run arbitrary code inside a chain which came in handy for running the narrator requests asynchronously.

Every day a script runs that creates new topics, runs the notebook, and uploads it to YouTube. But Teach-O-Matic can already teach you a lot. Everything from “How To Communicate With Aliens Using Interpretive Dance” to “How To Fly a Plane.”

Check out the YouTube channel to see other outputs. They’re all funny and weird. Send me your creations and I'll upload it to the channel. And of course, don’t forget to like and subscribe!
