Introducing Lemon Slice Live: the first real-time audio-video AI model Anyone can video chat with any character by just uploading a single photo. Every pixel on the screen is rendered at 25fps in real-time by a transformer model. Here’s how we built it + a live demo! 👇

2/ It's like Character AI with video. Here’s an example conversation from co-founder Andrew. Try it yourself at:

3/ Making it fast. We trained a custom video diffusion transformer (DiT) from scratch optimized for speed. After training our base model, we implemented student-teacher distillation to increase speed to 25fps with limited quality loss.

4/ Solving the infinite video problem. Most video DiT models (Sora, Runway, etc) experience quality degradation after multiple autoregressive extensions due to accumulation of generation errors. We developed a temporal consistency preservation technique that maintains coherence across long (multi-minute) sequences.

5/ Orchestrating a complex streaming architecture with minimal latency. Learn more in our tech report:

6/ Every new media technology follows a pattern. It first democratizes existing media formats before metamorphosing into something new. 📺 TV: initially a radio show with an image 🛜 YouTube: initially pirated TV shows 🪄 Generative Video: currently democratizing traditional video creation. But a new format will emerge.

7/ We're building this next format: interactive media. Our TV shows, movies, ads, and online courses will stop and talk to us. Our entertainment will be a mixture of passive and active experiences. If you want to build this future, we’re hiring!

8/ Thank you to our partners. We use @DeepgramAI (@deepgramscott) as our AI voice partner. @trydaily and @pipecat_ai (@kwindla) to help build a parallel processing pipeline that orchestrates everything. And @modal_labs (@bernhardsson, @akshat_b) as the end-to-end compute platform. We partnered with these folks because they are best in the world at enabling real-time interactions.

9/ And thank you to our investors. @ycombinator, @matrixvc, @snowmaker, @ilyasu, @dianakimball, @anneleeskates, @eshear, @christinacaci, @arashf, @ajratner, @ankurnagpal, @yanatweets, @aneelr, @gabor, @AndreaCoravos, @shwen, @accelmed, @sunilpai, @_Sparling_ and many more.

10/ Today, stream any character. Tomorrow, stream any imaginable universe. Give it a try and let us know what you think!

Sign up & create wholesome anime art on Moescape AI now!

using Lemon Slice Live to be your own shopping enabler