Skip navigation
Want to create an avatar from a single image?
0:00 / 0:30

Want to create an avatar from a single image?

Matthias Niessner

@MattNiessner50K followers

Visit on X
391 likesDownloadOriginal post

96,371 views

Want to create an avatar from a single image? FlexAvatar is a transformer model that creates full 360°, high-quality, and expressive 3D head avatar from just a single portrait image in minutes. Real-time Demo: FlexAvatar's lightweight architecture allows both animation and rendering in real-time, enabling interactive user experiences. To create a new 3D head avatar, only one image is required, e.g., from a webcam. The final avatar is ready after 2 minutes. Architecture: Under the hood, FlexAvatar adopts a transformer-based encoder-decoder design. The encoder maps the input image onto a latent avatar space, while the decoder produces 3D Gaussian attribute maps by incorporating the animation signal via cross-attention. The model learns all facial animations directly from the data without relying on pre-built 3D face models. This equips the avatars with realistic facial expressions. The internal avatar latent space can be conveniently used to integrate additional observations of a person via fitting. This enables use-cases where more than one image of a person is available, e.g., from a phone scan of the person. We train jointly on 2D monocular videos and multi-view data. However, in monocular videos, the animation signal leaks the target viewpoint, causing the model to produce incomplete 3D heads. We call this phenomenon entanglement of driving signal and target viewpoint. To prevent entanglement, we introduce bias sinks. These are learnable tokens that indicate whether a training sample stems from a monocular or a multi-view dataset. During training, the model learns to produce incomplete 3D heads only when the monocular token is present. During inference, FlexAvatar then always uses the multi-view token for which the model has learned to produce complete 3D heads. This simple design allows to combine the generalizability from monocular data with the quality of multi-view data. FlexAvatar summary: - Input: Single-image, phone scan, or monocular video - Output: Full 360° head avatar - Expressive animations - Real-time rendering and animation - Generalization to any portrait - Create a new avatar in 2 minutes - Use bias sinks to combine 2D and 3D data 🏠 🌍 🎥 Great work by Tobias Kirschstein and Simon Giebenhain!

10 Comments

Comments from the original post on X (Twitter)

  • Luis's profile picture

    @RealtimeLuis

    I hope the code or a demo really is coming soon. We already saw a couple like this and at the end nothing is released.

    5 likes

  • MetaDJ's profile picture

    @metadjai

    WOW ✨

    2 likes

  • Karan Jagtiani's profile picture

    @karanjagtiani04

    Impressive approach! The use of bias sinks for differentiating training data types is clever. How well does it handle varying lighting conditions in the input images?

    1 like

  • 0xLady's profile picture

    @2008_lady

    bro this is actually insane single pic to full 360 expressive head in 2 mins? we eating good in 2025bro this bias sink trick is actually genius entanglement solved in one line of code im stealing this for my next 3d mint legendary work fam

    1 like

  • Lewis N Watson's profile picture

    @LewisNWatson

    woah

    1 like

  • KellyV's profile picture

    @Kellyv_ai

    Great job

    1 like

  • Torsion's profile picture

    @TorsionXL

    This is what Meta should have done

    1 like

  • Andy Wojcicki's profile picture

    @pretendsmarts

    nice flex! 😉

    1 like

  • Himanshu Kumar's profile picture

    @codewithimanshu

    FlexAvatar's transformer model generates a 3D avatar within a processing time of minutes.

  • Risichad 🦾's profile picture

    @Risichad

    Impressive !