Want to create an avatar from a single image?
FlexAvatar is a transformer model that creates full 360°, high-quality, and expressive 3D head avatar from just a single portrait image in minutes.
Real-time Demo: FlexAvatar's lightweight architecture allows both animation and rendering in real-time, enabling interactive user experiences. To create a new 3D head avatar, only one image is required, e.g., from a webcam. The final avatar is ready after 2 minutes.
Architecture: Under the hood, FlexAvatar adopts a transformer-based encoder-decoder design. The encoder maps the input image onto a latent avatar space, while the decoder produces 3D Gaussian attribute maps by incorporating the animation signal via cross-attention.
The model learns all facial animations directly from the data without relying on pre-built 3D face models. This equips the avatars with realistic facial expressions.
The internal avatar latent space can be conveniently used to integrate additional observations of a person via fitting. This enables use-cases where more than one image of a person is available, e.g., from a phone scan of the person.
We train jointly on 2D monocular videos and multi-view data. However, in monocular videos, the animation signal leaks the target viewpoint, causing the model to produce incomplete 3D heads. We call this phenomenon entanglement of driving signal and target viewpoint.
To prevent entanglement, we introduce bias sinks. These are learnable tokens that indicate whether a training sample stems from a monocular or a multi-view dataset. During training, the model learns to produce incomplete 3D heads only when the monocular token is present.
During inference, FlexAvatar then always uses the multi-view token for which the model has learned to produce complete 3D heads. This simple design allows to combine the generalizability from monocular data with the quality of multi-view data.
FlexAvatar summary:
- Input: Single-image, phone scan, or monocular video
- Output: Full 360° head avatar
- Expressive animations
- Real-time rendering and animation
- Generalization to any portrait
- Create a new avatar in 2 minutes
- Use bias sinks to combine 2D and 3D data
🏠 🌍
🎥
Great work by Tobias Kirschstein and Simon Giebenhain!
I hope the code or a demo really is coming soon.
We already saw a couple like this and at the end nothing is released.
55 likes
@metadjai •
WOW ✨
22 likes
@karanjagtiani04 •
Impressive approach! The use of bias sinks for differentiating training data types is clever. How well does it handle varying lighting conditions in the input images?
11 like
@2008_lady •
bro this is actually insane
single pic to full 360 expressive head in 2 mins?
we eating good in 2025bro this bias sink trick is actually genius
entanglement solved in one line of code
im stealing this for my next 3d mint
legendary work fam
11 like
@LewisNWatson •
woah
11 like
@Kellyv_ai •
Great job
11 like
@TorsionXL •
This is what Meta should have done
11 like
@pretendsmarts •
nice flex! 😉
11 like
@codewithimanshu •
FlexAvatar's transformer model generates a 3D avatar within a processing time of minutes.