Tobias Fischer's banner
Tobias Fischer's profile picture

Tobias Fischer

@TobiasFischer11 • 1,025 subscribers

Research Scientist Intern @NVIDIA. PhD student at CVG, @ETH Zurich. Previously @Meta @RealityLabs, @RWTH, @berkeley_ai

Shorts

Do 3D reconstruction transformers really need a billion parameters, or are most of those layers just doing the same thing over and over? Introducing Déjà View: a single transformer block, looped K times, that matches or beats models 8–10× its size with lower compute. 🧵

Do 3D reconstruction transformers really need a billion parameters, or are most of those layers just doing the same thing over and over? Introducing Déjà View: a single transformer block, looped K times, that matches or beats models 8–10× its size with lower compute. 🧵

90,883 views