Tobias Fischer's banner
Tobias Fischer's profile picture

Tobias Fischer

@TobiasFischer11 • 1,031 subscribers

Researcher @Apple 3DV. PhD from CVG, @ETH Zurich. Previously @NVIDIA, @Meta @RealityLabs, @RWTH, @berkeley_ai

Shorts

Do 3D reconstruction transformers really need a billion parameters, or are most of those layers just doing the same thing over and over? Introducing Déjà View: a single transformer block, looped K times, that matches or beats models 8–10× its size with lower compute. 🧵

Do 3D reconstruction transformers really need a billion parameters, or are most of those layers just doing the same thing over and over? Introducing Déjà View: a single transformer block, looped K times, that matches or beats models 8–10× its size with lower compute. 🧵

92,921 Aufrufe