Do 3D reconstruction transformers really need a billion parameters,... or are most of those layers just doing the same thing over and over? Introducing Déjà View: a single transformer block, looped K times, that matches or beats models 8–10× its size with lower compute. 🧵show more

What are we doing people, is it just me,... or does the foolery need to stop. What’s the difference than going on a field with an actual base and work on the same thing? Are we creating robots or athletes?show more

How can we use test-time compute for spatial understanding?... 🤔 In InterPose, we propose to repeatedly sample generative video models to help two-view pose estimation and reconstruction, by leveraging the video models' keyframe interpolation abilities. A 🧵... (1/8)show more

Wonderland: Navigating 3D Scenes from a Single Image Contributions:... • First, we introduce a representation for controllable 3D generation by leveraging the generative priors from camera-guided video diffusion models. Unlike image models, video diffusion models are trained on extensive video datasets. This enables them to capture comprehensive spatial relationships within scenes across multiple views and embed a form of "3D awareness" in their latent space, which allows us to maintain 3D consistency in novel view synthesis. • Second, to achieve controllable novel view generation, we empower video models with precise control over specified camera motions. We introduce a novel dual-branch conditioning mechanism that effectively incorporates desired diverse camera trajectories into the video diffusion model. This enables expansion of a single image into a multi-view consistent capture of a 3D scene with precise pose control. • Third, to achieve efficient 3D reconstruction, we directly transform video latents into 3DGS. We propose a novel latent-based large reconstruction model (LaLRM) that lifts video latents to 3D in a feed-forward manner. With this design, during inference, our model directly predicts 3DGS from a single input image, effectively aligning the generation and reconstruction tasks—and bridging image space and 3D space—through the video latent space. Compared with reconstructing scenes from images, the video latent space offers a 256× spatial-temporal reduction while retaining essential and consistent 3D structural details. Such a high degree of compression is crucial, as it allows the LaLRM to handle a wider range of 3D scenes within the reconstruction framework, with the same memory constraints.show more

Create a 3D model from a single image, set... of images or a text prompt in < 1 minute 😮‍💨 This new AI paper called CAT3D shows us that it’ll keep getting easier to produce 3D models from 2D images — whether it’s a sparser real world 3D scan (a few photos instead of hundreds) or your favorite 2D image generator like Midjourney (just an image). How does this magic work? “This architecture is similar to video diffusion models, but with camera pose embeddings for each image instead of time embeddings. The generated views are passed into a robust 3D reconstruction pipeline to create the 3D representation (Zip-NeRF or 3DGS)”show more

🚀 Introducing GenLit – Reformulating Single-Image Relighting as Video... Generation! We leverage video diffusion models to perform realistic near-field relighting from just a single image—No explicit 3D reconstruction or ray tracing required! No intermediate graphics buffers, directly in the pixel space! 📄 Dive into the paper: 🎥 Project page & demos: 🛠 Code coming soon! #GenerativeAI #ComputerVision #Relighting #DiffusionModels #Graphics 🧵 1/5show more

Platysternon megacephalum (or big headed turtle) is a very... odd-shaped turtle with a huge head and a long tail that are almost the same size as its body. [📹 47ruacanhphongthuybmt]show more

Show-o One Single Transformer to Unify Multimodal Understanding and... Generation discuss: We present a unified transformer, i.e., Show-o, that unifies multimodal understanding and generation. Unlike fully autoregressive models, Show-o unifies autoregressive and (discrete) diffusion modeling to adaptively handle inputs and outputs of various and mixed modalities. The unified model flexibly supports a wide range of vision-language tasks including visual question-answering, text-to-image generation, text-guided inpainting/extrapolation, and mixed-modality generation. Across various benchmarks, it demonstrates comparable or superior performance to existing individual models with an equivalent or larger number of parameters tailored for understanding or generation. This significantly highlights its potential as a next-generation foundation model.show more

The US "diet industry" makes over $70 billion a... year... Yet Americans are fatter than ever. Why? They sell you useless fad diets and supplements that don't work. Here are the only 8 diet rules you need for fat loss (bookmark this): 🧵 1. Eat 150g+ of protein a dayshow more

all the parameters (weights and biases) of the same... multilayer perception over 200 epochs red/blue/yellow-three layers The top right knob in each layer being the weightshow more

The US "diet industry" makes over $70 billion a... year... Yet Americans are fatter than ever. Why? They sell you useless fad diets and supplements that don´t work. Here are the only 8 diet rules you need for fat loss (bookmark this): 🧵 1. Eat 150g+ of protein a dayshow more

The rise and fall of popular transformer architectures 📈... One pro of having a lot of transformer architectures implemented in transformers &amp; hosted on the Hugging Face Hub is that one can see the evolution of popularity of different models 👀show more

STEYER: "If you keep doing the same thing over... and over and expecting a different outcome, that's insanity!" Steve Hilton: "Then don't vote Democrat!show more

🚨🚨 The natural beauty of Pashtuns, mashaAllah. No makeup,... no surgery — just a brother and his sisters from a modest family. They do not need jewelry or cosmetic procedures; those whom God has blessed with beauty are never in need of anything artificial.show more

SHES SO SICK OF YALL ASKING HER TO DO... THE SAME THING OVER AND OVER AGAIN LMFAOOOshow more

View of destructive storms hitting downtown Indianapolis from my... third floor. Not sure if those blue flashes are transformers blowing or not #inwxshow more

Self-Calibrating Gaussian Splatting for Large Field of View Reconstruction... Note: Check below for full video. Abstract (cited): "In this paper, we present a self-calibrating framework that jointly optimizes camera parameters, lens distortion, and 3D Gaussian representations, enabling accurate and efficient scene reconstruction. Our technique is particularly effective for high-quality scene reconstruction from large field-of-view (FOV) imagery taken with wide-angle lenses, allowing the scene to be modeled from a smaller number of images. We introduce a novel method for modeling complex lens distortions using a hybrid network that combines invertible residual networks with explicit grids. This design effectively regularizes the optimization process, achieving greater accuracy than conventional camera models. Additionally, we propose a cubemap-based resampling strategy to support large FOV images without sacrificing resolution or introducing distortion artifacts. Our method is compatible with the fast rasterization of Gaussian Splatting, adaptable to a wide variety of camera lens distortions, and demonstrates state-of-the-art performance on both synthetic and real-world datasets."show more

Playing around with a "tunnel gun" that can open... a tunnel in front of you that can be looked into or moved through. This type of thing is really simple in my engine - just spawn an SDF capsule subtraction that is locked to the player's view.show more

CNN Legal Analyst Elie Honig: "Pam Bondi is, without... a question, qualified to be Attorney General. She's been a prosecutor for 20 years in Florida. For 8 of those, she was the Attorney General of the state. That's a very big, very complicated job‚ and that level of experience is on par with, or better than most United States Attorneys General that we've seen over the past 50 years or so."show more

New update drop 🎶 Blaster's beats are taking over!... Download the latest 2.2 update and join the party! #Transformers #Gaming #Blastershow more

INJECT IT 10 BILLION TIMES OVER