Share our recent work - TrackingWorld: World-centric Monocular 3D... Tracking of Almost All Pixels [NeurIPS'25] An optimization-based 3D tracking of all pixels. Code: Webpage: Welcome to try it! A feedforward version is on the way!show more

SpatialTracker Tracking Any 2D Pixels in 3D Space Recovering... dense and long-range pixel motion in videos is a challenging problem. Part of the difficulty arises from the 3D-to-2D projection process, leading to occlusions and discontinuities in the 2D motion domain.show more

3d world abilities of AI models keep getting better,... this is @Kling_AI 1.5 It can move around a space in 3d and you can steer its camera movements All based on a single input imageshow more

Our map tracking Russia's full-scale invasion of Ukraine has... almost more than 20,000 geolocated videos and photos since 2022. All of the data is interactive and traceable on the map here: 👇show more

hi all, excited to join! i'm building an expressive... mini "shoggoth" robot which will eventually be hooked up to gpt4o realtime voice. i'm currently working on the low-level policies, which are trained in a mujoco simulation with RL. to delay working on raw-pixels for now, i trained a pose-estimation model using deeplabcut and triangulate the position in 3d space using the stereo cameras. eventually, i'll use gpt4o's tool calling capabilities to activate several of these policies (closed and open loop) based on the dialog flow! captions: manual actuation of the tentacle / 3d pose estimation / target designshow more

📢 Our lab has been exploring 3D world models... for years — and we’re thrilled to share **PhysTwin**: a milestone that reconstructs object appearance, geometry, and dynamics from just a few seconds of interaction! Led by the amazing Hanxiao Jiang 👉 PhysTwin combines **Gaussian splatting** with **inverse dynamics optimization** based on simple **spring-mass** systems. ⚙️ The result? Real-time, action-conditioned 3D video prediction under novel interactions (i.e., 3D world models). 🔑 A few key takeaways: 1. Having the right structure (e.g., particles/masses) helps navigate the trade-off between sample efficiency, generalization, and broad applicability. 2. Visual foundation models (VFMs) have matured to the point where they can provide rich supervision for world modeling (e.g., tracking, shape completion). 3. Beyond VFMs, many crucial components have come together in recent years: Gaussian splats for rendering, NVIDIA Warp for high-performance simulation, and scene/asset generation from a wide range of labs and companies. The future of 3D world models is looking bright! ✨ 4. The resulting digital twin supports a wide range of downstream applications—especially in data generation and policy evaluation, thanks to its realistic rendering and simulation capabilities. 🎥 All code and data to reproduce the results, along with interactive demos, are available on the website. Check the following visualizations of: (1) observations, (2) reconstructed state/actions, (3) interactive digital twins, and (4) the overlays between real-world robot teleoperation and our model’s open-loop predictions.show more

Finally... A Tracking system that is similar to Vbridger... for 3D vtuber Luwke developed this Vbridger-adjacent system for 3D Vtuber and taught me It shares the same principles of Vbridger, which allow for a more custom look and get even closer to its 2D counterpart #ShylilyArtshow more

2025 is year of 3D AI Rodin AI 1.5... now can not only generate 3D model with clean meshes but also create high quality textures You can export all the models to 3D software to create a new worldshow more

Gaussian splats don't simulate light. They capture it. I... took one photograph of this room and generated it as a fully walkable 3D world in Mint. The volumetric rays, the shadow play on the rug, all preserved. This is what real-time 3D is becomingshow more

Just switch to Grok 3 from o1. Grok clearly... outperforms o1 in understanding the 3D world based on images. 3D scene generation just got a massive boost! 🎮🔥 The future of AI gaming is about to change forever. 🚀 #AI #Gaming #Grok #3D #GenerativeAIshow more

oh my.. this is over for developers Gemini 3... can create interactive 3D webpage in mins, just a few simple text prompts, it generates all the code you can control millions of particles with your hands and make them form any shape you want tutorial and prompts below:show more

Static 3D generation isn't enough. We need assets ready... for animation. Our new #SIGGRAPH work, AniGen, takes a single image and generates the 3D shape, skeleton, and skinning weights all at once. Code is fully open-sourced! Kudos to Yihua and VAST AI Research 🧵(1/4)show more

🚀🌍🚀 Echo-2 is live! It generates high-quality physically grounded... 3D scenes instead of just pixels. Check out the open demo to create and explore worlds in real-time! I gave it a picture from my Himalayas trek—it handles the massive scale range really well! 🏔️🌍show more

Charity powered by Web3SlashPlace People have lost everything and... are suffering from the horrible floods in Northern Thailand. 🆘 Andrew and his girlfriend went to the temple to donate food, water, clothes, etc. Once enough funds are raised Andrew plans on going directly to the northern Thai/Myanmar border to help the people suffering from the civil war in Myanmar and others suffering from the floods as well. 💚 During this evenings space we will have a discount on pixels for Web3SlashPlace where any amount of pixels purchased in SOL, ETH, and/or MATIC will be doubled! So for example, if you buy 100 pixels we will airdrop an additional 100 pixels to you manually after the space.▫️ 20% of all funds raised through Web3SlashPlace will go directly to people who need it most. We have ensured the donations today are going to those in need directly through a friend of ours who is doing more hands on work to help the tens of thousands of people (or more) effected by these floods. 🇹🇭show more

I'll be opening 3D Vtuber commissions on the 30th... of this month (bear in mind this could be subject to change) in the meantime I'll work on redoing some renders for my 3D vtuber portfolio. Here is a vid to give you an idea of my work. If interested feel free to dm me! 👍show more

Meta releases VGGSfM Visual Geometry Grounded Deep Structure From... Motion Structure-from-motion (SfM) is a long-standing problem in the computer vision community, which aims to reconstruct the camera poses and 3D structure of a scene from a set of unconstrained 2D images. Classical frameworks solve this problem in an incremental manner by detecting and matching keypoints, registering images, triangulating 3D points, and conducting bundle adjustment. Recent research efforts have predominantly revolved around harnessing the power of deep learning techniques to enhance specific elements (e.g., keypoint matching), but are still based on the original, non-differentiable pipeline. Instead, we propose a new deep SfM pipeline VGGSfM, where each component is fully differentiable and thus can be trained in an end-to-end manner. To this end, we introduce new mechanisms and simplifications. First, we build on recent advances in deep 2D point tracking to extract reliable pixel-accurate tracks, which eliminates the need for chaining pairwise matches. Furthermore, we recover all cameras simultaneously based on the image and track features instead of gradually registering cameras. Finally, we optimise the cameras and triangulate 3D points via a differentiable bundle adjustment layer. We attain state-of-the-art performance on three popular datasets, CO3D, IMC Phototourism, and ETH3D.show more

This isn’t a 3D model thrown in a box.... This is pure code. No Blender, no Maya, no shortcuts. Every voxel, every jump, every movement scripted from scratch. Generative art at this level means thinking like a designer, a coder, and an artist all at once. It’s not about placing pixels. It’s about writing the rules of how a frog should exist in the Bitcoin chain. BLOCKFROGS isn’t just generative. It’s engineered. Be part of this experience Wl = 2 Freemints 5 WL to snatch Post or Quote about BLOCK | Frogs | Panthers Drop the linkshow more

Code LLaMA is now on Perplexity’s LLaMa Chat! Try... asking it to write a function for you, or explain a code snippet: 🔗 This is the fastest way to try AI at Meta’s latest code-specialized LLM. With our model deployment expertise, we are able to provide you with this model less than 24 hours of it’s release. What’s next? We’ll integrate code LLaMA into Perplexity, all in service of providing you with the best answers to your most technical questions!show more

There is a volcano erupting in Hawaii, but because... of the government shutdown the agency tasked with tracking it hasn’t been able to share the news on social media. 🌋 Fortunately no one is in danger. ⚠️show more

🌀 #Live3D #Live2D #Live2DWIP 🌀 Today, I’d like to... share two of the three methods I use to create joint twisting in my Live2D-based 2D Pseudo-3D concept. On the right is the Glue Joint： The basic idea is to use Glue to connect two pseudo-3D ArtMeshes. By taking advantage of Glue’s weight settings, it can create an effect similar to a 3D joint. Once the weights are set up, it can move very freely with a relatively low amount of work. However, it also shares the same weakness as 3D joints: when rotated at large angles, it can produce unpleasant twisting and distortion. On the left is the Hand-Bent Joint： The basic idea is to add bending Keyforms directly to a Warp Deformer, then manually sculpt the ideal deformation. This method can create the most detailed and refined joints, depending entirely on how the rigger designs them. The downside is that it requires much more work. Every additional degree of freedom requires a significant amount of manual adjustment. These two joint methods have almost opposite characteristics, so in actual Live3D work, I choose the most suitable method depending on the situation. For example, in this hand model, I used Hand-Bent Joints for the arm twisting and fingers, while the wrist uses a Glue Joint.✨show more