Загрузка видео...

Не удалось загрузить видео

На главную

Check out this Stereo4D paper from Google DeepMind. It's a pretty clever approach to a persistent problem in computer vision -- getting good training data for how things move in 3D. The key insight is using VR180 videos -- those stereo fisheye videos we launched back in 2017 for...

67,919 просмотров • 1 год назад •via X (Twitter)

Комментарии: 0

Нет доступных комментариев

Здесь появятся комментарии из оригинального поста

Похожие видео

You can't 3D reconstruct glass from images... ...WRONG! Thanks for video diffusion, now just about anything is possible! Introducing...Diffusion Knows Transparency (DKT) Transparent and reflective objects usually break robot vision and photogrammetry pipelines because they don't follow the "solid object" rules standard cameras expect. DKT is a new AI model that repurposes the "internal physics engine" found in video generation models to solve this problem. Researchers took a massive video diffusion model (WAN) and fine-tuned it using a custom-built synthetic dataset to turn it into a high-precision depth sensor. To train the AI, they built the first massive synthetic video library of transparent objects, 1.32 million frames of perfectly labeled glass and metal objects in motion. Without ever seeing a "real" labeled video of glass during training, the model (DKT) outperformed all previous specialized systems on real-world benchmarks (ClearPose, DREDS). They created a "lightweight" 1.3B parameter version that runs fast enough (0.17s per frame) to be used on actual robot hardware. Two reasons I find this project important: 1. It further proves that synthetic data will be essential for training the next generation vision models. 2. In real-world robotic tests, using DKT's depth maps nearly doubled the success rate of robot arms trying to pick up objects on tricky reflective or translucent surfaces. At home robots will need to interact with these types of objects on a daily basis. Check out the project page here: Code is LIVE! #Computervision #Robotics #AI

Jonathan Stephens

17,712 просмотров • 6 месяцев назад

Two weeks ago I fixed one of my teeth with algorithms I wrote a couple of years ago! I got hooked by 3D scanning when I started to work for a software shop in Zurich that was programming 3D computational geometry algorithms for denture scanning to produce crowns (and more). Back then, a typical reconstruction pipeline was like: scan the patient’s teeth using an intraoral scanner, reconstruct the surface mesh, design the restoration digitally, and finally mill the crown out of ceramic. We were working mostly with point clouds and meshes, but it wasn’t just math, it was craftsmanship translated into a digital process. Every micron mattered. You could literally see how a good algorithm meant a better fit in someone’s mouth. Gaussian Splatting isn’t about surface reconstruction, it’s about appearance reconstruction. It doesn’t care about explicit topology, it captures how light interacts with the scene. In a sense, it’s the opposite philosophy of the dental world: instead of modeling what the object is, it models how the object looks. 3D Gaussian Splatting enables applications like training self driving cars, teaching robots to understand their environment, creating virtual worlds, or monitoring real sites. It represents scenes as millions of small Gaussians rendered in real time without the need for meshes or textures. Coming from a world where precision geometry was everything, this shift felt natural. It’s still about reconstruction, but with a different goal: not manufacturing a perfect object, but reproducing how the world actually looks. Two weeks ago I got my first dental crown, made with the same software, reconstruction algorithms, and Swiss precision I once helped develop. I haven’t worked there in two years, but sitting in that chair and seeing the process from the other side was a proud moment. It reminded me why I love this field.

MrNeRF

289,948 просмотров • 8 месяцев назад

The architecture of this new world model is one of the most interesting things I've seen lately: Let me first explain how most world models work: They predict and render one frame at a time. If you are navigating in one of these worlds, and you look left, the model draws whatever looks right in the moment. Every time you change your viewpoint, the model has to imagine what should be there again, so it's very common for these models to "forget" what's in the world. For example, if you put a toy on the table, look away, then look back, the toy might not be there anymore. Tripo AI is releasing its Project Eden model, which works very differently: The model builds the world first, and then renders it based on that map. That map holds the real state of the world: the geometry, every object, where things are, what's already happened. The picture you see on screen gets generated from the map. This architecture flips the whole thing. Now, you get the following: 1. The world stops forgetting. Leave, come back, and the toy is still on the table because it lives in the map, not in the last frame you saw. 2. You can edit the world, and those changes persist for anyone who enters later. 3. Multiple people and AI agents can coexist in the world and see it from different perspectives. This is early research, but it's looking really promising. They just raised nearly $200M across two rounds to build it out. Tripo will be at SIGGRAPH 2026 (July 19–23, Los Angeles Convention Center). If you work in 3D, embodied AI, simulation, or anything spatial, go connect with them there.

Santiago

30,104 просмотров • 14 дней назад

Depth Any Video with Scalable Synthetic Data AI physicists and chemists continue to make strides in depth estimation from video. Check out this new paper featuring some impressive examples. See the thread for more details (unfortunately no code yet). Abstract: Video depth estimation has long been hindered by the scarcity of consistent and scalable ground truth data, leading to inconsistent and unreliable results. In this paper, we introduce Depth Any Video, a model that tackles the challenge through two key innovations. First, we develop a scalable synthetic data pipeline, capturing real-time video depth data from diverse game environments, yielding 40,000 video clips of 5-second duration, each with precise depth annotations. Second, we leverage the powerful priors of generative video diffusion models to handle real-world videos effectively, integrating advanced techniques such as rotary position encoding and flow matching to further enhance flexibility and efficiency. Unlike previous models, which are limited to fixed-length video sequences, our approach introduces a novel mixed-duration training strategy that handles videos of varying lengths and performs robustly across different frame rates 0 - even on single frames. At inference, we propose a depth interpolation method that enables our model to infer high-resolution video depth across sequences of up to 150 frames. Our model outperforms all previous generative depth models in terms of spatial accuracy and temporal consistency.

MrNeRF

27,428 просмотров • 1 год назад

Hey Kishu Crew, It's been a minute since we dropped a big announcement like this, hasn't it? You all know how much #kishu’s anniversary means to us—it's a day we hold close to our hearts, a day we celebrate with style. And this year is no exception. From its humble beginnings as a fun memecoin, #kishu has grown into something much bigger than we ever imagined. We've carved out a name for ourselves in the wild world of crypto, and boy, what a ride it's been. Sure, there are some new kids on the block now, grabbing attention like we did back in the day. But Kishu? We've earned our stripes. We're the veterans, the OGs—the ones who've seen it all and still stand tall. In crypto, time moves at warp speed. But here we are, three years deep into the game. Not many projects can boast that kind of longevity. We've learned so much along the way—established friendships, partnerships, and overcome obstacles that many others couldn't. Looking back, it's been one hell of a journey, both in the crypto world and beyond. Personally, Kishu has brought us together in ways we never imagined. It's reminded us of what really matters: friendship, health, quality time with loved ones. It's given us a sense of purpose, a sense of belonging—a feeling money can't buy. And on the business side of things? Well, Kishu's been one hell of a teacher. It's shown us that we're stronger than we think, that we can weather any storm that comes our way. We always come out on top. Because as Franklin D. Roosevelt once said, "A smooth sea never made a skilled sailor." So this year, to celebrate our birthday, we've got something special in store for you—a Kishuverse mini game like you've never seen before. Oh, sorry - we meant four games. Kishu, meet GameGPT by Prism—a game changer in every sense of the word. Powered by AI and blockchain technology, it's an AI game builder that puts the power of creation in your hands. Sure sparks some curiosity, doesn't it? It should. Check them out at their website and socials at: For over three years, the team behind GameGPT by PRISM has been hard at work, crafting an AI-powered engine that's revolutionizing the gaming world. And now, they're bringing that same innovation to Kishu! • kishuverse Quest: NFT Odyssey Each game is a love letter to our community, bringing the Kishuverse to life in ways we always dreamt of. So grab your #kishuverse NFTs, dive into the world of GameGPT, and let the adventure begin. And from all of us here at #kishu, a heartfelt thank you for your unwavering support. Here's to another year of making memories and breaking boundaries.❤️ Let's celebrate in style! 🎉

Kishu Inu

38,949 просмотров • 2 лет назад