Loading video...

Video Failed to Load

Go Home

Colmap 4.0 was very recently released, so it inspired me to do some work to better understand it and its new capabilities with Rerun. I want to really understand how Colmap, and in particular, pycolmap, works outside of just calling it via the CLI. So my goal is to...

30,070 views • 5 months ago •via X (Twitter)

0 Comments

No comments available

Comments from the original post will appear here

Related Videos

Jacob Tierney discusses his process for writing Heated Rivalry and outlining season two: "The book [Heated Rivalry] is in five parts and very quickly I was like, part one, episode one. Part two, episode two. It was very clear to me. …So in this case, I actually did not outline. Because I was just using these parts of this book, and I knew these books so well at this point. Something that I did, and that I'm trying to do again now when I'm writing the new season, is I'm trying to use—Because there's a dreaminess to this show, I try to use my memory as a guide. I'm like, what do I remember? And then I try to give primacy to the stuff that I remember and that has stuck in my brain all these years with this story. So I’m like, oh I have to do that! And that's a nice way for me to kind of center things. Where if I have to do that, then it means maybe I don't have to do this, and it maybe means I want to combine or collapse different things. Because if this is going to take up—If one incident that I'm thinking of is going to take up the space in an episode that I think of as the heart, …then you don't need to do a first version of it in the same way, you know? Little things like that. That being said, for this season because I'm working with a co-writer as well, we have outlined everything. And every time, I do approach outlining like a teenager, where I'm like, [modulates voice] I don't want to. But then when I do it, I'm always like, why don't I always do this? It makes everything so much easier. So I kind of gaslight myself in that way." ✍🏼 transcription via Heated Rivalry News & Updates. Please credit if reposting. 🗣️ quote via q&a with Stage 32 on March 24, 2026. 🔗

Heated Rivalry News & Updates

60,684 views • 5 months ago

There's been a few cool updates recently. In particular, Rerun 0.33 released headless rendering. This, along with the Fable 5 release pushed me to work torwards making MAMMA realtime! I threw Fable at the problem, and it was able to take original implementation that was ~12 seconds / frame and get it all the way down to 40ms /frame, or nearly a 300x speedup 🏎️ How did I achieve this? TLDR: - Use rerun's headless rendering as supervision when optimizing - Save rrd file as test fixture to guide model optiziation with /goal - create an html artifact with headless rendering to provide detailed breakdown of what it did and how it actually looks like in the viewer There were a few critical bits to make sure that this ACTUALLY worked and that Fable didn't just cheat or delete something and declare victory. The first is that the original version used Rerun, this allowed us to save things to disk as an RRD file, meaning we could query the contents and use this as a sort of test fixture or golden artifact that held EXACTLY what all of the values should be. Then we can use this with /goal as a metric when doing the optimization to ensure there are no regressions. The second bit is the headless rendering, this gave us the ability to check that not only did the test fixture pass, but it also looked visually correct. This made a huge difference, and an awesome side affect of it is that we can use the headless rendering to create an implementations.html file. This gives a visual guide as to what the agent did (I walk through it in the video below) Along with this, we're working on an MCP server for rerun that allows full interactivity with the rerun viewer for your agent. So for example the agent can click, drag, move views, scroll timelines, ect. I used this to help the agent debug certain parts such as when the 2d sam masks didn't line up, or if the triangulated keypoints werent correctly matching with the optimized mesh. The agents could go, click into the view, scroll through the timeline and see where things went wrong. Fable + Headless Rendering + Rerun MCP == 300x speedup in less then a days work With these new tools, I'm planning on going back to my gaussian splatting implemntation and cleaning it up + making it fast!

Pablo Vela

22,880 views • 3 months ago

I've been on a SLAM/SFM kick. It's one of the more underexplored and lacking areas when it comes to human teleop/data collections, so I've brought over Deep Patch Visual Odometry/SLAM to Rerun and Gradio. With this example, we now have 1. pycuvslam 2. pycolmap/glomap 3. mast3r-slam 4. dpvo/slam all integrated into rerun. The question becomes, which method should be used in what situations? They all make different trade-offs with different camera requirements and throughput/accuracy. What about when a new method comes out? Now that I have several different methods, I plan to use VSLAM-LAB for evaluation. It uses prefix.dev to isolate all the dependencies of each of these methods and easily compare them against each other. In particular, I'll be converting the data preprocessing, algorithm outputs, and evaluation into rerun recordings (rrd files). This will allow both programmatic querying of anything stored in the files (which method had the highest ATE-to-FPS ratio? Which dataset/sequence caused the most difficulty? etc. etc.), all with easy visual inspection using the rerun server to link them all together. Another really important side effect of this is how it impacts agents. As Karpathy said ``` LLMs are exceptionally good at looping until they meet specific goals, and this is where most of the "feel the AGI" magic is to be found. Don't tell it what to do, give it success criteria, and watch it go. ``` by having accuracy and throughput metrics deeply tied with human inspectable artifacts. One can really accelerate agentic development with an actual understanding of how the method/data performs. I think this is another killer use case that I'll be really leaning into to make ingestion of new datasets/methods trivial with an agent. I'm making it my mission for folks to understand that rerun as a visualization tool only scratches the surface of what its true benefit is. Deep integration between data and visuals, with powerful query capabilities. I'll be focusing on the SLAM use case first and then bringing this into the full egocentric/exocentric data collection domain!

Pablo Vela

41,277 views • 5 months ago

🚨 🗣 Mikel Arteta on the decision to award Sunderland a penalty: "Look, the first question we have to discuss is that this is NOT ACCEPTABLE at this level. "It was a beautiful game of football, with two teams and an atmosphere in the stadium that was unbelievable, with Sunderland they are so organised; they are so good in so many phases, they have great players, they created a lot of issues we had to cope with. "We had to cope with all of that, it was a lot in a really difficult week after Chelsea and Napoli, and on top of that we have to go through what we've done today that in my opinion is NOT ACCEPTABLE. "I watched it 20 times, and I CANNOT find a way to understand how they even think to give a penalty in that situation, or the way the VAR has to intervene. "So I don't know what to think, but I'm SAD that we have to discuss in such a beautiful game something at this level that has the gravity of that, because that CHANGES the course of the season and can cost you the championship. "At this level, with all the work that we put in, this cannot happen. I cannot find an explanation - that's why I'm going to try and find an explanation now. "I want to be talking about how good we were, how good Sunderland were, and the level of the league and how beautiful this is - we should not be talking about that. "I cannot find an explanation - that's why I'm going to try and find an explanation now." 🗣️ On a very important victory: "I want to be talking about how good we were, how good Sunderland were, and the level of the league and how beautiful this is - we should not be talking about [refereeing decisions]." 🗣️ on whether the referee gave an explanation: No! (shakes head)

Connor Humm

84,294 views • 5 days ago

Now that I am home and have access to my files I decided to do a quick test with one of my Vtubing avatars. It works way better with my larger iPad Pro (less crashing/more memory and more screen space) compared to the mini so I did want to bring that up. Importing the file over as GLB was more stable than just OBJ plus it kept the color info from the previous texture. I texture all my avatars on substance painter but have been looking at an alternative when I am out and about that is not on the computer and this actually hits all the right "wants". Adding a quick video of the way the app works for me. I like that it has layers, I can alter my brushes and even add stabilization when I am drawing (which I use that extensively on procreate so that was a huge plus). The stamp tools will come in handy as well but did not show it on this video. The file itself is imported as "one mesh" but each part is treated as their own separate piece which I show in the video. I do the same thing on substance painter making it really easy for me to texture. The app then exports the texture out for each object which is the same way I do so on substance. Overall I am extremely impressed with the work Sparseal has done on this application and see how useful this will be for my current work flow of texturing. I for one love the ability to be "portable" which is a big reason I sculpt so much with Nomad Sculpt on the iPad. Having the freedom to do your work away from a desk and if you feel like doing it outside is probable why I yearn for iPad apps so much like so. Give this app a look, it is free to try on the App Store (It is $19 to be able to export, but a one time buy). It is called "Wafer" for the iPad. I already use CozyBlanket from the same creator to do re topology so I expected this level of fantastic with this current app.

Val / LatinVixen ➡️ Megaplex

17,469 views • 6 months ago

Peter Thiel gave a speech in a Hilton in 2010 that holds the keys to unlocking the source of many of America’s most severe problems. Key quote: “The task in this world… where politics has become so broken… is to find a way to escape from it. It’s not a way to fix it.” Palantir is currently tightening its grip around all of our data. Elon Musk is diverting untold billions into a Mars fantasy. All of the anarchist, antidemocratic ideas of the PayPal Mafia and the “Dark Enlightenment”—to use technology as an “escape”—were already well in process 15 years ago. —The internet as “alternate virtual reality” so you don’t have to “constantly convince people.” This is why he funded Satoshi (Bitcoin), MAGA3X (Pizzagate, Q), and pushed Musk to buy Twitter —PayPal (now blockchain/crypto/BTC) was to “overturn the monetary system” —“Escape” now more often referred to as “exit” —“Autonomous countries” now known as the “network state” JD Vance is a full member of the cult of the broligarchs. Unfortunately, this has been a very thorough coup and they have backup. It’s worth really absorbing what the living Antichrist, Peter Thiel, is saying here: “I don't think despair is the only answer. And I don't think, and it's because I don't think politics is the only way to go. And my thinking on this, you know, started to take a turn towards a more optimistic perspective in the mid to late '90s when I got involved in the tech boom in Silicon Valley. I ended up being the co-founder of a company called PayPal where -- and the initial founding vision was that we were going to use technology to change the whole world and basically overturn on the monetary system of the world. And, you know, we can debate on how much it succeeded or how little it succeeded. And there were parts of it that I think have worked, and parts of it were, you know, the jury is still out. But the basic idea was that we could never win an election on getting certain things. Because we were in such a small minority. But maybe you could actually unilaterally change the world without having to constantly convince people and beg people and plead with people who are never going to agree with you through a technological means. And this is where I think technology is this incredible alternative to politics. And, you know, there are a number of different technologies we can outline, but the task in this world where politics has become so broken and so dysfunctional is to find a way to escape from it. It's not a way to fix it. It is a way to escape. And there are, you know, a number of different options. I think the promising one of the 1990s and this last decade has been to escape onto the Internet and to sort of create an alternate virtual reality. Questions, of course, is still how does it intersect with the real world? There are, I think, escaping to outer space is a promise, although I think the space technology is not quite there. So I think that's sort of for the second half of the 21st century. I think we can try to, you know, create autonomous countries on oceans, underwater, all sorts of other spaces. But I think technology is the vehicle for how we should be looking to escape and move beyond politics as we find it today.”

Jim Stewartson, Decelerationist 🇨🇦🇺🇦🇺🇸

156,800 views • 1 year ago

Most people think Rerun is a visualization tool. In reality, it's a database masquerading as a visualizer. I wanted to showcase this functionality by building a full data pipeline consisting of: ingestion → baseline method → eval → finetuning for SLAM on egocentric data. I'll eventually extend this to the rest of my ego/exo datasets, but I wanted to start with a smaller bunch of datasets first. Rerun allows you to expose your saved .rrd files to a catalog where you store datasets. You can query, filter, and join them like any database using DataFusion under the hood. These are the same .rrd files that are automatically generated whenever you visualize anything in Rerun and decide to save it to disk. I brought in 109 VSLAM-LAB sequences across 14 datasets into the Rerun catalog as an example. These include 7Scenes, Euroc, eth3d, and others. Now I can query them with segment_table, filter_segments, and filter_contents instead of parsing CSVs and YAML files. With a strong set of ground-truth datasets for SLAM, baseline additions become nearly automatic with agents like Opus/Codex. This unification of data and visualization is imo the largest missing part for Physical AI. Visualization becomes a natural byproduct of having your data properly structured and queryable. The catalog API is what makes it a database, not just a viewer. I initially focused on VSLAM-LAB data, but I'll migrate all the egoexo data to this format in the coming days to really show just how useful this is.

Pablo Vela

35,179 views • 4 months ago

.Elon Musk (worth $250B) answers why he’s still working: I think it's a good question you asked, because it goes to, like, at a foundational level, what is my philosophy, and why does it lead to this conclusion? So the reason is that when I was a teenager, I had, like, an existential crisis to try to figure out what's the meaning of life. There doesn't seem to be any meaning. For me, at least the religious texts, and I read all of them that I could get my hands on did not seem convincing. Then I started reading the philosophers. Be careful of reading German philosophers as a teenager. It's definitely not going to help with your depression. So reading Schopenhauer, Nietzsche, as an adult, it's much more manageable. But as a kid, you're like, “Whoa.” So then I was like, “Man, I'm just struggling to find meaning in life here.” And then I read Hitchhiker's Guide to the Galaxy. And basically what Douglas Adams was saying is that we don't really know what the right questions are to ask. The question is not, “What's the meaning of life?” In The Hitchiker's Guide to the Galaxy, Earth it turns out is a big computer, and its goal is to answer the question, “What's the meaning of life?” And Earth comes up with the answer “42”. This is where the 42 number comes from. And 420 is just ten times 42. In that book, which is really sort of a book about, it's an existential philosophy book disguised as humor. They come to the conclusion that, no, the real problem is trying to formulate the question. And to really have the right question, you need a much bigger computer than Earth. And so maybe one way, I think, of characterizing this would be to say, “The universe is the answer. What is the question? Or what are the questions?” The more we can expand the scope and scale of consciousness, the better we can understand what questions to ask about the answer that is the universe. The more we can expand consciousness, become a multi-planet species, ultimately a multistellar species… we have a chance of figuring out what the hell is going on. And so this is why I think we should have more humans and both biological and digital consciousness. And why we should become a multi-planet species and a multistellar species is so that we can understand the nature of the universe. And then in order for that to occur, then we have to make sure that things are good on Earth. We don't want Earth to disappear, so sustainable energy is important.

Arjun Khemani

15,600,131 views • 2 years ago

When I saw the mask "Tribes of the Calf" from Kanbas I knew I had to make it into reality. The jewelry and gold really made it stand out for me. Since Sam Spratt's The Masquerade was revealed, I have been spending time sculpting and dissecting the mask to recreate it in 3D as faithfully as possible. I delved into the creation of this mask for many reasons. I love a good challenge and this mask surely was one for me. Creating something in 3D from a 2D image is not easy, and especially when the source has generative nature, some stuff is hard to interpret, but I tried my best to make sure the visual integrity of the mask is as close to the original as possible. Splitting the whole mask into parts, filling the missing pieces so I can build the textures was quite a lot of work. I tried to present the mask in my own style with a slightly different colorway to adapt to the mask itself. Please enjoy this short animation, and turn on sound🔊 This piece is my statement that I am here to stay. That I have a voice that often feels being lost in the void. That I have been creating and posting digital art for over 20 years now and will continue until I'm gone. I have a story to tell and I want to be heard. The space we have here is small, and is shrinking day by day. It doesn't have to be like that. We need to support each other and push ourselves and people here, otherwise we are all doomed. As Kanbas has put in their observation of the mask: "Inspirational. Emotional. Natural." This is what our space can be, and this is me making a statement with this homage. I will share a 4k still below as well as a short video showing the 3D GLB interactive model together with a yt link to the 4k video since compression here is pretty bad.

shoneec

17,894 views • 1 year ago

NEW🚨 Joe Lonsdale on Flock cameras: "The core of our Constitution is that we have to check our government; we have to watch it. [But] turning Flock off is just anti-civilization. It's going to help the criminals, which is what the far left wants here. There are ways we can use technology competently to both watch the watchers... and catch the bad guys." Will Cain: I just had the Texas Attorney General, Ken Paxton, in here in my studio. And as he was walking out, I said: Hey, what do you think of Flock? And he said to me: You know what? I'm really concerned because I don't like that kind of power in the hands of the government. Of course, I want to enforce the law, but I don't like the idea of the government having that kind of surveillance over average Americans. We know what they've done with that information in the past. Joe Lonsdale: I'm a supporter of the American Founders as well, and our whole Constitution was about checking the power of the government. So I think it's a healthy instinct for people on both sides to want to be suspicious, to want to watch the watchers. And we have to do that. But I'm also on the side of civilization. I have six young children, and this technology has caught hundreds of thousands of criminals. It's exonerated huge numbers of innocent people. And there are ways we can use technology competently to both watch the watchers to delete data you're not allowed to see and catch the bad guys... Will: All right, then last to you, Joe. The problem is, if you and I could agree and we probably can, this has some really valuable applications. We're catching kidnappers... They caught the Brown shooter... When is the government ever stopped at a narrow, good application? It grows and it always gets malignant. Joe: I one hundred percent agree that the core of our Constitution and our society is that we have to check our government, we have to watch it. We have to have rules to limit how they use these things. And it turns out the technology, if you're competent, if you have common sense, you could put those restrictions and everyone in the public should have a right to see how it was used. I'm totally fine with that, by the way. I'm not okay with the Flock camera getting me in trouble for jaywalking because that's B.S.. I think it should only be crimes with serious victims. I don't want to be watched either. None of us do. But if this is going to be able to save hundreds of thousands of people, and it's going to be able to protect innocent, exonerate people, obviously you want to be able to catch the bad guys. We had a case in Austin recently where I live where someone was not caught because they turned off all the cameras until they drove into a town nearby after a horrible crime that happened to have Flock. I think we can have a compromise where we watch the watchers... But I think turning it off is just anti-civilization. And it's going to help the criminals, which is what the far left wants here. Will Cain The Will Cain Show

American Optimist

65,431 views • 1 month ago