Loading video...

Video Failed to Load

Go Home

There's been a few cool updates recently. In particular, Rerun 0.33 released headless rendering. This, along with the Fable 5 release pushed me to work torwards making MAMMA realtime! I threw Fable at the problem, and it was able to take original implementation that was ~12 seconds / frame...

10,338 views • 1 month ago •via X (Twitter)

0 Comments

No comments available

Comments from the original post will appear here

Related Videos

Colmap 4.0 was very recently released, so it inspired me to do some work to better understand it and its new capabilities with Rerun. I want to really understand how Colmap, and in particular, pycolmap, works outside of just calling it via the CLI. So my goal is to use the low-level pycolmap API to log every part of the pipeline. The explicit goal is to have an alternative to the SQLite database that I can utilize. Instead of SQLite, I want to try logging everything directly to rerun and use RRD. This means I can have deep inspectability and still save the features/matches/2D view geometry, but be able to view it directly in rerun. I think this is one of the superpowers that rerun provides; data and visualizations are deeply integrated. As I'm often working with sequential data (videos), I'm going to specifically focus on four things: 1. Monocular Video Simple: Calls high-level APIs such as pycolmap.extract_features, pycolmap.match_sequential, pycolmap.incremental_mapping. These are basically identical to the CLI options and provide a good baseline. 2. Monocular Video Streamed: Take the above high-level APIs and break them down to their iterator version, logging each component in a streamed manner. This way, I can stream the intermediate features to rerun while the extraction/matching/mapping is happening. 3. Rig with unknown calibration: <- WHAT THE VIDEO SHOWS This is probably the most interesting version and the first one I've been working on. It allows one to set a rig between known sensors, such as in VR/AR devices, leading to much better reconstructions with multiple cameras. This is the case where we don't know the calibration a priori, so we have to run a reconstruction twice: once as a normal Colmap reconstruction with no rig constraints, use this to generate the constraints, and then do it again with the newly found rig. 4. Rig with known calibration: This is the RoboCap example, where we have a pre-calibrated set of sensors, so we don't need to run the two reconstructions and also gain better matching between cameras, both spatially and temporally. Again, this leads to a much better reconstruction! Along with all this, GLOMAP has become a first-class global mapper, making it super easy to use directly within pycolmap! I'm excited to do more with this and compare it to things like pycuvslam, vipe, and other alternatives.

Pablo Vela

30,070 views • 3 months ago

I asked Garry Tan how to use meta prompting to get better at AI: "My partners at YC Jared Friedman and Pete Koomen showed me how to do this. You can take almost anything that you do all the time and just drop it into a context window. And then say, “Here’s a bunch of inputs and outputs." And maybe you also add a bunch of notes. And then you tell it, “Write me a prompt that can act as an agent that takes this input and makes this output over here.” You can do this for almost any type of knowledge work. And you can even introspect. "What are things you notice that I did to convert this from the input to the output?”. And then you can just start using the prompt. Initially, it’s going to suck. Because it’s just not that smart yet. But what’s funny is now, I also use it to Iterate my writing. You can be very direct, "I would never say that", "Don’t say it like this", or "Oh, you used the long word there, use the short word". Just speak to it conversationally. And then when you're happy with the output, you can use that new output to make a new prompt. "Based on this conversation, give me a better initial prompt that incorporates all the things we talked about." And you can do this with literally everything. And in theory, there’s so much it applies to that people do day-to-day. You could use it for tweets. You could use it for editing podcasts. You can use it for pretty much everything. I have a folder of prompts that I use all the time. My YouTube prompt is on v27 or something. I'll go through this process with all the different max models. I'll use GPT 5.2 Pro. I’ll use Grok. I'll use Claude. Then, I’ll take all the outputs from all the models and put them into Claude and say "Here’s my prompt, here’s the output from four LLMs, including yourself. Rate each response and tell me what the pros and cons of each approach are." And I usually say "give it to me in numbered form". And then you can agree with one, disagree with two, tell it three is this or that. And then after that, you say given all of this, synthesize it."

The Peel

51,632 views • 4 months ago

The same kinds of productivity gains we've seen in coding with AI agents are heading to the rest of knowledge work. This is the jump when you go from having a chatbot to being able to actually have an agent go off and do work for minutes or even hours and come back with a complete work output that you then review. Here's an example of the new Box Agent filling out an RFP response from an existing knowledge base. This process would normally take hours to fill out, and requires the full attention of the user doing the work. Now, you provide the Box Agent with the RFP questions, and it will go off, make a plan, extract all the relevant questions, read through existing source material to come up with an answer, and then generate a new word document as the final output. All while you're doing something else. The key to this architecture is that the agent is able to use all of the same tools in the background that a user uses to get work done. The agent can search for documents, read entire files, run scripts and tools in the background, and even be able to write code on the fly to automate tasks it hasn't seen before. And best of all, the Box Agent will (soon) work from the Box MCP and CLI so you can invoke it in any agentic system as a step in a process. This kind of agent complexity would have been impossible even 6 months ago. Models consistently failed at tracking long running tasks or using the right tools at the right moment for the task. But this is all now possible because of models like GPT-5.4, Opus 4.6, and Gemini 3, and is only getting better by the month. Just as we moved from engineers writing code and using AI as an assistant to answer questions, in many areas of knowledge work -like legal, finance, consulting, sales, marketing, and more- when we have a problem we'll just kick off the AI agent to just go work on it for us in the background.

Aaron Levie

24,618 views • 3 months ago

Jacob Tierney discusses his process for writing Heated Rivalry and outlining season two: "The book [Heated Rivalry] is in five parts and very quickly I was like, part one, episode one. Part two, episode two. It was very clear to me. …So in this case, I actually did not outline. Because I was just using these parts of this book, and I knew these books so well at this point. Something that I did, and that I'm trying to do again now when I'm writing the new season, is I'm trying to use—Because there's a dreaminess to this show, I try to use my memory as a guide. I'm like, what do I remember? And then I try to give primacy to the stuff that I remember and that has stuck in my brain all these years with this story. So I’m like, oh I have to do that! And that's a nice way for me to kind of center things. Where if I have to do that, then it means maybe I don't have to do this, and it maybe means I want to combine or collapse different things. Because if this is going to take up—If one incident that I'm thinking of is going to take up the space in an episode that I think of as the heart, …then you don't need to do a first version of it in the same way, you know? Little things like that. That being said, for this season because I'm working with a co-writer as well, we have outlined everything. And every time, I do approach outlining like a teenager, where I'm like, [modulates voice] I don't want to. But then when I do it, I'm always like, why don't I always do this? It makes everything so much easier. So I kind of gaslight myself in that way." ✍🏼 transcription via Heated Rivalry News & Updates. Please credit if reposting. 🗣️ quote via q&a with Stage 32 on March 24, 2026. 🔗

Heated Rivalry News & Updates

60,684 views • 3 months ago

Google DeepMind CEO Demis Hassabis on "leaving AI in the lab for longer” (full question + answer in the video as I've seen him misquoted). Here's what he said: "For me, the best use case of AI was to improve human health and accelerate scientific discovery..." "Given how important AGI is and how transformative a technology is, maybe the most transformative one in human history, I thought it would be best to approach the sort of latter stages of building it, which we're in now, using the scientific method, very carefully, very precisely, very thoughtfully, and rigorously with all the best scientists, in my ideal world, collaborating on in CERN-like effort, on making sure each step we understood each step each as we got to the final goal of, of building AGI.... "While we're building AGI in this careful scientific way, humanity could benefit from the proceeds of that, like cures for cancer, or maybe new energy sources or new materials… “Looking at this from 20, 30 years ago when I started out on all of this, that would have been the ideal way for it to play out, in my opinion. “Now, it didn't happen like that because technology's unpredictable and in fact, it turns out that things like language were a lot easier than we were all expecting… “We were sort of playing around with that, so were the other leading labs, but of course with ChatGPT and fair play to OpenAI, they scaled it and then they put it out there. “And I think even they say it was kind of a research experiment. They didn't realize it would go so viral. And I think none of us did and we had sort of fairly equivalent systems at the time… “Now, the downside of it is, we're in this sort of ferocious commercial pressure race that everyone's sort of locked into currently. “And then on top of that, there's geopolitical issues like the US-China race and so on. So there's sort of multiple levels of pressure to sort of move fast. So the benefit of that, of course, you get faster progress, obviously. The progress is just at lightning speed these days. So that's good for all the good use cases. The second benefit is that everybody, all of the viewers out there, everyone, you're all getting to use the most cutting edge AI technology, perhaps only three to six months behind what is actually in the labs. So that's kind of mind blowing. “It's also great because I think it gives everyone a feeling for, it's democratizing AI. It's giving everyone a feeling for what it's like to interact with cutting edge AI and what it can do and what it can't do… “So I think there's positives and negatives about the way it's gone. It's not the way I dreamed about years ago where we would be sort of contemplating this philosophically and carefully considering each next step. We're not in that world. And I'm, although I'm a scientist first and foremost, I'm also a pragmatic engineer. So, we have to deal with the world as we find it and make the best of that. And we try to do that by advancing the frontier, but also trying to be as responsible as we can with doing that as we deploy these, you know, very powerful technologies, like Gemini and Alphafold.”

Cleo Abram

64,840 views • 3 months ago

I've been on a SLAM/SFM kick. It's one of the more underexplored and lacking areas when it comes to human teleop/data collections, so I've brought over Deep Patch Visual Odometry/SLAM to Rerun and Gradio. With this example, we now have 1. pycuvslam 2. pycolmap/glomap 3. mast3r-slam 4. dpvo/slam all integrated into rerun. The question becomes, which method should be used in what situations? They all make different trade-offs with different camera requirements and throughput/accuracy. What about when a new method comes out? Now that I have several different methods, I plan to use VSLAM-LAB for evaluation. It uses prefix.dev to isolate all the dependencies of each of these methods and easily compare them against each other. In particular, I'll be converting the data preprocessing, algorithm outputs, and evaluation into rerun recordings (rrd files). This will allow both programmatic querying of anything stored in the files (which method had the highest ATE-to-FPS ratio? Which dataset/sequence caused the most difficulty? etc. etc.), all with easy visual inspection using the rerun server to link them all together. Another really important side effect of this is how it impacts agents. As Karpathy said ``` LLMs are exceptionally good at looping until they meet specific goals, and this is where most of the "feel the AGI" magic is to be found. Don't tell it what to do, give it success criteria, and watch it go. ``` by having accuracy and throughput metrics deeply tied with human inspectable artifacts. One can really accelerate agentic development with an actual understanding of how the method/data performs. I think this is another killer use case that I'll be really leaning into to make ingestion of new datasets/methods trivial with an agent. I'm making it my mission for folks to understand that rerun as a visualization tool only scratches the surface of what its true benefit is. Deep integration between data and visuals, with powerful query capabilities. I'll be focusing on the SLAM use case first and then bringing this into the full egocentric/exocentric data collection domain!

Pablo Vela

40,864 views • 2 months ago

What does the reputation model look like for agents? (alpha leak below) And how do we associate the proofs that we have about human beings with the agents who represent them? You may have heard of a process called KYC or Know Your Customer. That's very common with traditional financial applications and services. We have introduced a concept that we call KYA or Know Your Agent, which is a structured way to be able to express what model, how data was used in training, who the deployer is, what entities this agent instance is accountable back to, providing not only provenance but identity of the associated organization or entity. That's also another root of trust that we think about a lot: Enterprises and organizations tied back to things like their domains. To share a little bit of an alpha leak here, a product that we're excited to be rolling out in the next few weeks will allow our enterprise partners to more easily verify and prove the traits and capabilities of their teams as well as their counterparties. On the agent front, that makes it really easy to prove that an agent is acting on behalf of a given business or entity. We've already seen lawsuits where the absence of such technology has been a huge risk, such as with airlines that incorporate ChatGPT wrappers in their support pages. And then those AI enabled interactions end up making up plane tickets that don't exist and those airlines have to honor them. As small of an example as that might be, being able to prove agent accountability also unlocks a huge set of opportunities for use in enterprise for those agent to agent interactions. The Deep Trust Framework that our team has put together that we're excited to be bringing into a friendly SDK form in the next few weeks for some of our partners includes those reputation based capabilities, so how you can basically keep track of the interactions an agent has had, associate all of that to the entity to which they're accountable, and then that creates a sustainable reputation model for these agent to agent Interactions. Source: Billions CEO Evin McMullen evin speaking at House of Chimera Spaces Event Dec 3, 2025

Billions

68,458 views • 7 months ago

American Surgeon shows the actual letter from UnitedHealthcare DENYING a patient in emergency condition from receiving care “This is a woman who was in the emergency room with pulmonary embolisms” “I think we all knew this would happen. I had another patient come in and share with me that UnitedHealthcare denied her inpatient's day. So this is a patient who had shortness of breath and some chest pain, and she just knew that something wasn't right in her body. She had a family history of blood clots and she'd had a deep flap surgery a couple of weeks ago. She went to the hospital and they saw her and they found that she had a life threatening condition known as pulmonary embolisms. So she was admitted to the hospital and taken care of really well by the doctors there. And they ordered all the right things. After a couple of days, she was discharged. She got a letter from UnitedHealthcare explaining that they didn't agree with the level of her care and that they would not cover it. So I'm gonna share some of the language of that letter with you, and I want you to know that my patient that we talked about previously who had her surgery denied had almost exactly the same letter shared. So there's some troubling things in this letter. I think this term is really interesting. United is saying they reviewed the request for inpatient admission. So let's all just pause and consider that. This is a woman who was in the emergency room with pulmonary embolisms, and the doctor wasn't really requesting anything. They were saying this patient needs to be in the hospital. But an insurance company sees this as a request, and that's part of this prior auth environment that we're living in. So I think it's important as patients and as physicians to just acknowledge that this is our reality now. Someone can think that there's a good medical decision for you and can write orders and wanna do the right thing for you, but your insurance company is seeing that as a request and deciding whether or not they wanna do it. One of the criteria that this insurance company used to decide whether or not to accept or deny this request was whether it's medically necessary. And it's so interesting that we're letting insurance companies and the doctors who work for insurance companies determine what's medically necessary and not just the doctor in front of the patient in the emergency room. So this is a really bold statement from UnitedHealthcare for my patient. They say you did not have to be admitted as an inpatient to the hospital for this care. I think we all need to just reflect on that. An insurance company is telling a patient and her doctor that they disagree with the plan of care to keep that patient safe. I know that this is boiling down to whether it's an inpatient admission or an observation admission, and that's really about money. But what I wanna point out to you is they're making medical decisions. This insurance company is actually weighing in and disagreeing with a doctor who made a medical decision to admit this patient for her safety. So this specific sentence, when a doctor or facility treats a patient above the recommended level of care, we cannot cover it. What the heck? That's what we do. We go above and beyond as physicians. It's clear that insurance companies don't, and they're actually saying it here.”

Wall Street Apes

115,691 views • 1 year ago