Streaming iPhone data in real-time directly to Rerun 🚀... The collection process is one of the most frustrating parts of building imitation-learning datasets. I’ve got a little army of sensors—📱 iPhone, iPad, Quest 3—but getting them temporally aligned, spatially aligned, AND seeing real-time feedback while recording is tough. I stumbled on a great library from Cake Lab (WPI) called ARFlow. It’s a thin client built on Unity’s ARFoundation that connects over gRPC to a server running Rerun for live data logging. I forked it to: - Log the SLAM translation poses, and - Upgrade rerun to v0.23 for my use case. So far, it works well, but there are still a few hitches: 1. Right now, it’s solid on iPhone and iPad; my Quest 3 client is still slow and not super reliable. 2. I’m using an older ARFlow branch focused on real-time streaming only—no spatial or temporal sync yet. Unity builds for iOS keep failing. 🛠️ 3. Nothing is saved locally to the client, so packet loss is a risk on shaky networks. There’s huge potential in tapping the ubiquitous sensors we carry around every day, and ARFlow is a big step toward making that easyshow more

I know I’ve said this before but the iPad... is a technological wonder. It’s one of the most beautiful devices ever, especially the iPad Pro with the matte display, which is what I have. The only problem? If I’m not an artist, not exactly sure what the use case is. Like where does it fit in my workflow. For me, the only app that is far superior on iPad over any other device is Flipboard. For everything else, iPhone is perfect and if I need to do some real work, MacBook Pro or even MacBook Air. What am I missing? What do you use your iPad for? Flipboard on iPad is magical.show more

🚀 Introducing EgoExo Forge - built on top of... Rerun, Gradio, and Hugging Face hub (I’ll be in San Francisco July 21–29 — if you’re into robotics, egocentric AI, large-scale data collection, or just want to chat, DM me!) In my opinion, large-scale, diverse, and high-quality data is still the largest bottleneck for generalized robotics deployment. I believe that some version of imitation learning from human examples will be the most scalable + clean way to train humanoid robots 🤖 (similar to what Tesla did for Full Self Driving). Teleop is too expensive to collect a large enough dataset in a reasonable manner, so passive collection via egocentric (and in certain cases, exocentric) views feels like the right bet. Over the past few months, I've been trying to build out the scaffolding for this and using Rerun as my underlying infrastructure. Data being collected needs to be easily inspectable + time series and rerun provides the right tooling for this. My goal is to first build out a ground truth representative dataset from already existing open source data, generate some reasonable baselines, and then go out and collect my own data that adheres to the defined schema. 🔍 Starting with open-source datasets 1. EgoDex from Apple 2. HOCap from Nvidia and the University of Texas at Dallas 3. Assembly101 from Meta All these different datasets have different sensor configurations + annotations, so my goal with egoexo-forge is to have one consistent labeling scheme + data layout. I built a data pipeline that aligns all of the different datasets in one general schema assuming the COCO133 keypoint layout that allows for exo+ego, ego only, or exo only Since the scaffolding is already there, it becomes MUCH easier to add other datasets. So the next ones that I'll be including are HD-EPIC kitchens dataset, HOT3D, and finally my own personal iPhone + insta360 go collection method. Once I have a diverse variety of datasets, I'll double down on what I believe to be the key algorithms required to make useful data for imitation learning 📊 1. Camera Pose estimation via SLAM/SFM for ego perspective (and automatic calibration for exo) 2. Human pose estimation for both egocentric + exocentric views 3. Metric 3D reconstruction + object tracking I'll be setting up reasonable open-source baselines for each of these to validate that these datasets work, and then finally try to use the generated datasets for some imitation learning via the pi0-lerobot repo I've been working on. I plan on making a blog post + providing more info on all of this in the near future so stay tunedshow more

Colmap 4.0 was very recently released, so it inspired... me to do some work to better understand it and its new capabilities with Rerun. I want to really understand how Colmap, and in particular, pycolmap, works outside of just calling it via the CLI. So my goal is to use the low-level pycolmap API to log every part of the pipeline. The explicit goal is to have an alternative to the SQLite database that I can utilize. Instead of SQLite, I want to try logging everything directly to rerun and use RRD. This means I can have deep inspectability and still save the features/matches/2D view geometry, but be able to view it directly in rerun. I think this is one of the superpowers that rerun provides; data and visualizations are deeply integrated. As I'm often working with sequential data (videos), I'm going to specifically focus on four things: 1. Monocular Video Simple: Calls high-level APIs such as pycolmap.extract_features, pycolmap.match_sequential, pycolmap.incremental_mapping. These are basically identical to the CLI options and provide a good baseline. 2. Monocular Video Streamed: Take the above high-level APIs and break them down to their iterator version, logging each component in a streamed manner. This way, I can stream the intermediate features to rerun while the extraction/matching/mapping is happening. 3. Rig with unknown calibration: <- WHAT THE VIDEO SHOWS This is probably the most interesting version and the first one I've been working on. It allows one to set a rig between known sensors, such as in VR/AR devices, leading to much better reconstructions with multiple cameras. This is the case where we don't know the calibration a priori, so we have to run a reconstruction twice: once as a normal Colmap reconstruction with no rig constraints, use this to generate the constraints, and then do it again with the newly found rig. 4. Rig with known calibration: This is the RoboCap example, where we have a pre-calibrated set of sensors, so we don't need to run the two reconstructions and also gain better matching between cameras, both spatially and temporally. Again, this leads to a much better reconstruction! Along with all this, GLOMAP has become a first-class global mapper, making it super easy to use directly within pycolmap! I'm excited to do more with this and compare it to things like pycuvslam, vipe, and other alternatives.show more

got cloud inference working! here i have smolvla running... on a remote 4090 on prime intellect with a thin client running on my local pc sending observations to the remote server and receiving action chunks back. round trip latency is varying between 320-470ms! the 4090 instance I'm using is $0.62/hr and not even one of the cheaper ones, a raspberry pi v5 is < $100 and about $25 for a v3, which works fine as a clientshow more

Also, 👀 on this from Dave earlier today on... Foul Territory. “We know this is a real big winter time for us. We’ve been talking about this for weeks. And, I’ve proposed something to him that he’s given me an approval on it so I know where my payroll is and it’s still a very hefty payroll.”show more

Spotlight on iOS is soooooooo slow. sometimes takes 15... seconds to show search results. It’s in an unusable state. This is on an iPhone 13 mini, the real-time spotlight experience. Am I the only one?show more

I added a GUI file explorer to Loki C2!... It’s not winning any design awards, but it works surprisingly well. The Loki C2 client is built with Electron. I got the explorer up and running in just a few hours—AI is killer for web dev tasks.show more

Most people have no idea that these photos exist... from the surface of Venus. Climate change is real. It’s happening on Venus and it’s happening on Earth. Did you know that Venus may have been habitable at one point in time? It’s known as Earth’s sister planet. Below are some of the only images ever taken from the surface of Venus. One day Earth may look similar to this. There is no argument that climate change is real. It happened on Venus and it’s constantly happening on Earth. Human interaction most definitely has some effects on the planet’s climate change, but so too do non-human factors — even to a greater degree. My hope is that, not only can humans work to slow down the process, but also one day come up with solutions to reverse it.show more

Sam3 + Body is freaking amazing. I'm in the... process of building an open-source Rerun and Gradio demo that is similar to what Meta provided. Got the basic functionality up and running, now I need to hook it up to a Gradio interface. It's a really good modelshow more

I made over 2.5 million dollars this past week... betting sports. Yes, it sounds easy. Yes, it sounds simple. But the truth is, this is the result of years of obsession, discipline, and grinding at my craft. I spent four straight years playing poker 18 hours a day. That was my entire life. Wake up, play poker, think about poker, sleep, repeat. That level of focus is how I became one of the top players in the world and made over 10 million dollars playing poker. Poker built my foundation. Discipline, risk management, emotional control, and the ability to perform under real pressure. But the reality is, there are no billionaires in poker. There are billionaires in sports betting. So I went all in on sports betting and walked away from poker completely. I took everything I learned and built this the right way. I hired the best analysts and handicappers in the world, people I met through poker, and brought them together under one operation. Because of the platform I’ve built, these guys make more money working with me than they ever could on their own. That is how I’m able to operate at an extraordinary level and consistently win at a very high rate. Winning 2.5 million dollars in a week is incredible, and I’m grateful, but I’m not satisfied. I’m constantly sharpening my edge and building something bigger. My vision is to turn this into a nine figure a year business. I truly believe I’m on the path to becoming a billionaire one day. I think back to being a kid, dreaming of being a professional gambler, having a gambling themed bar mitzvah, and looking up to my father, one of the best poker players in the world. This path has been inside me for a long time. Today, my entire life revolves around becoming the best sports bettor possible. I wake up thinking about it, go to sleep thinking about it, and live it every single day. Grateful for the journey. Let’s keep going.show more

I know my camera lens is not clean, but... it’s impossible for me right now to move and find a cloth, I somehow managed to get on wheelchair and right now I’m sitting next to the window..I thought of recording a video because i was feeling better.. i’ve been listening to the life of a show girl, so yeah, my mood is better and my energy feels restoring…cheers!show more

Transparency post: (will delete) This is a video of... me giving up in real time. I’ve been having a rough few days. Despite it being my highest income month from UGC & despite the opportunities I’ve been getting, I’ve been feeling really discouraged. After crying on and off all day, I wanted to tough it out and get a project done. I felt that my energy was off but kept filming until I started stumbling on some words and couldn’t take it anymore. All this to say. UGC is NOT easy no matter what anyone tells you. It’s a 1 man business and you’re responsible for every last bit of your successes or failures. On top of it all, you still have to keep up with your personal life and responsibilities. So the pressure is intense and it’s inevitable. I’m not posting this because I have an inspirational message to share, but I’m posting this to show new creators that despite often seeing success stories, there is often a lot of pain and struggle behind those stories. So be prepared, make your mental health a priority along your journey. And whatever you do, don’t lose yourself in this field. #ugccommunityshow more

I built a directory of beaches in manus in... just two prompts it's ridiculous, BUT here's why *you* are more important than ever: it still relies on crawling the web and on other sites to provide the data. for an MVP of a directory, or pseo site, or saas etc that's fine. it's never been easier to whip up that idea in minutes but if you want long term success you need to be the source and not the fork - and that only comes from doing stuff ai can't replicate (yet) all of the data from this site was crawled from elsewhere. is it accurate? how often is it updated? what if those sources change? when it becomes so easy to do things like build a directory or vibe code a saas, doing the hard things is more important than ever i have another app in this niche that has around 10,000 monthly active users it's been going for years and years at this point on autopilot i did it by painstakingly parsing time series of sea temperature data from the us government with a bot that runs 4x a day - no ai 😭 (currently has 63.4m rows of data) this site is the source for manus and other tools and is very accurate. I've had many opportunities to sell the data into bigger companies and none of that would be possible taking the easy route anyway: tldr manus is amazing but humans working on the hard problems with ai as a copilot is still the way you winshow more

Today I vibe coded an AR game entirely within... my Meta Quest 3, using Gemini 3. The holodeck is real! Just go to in the Meta browser, toggle canvas, and ask (via voice) for a WebXR app. Getting scene geometry took a few tries, but it basically just works.show more

By Thursday, we will be announcing Phase IV of... the Health Insurance for vulnerable citizens in Kaduna. The figure takes us to over 1, 000 in partnership with KACHMA. I missed being in the office. In the next few weeks, I will state my position politically. I owe the public that. I always state whatever I do through my handles. I was with my father for a few hours and he is fine with me running. As God is my witness, and on behalf of the excellent people Kaduna North, I will be running for office in 2027, if alive. We will still focus on the job we were elected to do, and there are a few leaders, Northern Statesmen and fathers that I have to speak to. My position is peculiar. But I have tried to handle with honour and dignity. My wife and I have decided this is the right course. And my people are with me, on social media and offline. I have never feared an election for a day. But it is the right of anyone to try. Respect that right knowing my record speaks for me. Thank you.show more

So I have been trying to do my own... take on the 4-2-1-3. but it is not for my play style. Will try some more, later on. For now I ended up with a 5-2-1-2 that I like a lot. And it’s surprisingly good against the 4-2-1-3. Anyone wants to test? 🔥🏴‍☠️show more

The past year has seen me have a renaissance,... in the truest sense… I won’t go into details now but will at some point before long. What has brought so much happiness to my life and those around me this past year has been my falling back in love with sport. Cycling has, and always will be, my number one. Yet I’d forgotten that I simply love sport, not for results but for the sheer joy of doing it, I’d completely forgotten that the health of my mind is intrinsically connected to the health of my body. I’ve rediscovered the love I had for sport that existed before the world of professional cycling took over in the way it did. I’ve been pushing myself and trying new things this past year, indifferent to the results, just out having fun and at times going deeper than I thought I was capable of anymore. Last week I got on a TT bike for the first time in a decade, Factor Bikes built me a bike, I’ve been looking at it for two years and decided it was time to get fitted, getting back on it felt like going home. Anyway, the long and the short of this is that it’s inspired me to create a club to inspire and be inspired. A community for us to share our love for getting out there and doing it, because I’ve realized that although I spend most of my sporting life on my own I derive the most pleasure when feeling part of something. It’s in its early days, I’ve called it Sporting Club CHPT3 aka SCC3, I’d love you to check it out and join. It’s still in its infancy, but I hope it’s going to grow into something that will inspire you as much as me.show more

UPDATE: I’M ABLE TO SPEAK AGAIN!! I been talking... since Tuesday. For those that aren’t familiar with tracheotomies, because of the open hole in my throat, it prevents me from speaking because air goes out the trach rather than up through your voice box. So in order for me to speak, I have a cap called a speaking valve (the purple cap). What it does is cover the trach to allow the air I breathe to go through my nose and mouth again while stopping air from coming out my throat, allowing my voice to come out. It’s a really big adjustment and what should feel like breathing normal doesn’t feel natural at all. I can only wear it for a short time before getting tired for now. A week ago I didn’t even know how to breathe with it on, but last night I had it on for the longest I’ve had so far and it felt comfortable. So there’s hope to getting back to normalcy. I Still have to adjust to my daily life with this thing in my throat. Still not comfortable gaming or sitting for long period of time because of the position I need to be in. It’s getting better though. Hopefully it’s still just part of the healing process. Also. Thank you to the community for giving me the confidence to post videos and pictures of myself in the most unflattering situations.show more

What the fuck is China building? This is not... a clip from movie, this is a real project in China. Due to the trade war, there’s a video of a Chinese guy said, “we both benefit from trade, U.S. and China. But only one of us is using the wealth to build for our people”. that is 🇨🇳show more

ermmm I got 2 more babies xD i had... to go back and get the other sisters they’re all from the same litter i felt so bad :c but once they’re all 3 bonded with my 4 older female rats im going to do a big cage upgrade and they’ll all be in the same one! but this is two of the new babies the other one is shy and sleepy 😴 ill try to take a pic of all 3 of them later! so the video is 2 of 3 of the new babies, and the 2nd pic is their cage until they bond with my adult rats and get a bit bigger, in which case by then i will be moving all of 7 (YES now SEVEN hahah) of my female ratties to the big big cage next to my older pack of 4 girls’s cage (u can see champagne -the albino- and oreo-the one below) saying hello in pic 4 :3 and what’s crazy is that the current rat cage for my 4 older girls is a pretty good size, so moving all of them to the larger cage is going to be crazy for them, im gonna make it like a rat theme park hahashow more