Video yükleniyor...

Video Yüklenemedi

Ana Sayfaya Dön

Streaming iPhone data in real-time directly to Rerun 🚀 The collection process is one of the most frustrating parts of building imitation-learning datasets. I’ve got a little army of sensors—📱 iPhone, iPad, Quest 3—but getting them temporally aligned, spatially aligned, AND seeing real-time feedback while recording is tough. I...

27,433 görüntüleme • 1 yıl önce •via X (Twitter)

0 Yorum

Yorum bulunmuyor

Orijinal gönderinin yorumları burada görünecek

Benzer Videolar

🚀 Introducing EgoExo Forge - built on top of Rerun, Gradio, and Hugging Face hub (I’ll be in San Francisco July 21–29 — if you’re into robotics, egocentric AI, large-scale data collection, or just want to chat, DM me!) In my opinion, large-scale, diverse, and high-quality data is still the largest bottleneck for generalized robotics deployment. I believe that some version of imitation learning from human examples will be the most scalable + clean way to train humanoid robots 🤖 (similar to what Tesla did for Full Self Driving). Teleop is too expensive to collect a large enough dataset in a reasonable manner, so passive collection via egocentric (and in certain cases, exocentric) views feels like the right bet. Over the past few months, I've been trying to build out the scaffolding for this and using Rerun as my underlying infrastructure. Data being collected needs to be easily inspectable + time series and rerun provides the right tooling for this. My goal is to first build out a ground truth representative dataset from already existing open source data, generate some reasonable baselines, and then go out and collect my own data that adheres to the defined schema. 🔍 Starting with open-source datasets 1. EgoDex from Apple 2. HOCap from Nvidia and the University of Texas at Dallas 3. Assembly101 from Meta All these different datasets have different sensor configurations + annotations, so my goal with egoexo-forge is to have one consistent labeling scheme + data layout. I built a data pipeline that aligns all of the different datasets in one general schema assuming the COCO133 keypoint layout that allows for exo+ego, ego only, or exo only Since the scaffolding is already there, it becomes MUCH easier to add other datasets. So the next ones that I'll be including are HD-EPIC kitchens dataset, HOT3D, and finally my own personal iPhone + insta360 go collection method. Once I have a diverse variety of datasets, I'll double down on what I believe to be the key algorithms required to make useful data for imitation learning 📊 1. Camera Pose estimation via SLAM/SFM for ego perspective (and automatic calibration for exo) 2. Human pose estimation for both egocentric + exocentric views 3. Metric 3D reconstruction + object tracking I'll be setting up reasonable open-source baselines for each of these to validate that these datasets work, and then finally try to use the generated datasets for some imitation learning via the pi0-lerobot repo I've been working on. I plan on making a blog post + providing more info on all of this in the near future so stay tuned

Pablo Vela

37,360 görüntüleme • 1 yıl önce

Colmap 4.0 was very recently released, so it inspired me to do some work to better understand it and its new capabilities with Rerun. I want to really understand how Colmap, and in particular, pycolmap, works outside of just calling it via the CLI. So my goal is to use the low-level pycolmap API to log every part of the pipeline. The explicit goal is to have an alternative to the SQLite database that I can utilize. Instead of SQLite, I want to try logging everything directly to rerun and use RRD. This means I can have deep inspectability and still save the features/matches/2D view geometry, but be able to view it directly in rerun. I think this is one of the superpowers that rerun provides; data and visualizations are deeply integrated. As I'm often working with sequential data (videos), I'm going to specifically focus on four things: 1. Monocular Video Simple: Calls high-level APIs such as pycolmap.extract_features, pycolmap.match_sequential, pycolmap.incremental_mapping. These are basically identical to the CLI options and provide a good baseline. 2. Monocular Video Streamed: Take the above high-level APIs and break them down to their iterator version, logging each component in a streamed manner. This way, I can stream the intermediate features to rerun while the extraction/matching/mapping is happening. 3. Rig with unknown calibration: <- WHAT THE VIDEO SHOWS This is probably the most interesting version and the first one I've been working on. It allows one to set a rig between known sensors, such as in VR/AR devices, leading to much better reconstructions with multiple cameras. This is the case where we don't know the calibration a priori, so we have to run a reconstruction twice: once as a normal Colmap reconstruction with no rig constraints, use this to generate the constraints, and then do it again with the newly found rig. 4. Rig with known calibration: This is the RoboCap example, where we have a pre-calibrated set of sensors, so we don't need to run the two reconstructions and also gain better matching between cameras, both spatially and temporally. Again, this leads to a much better reconstruction! Along with all this, GLOMAP has become a first-class global mapper, making it super easy to use directly within pycolmap! I'm excited to do more with this and compare it to things like pycuvslam, vipe, and other alternatives.

Pablo Vela

30,070 görüntüleme • 6 ay önce

I really learnt from the best If your content is averaging 700 views it’s of two things 1. It’s either you did not warm up your account well to the hashtag you are posting with 2. You have a general content problem , you need to find content that has been pushed in the last 1 month max and post I have 4 iPhones , 3 iphone 8 and 1 iPhone 7 , I post content on all everyday been doign this for the past 2 years I use the iPhone 7 to post for one of my brands And I use the 3 iPhone 8 to post for one brand The most important thing is , find what works for one phone and spread it across others It took me years to learn this One big lesson, don’t tell your vpn to X , you will hate yourself , not telling people the vpn I am using so they don’t overcrowd it If you post a content in your main niche, you should be averaging 1k+ - 5k+ views Trust me it’s a lot of work I also started posting on instagram and YouTube and they work differently , don’t post the same video content on both without observing hashtags I also posted on lemon8 , one of my post average 10k+ views Daily I get around 50 users , I have gone viral several times, one of my biggest virality is 700k+ views I really want to buy more iPhone 7 and 8 , It costs me arround $50-70 for each locally here Recently I have been thinking of how do I get clippers locally to do this and train them but it looks like it’s hard because you have to train them Taking advice from the legend Alex Nguyen I have not made a lot but trust me , it works This is proof from one of the apps , we ask during onboarding where they find us

Pixel_builder

49,140 görüntüleme • 3 ay önce

iPhone Takes a Photo of You Every 5 Seconds While you’re using your iPhone, it takes a photo of you every 5 seconds. More precisely - when you pick up or put down your iPhone, and also when it’s unlocked and sits motionless for a long time, the Face ID sensors take pictures every 5 seconds. You can see this through the infrared lens: it looks like the iPhone is taking a photo in the dark with a flash. Even if you cover the sensor, it will still keep trying to take a picture. In reality, of course, the iPhone isn’t taking photos. It scans your face to figure out whether you’re looking at it. In Face ID settings this mode is called Attention Awareness. You’re working on your iPhone, it’s charging, you get a call - and the iPhone “takes pictures” with the Face ID camera. As soon as it realizes you’re looking at it, the ringtone gets quieter. The same thing works with alarms and other notifications. This is not actually taking photos - it’s the TrueDepth infrared sensors scanning your face for the Attention Aware Features. How to turn this off on iPhone. You need to disable Attention Aware Features. Method 1 (main one): 1. Open Settings. 2. Tap Face ID & Passcode. 3. Enter your passcode. 4. Find Attention Aware Features and turn it off. Method 2 (via Accessibility): 1. Open Settings → Accessibility. 2. Tap Face ID & Attention. 3. Turn off Attention Aware Features. After that, your iPhone will stop automatically lowering the volume of calls, alarms, and notifications when you’re looking at the screen, and it won’t scan your face as actively for “attention.”

Officer's Notes

18,831 görüntüleme • 1 ay önce

I made over 2.5 million dollars this past week betting sports. Yes, it sounds easy. Yes, it sounds simple. But the truth is, this is the result of years of obsession, discipline, and grinding at my craft. I spent four straight years playing poker 18 hours a day. That was my entire life. Wake up, play poker, think about poker, sleep, repeat. That level of focus is how I became one of the top players in the world and made over 10 million dollars playing poker. Poker built my foundation. Discipline, risk management, emotional control, and the ability to perform under real pressure. But the reality is, there are no billionaires in poker. There are billionaires in sports betting. So I went all in on sports betting and walked away from poker completely. I took everything I learned and built this the right way. I hired the best analysts and handicappers in the world, people I met through poker, and brought them together under one operation. Because of the platform I’ve built, these guys make more money working with me than they ever could on their own. That is how I’m able to operate at an extraordinary level and consistently win at a very high rate. Winning 2.5 million dollars in a week is incredible, and I’m grateful, but I’m not satisfied. I’m constantly sharpening my edge and building something bigger. My vision is to turn this into a nine figure a year business. I truly believe I’m on the path to becoming a billionaire one day. I think back to being a kid, dreaming of being a professional gambler, having a gambling themed bar mitzvah, and looking up to my father, one of the best poker players in the world. This path has been inside me for a long time. Today, my entire life revolves around becoming the best sports bettor possible. I wake up thinking about it, go to sleep thinking about it, and live it every single day. Grateful for the journey. Let’s keep going.

Sean Perry

106,001 görüntüleme • 8 ay önce

The past year has seen me have a renaissance, in the truest sense… I won’t go into details now but will at some point before long. What has brought so much happiness to my life and those around me this past year has been my falling back in love with sport. Cycling has, and always will be, my number one. Yet I’d forgotten that I simply love sport, not for results but for the sheer joy of doing it, I’d completely forgotten that the health of my mind is intrinsically connected to the health of my body. I’ve rediscovered the love I had for sport that existed before the world of professional cycling took over in the way it did. I’ve been pushing myself and trying new things this past year, indifferent to the results, just out having fun and at times going deeper than I thought I was capable of anymore. Last week I got on a TT bike for the first time in a decade, Factor Bikes built me a bike, I’ve been looking at it for two years and decided it was time to get fitted, getting back on it felt like going home. Anyway, the long and the short of this is that it’s inspired me to create a club to inspire and be inspired. A community for us to share our love for getting out there and doing it, because I’ve realized that although I spend most of my sporting life on my own I derive the most pleasure when feeling part of something. It’s in its early days, I’ve called it Sporting Club CHPT3 aka SCC3, I’d love you to check it out and join. It’s still in its infancy, but I hope it’s going to grow into something that will inspire you as much as me.

David Millar

111,780 görüntüleme • 2 yıl önce

The gold standard fluid interactions on iOS are built using in-process client animations (like SwiftUI does it) and not render-server animations (like CoreAnimation does it). This is common knowledge inside of Apple’s UI framework and system experience teams. A close inspection of iOS’s evolution reveals the gradual upgrading of system experiences written using render-server animations (that often disable user interaction) with ones using client animations (that are interruptible and interactive). The app switcher for iPhone X, the Dynamic Island, and Liquid Glass bars are prime examples of this trend. The other thing that makes these experiences feel so fluid is their use of spring animations that preserve velocity, rather than Bézier curve easing functions. To get velocity preservation, you need to be able to interrupt a spring animation and retarget it or drive it with a gesture. That’s a lot easier to do when the animation is running in the same process as the event handling. When we were first pitching SwiftUI, two of our go-to demos were a recreation of the iOS 9 navigation and Home Screen interactions which were fully interactive and interruptible, at a time when the actual implementations of those experiences in the OS disabled user interaction and ran server-side animations. CoreAnimation is great and the framework does much more than animation. You can build a fine app using its server-side animations. But if your UI framework can’t do efficient main thread client animations, there’s a ceiling to the quality of the experience your app can provide.

Kyle Macomber

194,329 görüntüleme • 24 gün önce

$OnlyMarms Update for the end of Day 2 🦫 The receipts just keep stacking up. Since yesterday... 📺 The token has now been mentioned LIVE on television for the second time, this time on NBC. ( 🎙️ The story has now reached radio, with its first major interview airing on Radio-Canada. ( 🌐 The M.A.D. Lab has created an official OnlyMarms page on its website, documenting the community initiative and bringing everything together in one place. ( 📰 And more media outlets continue picking up the story by the hour - from major newspapers to university publications and international outlets. Take a step back for a second. $OnlyMarms sends a message and sets a statement: Meme coins can do good, and Meme coins can have real-world impact. It is the first time in a while, that we see positive media reports on a meme coin. This isn't a a simple meme that we have invented, it is actually a real world problem that we got to turn into a Crypto narrative to help the M.A.D Lab with fundraising, and awareness. The Pump.fun community, together against a real-world problem. A wildlife research lab founded in 1962 lost critical government funding after more than 60 years of continuous research. The community built around that mission. Now, every TV appearance, every radio interview, every news article, and every official update from the lab brings more attention - not just to the token, but to the research itself and the main issue: get the Lab their funding back. This is what makes OnlyMarms different. The narrative doesn't depend on price action, this is bigger than that. It evolves every time the world learns about the story. For the first time in a while, we have a narrative that I think can send a message and set a statement: Meme coins can do good, and Meme coins can have real-world impact. It is the first time in a while, that we see positive media reports on a meme coin. 🦫 Official M.A.D. Lab OnlyMarms page: 🌍 Community Website: Community Chat for raids and bagworking: Official Linktree: CA: HBrfYZgeLKdSvBBGnGkvAK4563pq8oBGpgNFAaespump Also we set up an official account where more marmot content will be posted: OnlyMarms

Miggl

106,610 görüntüleme • 2 ay önce