Bilawal Sidhu
@bilawalsidhu • 107,308 subscribers
Spatial intelligence. World models. Visual effects. Creator w/ 2.1M+ audience. Tech Curator @ TED. A16z Scout. Ex-Google PM (AR/VR & 3D Maps) https://t.co/fysPkbPoQ2
Shorts
Videos
holy crap! apple just beat google to the punch -- 3d gaussian splatting is coming to apple maps. these 3d scenes are made from oblique aerial imagery. but unlike blobby photogrammetry -- no more broccoli trees, no more melted powerlines -- ground level detail that actually holds up. here's hoping google maps/earth follows suite soon -- they have a significantly larger corpus of sensor data to work with. time to splat the world!
Bilawal Sidhu1,090,688 Aufrufe • vor 1 Monat
God's eye view 24-hour replay of Operation Epic Fury. The Iran strikes kicked off and I set an AI agent swarm loose to record every OSINT signal I could find before the caches cleared. Built a full 4D reconstruction in WorldView. I can scrub through minute by minute and watch the whole thing unfold on a 3D globe: > Airspace clearing over Tehran > Ground strike coordinates locking in > Severe GPS interference blinding the region > EO and SAR satellites making passes over the strike zone > No-fly zones locking down 9 countries > Shipping fleets scrambling at the Strait of Hormuz It's pretty amazing how complete of a picture you can build without "proprietary data fusion" -- one dev with public signals and a love for computer graphics and geospatial intelligence. Thank you for all the love on my last post. Dropping WorldView in April. This my friends is just the beginning.
Bilawal Sidhu3,999,520 Aufrufe • vor 4 Monaten
Just used claude fable (aka mythos) to create this city block simulator complete with multi-agent traffic, live detection boxes + tracks, and day to night cycle. And it just one shotted it. This is gonna be fun -- the gap between idea and execution just keeps collapsing.
Bilawal Sidhu372,058 Aufrufe • vor 1 Monat
Before/after of Corridor's latest AI video is wild. They shot video on greenscreen, made virtual sets in Unreal, then reskinned it to anime by finetuning Stable Diffusion. Net result? 120 VFX shots done by a team of 3 on a dime. Bravo! This is a milestone in creative technology🧵
Bilawal Sidhu13,178,924 Aufrufe • vor 3 Jahren
I made a 4D god's eye replay of the Iran strikes using public OSINT data. When I turned on the orbital layer in worldview something jumped out. You can see satellite passes stack up over the strike zones in the hours before & after impact. Everyone was watching. Some of them were overhead before it started. American KH-11s and TOPAZ SAR. Russian BARS-M and Persona. Chinese Gaofen optical and SAR. Maxar WorldView Legion. Airbus Pleiades. Capella. ICEYE. That's textbook behavior -- you collect right before for targeting, you strike, then you collect again for battle damage assessment. Just wild to see it all replayed in 3D like this. The commercial constellation density is also striking. What used to be exclusive nation state capability is now mirrored by half a dozen commercial operators. The intelligence monopoly is over.
Bilawal Sidhu718,701 Aufrufe • vor 4 Monaten
Okay it happened! Snapchat Spectacles AR glasses. Fully standalone. 46 degree field of view. 37 pixels per degree. That’s roughly like a 100” TV screen! 2x snapdragon chips. 45 minutes of battery. Auto transitioning lenses. Designed for co-presence. Spectator mode and more. Gotta hand it to Snap for pushing on this extremely hard engineering challenge, despite the rest of their peers going VR first as a stepping stone to this ultimate vision.
Bilawal Sidhu2,664,068 Aufrufe • vor 1 Jahr
Everything here is 100% generated w/ Google Veo 2. I've got early access, and the visual fidelity and prompt adherence is genuinely nuts. Let's test it together and have some fun. Drop your prompts below -- and for the next hour or so I'll reply with videos 👇
Bilawal Sidhu2,242,545 Aufrufe • vor 1 Jahr
Google is now using Gemini to cross-reference ~250M places with Street View imagery to identify visible landmarks for turn-by-turn nav. Think iconic buildings, gas stations and restaurants. So instead of "turn right in 500 feet" you get "turn right after the Thai Siam Restaurant" with the landmark highlighted. AI solving the distance estimation problem by using what you can actually see. Rolling out in US.
Bilawal Sidhu962,971 Aufrufe • vor 8 Monaten
Hollywood imagined a camera that could watch over an entire city. The military actually built it. There's a secret camera that can literally rewind time over an entire city. It captures 30 square miles at once. Every car, every person, every movement is recorded, indexed, and completely searchable. If an attack happens, operators just hit "rewind" to track the suspects back to where they came from. Turns out Enemy of the State wasn't fiction. It was a technical roadmap. And the folks that worked on the movie's visual effects actually helped build the real system. This is the story of WAMI -- the ultimate god's eye view, and how a spy-thriller movie trope became reality. I spent weeks breaking down how it works and the AI infused upgrade taking it to the next level. 00:00 What Is WAMI? 02:27 The Hollywood Origin Story 06:19 Baltimore's Secret Spy Planes 10:18 The Shadow Air Force 12:47 AI Automated Mass Tracking 15:45 Ukraine's Battlefield AI 17:48 Live 3D Scene Reconstruction 19:38 The Living Digital Twin
Bilawal Sidhu63,470 Aufrufe • vor 18 Tagen
This will change the way we experience sports forever -- watching the game from a gods eye view. Arcturus is building 4D gaussian splatting tech that can capture every angle of a sporting event and pushes the bar for volumetric video. I tested this in a headset and it makes 360 and 3D 180 video look ancient. This puts you closer to the action than any stadium seat, and it’s genuinely mind blowing.
Bilawal Sidhu501,441 Aufrufe • vor 5 Monaten
OpenClaw creator on Opus vs Codex: “Opus is like the coworker that is a little silly sometimes, but it's really funny and you keep him around. Codex is like the weirdo in the corner that you don't want to talk to, but he's reliable and gets shit done.” LMAO. Accurate.
Bilawal Sidhu429,825 Aufrufe • vor 5 Monaten
Is the Strait of Hormuz open or closed? Came up over lunch so I voice noted my agent to "boot up god's eye view and check." It sent me back this timelapse clip -- refreshed the AIS data, checked oil futures, mapped 120 days of vessel transits and rendered it out. TL;DR it's kinda open. Traffic is moving again, just not back to pre-conflict normal. Feels like I have a geopolitical analyst on demand. We're already living in the future my friends!
Bilawal Sidhu68,522 Aufrufe • vor 27 Tagen
The internet going wild with the microwave AI filter -- prolly because it's pure nightmare fuel 😭
Bilawal Sidhu1,026,814 Aufrufe • vor 1 Jahr
"When you ask your stoned roommates to put away the groceries" 😭
Bilawal Sidhu769,860 Aufrufe • vor 1 Jahr
People are undoubtedly a little alarmed at having unwittingly helped build a 3D map of the world for Niantic by contributing 30 billion crowdsourced images. I interviewed Niantic's CTO Brian McClendon about exactly this in a TED interview last year -- he's also the guy who co-created Google Earth. But let's put it in perspective. Pokestop data isn't what you think it is. It's not a surveillance panopticon of your neighborhood. These are static captures of parks, statues, murals, landmarks -- the places people congregate. Brian described it as "building the map from the bottom up, from the locations where people spend time." Think of these 20 million waypoints as basically the inverse of what Google mapped with Street View. Google mapped the drivable streets. Niantic mapped where people actually hang out. Cool data, genuinely useful for visual positioning -- but very different from what the headlines imply. And lest we forget that Niantic is just one of many companies quietly building their own map of the world right now -- and they're all capturing different facets of reality: >🚶 person-level: Axon body cams on hundreds of thousands of officers. Meta Ray-Ban glasses capturing first-person POV at scale -- overseas operators reviewing images every time someone says "Hey Meta." > 🚗 vehicle-level: Tesla dashcams on every car in the fleet, massive onboard compute extracting and distilling data to the cloud. Waymo with cm-accurate 3D maps of every city they operate in. Fleet telematics cameras on delivery vehicles globally. > 🏠 street & home-level: Flock Safety deploying CCTV across neighborhoods and cities. Amazon with Ring cameras on every doorstep and mailroom (recently got dragged over that Super Bowl commercial about fusing all these cams together to find your dog) plus dashcams on every Prime delivery van. Roomba mapping your floor plan every time it vacuums -- Amazon wanted that data badly enough to try acquiring iRobot for $1.7B before regulators shut it down. > 🥽 headset-level: Apple Vision Pro and Meta Quest build a 3D model of whatever room you're in every time you put them on. Between Ring, Roomba, and your headset, your entire home is being spatially understood by at least three different companies. >📍platform-level: Google with Street View cars, aerial planes, satellite imagery, and live location from every Android phone in your pocket. Apple doing the same with mapping cars AND every LiDAR iPhone is quietly a 3D scanner. And yeah, despite the "Apple is too privacy-conscious" narrative, they're collecting location data too. >🏃 trajectory-level: Strava mapped every running and cycling trail on Earth -- and accidentally exposed secret military bases in Afghanistan and Syria because soldiers logged their jogs. When you aggregate enough individual trajectories, patterns emerge that were never supposed to be visible. > 🛰️ space-level: Planet Labs imaging the entire Earth's landmass every single day from orbit. Vantor capturing it in higher detail. Iceye doing it in 3D using SAR. If something changes anywhere on the planet -- a building goes up, a forest burns down, a military convoy moves -- before-and-after imagery within 24 hours. Fused together -- we have everything from body cam to dashcam to doorbell to phone to satellite -- every layer of physical reality is being mapped by somebody right now. Different sensors, different angles, different purposes. Same pattern. The interesting part is how they incentivize it. Google spends billions. Mapillary tried altruism. Hivemapper grinds with crypto. Pokémon GO cracked something none of them could: a game mechanic that subsidizes the scanning behavior. You're not building a map. You're catching pokemon. The map is just a side effect. 3D scanning is still a niche hobby for reality capture nerds like me. The moment somebody gamifies dense 3D capture at scale -- not posed photos but actual geometry -- that's when this blows wide open. Niantic sold the games for $3.5B but kept the spatial platform, with a data-sharing agreement in place. One team makes the game great, the other builds the spatial infrastructure underneath. Incentives finally aligned. Gaming is becoming a way for humans to contribute real-world trajectories that help physical AI learn about the real world. Google does it with live traffic. Tesla does it with autopilot. The mechanic is different but the pattern is identical -- and most people are already part of at least one -- if not a majority -- of these datasets whether they realize it or not.
Bilawal Sidhu203,550 Aufrufe • vor 4 Monaten