Bilawal Sidhu's banner
Bilawal Sidhu's profile picture

Bilawal Sidhu

@bilawalsidhu • 119,791 subscribers

decompiling reality; reconstructing real world events from public data. experimenting with vfx, sensing & robotics. https://t.co/O19H0QHsGW

Shorts

Space and time reconstructed in 4D Is this how higher dimensional beings see us - every moment at once? Starting to understand what Vonnegut meant by humans being “great millipedes” - clearly it applies to our four legged friends too! Geolocated 2d video → per frame 3d gaussians → each left precisely where & when it happened

Space and time reconstructed in 4D Is this how higher dimensional beings see us - every moment at once? Starting to understand what Vonnegut meant by humans being “great millipedes” - clearly it applies to our four legged friends too! Geolocated 2d video → per frame 3d gaussians → each left precisely where & when it happened

33,079,993 views

What even is time and space? Kurt Vonnegut's "Tralfamadorians don't see human beings as two-legged creatures, either. They see them as great millipedes - with babies' legs on one end and old people's legs at the other” So here's me walking through the world, leaving a 3D snapshot of every moment exactly when and where it happened. Feels a lot like onion skinning reality (to use the animation analogy). We are beings stuck in the arrow of time - who get momentary glimpses of what it means to break free from it. Perhaps this is one of those glimpses. Did not expect the last post to blow up like that. Really enjoyed the convos - thanks for all the love and the new rabbit holes to dive into.

What even is time and space? Kurt Vonnegut's "Tralfamadorians don't see human beings as two-legged creatures, either. They see them as great millipedes - with babies' legs on one end and old people's legs at the other” So here's me walking through the world, leaving a 3D snapshot of every moment exactly when and where it happened. Feels a lot like onion skinning reality (to use the animation analogy). We are beings stuck in the arrow of time - who get momentary glimpses of what it means to break free from it. Perhaps this is one of those glimpses. Did not expect the last post to blow up like that. Really enjoyed the convos - thanks for all the love and the new rabbit holes to dive into.

665,039 views

peak internet: ai generated cctv footage of police arresting ppl for wearing huge boots video credit: u/Qemmish

peak internet: ai generated cctv footage of police arresting ppl for wearing huge boots video credit: u/Qemmish

25,875,119 views

It's mind bending walking around the same place simultaneously in two timelines Inside the frame it's winter, and outside the frame it's summer - until you step inside. Recorded this footage in the winter and localized it against a massive 3d scan of the same ranch in the summer. You can follow the camera from the outside, then step into the moment I recorded. We spend so much time looking at memories through 2d rectangles in our camera roll. It's a strange feeling to walk around one instead. Like navigating through space instead of scrolling through time. The geospatial memory palace continues to come to life!

It's mind bending walking around the same place simultaneously in two timelines Inside the frame it's winter, and outside the frame it's summer - until you step inside. Recorded this footage in the winter and localized it against a massive 3d scan of the same ranch in the summer. You can follow the camera from the outside, then step into the moment I recorded. We spend so much time looking at memories through 2d rectangles in our camera roll. It's a strange feeling to walk around one instead. Like navigating through space instead of scrolling through time. The geospatial memory palace continues to come to life!

279,829 views

Visualizing how higher dimensions might perceive our reality. Past, present, and future all at once.

Visualizing how higher dimensions might perceive our reality. Past, present, and future all at once.

178,007 views

2d moments frozen in time. Turned into 3d holograms. Left exactly where they happened in the real world. The geospatial memory palace coming to life. Excited baby deer startles mama deer momentarily, who then chills out after :) Can you imagine when your entire camera roll comes to life like this?

2d moments frozen in time. Turned into 3d holograms. Left exactly where they happened in the real world. The geospatial memory palace coming to life. Excited baby deer startles mama deer momentarily, who then chills out after :) Can you imagine when your entire camera roll comes to life like this?

343,881 views

OpenAI just dropped their Sora research paper. As expected, the video-to-video results are flipping spectacular 🪄 A few other gems:

OpenAI just dropped their Sora research paper. As expected, the video-to-video results are flipping spectacular 🪄 A few other gems:

1,873,820 views

What if every video you ever shot could turn into a permanent 3D hologram in the exact place it happened? I did it with photos first. Now I can do it with any video. Here’s a mama deer and her baby deer, filmed with my iphone a few days ago -- now floating as geo anchored holograms exactly where I captured them.

What if every video you ever shot could turn into a permanent 3D hologram in the exact place it happened? I did it with photos first. Now I can do it with any video. Here’s a mama deer and her baby deer, filmed with my iphone a few days ago -- now floating as geo anchored holograms exactly where I captured them.

133,806 views

Nano Banana Pro is a really good cartographer. Used it to turn low res satellite imagery into a detailed hand drawn map and vector HD map. Pretty wild how well it segments everything and even recovers paths/roads hidden under tree cover. Looks way more detailed than the current google basemap which is pretty sparse in countries like India. Included both in video for comparison.

Nano Banana Pro is a really good cartographer. Used it to turn low res satellite imagery into a detailed hand drawn map and vector HD map. Pretty wild how well it segments everything and even recovers paths/roads hidden under tree cover. Looks way more detailed than the current google basemap which is pretty sparse in countries like India. Included both in video for comparison.

554,024 views

Generative AI is super cool… BUT I’m continually blown away with the work happening in ‘procedural’ 3D modelling. Especially given these plugins are for a free (!) 3D tool like Blender. We needed a fancy Houdini license to do this just a few years ago 🤯

Generative AI is super cool… BUT I’m continually blown away with the work happening in ‘procedural’ 3D modelling. Especially given these plugins are for a free (!) 3D tool like Blender. We needed a fancy Houdini license to do this just a few years ago 🤯

1,366,062 views

Damn it worked! Genie 3 world --> inpaint UI --> 4x topaz AI upscale --> train 3d gaussian splat You can step inside a painting of Socrates from 1787. Better than any image-to-3d model I've seen. I think Google has stumbled upon the killer app for VR -- the literal holodeck.

Damn it worked! Genie 3 world --> inpaint UI --> 4x topaz AI upscale --> train 3d gaussian splat You can step inside a painting of Socrates from 1787. Better than any image-to-3d model I've seen. I think Google has stumbled upon the killer app for VR -- the literal holodeck.

659,325 views

Progress update: figuring out the 3D location of every photo taken at TED with attribution. It's starting to feel magical -- makes me wonder what experiences are possible if we could do this for every live event ever.

Progress update: figuring out the 3D location of every photo taken at TED with attribution. It's starting to feel magical -- makes me wonder what experiences are possible if we could do this for every live event ever.

101,647 views

Lmao. What niche even is this — grassroots dirt track racing meets google maps nerds? Veo 3 videos are seriously ridiculous and fun. Turn audio on for max enjoyment.

Lmao. What niche even is this — grassroots dirt track racing meets google maps nerds? Veo 3 videos are seriously ridiculous and fun. Turn audio on for max enjoyment.

452,190 views

One of the wildest emergent capabilities of Genie 3 is that maps actually work. As I walk around the forest, the GPS display updates its heading in real time. Remember. There is no game engine here. This is an AI hallucinating a working navigational instrument purely from next frame prediction. 🤯

One of the wildest emergent capabilities of Genie 3 is that maps actually work. As I walk around the forest, the GPS display updates its heading in real time. Remember. There is no game engine here. This is an AI hallucinating a working navigational instrument purely from next frame prediction. 🤯

247,445 views

The lines between code & content are blurring. I made this 3d city block animation in claude 3.7. Then I used runway gen-3's video-to-video to style it like a lego city at night. At the rate things are going, this'll be a shader running in real-time.

The lines between code & content are blurring. I made this 3d city block animation in claude 3.7. Then I used runway gen-3's video-to-video to style it like a lego city at night. At the rate things are going, this'll be a shader running in real-time.

488,261 views

I love 3d maps like this because they’re inherently an abstraction of reality. Unlike 3d scans, the goal isn’t to create a 1:1 mirror world. The goal is to create a stylized distillation down to its visual essence, so you can recognize it effortlessly.

I love 3d maps like this because they’re inherently an abstraction of reality. Unlike 3d scans, the goal isn’t to create a 1:1 mirror world. The goal is to create a stylized distillation down to its visual essence, so you can recognize it effortlessly.

249,351 views

This is IronSight - a 4D reconstruction built by fusing footage from two pairs of meta ray-bans. A google research buddy saw the prototype and joked this would've been a siggraph paper a few years ago. Today it's a weekend build with fable. Stay tuned for more mad science. Happy 4th!

This is IronSight - a 4D reconstruction built by fusing footage from two pairs of meta ray-bans. A google research buddy saw the prototype and joked this would've been a siggraph paper a few years ago. Today it's a weekend build with fable. Stay tuned for more mad science. Happy 4th!

95,286 views

This tech maps the physical world in 3d and snaps it perfectly to my camera feed at 60 fps. Visual Positioning Systems (VPS) are the under hyped backbone of spatial computing. This is how we connect the world of bits & atoms.

This tech maps the physical world in 3d and snaps it perfectly to my camera feed at 60 fps. Visual Positioning Systems (VPS) are the under hyped backbone of spatial computing. This is how we connect the world of bits & atoms.

93,864 views

AI stitching together multiple video feeds into one omniscient traffic god. This is what happens when cameras start talking to each other -- mapping the trajectory of every vehicle and pedestrian seamlessly across cameras. Spatial intelligence is coming to a city near you.

AI stitching together multiple video feeds into one omniscient traffic god. This is what happens when cameras start talking to each other -- mapping the trajectory of every vehicle and pedestrian seamlessly across cameras. Spatial intelligence is coming to a city near you.

329,360 views

Videos

LIVE
1.2k

Anya Rossi

sweetdream.ai

SweetDream.aiSponsored•Livecam
Streaming Now

Watch Anya Live

Anya is streaming live right now! Join her private show and enjoy exclusive content.

HD live stream
Exclusive private shows
1.2k viewers online

Free preview available • Premium content

Space and time reconstructed in 4D - y'all asked to see every moment all at once, so here you go. Seeing the full journey like this makes vonnegut’s “great millipedes” immediately click. Makes me go full existential about determinism vs free will. Then I start imagining higher dimensions and parallel timelines and my head explodes, along with my GPU. Also officially my first experiment with opus 5.5
0:22
bilawalsidhu's profile picture

Space and time reconstructed in 4D - y'all asked to see every moment all at once, so here you go. Seeing the full journey like this makes vonnegut’s “great millipedes” immediately click. Makes me go full existential about determinism vs free will. Then I start imagining higher dimensions and parallel timelines and my head explodes, along with my GPU. Also officially my first experiment with opus 5.5

Bilawal Sidhu

909,606 views • 26 days ago

God's eye view 24-hour replay of Operation Epic Fury. The Iran strikes kicked off and I set an AI agent swarm loose to record every OSINT signal I could find before the caches cleared. Built a full 4D reconstruction in WorldView. I can scrub through minute by minute and watch the whole thing unfold on a 3D globe: > Airspace clearing over Tehran > Ground strike coordinates locking in > Severe GPS interference blinding the region > EO and SAR satellites making passes over the strike zone > No-fly zones locking down 9 countries > Shipping fleets scrambling at the Strait of Hormuz It's pretty amazing how complete of a picture you can build without "proprietary data fusion" -- one dev with public signals and a love for computer graphics and geospatial intelligence. Thank you for all the love on my last post. Dropping WorldView in April. This my friends is just the beginning.
0:52
bilawalsidhu's profile picture

God's eye view 24-hour replay of Operation Epic Fury. The Iran strikes kicked off and I set an AI agent swarm loose to record every OSINT signal I could find before the caches cleared. Built a full 4D reconstruction in WorldView. I can scrub through minute by minute and watch the whole thing unfold on a 3D globe: > Airspace clearing over Tehran > Ground strike coordinates locking in > Severe GPS interference blinding the region > EO and SAR satellites making passes over the strike zone > No-fly zones locking down 9 countries > Shipping fleets scrambling at the Strait of Hormuz It's pretty amazing how complete of a picture you can build without "proprietary data fusion" -- one dev with public signals and a love for computer graphics and geospatial intelligence. Thank you for all the love on my last post. Dropping WorldView in April. This my friends is just the beginning.

Bilawal Sidhu

4,008,552 views • 7 months ago

First person view of the FlyDubai incident is one helluva rollercoaster. At its peak it was falling 31,000 ft/min. At that rate the desert was ~30 seconds away. Watch the horizon. Reconstructed w/ God's Eye View + Flightradar24 data.
0:57
bilawalsidhu's profile picture

First person view of the FlyDubai incident is one helluva rollercoaster. At its peak it was falling 31,000 ft/min. At that rate the desert was ~30 seconds away. Watch the horizon. Reconstructed w/ God's Eye View + Flightradar24 data.

Bilawal Sidhu

148,292 views • 18 days ago

All 4.5 years of the war in Ukraine through satellite fire detections. You can see the border line up clearly in waves. Staggering to see it from this point of view.
1:06
bilawalsidhu's profile picture

All 4.5 years of the war in Ukraine through satellite fire detections. You can see the border line up clearly in waves. Staggering to see it from this point of view.

Bilawal Sidhu

92,541 views • 12 days ago

Before/after of Corridor's latest AI video is wild. They shot video on greenscreen, made virtual sets in Unreal, then reskinned it to anime by finetuning Stable Diffusion. Net result? 120 VFX shots done by a team of 3 on a dime. Bravo! This is a milestone in creative technology🧵
0:39
bilawalsidhu's profile picture

Before/after of Corridor's latest AI video is wild. They shot video on greenscreen, made virtual sets in Unreal, then reskinned it to anime by finetuning Stable Diffusion. Net result? 120 VFX shots done by a team of 3 on a dime. Bravo! This is a milestone in creative technology🧵

Bilawal Sidhu

13,184,183 views • 3 years ago

holy crap! apple just beat google to the punch -- 3d gaussian splatting is coming to apple maps. these 3d scenes are made from oblique aerial imagery. but unlike blobby photogrammetry -- no more broccoli trees, no more melted powerlines -- ground level detail that actually holds up. here's hoping google maps/earth follows suite soon -- they have a significantly larger corpus of sensor data to work with. time to splat the world!
0:25
bilawalsidhu's profile picture

holy crap! apple just beat google to the punch -- 3d gaussian splatting is coming to apple maps. these 3d scenes are made from oblique aerial imagery. but unlike blobby photogrammetry -- no more broccoli trees, no more melted powerlines -- ground level detail that actually holds up. here's hoping google maps/earth follows suite soon -- they have a significantly larger corpus of sensor data to work with. time to splat the world!

Bilawal Sidhu

1,092,506 views • 4 months ago

People forget we have access to free global geostationary satellite imagery. Used it to track recent storms in the pacific using God's Eye View.
0:33
bilawalsidhu's profile picture

People forget we have access to free global geostationary satellite imagery. Used it to track recent storms in the pacific using God's Eye View.

Bilawal Sidhu

14,281 views • 2 days ago

Replaying the flight tracking data from the flydubai incident is harrowing. Imagine sitting in a plane that drops 14k ft in under 30 seconds. Passengers go full "let's roll" and storm the cockpit, while a bleeding captain has the awareness to open the door. Incredible recovery. Made w/ god's eye view + flightradar24 data.
0:31
bilawalsidhu's profile picture

Replaying the flight tracking data from the flydubai incident is harrowing. Imagine sitting in a plane that drops 14k ft in under 30 seconds. Passengers go full "let's roll" and storm the cockpit, while a bleeding captain has the awareness to open the door. Incredible recovery. Made w/ god's eye view + flightradar24 data.

Bilawal Sidhu

115,430 views • 19 days ago

all I can think about after seeing the tesla roadster demo
0:44
bilawalsidhu's profile picture

all I can think about after seeing the tesla roadster demo

Bilawal Sidhu

17,304 views • 3 days ago

OG Anunoby is too sick. Here is the full point-of-view 3d reconstruction of his winning tip-in from the Knicks game last night. You can literally relive it from his perspective. Built with viewpoint pro using stadium tracking cameras and unreal engine.
0:28
bilawalsidhu's profile picture

OG Anunoby is too sick. Here is the full point-of-view 3d reconstruction of his winning tip-in from the Knicks game last night. You can literally relive it from his perspective. Built with viewpoint pro using stadium tracking cameras and unreal engine.

Bilawal Sidhu

716,890 views • 4 months ago

Okay it happened! Snapchat Spectacles AR glasses. Fully standalone. 46 degree field of view. 37 pixels per degree. That’s roughly like a 100” TV screen! 2x snapdragon chips. 45 minutes of battery. Auto transitioning lenses. Designed for co-presence. Spectator mode and more. Gotta hand it to Snap for pushing on this extremely hard engineering challenge, despite the rest of their peers going VR first as a stepping stone to this ultimate vision.
4:21
bilawalsidhu's profile picture

Okay it happened! Snapchat Spectacles AR glasses. Fully standalone. 46 degree field of view. 37 pixels per degree. That’s roughly like a 100” TV screen! 2x snapdragon chips. 45 minutes of battery. Auto transitioning lenses. Designed for co-presence. Spectator mode and more. Gotta hand it to Snap for pushing on this extremely hard engineering challenge, despite the rest of their peers going VR first as a stepping stone to this ultimate vision.

Bilawal Sidhu

2,665,469 views • 2 years ago

God’s Eye View V1 is open source. It feels like a spy simulator in your browser -- except the underlying data is real, and you can talk to the planet too. Track planes, ships, satellites, traffic cameras, and critical infrastructure. Use voice mode to ask what’s happening, annotate the 3D world, or jump into a plane’s cockpit. Already a ton to explore. Code is MIT licensed, so add new layers, extend the voice agent, break things, and show me what you cook.
0:39
bilawalsidhu's profile picture

God’s Eye View V1 is open source. It feels like a spy simulator in your browser -- except the underlying data is real, and you can talk to the planet too. Track planes, ships, satellites, traffic cameras, and critical infrastructure. Use voice mode to ask what’s happening, annotate the 3D world, or jump into a plane’s cockpit. Already a ton to explore. Code is MIT licensed, so add new layers, extend the voice agent, break things, and show me what you cook.

Bilawal Sidhu

192,762 views • 1 month ago

Watch the crash landing of the Amazon cargo plane from a virtual cockpit view. Reconstructed using public flight tracking data, bystander footage, ATC audio, and visualized in god’s eye view (open source). Flight 7598’s final resting position was geolocated from news helicopter footage.
1:19
bilawalsidhu's profile picture

Watch the crash landing of the Amazon cargo plane from a virtual cockpit view. Reconstructed using public flight tracking data, bystander footage, ATC audio, and visualized in god’s eye view (open source). Flight 7598’s final resting position was geolocated from news helicopter footage.

Bilawal Sidhu

139,610 views • 1 month ago

Everything here is 100% generated w/ Google Veo 2. I've got early access, and the visual fidelity and prompt adherence is genuinely nuts. Let's test it together and have some fun. Drop your prompts below -- and for the next hour or so I'll reply with videos 👇
0:27
bilawalsidhu's profile picture

Everything here is 100% generated w/ Google Veo 2. I've got early access, and the visual fidelity and prompt adherence is genuinely nuts. Let's test it together and have some fun. Drop your prompts below -- and for the next hour or so I'll reply with videos 👇

Bilawal Sidhu

2,242,856 views • 1 year ago

I reconstructed Fleet Week in 3D from real flight and vessel tracking data - all rendered in a photorealistic digital twin of San Francisco. The camera engine reads the flight telemetry to track each jet and speed ramp at just the right moment. Reliving any event in any city from a god's eye view is closer than you think. Shout out to the aviators who give us this glorious treat every year!
0:40
bilawalsidhu's profile picture

I reconstructed Fleet Week in 3D from real flight and vessel tracking data - all rendered in a photorealistic digital twin of San Francisco. The camera engine reads the flight telemetry to track each jet and speed ramp at just the right moment. Reliving any event in any city from a god's eye view is closer than you think. Shout out to the aviators who give us this glorious treat every year!

Bilawal Sidhu

26,906 views • 8 days ago

I made a 4D god's eye replay of the Iran strikes using public OSINT data. When I turned on the orbital layer in worldview something jumped out. You can see satellite passes stack up over the strike zones in the hours before & after impact. Everyone was watching. Some of them were overhead before it started. American KH-11s and TOPAZ SAR. Russian BARS-M and Persona. Chinese Gaofen optical and SAR. Maxar WorldView Legion. Airbus Pleiades. Capella. ICEYE. That's textbook behavior -- you collect right before for targeting, you strike, then you collect again for battle damage assessment. Just wild to see it all replayed in 3D like this. The commercial constellation density is also striking. What used to be exclusive nation state capability is now mirrored by half a dozen commercial operators. The intelligence monopoly is over.
0:43
bilawalsidhu's profile picture

I made a 4D god's eye replay of the Iran strikes using public OSINT data. When I turned on the orbital layer in worldview something jumped out. You can see satellite passes stack up over the strike zones in the hours before & after impact. Everyone was watching. Some of them were overhead before it started. American KH-11s and TOPAZ SAR. Russian BARS-M and Persona. Chinese Gaofen optical and SAR. Maxar WorldView Legion. Airbus Pleiades. Capella. ICEYE. That's textbook behavior -- you collect right before for targeting, you strike, then you collect again for battle damage assessment. Just wild to see it all replayed in 3D like this. The commercial constellation density is also striking. What used to be exclusive nation state capability is now mirrored by half a dozen commercial operators. The intelligence monopoly is over.

Bilawal Sidhu

720,356 views • 7 months ago

bro putting a belt fed machine gun on a monitor arm is probably the most america thing i've seen all week. shout out eric pettway.
1:17
bilawalsidhu's profile picture

bro putting a belt fed machine gun on a monitor arm is probably the most america thing i've seen all week. shout out eric pettway.

Bilawal Sidhu

416,927 views • 4 months ago

Just used claude fable (aka mythos) to create this city block simulator complete with multi-agent traffic, live detection boxes + tracks, and day to night cycle. And it just one shotted it. This is gonna be fun -- the gap between idea and execution just keeps collapsing.
0:26
bilawalsidhu's profile picture

Just used claude fable (aka mythos) to create this city block simulator complete with multi-agent traffic, live detection boxes + tracks, and day to night cycle. And it just one shotted it. This is gonna be fun -- the gap between idea and execution just keeps collapsing.

Bilawal Sidhu

373,046 views • 4 months ago

Google is now using Gemini to cross-reference ~250M places with Street View imagery to identify visible landmarks for turn-by-turn nav. Think iconic buildings, gas stations and restaurants. So instead of "turn right in 500 feet" you get "turn right after the Thai Siam Restaurant" with the landmark highlighted. AI solving the distance estimation problem by using what you can actually see. Rolling out in US.
0:46
bilawalsidhu's profile picture

Google is now using Gemini to cross-reference ~250M places with Street View imagery to identify visible landmarks for turn-by-turn nav. Think iconic buildings, gas stations and restaurants. So instead of "turn right in 500 feet" you get "turn right after the Thai Siam Restaurant" with the landmark highlighted. AI solving the distance estimation problem by using what you can actually see. Rolling out in US.

Bilawal Sidhu

963,315 views • 11 months ago

This will change the way we experience sports forever -- watching the game from a gods eye view. Arcturus is building 4D gaussian splatting tech that can capture every angle of a sporting event and pushes the bar for volumetric video. I tested this in a headset and it makes 360 and 3D 180 video look ancient. This puts you closer to the action than any stadium seat, and it’s genuinely mind blowing.
0:23
bilawalsidhu's profile picture

This will change the way we experience sports forever -- watching the game from a gods eye view. Arcturus is building 4D gaussian splatting tech that can capture every angle of a sporting event and pushes the bar for volumetric video. I tested this in a headset and it makes 360 and 3D 180 video look ancient. This puts you closer to the action than any stadium seat, and it’s genuinely mind blowing.

Bilawal Sidhu

513,264 views • 8 months ago