Bilawal Sidhu's banner

Bilawal Sidhu

@bilawalsidhu • 119,791 subscribers

decompiling reality; reconstructing real world events from public data. experimenting with vfx, sensing & robotics. https://t.co/O19H0QHsGW

Shorts

Space and time reconstructed in 4D Is this how higher dimensional beings see us - every moment at once? Starting to understand what Vonnegut meant by humans being “great millipedes” - clearly it applies to our four legged friends too! Geolocated 2d video → per frame 3d gaussians → each left precisely where & when it happened

Space and time reconstructed in 4D Is this how higher dimensional beings see us - every moment at once? Starting to understand what Vonnegut meant by humans being “great millipedes” - clearly it applies to our four legged friends too! Geolocated 2d video → per frame 3d gaussians → each left precisely where & when it happened

33,077,714 görüntüleme

What even is time and space? Kurt Vonnegut's "Tralfamadorians don't see human beings as two-legged creatures, either. They see them as great millipedes - with babies' legs on one end and old people's legs at the other” So here's me walking through the world, leaving a 3D snapshot of every moment exactly when and where it happened. Feels a lot like onion skinning reality (to use the animation analogy). We are beings stuck in the arrow of time - who get momentary glimpses of what it means to break free from it. Perhaps this is one of those glimpses. Did not expect the last post to blow up like that. Really enjoyed the convos - thanks for all the love and the new rabbit holes to dive into.

What even is time and space? Kurt Vonnegut's "Tralfamadorians don't see human beings as two-legged creatures, either. They see them as great millipedes - with babies' legs on one end and old people's legs at the other” So here's me walking through the world, leaving a 3D snapshot of every moment exactly when and where it happened. Feels a lot like onion skinning reality (to use the animation analogy). We are beings stuck in the arrow of time - who get momentary glimpses of what it means to break free from it. Perhaps this is one of those glimpses. Did not expect the last post to blow up like that. Really enjoyed the convos - thanks for all the love and the new rabbit holes to dive into.

665,039 görüntüleme

peak internet: ai generated cctv footage of police arresting ppl for wearing huge boots video credit: u/Qemmish

peak internet: ai generated cctv footage of police arresting ppl for wearing huge boots video credit: u/Qemmish

25,875,119 görüntüleme

It's mind bending walking around the same place simultaneously in two timelines Inside the frame it's winter, and outside the frame it's summer - until you step inside. Recorded this footage in the winter and localized it against a massive 3d scan of the same ranch in the summer. You can follow the camera from the outside, then step into the moment I recorded. We spend so much time looking at memories through 2d rectangles in our camera roll. It's a strange feeling to walk around one instead. Like navigating through space instead of scrolling through time. The geospatial memory palace continues to come to life!

It's mind bending walking around the same place simultaneously in two timelines Inside the frame it's winter, and outside the frame it's summer - until you step inside. Recorded this footage in the winter and localized it against a massive 3d scan of the same ranch in the summer. You can follow the camera from the outside, then step into the moment I recorded. We spend so much time looking at memories through 2d rectangles in our camera roll. It's a strange feeling to walk around one instead. Like navigating through space instead of scrolling through time. The geospatial memory palace continues to come to life!

279,829 görüntüleme

Visualizing how higher dimensions might perceive our reality. Past, present, and future all at once.

Visualizing how higher dimensions might perceive our reality. Past, present, and future all at once.

178,007 görüntüleme

2d moments frozen in time. Turned into 3d holograms. Left exactly where they happened in the real world. The geospatial memory palace coming to life. Excited baby deer startles mama deer momentarily, who then chills out after :) Can you imagine when your entire camera roll comes to life like this?

2d moments frozen in time. Turned into 3d holograms. Left exactly where they happened in the real world. The geospatial memory palace coming to life. Excited baby deer startles mama deer momentarily, who then chills out after :) Can you imagine when your entire camera roll comes to life like this?

343,881 görüntüleme

OpenAI just dropped their Sora research paper. As expected, the video-to-video results are flipping spectacular 🪄 A few other gems:

OpenAI just dropped their Sora research paper. As expected, the video-to-video results are flipping spectacular 🪄 A few other gems:

1,873,820 görüntüleme

What if every video you ever shot could turn into a permanent 3D hologram in the exact place it happened? I did it with photos first. Now I can do it with any video. Here’s a mama deer and her baby deer, filmed with my iphone a few days ago -- now floating as geo anchored holograms exactly where I captured them.

What if every video you ever shot could turn into a permanent 3D hologram in the exact place it happened? I did it with photos first. Now I can do it with any video. Here’s a mama deer and her baby deer, filmed with my iphone a few days ago -- now floating as geo anchored holograms exactly where I captured them.

133,806 görüntüleme

Nano Banana Pro is a really good cartographer. Used it to turn low res satellite imagery into a detailed hand drawn map and vector HD map. Pretty wild how well it segments everything and even recovers paths/roads hidden under tree cover. Looks way more detailed than the current google basemap which is pretty sparse in countries like India. Included both in video for comparison.

Nano Banana Pro is a really good cartographer. Used it to turn low res satellite imagery into a detailed hand drawn map and vector HD map. Pretty wild how well it segments everything and even recovers paths/roads hidden under tree cover. Looks way more detailed than the current google basemap which is pretty sparse in countries like India. Included both in video for comparison.

554,024 görüntüleme

Generative AI is super cool… BUT I’m continually blown away with the work happening in ‘procedural’ 3D modelling. Especially given these plugins are for a free (!) 3D tool like Blender. We needed a fancy Houdini license to do this just a few years ago 🤯

Generative AI is super cool… BUT I’m continually blown away with the work happening in ‘procedural’ 3D modelling. Especially given these plugins are for a free (!) 3D tool like Blender. We needed a fancy Houdini license to do this just a few years ago 🤯

1,366,062 görüntüleme

Damn it worked! Genie 3 world --> inpaint UI --> 4x topaz AI upscale --> train 3d gaussian splat You can step inside a painting of Socrates from 1787. Better than any image-to-3d model I've seen. I think Google has stumbled upon the killer app for VR -- the literal holodeck.

Damn it worked! Genie 3 world --> inpaint UI --> 4x topaz AI upscale --> train 3d gaussian splat You can step inside a painting of Socrates from 1787. Better than any image-to-3d model I've seen. I think Google has stumbled upon the killer app for VR -- the literal holodeck.

659,325 görüntüleme

Progress update: figuring out the 3D location of every photo taken at TED with attribution. It's starting to feel magical -- makes me wonder what experiences are possible if we could do this for every live event ever.

Progress update: figuring out the 3D location of every photo taken at TED with attribution. It's starting to feel magical -- makes me wonder what experiences are possible if we could do this for every live event ever.

101,647 görüntüleme

Lmao. What niche even is this — grassroots dirt track racing meets google maps nerds? Veo 3 videos are seriously ridiculous and fun. Turn audio on for max enjoyment.

Lmao. What niche even is this — grassroots dirt track racing meets google maps nerds? Veo 3 videos are seriously ridiculous and fun. Turn audio on for max enjoyment.

452,190 görüntüleme

One of the wildest emergent capabilities of Genie 3 is that maps actually work. As I walk around the forest, the GPS display updates its heading in real time. Remember. There is no game engine here. This is an AI hallucinating a working navigational instrument purely from next frame prediction. 🤯

One of the wildest emergent capabilities of Genie 3 is that maps actually work. As I walk around the forest, the GPS display updates its heading in real time. Remember. There is no game engine here. This is an AI hallucinating a working navigational instrument purely from next frame prediction. 🤯

247,445 görüntüleme

The lines between code & content are blurring. I made this 3d city block animation in claude 3.7. Then I used runway gen-3's video-to-video to style it like a lego city at night. At the rate things are going, this'll be a shader running in real-time.

The lines between code & content are blurring. I made this 3d city block animation in claude 3.7. Then I used runway gen-3's video-to-video to style it like a lego city at night. At the rate things are going, this'll be a shader running in real-time.

488,261 görüntüleme

I love 3d maps like this because they’re inherently an abstraction of reality. Unlike 3d scans, the goal isn’t to create a 1:1 mirror world. The goal is to create a stylized distillation down to its visual essence, so you can recognize it effortlessly.

I love 3d maps like this because they’re inherently an abstraction of reality. Unlike 3d scans, the goal isn’t to create a 1:1 mirror world. The goal is to create a stylized distillation down to its visual essence, so you can recognize it effortlessly.

249,351 görüntüleme

This is IronSight - a 4D reconstruction built by fusing footage from two pairs of meta ray-bans. A google research buddy saw the prototype and joked this would've been a siggraph paper a few years ago. Today it's a weekend build with fable. Stay tuned for more mad science. Happy 4th!

This is IronSight - a 4D reconstruction built by fusing footage from two pairs of meta ray-bans. A google research buddy saw the prototype and joked this would've been a siggraph paper a few years ago. Today it's a weekend build with fable. Stay tuned for more mad science. Happy 4th!

95,286 görüntüleme

This tech maps the physical world in 3d and snaps it perfectly to my camera feed at 60 fps. Visual Positioning Systems (VPS) are the under hyped backbone of spatial computing. This is how we connect the world of bits & atoms.

This tech maps the physical world in 3d and snaps it perfectly to my camera feed at 60 fps. Visual Positioning Systems (VPS) are the under hyped backbone of spatial computing. This is how we connect the world of bits & atoms.

93,864 görüntüleme

AI stitching together multiple video feeds into one omniscient traffic god. This is what happens when cameras start talking to each other -- mapping the trajectory of every vehicle and pedestrian seamlessly across cameras. Spatial intelligence is coming to a city near you.

AI stitching together multiple video feeds into one omniscient traffic god. This is what happens when cameras start talking to each other -- mapping the trajectory of every vehicle and pedestrian seamlessly across cameras. Spatial intelligence is coming to a city near you.

329,360 görüntüleme

Videos

Anya Rossi

sweetdream.ai

SweetDream.ai•Sponsored•Livecam

Watch Anya Live

Anya is streaming live right now! Join her private show and enjoy exclusive content.

Exclusive private shows

1.2k viewers online

Private Show

Join now for exclusive access

Free preview available • Premium content

Space and time reconstructed in 4D - y'all asked to see every moment all at once, so here you go. Seeing the full journey like this makes vonnegut’s “great millipedes” immediately click. Makes me go full existential about determinism vs free will. Then I start imagining higher dimensions and parallel timelines and my head explodes, along with my GPU. Also officially my first experiment with opus 5.5

Space and time reconstructed in 4D - y'all asked to see every moment all at once, so here you go. Seeing the full journey like this makes vonnegut’s “great millipedes” immediately click. Makes me go full existential about determinism vs free will. Then I start imagining higher dimensions and parallel timelines and my head explodes, along with my GPU. Also officially my first experiment with opus 5.5

909,606 görüntüleme • 26 gün önce

God's eye view 24-hour replay of Operation Epic Fury. The Iran strikes kicked off and I set an AI agent swarm loose to record every OSINT signal I could find before the caches cleared. Built a full 4D reconstruction in WorldView. I can scrub through minute by minute and watch the whole thing unfold on a 3D globe: > Airspace clearing over Tehran > Ground strike coordinates locking in > Severe GPS interference blinding the region > EO and SAR satellites making passes over the strike zone > No-fly zones locking down 9 countries > Shipping fleets scrambling at the Strait of Hormuz It's pretty amazing how complete of a picture you can build without "proprietary data fusion" -- one dev with public signals and a love for computer graphics and geospatial intelligence. Thank you for all the love on my last post. Dropping WorldView in April. This my friends is just the beginning.

God's eye view 24-hour replay of Operation Epic Fury. The Iran strikes kicked off and I set an AI agent swarm loose to record every OSINT signal I could find before the caches cleared. Built a full 4D reconstruction in WorldView. I can scrub through minute by minute and watch the whole thing unfold on a 3D globe: > Airspace clearing over Tehran > Ground strike coordinates locking in > Severe GPS interference blinding the region > EO and SAR satellites making passes over the strike zone > No-fly zones locking down 9 countries > Shipping fleets scrambling at the Strait of Hormuz It's pretty amazing how complete of a picture you can build without "proprietary data fusion" -- one dev with public signals and a love for computer graphics and geospatial intelligence. Thank you for all the love on my last post. Dropping WorldView in April. This my friends is just the beginning.

4,008,552 görüntüleme • 7 ay önce

First person view of the FlyDubai incident is one helluva rollercoaster. At its peak it was falling 31,000 ft/min. At that rate the desert was ~30 seconds away. Watch the horizon. Reconstructed w/ God's Eye View + Flightradar24 data.

First person view of the FlyDubai incident is one helluva rollercoaster. At its peak it was falling 31,000 ft/min. At that rate the desert was ~30 seconds away. Watch the horizon. Reconstructed w/ God's Eye View + Flightradar24 data.

147,974 görüntüleme • 17 gün önce

All 4.5 years of the war in Ukraine through satellite fire detections. You can see the border line up clearly in waves. Staggering to see it from this point of view.

All 4.5 years of the war in Ukraine through satellite fire detections. You can see the border line up clearly in waves. Staggering to see it from this point of view.

92,541 görüntüleme • 12 gün önce

Before/after of Corridor's latest AI video is wild. They shot video on greenscreen, made virtual sets in Unreal, then reskinned it to anime by finetuning Stable Diffusion. Net result? 120 VFX shots done by a team of 3 on a dime. Bravo! This is a milestone in creative technology🧵

Before/after of Corridor's latest AI video is wild. They shot video on greenscreen, made virtual sets in Unreal, then reskinned it to anime by finetuning Stable Diffusion. Net result? 120 VFX shots done by a team of 3 on a dime. Bravo! This is a milestone in creative technology🧵

13,184,183 görüntüleme • 3 yıl önce

holy crap! apple just beat google to the punch -- 3d gaussian splatting is coming to apple maps. these 3d scenes are made from oblique aerial imagery. but unlike blobby photogrammetry -- no more broccoli trees, no more melted powerlines -- ground level detail that actually holds up. here's hoping google maps/earth follows suite soon -- they have a significantly larger corpus of sensor data to work with. time to splat the world!

holy crap! apple just beat google to the punch -- 3d gaussian splatting is coming to apple maps. these 3d scenes are made from oblique aerial imagery. but unlike blobby photogrammetry -- no more broccoli trees, no more melted powerlines -- ground level detail that actually holds up. here's hoping google maps/earth follows suite soon -- they have a significantly larger corpus of sensor data to work with. time to splat the world!

1,092,506 görüntüleme • 4 ay önce

People forget we have access to free global geostationary satellite imagery. Used it to track recent storms in the pacific using God's Eye View.

People forget we have access to free global geostationary satellite imagery. Used it to track recent storms in the pacific using God's Eye View.

13,690 görüntüleme • 2 gün önce

Replaying the flight tracking data from the flydubai incident is harrowing. Imagine sitting in a plane that drops 14k ft in under 30 seconds. Passengers go full "let's roll" and storm the cockpit, while a bleeding captain has the awareness to open the door. Incredible recovery. Made w/ god's eye view + flightradar24 data.

Replaying the flight tracking data from the flydubai incident is harrowing. Imagine sitting in a plane that drops 14k ft in under 30 seconds. Passengers go full "let's roll" and storm the cockpit, while a bleeding captain has the awareness to open the door. Incredible recovery. Made w/ god's eye view + flightradar24 data.

115,430 görüntüleme • 19 gün önce

all I can think about after seeing the tesla roadster demo

all I can think about after seeing the tesla roadster demo

17,304 görüntüleme • 3 gün önce

OG Anunoby is too sick. Here is the full point-of-view 3d reconstruction of his winning tip-in from the Knicks game last night. You can literally relive it from his perspective. Built with viewpoint pro using stadium tracking cameras and unreal engine.

OG Anunoby is too sick. Here is the full point-of-view 3d reconstruction of his winning tip-in from the Knicks game last night. You can literally relive it from his perspective. Built with viewpoint pro using stadium tracking cameras and unreal engine.

716,890 görüntüleme • 4 ay önce

Okay it happened! Snapchat Spectacles AR glasses. Fully standalone. 46 degree field of view. 37 pixels per degree. That’s roughly like a 100” TV screen! 2x snapdragon chips. 45 minutes of battery. Auto transitioning lenses. Designed for co-presence. Spectator mode and more. Gotta hand it to Snap for pushing on this extremely hard engineering challenge, despite the rest of their peers going VR first as a stepping stone to this ultimate vision.

Okay it happened! Snapchat Spectacles AR glasses. Fully standalone. 46 degree field of view. 37 pixels per degree. That’s roughly like a 100” TV screen! 2x snapdragon chips. 45 minutes of battery. Auto transitioning lenses. Designed for co-presence. Spectator mode and more. Gotta hand it to Snap for pushing on this extremely hard engineering challenge, despite the rest of their peers going VR first as a stepping stone to this ultimate vision.

2,665,469 görüntüleme • 2 yıl önce

God’s Eye View V1 is open source. It feels like a spy simulator in your browser -- except the underlying data is real, and you can talk to the planet too. Track planes, ships, satellites, traffic cameras, and critical infrastructure. Use voice mode to ask what’s happening, annotate the 3D world, or jump into a plane’s cockpit. Already a ton to explore. Code is MIT licensed, so add new layers, extend the voice agent, break things, and show me what you cook.

God’s Eye View V1 is open source. It feels like a spy simulator in your browser -- except the underlying data is real, and you can talk to the planet too. Track planes, ships, satellites, traffic cameras, and critical infrastructure. Use voice mode to ask what’s happening, annotate the 3D world, or jump into a plane’s cockpit. Already a ton to explore. Code is MIT licensed, so add new layers, extend the voice agent, break things, and show me what you cook.

192,762 görüntüleme • 1 ay önce

Watch the crash landing of the Amazon cargo plane from a virtual cockpit view. Reconstructed using public flight tracking data, bystander footage, ATC audio, and visualized in god’s eye view (open source). Flight 7598’s final resting position was geolocated from news helicopter footage.

Watch the crash landing of the Amazon cargo plane from a virtual cockpit view. Reconstructed using public flight tracking data, bystander footage, ATC audio, and visualized in god’s eye view (open source). Flight 7598’s final resting position was geolocated from news helicopter footage.

139,610 görüntüleme • 1 ay önce

Everything here is 100% generated w/ Google Veo 2. I've got early access, and the visual fidelity and prompt adherence is genuinely nuts. Let's test it together and have some fun. Drop your prompts below -- and for the next hour or so I'll reply with videos 👇

Everything here is 100% generated w/ Google Veo 2. I've got early access, and the visual fidelity and prompt adherence is genuinely nuts. Let's test it together and have some fun. Drop your prompts below -- and for the next hour or so I'll reply with videos 👇

2,242,856 görüntüleme • 1 yıl önce

I reconstructed Fleet Week in 3D from real flight and vessel tracking data - all rendered in a photorealistic digital twin of San Francisco. The camera engine reads the flight telemetry to track each jet and speed ramp at just the right moment. Reliving any event in any city from a god's eye view is closer than you think. Shout out to the aviators who give us this glorious treat every year!

I reconstructed Fleet Week in 3D from real flight and vessel tracking data - all rendered in a photorealistic digital twin of San Francisco. The camera engine reads the flight telemetry to track each jet and speed ramp at just the right moment. Reliving any event in any city from a god's eye view is closer than you think. Shout out to the aviators who give us this glorious treat every year!

26,906 görüntüleme • 8 gün önce

I made a 4D god's eye replay of the Iran strikes using public OSINT data. When I turned on the orbital layer in worldview something jumped out. You can see satellite passes stack up over the strike zones in the hours before & after impact. Everyone was watching. Some of them were overhead before it started. American KH-11s and TOPAZ SAR. Russian BARS-M and Persona. Chinese Gaofen optical and SAR. Maxar WorldView Legion. Airbus Pleiades. Capella. ICEYE. That's textbook behavior -- you collect right before for targeting, you strike, then you collect again for battle damage assessment. Just wild to see it all replayed in 3D like this. The commercial constellation density is also striking. What used to be exclusive nation state capability is now mirrored by half a dozen commercial operators. The intelligence monopoly is over.

I made a 4D god's eye replay of the Iran strikes using public OSINT data. When I turned on the orbital layer in worldview something jumped out. You can see satellite passes stack up over the strike zones in the hours before & after impact. Everyone was watching. Some of them were overhead before it started. American KH-11s and TOPAZ SAR. Russian BARS-M and Persona. Chinese Gaofen optical and SAR. Maxar WorldView Legion. Airbus Pleiades. Capella. ICEYE. That's textbook behavior -- you collect right before for targeting, you strike, then you collect again for battle damage assessment. Just wild to see it all replayed in 3D like this. The commercial constellation density is also striking. What used to be exclusive nation state capability is now mirrored by half a dozen commercial operators. The intelligence monopoly is over.

720,356 görüntüleme • 7 ay önce

bro putting a belt fed machine gun on a monitor arm is probably the most america thing i've seen all week. shout out eric pettway.

bro putting a belt fed machine gun on a monitor arm is probably the most america thing i've seen all week. shout out eric pettway.

416,927 görüntüleme • 4 ay önce

Just used claude fable (aka mythos) to create this city block simulator complete with multi-agent traffic, live detection boxes + tracks, and day to night cycle. And it just one shotted it. This is gonna be fun -- the gap between idea and execution just keeps collapsing.

Just used claude fable (aka mythos) to create this city block simulator complete with multi-agent traffic, live detection boxes + tracks, and day to night cycle. And it just one shotted it. This is gonna be fun -- the gap between idea and execution just keeps collapsing.

373,046 görüntüleme • 4 ay önce

Google is now using Gemini to cross-reference ~250M places with Street View imagery to identify visible landmarks for turn-by-turn nav. Think iconic buildings, gas stations and restaurants. So instead of "turn right in 500 feet" you get "turn right after the Thai Siam Restaurant" with the landmark highlighted. AI solving the distance estimation problem by using what you can actually see. Rolling out in US.

Google is now using Gemini to cross-reference ~250M places with Street View imagery to identify visible landmarks for turn-by-turn nav. Think iconic buildings, gas stations and restaurants. So instead of "turn right in 500 feet" you get "turn right after the Thai Siam Restaurant" with the landmark highlighted. AI solving the distance estimation problem by using what you can actually see. Rolling out in US.

963,315 görüntüleme • 11 ay önce

This will change the way we experience sports forever -- watching the game from a gods eye view. Arcturus is building 4D gaussian splatting tech that can capture every angle of a sporting event and pushes the bar for volumetric video. I tested this in a headset and it makes 360 and 3D 180 video look ancient. This puts you closer to the action than any stadium seat, and it’s genuinely mind blowing.

This will change the way we experience sports forever -- watching the game from a gods eye view. Arcturus is building 4D gaussian splatting tech that can capture every angle of a sporting event and pushes the bar for volumetric video. I tested this in a headset and it makes 360 and 3D 180 video look ancient. This puts you closer to the action than any stadium seat, and it’s genuinely mind blowing.

513,264 görüntüleme • 8 ay önce