Bilawal Sidhu's banner

Bilawal Sidhu

@bilawalsidhu • 110,320 subscribers

Spatial intelligence. World models. Visual effects. Creator w/ 2.1M+ audience. Tech Curator @ TED. A16z Scout. Ex-Google PM (AR/VR & 3D Maps) https://t.co/fysPkbPoQ2

Shorts

2d moments frozen in time. Turned into 3d holograms. Left exactly where they happened in the real world. The geospatial memory palace coming to life. Excited baby deer startles mama deer momentarily, who then chills out after :) Can you imagine when your entire camera roll comes to life like this?

2d moments frozen in time. Turned into 3d holograms. Left exactly where they happened in the real world. The geospatial memory palace coming to life. Excited baby deer startles mama deer momentarily, who then chills out after :) Can you imagine when your entire camera roll comes to life like this?

343,600 görüntüleme

peak internet: ai generated cctv footage of police arresting ppl for wearing huge boots video credit: u/Qemmish

peak internet: ai generated cctv footage of police arresting ppl for wearing huge boots video credit: u/Qemmish

25,872,865 görüntüleme

What if every video you ever shot could turn into a permanent 3D hologram in the exact place it happened? I did it with photos first. Now I can do it with any video. Here’s a mama deer and her baby deer, filmed with my iphone a few days ago -- now floating as geo anchored holograms exactly where I captured them.

What if every video you ever shot could turn into a permanent 3D hologram in the exact place it happened? I did it with photos first. Now I can do it with any video. Here’s a mama deer and her baby deer, filmed with my iphone a few days ago -- now floating as geo anchored holograms exactly where I captured them.

132,809 görüntüleme

Progress update: figuring out the 3D location of every photo taken at TED with attribution. It's starting to feel magical -- makes me wonder what experiences are possible if we could do this for every live event ever.

Progress update: figuring out the 3D location of every photo taken at TED with attribution. It's starting to feel magical -- makes me wonder what experiences are possible if we could do this for every live event ever.

100,640 görüntüleme

OpenAI just dropped their Sora research paper. As expected, the video-to-video results are flipping spectacular 🪄 A few other gems:

OpenAI just dropped their Sora research paper. As expected, the video-to-video results are flipping spectacular 🪄 A few other gems:

1,873,706 görüntüleme

Nano Banana Pro is a really good cartographer. Used it to turn low res satellite imagery into a detailed hand drawn map and vector HD map. Pretty wild how well it segments everything and even recovers paths/roads hidden under tree cover. Looks way more detailed than the current google basemap which is pretty sparse in countries like India. Included both in video for comparison.

Nano Banana Pro is a really good cartographer. Used it to turn low res satellite imagery into a detailed hand drawn map and vector HD map. Pretty wild how well it segments everything and even recovers paths/roads hidden under tree cover. Looks way more detailed than the current google basemap which is pretty sparse in countries like India. Included both in video for comparison.

554,024 görüntüleme

Generative AI is super cool… BUT I’m continually blown away with the work happening in ‘procedural’ 3D modelling. Especially given these plugins are for a free (!) 3D tool like Blender. We needed a fancy Houdini license to do this just a few years ago 🤯

Generative AI is super cool… BUT I’m continually blown away with the work happening in ‘procedural’ 3D modelling. Especially given these plugins are for a free (!) 3D tool like Blender. We needed a fancy Houdini license to do this just a few years ago 🤯

1,365,963 görüntüleme

Damn it worked! Genie 3 world --> inpaint UI --> 4x topaz AI upscale --> train 3d gaussian splat You can step inside a painting of Socrates from 1787. Better than any image-to-3d model I've seen. I think Google has stumbled upon the killer app for VR -- the literal holodeck.

Damn it worked! Genie 3 world --> inpaint UI --> 4x topaz AI upscale --> train 3d gaussian splat You can step inside a painting of Socrates from 1787. Better than any image-to-3d model I've seen. I think Google has stumbled upon the killer app for VR -- the literal holodeck.

658,620 görüntüleme

This is IronSight - a 4D reconstruction built by fusing footage from two pairs of meta ray-bans. A google research buddy saw the prototype and joked this would've been a siggraph paper a few years ago. Today it's a weekend build with fable. Stay tuned for more mad science. Happy 4th!

This is IronSight - a 4D reconstruction built by fusing footage from two pairs of meta ray-bans. A google research buddy saw the prototype and joked this would've been a siggraph paper a few years ago. Today it's a weekend build with fable. Stay tuned for more mad science. Happy 4th!

95,105 görüntüleme

This tech maps the physical world in 3d and snaps it perfectly to my camera feed at 60 fps. Visual Positioning Systems (VPS) are the under hyped backbone of spatial computing. This is how we connect the world of bits & atoms.

This tech maps the physical world in 3d and snaps it perfectly to my camera feed at 60 fps. Visual Positioning Systems (VPS) are the under hyped backbone of spatial computing. This is how we connect the world of bits & atoms.

93,660 görüntüleme

One of the wildest emergent capabilities of Genie 3 is that maps actually work. As I walk around the forest, the GPS display updates its heading in real time. Remember. There is no game engine here. This is an AI hallucinating a working navigational instrument purely from next frame prediction. 🤯

One of the wildest emergent capabilities of Genie 3 is that maps actually work. As I walk around the forest, the GPS display updates its heading in real time. Remember. There is no game engine here. This is an AI hallucinating a working navigational instrument purely from next frame prediction. 🤯

247,184 görüntüleme

Lmao. What niche even is this — grassroots dirt track racing meets google maps nerds? Veo 3 videos are seriously ridiculous and fun. Turn audio on for max enjoyment.

Lmao. What niche even is this — grassroots dirt track racing meets google maps nerds? Veo 3 videos are seriously ridiculous and fun. Turn audio on for max enjoyment.

452,046 görüntüleme

I love 3d maps like this because they’re inherently an abstraction of reality. Unlike 3d scans, the goal isn’t to create a 1:1 mirror world. The goal is to create a stylized distillation down to its visual essence, so you can recognize it effortlessly.

I love 3d maps like this because they’re inherently an abstraction of reality. Unlike 3d scans, the goal isn’t to create a 1:1 mirror world. The goal is to create a stylized distillation down to its visual essence, so you can recognize it effortlessly.

249,351 görüntüleme

The lines between code & content are blurring. I made this 3d city block animation in claude 3.7. Then I used runway gen-3's video-to-video to style it like a lego city at night. At the rate things are going, this'll be a shader running in real-time.

The lines between code & content are blurring. I made this 3d city block animation in claude 3.7. Then I used runway gen-3's video-to-video to style it like a lego city at night. At the rate things are going, this'll be a shader running in real-time.

487,987 görüntüleme

AI stitching together multiple video feeds into one omniscient traffic god. This is what happens when cameras start talking to each other -- mapping the trajectory of every vehicle and pedestrian seamlessly across cameras. Spatial intelligence is coming to a city near you.

AI stitching together multiple video feeds into one omniscient traffic god. This is what happens when cameras start talking to each other -- mapping the trajectory of every vehicle and pedestrian seamlessly across cameras. Spatial intelligence is coming to a city near you.

329,235 görüntüleme

Nano is a depth-aware atmospheric haze plugin that uses ML depth estimation to add physically accurate fog and light scattering to your footage. Works *best* on log footage with visible light sources - it analyzes scene highlights then creates airlight (atmospheric scatter) and halation (light bloom) that responds to actual depth in the scene. Pretty clever approach to getting that cinematic haze look without having to pump a fog machine on set. Makes the OG Trapcode Shine look extremely dated (basically 2D light streaks masked by luminance values), and is yet way more controllable than the current crop of generative AI video-to-video tools.

Nano is a depth-aware atmospheric haze plugin that uses ML depth estimation to add physically accurate fog and light scattering to your footage. Works best on log footage with visible light sources - it analyzes scene highlights then creates airlight (atmospheric scatter) and halation (light bloom) that responds to actual depth in the scene. Pretty clever approach to getting that cinematic haze look without having to pump a fog machine on set. Makes the OG Trapcode Shine look extremely dated (basically 2D light streaks masked by luminance values), and is yet way more controllable than the current crop of generative AI video-to-video tools.

275,436 görüntüleme

Generative AI is really cool but sometimes you want to drift your car through an intersection in a super specific way. Draw a spline then get 3D onion skinning so you can adjust the curves with a clear spatial reference. iCars plugin for Blender:

Generative AI is really cool but sometimes you want to drift your car through an intersection in a super specific way. Draw a spline then get 3D onion skinning so you can adjust the curves with a clear spatial reference. iCars plugin for Blender:

183,667 görüntüleme

Heads up! Mosaic dropped a pretty wild dataset of 1.26 million 360° images of Prague 🤯 If you're a researcher, creator or developer into 3D/AI/Geo, I think you're gonna wanna play with this Here's the scoop on this 15 TERAPIXEL dataset & the crazy things you can do with it 🧵

Heads up! Mosaic dropped a pretty wild dataset of 1.26 million 360° images of Prague 🤯 If you're a researcher, creator or developer into 3D/AI/Geo, I think you're gonna wanna play with this Here's the scoop on this 15 TERAPIXEL dataset & the crazy things you can do with it 🧵

295,885 görüntüleme

I can no longer walk around a city without seeing a machine-readable 3D model in my head. This is a geometric and semantic 3D model of San Francisco. These maps connect the world of bits and atoms, enabling visual positioning, 3D navigation and geospatial intelligence.

I can no longer walk around a city without seeing a machine-readable 3D model in my head. This is a geometric and semantic 3D model of San Francisco. These maps connect the world of bits and atoms, enabling visual positioning, 3D navigation and geospatial intelligence.

260,241 görüntüleme

Videos

Anya Rossi

sweetdream.ai

SweetDream.ai•Sponsored•Livecam

Watch Anya Live

Anya is streaming live right now! Join her private show and enjoy exclusive content.

Exclusive private shows

1.2k viewers online

Private Show

Join now for exclusive access

Free preview available • Premium content

If you look at the state of the art in procedural 3d generation then you’ll quickly realize that language models will make a serious dent in controllable world building - manifesting whatever we want into existing 3d tools like houdini, blender or unreal.

If you look at the state of the art in procedural 3d generation then you’ll quickly realize that language models will make a serious dent in controllable world building - manifesting whatever we want into existing 3d tools like houdini, blender or unreal.

97,169 görüntüleme • 3 gün önce

The future of sports is looking exceedingly bright, esp with all the great work happening in spatial AI. Here's what Arcturus can pull off with stadium scale capture rigs. Amazing for AR/VR but also the traditional broadcast experience itself.

The future of sports is looking exceedingly bright, esp with all the great work happening in spatial AI. Here's what Arcturus can pull off with stadium scale capture rigs. Amazing for AR/VR but also the traditional broadcast experience itself.

16,281 görüntüleme • 1 gün önce

God’s Eye View V1 is open source. It feels like a spy simulator in your browser -- except the underlying data is real, and you can talk to the planet too. Track planes, ships, satellites, traffic cameras, and critical infrastructure. Use voice mode to ask what’s happening, annotate the 3D world, or jump into a plane’s cockpit. Already a ton to explore. Code is MIT licensed, so add new layers, extend the voice agent, break things, and show me what you cook.

God’s Eye View V1 is open source. It feels like a spy simulator in your browser -- except the underlying data is real, and you can talk to the planet too. Track planes, ships, satellites, traffic cameras, and critical infrastructure. Use voice mode to ask what’s happening, annotate the 3D world, or jump into a plane’s cockpit. Already a ton to explore. Code is MIT licensed, so add new layers, extend the voice agent, break things, and show me what you cook.

186,864 görüntüleme • 10 gün önce

God's eye view 24-hour replay of Operation Epic Fury. The Iran strikes kicked off and I set an AI agent swarm loose to record every OSINT signal I could find before the caches cleared. Built a full 4D reconstruction in WorldView. I can scrub through minute by minute and watch the whole thing unfold on a 3D globe: > Airspace clearing over Tehran > Ground strike coordinates locking in > Severe GPS interference blinding the region > EO and SAR satellites making passes over the strike zone > No-fly zones locking down 9 countries > Shipping fleets scrambling at the Strait of Hormuz It's pretty amazing how complete of a picture you can build without "proprietary data fusion" -- one dev with public signals and a love for computer graphics and geospatial intelligence. Thank you for all the love on my last post. Dropping WorldView in April. This my friends is just the beginning.

God's eye view 24-hour replay of Operation Epic Fury. The Iran strikes kicked off and I set an AI agent swarm loose to record every OSINT signal I could find before the caches cleared. Built a full 4D reconstruction in WorldView. I can scrub through minute by minute and watch the whole thing unfold on a 3D globe: > Airspace clearing over Tehran > Ground strike coordinates locking in > Severe GPS interference blinding the region > EO and SAR satellites making passes over the strike zone > No-fly zones locking down 9 countries > Shipping fleets scrambling at the Strait of Hormuz It's pretty amazing how complete of a picture you can build without "proprietary data fusion" -- one dev with public signals and a love for computer graphics and geospatial intelligence. Thank you for all the love on my last post. Dropping WorldView in April. This my friends is just the beginning.

4,005,489 görüntüleme • 6 ay önce

holy crap! apple just beat google to the punch -- 3d gaussian splatting is coming to apple maps. these 3d scenes are made from oblique aerial imagery. but unlike blobby photogrammetry -- no more broccoli trees, no more melted powerlines -- ground level detail that actually holds up. here's hoping google maps/earth follows suite soon -- they have a significantly larger corpus of sensor data to work with. time to splat the world!

holy crap! apple just beat google to the punch -- 3d gaussian splatting is coming to apple maps. these 3d scenes are made from oblique aerial imagery. but unlike blobby photogrammetry -- no more broccoli trees, no more melted powerlines -- ground level detail that actually holds up. here's hoping google maps/earth follows suite soon -- they have a significantly larger corpus of sensor data to work with. time to splat the world!

1,092,506 görüntüleme • 2 ay önce

Before/after of Corridor's latest AI video is wild. They shot video on greenscreen, made virtual sets in Unreal, then reskinned it to anime by finetuning Stable Diffusion. Net result? 120 VFX shots done by a team of 3 on a dime. Bravo! This is a milestone in creative technology🧵

Before/after of Corridor's latest AI video is wild. They shot video on greenscreen, made virtual sets in Unreal, then reskinned it to anime by finetuning Stable Diffusion. Net result? 120 VFX shots done by a team of 3 on a dime. Bravo! This is a milestone in creative technology🧵

13,180,515 görüntüleme • 3 yıl önce

OG Anunoby is too sick. Here is the full point-of-view 3d reconstruction of his winning tip-in from the Knicks game last night. You can literally relive it from his perspective. Built with viewpoint pro using stadium tracking cameras and unreal engine.

OG Anunoby is too sick. Here is the full point-of-view 3d reconstruction of his winning tip-in from the Knicks game last night. You can literally relive it from his perspective. Built with viewpoint pro using stadium tracking cameras and unreal engine.

716,890 görüntüleme • 2 ay önce

This damn near looks like a reality TV show. AI is absolutely shattering the visual Turing test.

This damn near looks like a reality TV show. AI is absolutely shattering the visual Turing test.

175,167 görüntüleme • 1 ay önce

Just used claude fable (aka mythos) to create this city block simulator complete with multi-agent traffic, live detection boxes + tracks, and day to night cycle. And it just one shotted it. This is gonna be fun -- the gap between idea and execution just keeps collapsing.

Just used claude fable (aka mythos) to create this city block simulator complete with multi-agent traffic, live detection boxes + tracks, and day to night cycle. And it just one shotted it. This is gonna be fun -- the gap between idea and execution just keeps collapsing.

372,633 görüntüleme • 2 ay önce

bro putting a belt fed machine gun on a monitor arm is probably the most america thing i've seen all week. shout out eric pettway.

bro putting a belt fed machine gun on a monitor arm is probably the most america thing i've seen all week. shout out eric pettway.

416,725 görüntüleme • 3 ay önce

I made a 4D god's eye replay of the Iran strikes using public OSINT data. When I turned on the orbital layer in worldview something jumped out. You can see satellite passes stack up over the strike zones in the hours before & after impact. Everyone was watching. Some of them were overhead before it started. American KH-11s and TOPAZ SAR. Russian BARS-M and Persona. Chinese Gaofen optical and SAR. Maxar WorldView Legion. Airbus Pleiades. Capella. ICEYE. That's textbook behavior -- you collect right before for targeting, you strike, then you collect again for battle damage assessment. Just wild to see it all replayed in 3D like this. The commercial constellation density is also striking. What used to be exclusive nation state capability is now mirrored by half a dozen commercial operators. The intelligence monopoly is over.

I made a 4D god's eye replay of the Iran strikes using public OSINT data. When I turned on the orbital layer in worldview something jumped out. You can see satellite passes stack up over the strike zones in the hours before & after impact. Everyone was watching. Some of them were overhead before it started. American KH-11s and TOPAZ SAR. Russian BARS-M and Persona. Chinese Gaofen optical and SAR. Maxar WorldView Legion. Airbus Pleiades. Capella. ICEYE. That's textbook behavior -- you collect right before for targeting, you strike, then you collect again for battle damage assessment. Just wild to see it all replayed in 3D like this. The commercial constellation density is also striking. What used to be exclusive nation state capability is now mirrored by half a dozen commercial operators. The intelligence monopoly is over.

719,763 görüntüleme • 6 ay önce

Okay it happened! Snapchat Spectacles AR glasses. Fully standalone. 46 degree field of view. 37 pixels per degree. That’s roughly like a 100” TV screen! 2x snapdragon chips. 45 minutes of battery. Auto transitioning lenses. Designed for co-presence. Spectator mode and more. Gotta hand it to Snap for pushing on this extremely hard engineering challenge, despite the rest of their peers going VR first as a stepping stone to this ultimate vision.

Okay it happened! Snapchat Spectacles AR glasses. Fully standalone. 46 degree field of view. 37 pixels per degree. That’s roughly like a 100” TV screen! 2x snapdragon chips. 45 minutes of battery. Auto transitioning lenses. Designed for co-presence. Spectator mode and more. Gotta hand it to Snap for pushing on this extremely hard engineering challenge, despite the rest of their peers going VR first as a stepping stone to this ultimate vision.

2,664,895 görüntüleme • 1 yıl önce

Everything here is 100% generated w/ Google Veo 2. I've got early access, and the visual fidelity and prompt adherence is genuinely nuts. Let's test it together and have some fun. Drop your prompts below -- and for the next hour or so I'll reply with videos 👇

Everything here is 100% generated w/ Google Veo 2. I've got early access, and the visual fidelity and prompt adherence is genuinely nuts. Let's test it together and have some fun. Drop your prompts below -- and for the next hour or so I'll reply with videos 👇

2,242,711 görüntüleme • 1 yıl önce

Asked God’s Eye View to explain why there’s so much military activity in this area -- all using voice, while it sees what I’m seeing on the 3D map. Turns out Fort Rucker is a hot spot for helicopter training. So I jumped into cockpit view to track one of the choppers live in the middle of a drill. IMO gpt-realtime-2 is quite underrated for geospatial apps. Voice is such a natural interface for exploring the world and the data underpinning it. Code is open source if you wanna try it.

Asked God’s Eye View to explain why there’s so much military activity in this area -- all using voice, while it sees what I’m seeing on the 3D map. Turns out Fort Rucker is a hot spot for helicopter training. So I jumped into cockpit view to track one of the choppers live in the middle of a drill. IMO gpt-realtime-2 is quite underrated for geospatial apps. Voice is such a natural interface for exploring the world and the data underpinning it. Code is open source if you wanna try it.

30,423 görüntüleme • 9 gün önce

Google is now using Gemini to cross-reference ~250M places with Street View imagery to identify visible landmarks for turn-by-turn nav. Think iconic buildings, gas stations and restaurants. So instead of "turn right in 500 feet" you get "turn right after the Thai Siam Restaurant" with the landmark highlighted. AI solving the distance estimation problem by using what you can actually see. Rolling out in US.

Google is now using Gemini to cross-reference ~250M places with Street View imagery to identify visible landmarks for turn-by-turn nav. Think iconic buildings, gas stations and restaurants. So instead of "turn right in 500 feet" you get "turn right after the Thai Siam Restaurant" with the landmark highlighted. AI solving the distance estimation problem by using what you can actually see. Rolling out in US.

963,168 görüntüleme • 10 ay önce

Pretty cool! Nano Banana is now inside Google Earth so you can reskin your home, city -- or even try your hand at time travel.

Pretty cool! Nano Banana is now inside Google Earth so you can reskin your home, city -- or even try your hand at time travel.

99,242 görüntüleme • 1 ay önce

This will change the way we experience sports forever -- watching the game from a gods eye view. Arcturus is building 4D gaussian splatting tech that can capture every angle of a sporting event and pushes the bar for volumetric video. I tested this in a headset and it makes 360 and 3D 180 video look ancient. This puts you closer to the action than any stadium seat, and it’s genuinely mind blowing.

This will change the way we experience sports forever -- watching the game from a gods eye view. Arcturus is building 4D gaussian splatting tech that can capture every angle of a sporting event and pushes the bar for volumetric video. I tested this in a headset and it makes 360 and 3D 180 video look ancient. This puts you closer to the action than any stadium seat, and it’s genuinely mind blowing.

501,991 görüntüleme • 6 ay önce

Using voice mode to monitor rush hour traffic in God's Eye View. It uses aggregated location data from TomTom to visualize how busy every road segment is. And in cities like Austin and London you can look at public CCTV cameras to confirm the actual conditions on the ground. Open source and MIT license. 8k+ stars on GitHub.

Using voice mode to monitor rush hour traffic in God's Eye View. It uses aggregated location data from TomTom to visualize how busy every road segment is. And in cities like Austin and London you can look at public CCTV cameras to confirm the actual conditions on the ground. Open source and MIT license. 8k+ stars on GitHub.

16,865 görüntüleme • 6 gün önce

Reconstructing the world in 3D from random internet photos is a deep rabbit hole. In 2008, Photosynth proved that 3D reconstruction of smaller monuments was possible. The next year, "Building Rome in a Day" proved it could be done for entire cities. Since then, there’s been a wild lineage of research from early point clouds to modern NeRFs and 3DGS --with a similar cast of characters appearing along the way. In this deep dive, we'll break it all down, and explore why IARPA is funding what comes next. 0:00 The Internet's 3D Model of the World 0:40 Building Rome in a Day (2009) 2:09 The Long Tail Problem 3:18 MegaDepth and the Mannequin Challenge 4:44 NeRFs and 3D Gaussian Splatting 7:19 MegaScenes, Doppelgangers, and Foundation Models 10:00 MegaDepth-X Punches Through the Wall 11:26 Why IARPA Is Funding What's Next 13:51 The 4D Frontier and the Sensorium

Reconstructing the world in 3D from random internet photos is a deep rabbit hole. In 2008, Photosynth proved that 3D reconstruction of smaller monuments was possible. The next year, "Building Rome in a Day" proved it could be done for entire cities. Since then, there’s been a wild lineage of research from early point clouds to modern NeRFs and 3DGS --with a similar cast of characters appearing along the way. In this deep dive, we'll break it all down, and explore why IARPA is funding what comes next. 0:00 The Internet's 3D Model of the World 0:40 Building Rome in a Day (2009) 2:09 The Long Tail Problem 3:18 MegaDepth and the Mannequin Challenge 4:44 NeRFs and 3D Gaussian Splatting 7:19 MegaScenes, Doppelgangers, and Foundation Models 10:00 MegaDepth-X Punches Through the Wall 11:26 Why IARPA Is Funding What's Next 13:51 The 4D Frontier and the Sensorium

51,997 görüntüleme • 22 gün önce

OpenClaw creator on Opus vs Codex: “Opus is like the coworker that is a little silly sometimes, but it's really funny and you keep him around. Codex is like the weirdo in the corner that you don't want to talk to, but he's reliable and gets shit done.” LMAO. Accurate.

OpenClaw creator on Opus vs Codex: “Opus is like the coworker that is a little silly sometimes, but it's really funny and you keep him around. Codex is like the weirdo in the corner that you don't want to talk to, but he's reliable and gets shit done.” LMAO. Accurate.

429,900 görüntüleme • 6 ay önce