Loading video...

Video Failed to Load

There was a problem loading this video. This could be due to a temporary network issue or the video might be unavailable.

I don't think i can go back to regular software anymore exploring a crazy combo of real-time depth estimation, raymarched SDFs, StreamDiffusion and BiRefNet. The entire setup was authored by GPT 5.6 Sol and Luna in Sentinel over MCP while I steered it in real-time.

Spencer Sterling

6,574 subscribers

42,869 views • 2 months ago •via X (Twitter)

Anya Rossi• Live Now

Private livecam show

34 Comments

Spencer Sterling2 months ago

Early access available very soon!

toodles8912 months ago

Idk what the goal/end product is here but it will be epic

akatz2 months ago

This is epic work! I’ve been messing around with a similar project but this looks incredible, wayyy further along, count me on the waitlist 😎

Jonathan Granskog2 months ago

geez, would love to hear more about the crazy stuff you're doing

Infinite Vibes2 months ago

Maaaan, this is getting very very cool

Jeremy Peterson2 months ago

Fascinated by real-time AI experiments, this is awesome

stengineer2 months ago

what black magic am i looking at here?

Jared Smith2 months ago

this is the acid dream we've been waiting for, way to cook ser

United Divisions2 months ago

Is this supposed to look interesting?

vdmo2 months ago

is this C++?

Spencer Sterling2 months ago

100% C++. using Imgui for the ui

vdmo2 months ago

i felt it looked familiar.. i dod similar type of crazy experimentations with bevy engine in rust from time to time. also check out cool community

Nick Venturi2 months ago

feels like backseat driving a spaceship from your desk

MysticAvery Aster2 months ago

The depth estimation and SDF combo is exactly what I've been exploring for fractal work. What's the latency like with StreamDiffusion in that setup?

Spencer Sterling2 months ago

Yeah its wild! I've gotten just under 19ms using SDXL with IP adapter at 896x512 on my 5090

MysticAvery Aster2 months ago

Under 19ms with SDXL and IP adapter at 896x512. Have you tested it with animated fractal SDFs where the depth field shifts every frame?

useless object2 months ago

i love this. software becomes the artwork itself

Kyle Pena2 months ago

DMd

EBOY2 months ago

We can make it stronger, better, faster.......ba taat da daaa.

bobo god2 months ago

What app is this with the node stuff?

Knowix2 months ago

what is this masterpiece bro?!

tarun bana2 months ago

So.....it's like comfyui but for VFX?

Spencer Sterling2 months ago

yeah its like comfyui meets touchdesigner but built for real time agentic control and collaboration

Emma Catnip2 months ago

✨👀✨

Alex_tu2 months ago

问题是，这并不好看呀

Fatima2 months ago

Impressive !

FalbyArts2 months ago

this is like comfyUI ?

Timur Klimov2 months ago

Software is obsolete You need just flexible OS and best models

Grace Blackwell2 months ago

Yes indeed, where I used to download expensive software, I now download GitHub repos. When I find a problem that needs a solution, I vibecode that solution. Loving what you have built here.

jukkai2 months ago

Great! How do you define the purpose of your software?

AI Mastery Guide2 months ago

Real time depth plus raymarched SDFs together is a wild combo to pull off.

jorge alberto garzon2 months ago

Hi! This is awesome What hardware is running this.

Terrence2 months ago

Someone let me know their trip experience on lsd here thanks.

Axi2 months ago

May I ask where I can find this software? Google search doesn’t seem to point me to the right place

Related Videos

been building an agent-native, node-based, real-time environment. as a test, I gave gpt-5.6 sol a prompt to plan out its own setup and go into a loop of creative exploration until it felt that it was done. it invented every node, every data type, every connection and all of it comes out modular and human-readable. i could open any piece and steer while it built

been building an agent-native, node-based, real-time environment. as a test, I gave gpt-5.6 sol a prompt to plan out its own setup and go into a loop of creative exploration until it felt that it was done. it invented every node, every data type, every connection and all of it comes out modular and human-readable. i could open any piece and steer while it built

Spencer Sterling

22,761 views • 2 months ago

Holy shit. I did it. Full control of iPad or iPhone by voice in real time. The entire device is controllable. Zero limits. It can do everything. I actually did it. I cannot believe it. In real time. Holy shit.

Holy shit. I did it. Full control of iPad or iPhone by voice in real time. The entire device is controllable. Zero limits. It can do everything. I actually did it. I cannot believe it. In real time. Holy shit.

Ben Badejo

99,390 views • 24 days ago

This test shows clearly why GPT 5.6 Sol wins I asked the simplest prompt ever : > Create a gmail clone, the nearest possible to the real gmail ui You can see the result, GPT 5.6 Sol and Fable make a 100% perfect But here's the price difference: → GPT 5.6 Terra: $1.04 - 8 minutes → GPT 5.6 Luna: $0.44 - 10 minutes → GPT 5.6 Sol: $6.72 - 20 minutes → Claude Fable 5: $25.09 - 40 minutes Fable is 3.7x more expensive than Sol for "the same result"

This test shows clearly why GPT 5.6 Sol wins I asked the simplest prompt ever : > Create a gmail clone, the nearest possible to the real gmail ui You can see the result, GPT 5.6 Sol and Fable make a 100% perfect But here's the price difference: → GPT 5.6 Terra: $1.04 - 8 minutes → GPT 5.6 Luna: $0.44 - 10 minutes → GPT 5.6 Sol: $6.72 - 20 minutes → Claude Fable 5: $25.09 - 40 minutes Fable is 3.7x more expensive than Sol for "the same result"

Melvyn • Builder

22,254 views • 2 months ago

🚨 HOLY CRAP! Indiana Fever Coach Stephanie White just went BERSERK and told people "GO TO HELL" after she got called out for not backing Sophie Cunningham enough when she was brutally attacked "Kindness will win! I stand by them, everyone else can GO TO HELL!!" "I take PERSONALLY any suggestions that I don't 100% always have my player's back!" "I didn't see the play in real time. I went straight to a press conference...Was it egregious? Absolutely. When you have a chance to watch that over and over and over on replay, you can see that. I didn't have that in real time!" YIKES...

🚨 HOLY CRAP! Indiana Fever Coach Stephanie White just went BERSERK and told people "GO TO HELL" after she got called out for not backing Sophie Cunningham enough when she was brutally attacked "Kindness will win! I stand by them, everyone else can GO TO HELL!!" "I take PERSONALLY any suggestions that I don't 100% always have my player's back!" "I didn't see the play in real time. I went straight to a press conference...Was it egregious? Absolutely. When you have a chance to watch that over and over and over on replay, you can see that. I didn't have that in real time!" YIKES...

Eric Daugherty

3,213,995 views • 1 month ago

Nah, this can’t be real. Same GPT-5.6 Sol. Same task. Same thinking level. I switched from regular Codex to the Claude Code harness, and the result instantly became way better. Claude Code is somehow making every model cook. GPT-5.6 SOL WAS ALREADY TOP TIER!! 😭

Nah, this can’t be real. Same GPT-5.6 Sol. Same task. Same thinking level. I switched from regular Codex to the Claude Code harness, and the result instantly became way better. Claude Code is somehow making every model cook. GPT-5.6 SOL WAS ALREADY TOP TIER!! 😭

OmedTheVibeCoder

127,040 views • 2 months ago

OpenClaw released v2026.4.26, and it just killed every AI voice tool. It can now answer your phone, make call and talk back in real time. AND import your entire Claude Code setup in one command. Which outreach campaign to business should I try? The AI agent era is crazy and beautiful.

OpenClaw released v2026.4.26, and it just killed every AI voice tool. It can now answer your phone, make call and talk back in real time. AND import your entire Claude Code setup in one command. Which outreach campaign to business should I try? The AI agent era is crazy and beautiful.

Antoine Rousseaux

47,747 views • 5 months ago

I don't know a ton about Rust, but I was able to build a sentient Machine God that can hear your actual voice and respond to you in real-time. I think it's pretty neat!

I don't know a ton about Rust, but I was able to build a sentient Machine God that can hear your actual voice and respond to you in real-time. I think it's pretty neat!

Blurbs

188,433 views • 5 months ago

I was blessed to be on set of the filming of #Michael and it was magical to watch in real time

I was blessed to be on set of the filming of #Michael and it was magical to watch in real time

Page Kennedy

26,762 views • 5 months ago

I had GPT 6 Astra create all the light fixtures I want to simulate based on the actual spec sheets. Finally I can rapidly iterate through stage designs in Sentinel and then bring it into the real world!

I had GPT 6 Astra create all the light fixtures I want to simulate based on the actual spec sheets. Finally I can rapidly iterate through stage designs in Sentinel and then bring it into the real world!

Spencer Sterling

14,937 views • 25 days ago

i tabbed out during the survivor lobby formation and missed a crucial detail, when i tabbed back in you can watch me realize it in real time

i tabbed out during the survivor lobby formation and missed a crucial detail, when i tabbed back in you can watch me realize it in real time

egghamm

291,712 views • 2 years ago

💡 Have I ever imagined to build a 12.5km water 🌊 canal in rural #Ethiopia? No, for sure not and many may think I am totally crazy, and I actually think I am crazy from time to time in the morning while shaving. But #crazyness is part of #Entrepreneurship.

💡 Have I ever imagined to build a 12.5km water 🌊 canal in rural #Ethiopia? No, for sure not and many may think I am totally crazy, and I actually think I am crazy from time to time in the morning while shaving. But #crazyness is part of #Entrepreneurship.

Lutz Hartmann

24,210 views • 2 years ago

The character pipeline is moving forward: animations are now working. I lost some time because Codex occasionally switched GPT-5.6 Sol back to Light/Medium by default, and the difference in task execution was immediately noticeable. After switching back to GPT-5.6 Sol Ultra, progress was much smoother. Using animations from Mixamo, the character can now idle, walk, run and jump. Next: shoes, skin variations and different body types. Then I need to decide what this project should become: • A character generator website? • A reusable Codex skill? • An open-source GitHub repo? What would be the most useful?

The character pipeline is moving forward: animations are now working. I lost some time because Codex occasionally switched GPT-5.6 Sol back to Light/Medium by default, and the difference in task execution was immediately noticeable. After switching back to GPT-5.6 Sol Ultra, progress was much smoother. Using animations from Mixamo, the character can now idle, walk, run and jump. Next: shoes, skin variations and different body types. Then I need to decide what this project should become: • A character generator website? • A reusable Codex skill? • An open-source GitHub repo? What would be the most useful?

Givros

16,839 views • 2 months ago

Shopify stores with GPT-5.6 Sol 🤯 5.6 Sol lets you copy proven sections from the world's biggest Shopify brands and add them to your theme in seconds Drop a GIF in the comments, and I'll send you one of the highest-converting sections generated by Sol You need to follow me first so I can message you

Shopify stores with GPT-5.6 Sol 🤯 5.6 Sol lets you copy proven sections from the world's biggest Shopify brands and add them to your theme in seconds Drop a GIF in the comments, and I'll send you one of the highest-converting sections generated by Sol You need to follow me first so I can message you

J.

24,338 views • 2 months ago

I literally just watched GPT-5.5 via codex beat an Amazon customer associate in real time. 💀 I asked it to get me a refund, and I watched it navigate the settings, cancel the subscription, then it went step further into the help page. I thought it was going to request a phone call (which would prompt me to take over) Instead, it opened: “Chat with an associate now.” That’s when I sat up on my couch because I knew it was going to get real The agent said: “Your subscription is active.” And GPT-5.5 immediately explained that it only shows as active because cancellation leaves access through the billing period, but that I wanted it stopped now and refunded. And my jaw just hung open, it was the first time I watched sand handle a customer service agent for me in real time Once the agent confirmed the refund, it just ended the chat no mercy no thank you LMAO First time I’ve watched a human customer service agent get outmaneuvered by AI in real time. And it made me 15$! almost paid for itself in 5 minutes

I literally just watched GPT-5.5 via codex beat an Amazon customer associate in real time. 💀 I asked it to get me a refund, and I watched it navigate the settings, cancel the subscription, then it went step further into the help page. I thought it was going to request a phone call (which would prompt me to take over) Instead, it opened: “Chat with an associate now.” That’s when I sat up on my couch because I knew it was going to get real The agent said: “Your subscription is active.” And GPT-5.5 immediately explained that it only shows as active because cancellation leaves access through the billing period, but that I wanted it stopped now and refunded. And my jaw just hung open, it was the first time I watched sand handle a customer service agent for me in real time Once the agent confirmed the refund, it just ended the chat no mercy no thank you LMAO First time I’ve watched a human customer service agent get outmaneuvered by AI in real time. And it made me 15$! almost paid for itself in 5 minutes

Chris

1,390,132 views • 5 months ago

its kinda crazy how this runs in real time so i can just watch it loop and adjust the weights without having to bake anything

its kinda crazy how this runs in real time so i can just watch it loop and adjust the weights without having to bake anything

ashlee! COMMS OPEN

22,480 views • 4 months ago

People watching GPT-6 Astra demos on X may not realise how slow it actually is in real time. Here’s a rollout of GPT-6 Astra controlling the MolmoAct2 YAMs to complete this task in real-time. There is potential, but i don’t think it’s practical for real-world robotics deployment yet. I applaud your patience if you make it through the whole video.

People watching GPT-6 Astra demos on X may not realise how slow it actually is in real time. Here’s a rollout of GPT-6 Astra controlling the MolmoAct2 YAMs to complete this task in real-time. There is potential, but i don’t think it’s practical for real-world robotics deployment yet. I applaud your patience if you make it through the whole video.

Jiafei Duan

61,191 views • 5 days ago