Loading video...

Video Failed to Load

There was a problem loading this video. This could be due to a temporary network issue or the video might be unavailable.

Why not use the real-world as a game level? This is a real-time augmented reality prototype using a physics based character controller, all running on the web 👀

Ian Curtis

25,593 subscribers

533,313 views • 2 years ago •via X (Twitter)

Education Gaming Science & Technology

Anya Rossi• Live Now

Private livecam show

11 Comments

I▲N CURTIS2 years ago

This WebAR experience is anchored to a real-world location using Niantic VPS. I’m utilizing ammo.js for the physics system, adjusting velocity via joystick input to guide the character's movements and handle jump mechanics. Debug visual for reference:

Nate Grant2 years ago

Haven’t you seen ready player 1? No one cares about their crappy apartment, they want to be transported to new/amazing spaces. We tried this in HoloLens - cool for 1sec for the novelty then “who cares”. Pokémon Go is unique as the whole premise is catching Pokémon in the wild.

I▲N CURTIS2 years ago

I just built this for fun this past weekend. I like my crappy apartment. thank you very much.

BroadwayAllDay2 years ago

this + gaussian splatting is how every action figure anyone ever owned will be brought to life. Toy Story for real!

I▲N CURTIS2 years ago

Yoo that’s an awesome idea 👀

Foor1o862 years ago

You could use the stove as fire obstacle :D

I▲N CURTIS2 years ago

good idea. I’ll add it to version 2.0 😉🔥

Alexson Chu2 years ago

nice!! I had similar idea before as well, but using ARMesh using Niantic Unity SDK Cool idea to use VPS too

I▲N CURTIS2 years ago

Yoo this is awesome 👀👀🙌

arthurfranco2 years ago

a skateboard game might be a good cross with this tech/vr... legendary spots, rails.. a wedding with the streets

I▲N CURTIS2 years ago

🛹🙌💯

Related Videos

Marblie is a web-based 3D marble run game that explores interactive building mechanics and real-time physics simulation in the browser.

Marblie is a web-based 3D marble run game that explores interactive building mechanics and real-time physics simulation in the browser.

Three.js

15,524 views • 1 year ago

Apollo: a ChatGPT-powered app for real-time knowledge. Talk to it all day long through your headphones. If augmented reality is an overlay on the world, this is augmented intelligence — an overlay on your thoughts. Reply for a TestFlight DM soon.

Apollo: a ChatGPT-powered app for real-time knowledge. Talk to it all day long through your headphones. If augmented reality is an overlay on the world, this is augmented intelligence — an overlay on your thoughts. Reply for a TestFlight DM soon.

Aaron Ng

710,585 views • 3 years ago

PHC has been accepted by ICCV 2023! We aim to develop a physics-based humanoid controller capable of imitating ALL of the motion from the AMASS dataset (almost there🧐), recover from failure state, does NOT use any external forces, all the while supporting real-time use cases!

PHC has been accepted by ICCV 2023! We aim to develop a physics-based humanoid controller capable of imitating ALL of the motion from the AMASS dataset (almost there🧐), recover from failure state, does NOT use any external forces, all the while supporting real-time use cases!

Zhengyi “Zen” Luo

57,974 views • 3 years ago

OUR FLESH IS NOT REAL The dream world is the real world, and the real world is the dream world. You are in an upside down reality. Brother Bobby Hemmit tried to tell us this back in the 90s.. Yakhi is telling us the truth. YOU ARE NOT REAL. This is not the true world, this is a hologram. This is not the true pleroma. All the sh*t that’s going on is a stage. The world is a stage, just not getting paid. You are the main characters. You are a soul! You descent into this existence, and you think it's real because of your 5 senses. The flesh is a prison. This is why I'm not worried about death, death ain’t real. You are transcending!

OUR FLESH IS NOT REAL The dream world is the real world, and the real world is the dream world. You are in an upside down reality. Brother Bobby Hemmit tried to tell us this back in the 90s.. Yakhi is telling us the truth. YOU ARE NOT REAL. This is not the true world, this is a hologram. This is not the true pleroma. All the sh*t that’s going on is a stage. The world is a stage, just not getting paid. You are the main characters. You are a soul! You descent into this existence, and you think it's real because of your 5 senses. The flesh is a prison. This is why I'm not worried about death, death ain’t real. You are transcending!

🧬Maxpein🧬

26,781 views • 24 days ago

Web based augmented reality portal using VPS. Entire scene is 10mb in size. I learned a lot about baked lightning building this one. Hit me up if you are at AWE 👀

Web based augmented reality portal using VPS. Entire scene is 10mb in size. I learned a lot about baked lightning building this one. Hit me up if you are at AWE 👀

Ian Curtis

13,023 views • 1 year ago

Interactive games are on the horizon 👀 This is a demo clip from a new AI-powered game called “Whispers from the Star.” You have real-time voice chats with the main character, Stella - and guide her actions in the world. Cool example of multimodal AI in use!

Interactive games are on the horizon 👀 This is a demo clip from a new AI-powered game called “Whispers from the Star.” You have real-time voice chats with the main character, Stella - and guide her actions in the world. Cool example of multimodal AI in use!

Justine Moore

55,479 views • 1 year ago

The Infinite Door Portal 🚪 This is a real-time augmented reality experience, powered by generative AI to create a doorway to wherever you can imagine.

The Infinite Door Portal 🚪 This is a real-time augmented reality experience, powered by generative AI to create a doorway to wherever you can imagine.

Ian Curtis

53,440 views • 2 years ago

For those who curious about RUNNING TRAIN | 走ル列車!: 1. The game is running on Unreal Engine (FULLY OPTIMIZED FOR NVIDIA 1050M + ABOVE). 2. This is a 3D real-time gameplay, not pre-rendered footage. 3. Playable with MasCon Controller.

For those who curious about RUNNING TRAIN | 走ル列車!: 1. The game is running on Unreal Engine (FULLY OPTIMIZED FOR NVIDIA 1050M + ABOVE). 2. This is a 3D real-time gameplay, not pre-rendered footage. 3. Playable with MasCon Controller.

South East Asia Game Aesthetic

111,435 views • 1 month ago

Pay very close attention. This is not a psyop, this is not a joke. Expect it all back! This is the real reality!

Pay very close attention. This is not a psyop, this is not a joke. Expect it all back! This is the real reality!

Santa Trump.. 🇺🇸🇺🇸🇺🇸

16,102 views • 7 months ago

I'm testing a new technique: I'm texturing a 3D model with an AI video texture that changes based on the player's viewing angle. This allows for real-time dynamic lighting on the character and is highly optimized. The test is running in standalone VR. WIP.

I'm testing a new technique: I'm texturing a 3D model with an AI video texture that changes based on the player's viewing angle. This allows for real-time dynamic lighting on the character and is highly optimized. The test is running in standalone VR. WIP.

Alex

11,667 views • 3 months ago

Socialist Seattle Mayoral candidate Katie Wilson on her lack of any real world experience after never having a real job: Running a tiny lefty non profit that can't file its taxes on time is the same as running a Fortune 500 company

Socialist Seattle Mayoral candidate Katie Wilson on her lack of any real world experience after never having a real job: Running a tiny lefty non profit that can't file its taxes on time is the same as running a Fortune 500 company

Ari Hoffman

104,250 views • 8 months ago

Augmented Reality (AR) “It’s the first Apple product you look through, and not at” - Tim Cook Vision Pro is a new kind of computer that seamlessly blends the real world with the digital world. Your no longer limited by a display as your surroundings are now a limitless canvas.

Augmented Reality (AR) “It’s the first Apple product you look through, and not at” - Tim Cook Vision Pro is a new kind of computer that seamlessly blends the real world with the digital world. Your no longer limited by a display as your surroundings are now a limitless canvas.

Mark Wlosinski

995,269 views • 3 years ago

This is a real historical man at a real point in history—Adam. It’s not “mytho-history,” as some apologists say in an attempt to play footsie with the world. No—this is a real man at a real point in time. - Johnny Ardavanis

This is a real historical man at a real point in history—Adam. It’s not “mytho-history,” as some apologists say in an attempt to play footsie with the world. No—this is a real man at a real point in time. - Johnny Ardavanis

Alisa Childers

37,666 views • 4 months ago

The one time paying attention in physics class had a real world application:

The one time paying attention in physics class had a real world application:

AlphaFox

219,405 views • 1 year ago

Excited to share that our paper 🌊🤺 “CFC: Simulating Character–Fluid Coupling using a Two-Level World Model” has been accepted to #SIGGRAPHASIA2025! In this work, we build a two-level world model (neural physics) for rigid-body–fluid interaction and use it to train physics-based character controllers efficiently. We study: (1) learning to model highly dynamic fluid environments, (2) representing character–fluid interaction via joint-level forces as an interface, and (3) enabling supervised policy learning on the learned world model—avoiding expensive fluid simulation in the training loop. Our talk is on Monday afternoon(Dec 15)—hope to see you there! Time: Monday, 15 December 2025 5:02pm - 5:13pm GMT+8 Location: Meeting Room S221, Level 2. #SIGGRAPHASIA #SIGGRAPH

Excited to share that our paper 🌊🤺 “CFC: Simulating Character–Fluid Coupling using a Two-Level World Model” has been accepted to #SIGGRAPHASIA2025! In this work, we build a two-level world model (neural physics) for rigid-body–fluid interaction and use it to train physics-based character controllers efficiently. We study: (1) learning to model highly dynamic fluid environments, (2) representing character–fluid interaction via joint-level forces as an interface, and (3) enabling supervised policy learning on the learned world model—avoiding expensive fluid simulation in the training loop. Our talk is on Monday afternoon(Dec 15)—hope to see you there! Time: Monday, 15 December 2025 5:02pm - 5:13pm GMT+8 Location: Meeting Room S221, Level 2. #SIGGRAPHASIA #SIGGRAPH

Zhiyang (Frank) Dou

20,200 views • 6 months ago

A new paper by Disney Research introduces a 2-stage technique for motion tracking in physics-based character animation, using a pretrained latent space and RL to control diverse and unseen motions on both virtual and real-world humanoid robots. Paper:

A new paper by Disney Research introduces a 2-stage technique for motion tracking in physics-based character animation, using a pretrained latent space and RL to control diverse and unseen motions on both virtual and real-world humanoid robots. Paper:

The Humanoid Hub

20,051 views • 1 year ago

$Three.js Water Pro is making Subnautica in the browser a real possibility. Rewrote the lighting model so light reflecting off the ocean floor is now refracted and attenuated based on real-world physics. Still can't believe what a difference it makes🤯$

Three.js Water Pro is making Subnautica in the browser a real possibility. Rewrote the lighting model so light reflecting off the ocean floor is now refracted and attenuated based on real-world physics. Still can't believe what a difference it makes🤯

Dan Greenheck

175,530 views • 1 month ago

I really want to show off the cutting edge tech the team is building and how we're turning AI image generation into real living environments using gaussian splats and at the :19 mark of this video you can see how we're blending splats together to create a real world. What this looks like from a gaming perspective is this all happens behind the players view to simulate a real world environment. As you move through the space, distance becomes a variable to consider on how images update and are experienced. We are creating a new reality in real time.

I really want to show off the cutting edge tech the team is building and how we're turning AI image generation into real living environments using gaussian splats and at the :19 mark of this video you can see how we're blending splats together to create a real world. What this looks like from a gaming perspective is this all happens behind the players view to simulate a real world environment. As you move through the space, distance becomes a variable to consider on how images update and are experienced. We are creating a new reality in real time.

𝔹𝕃𝕍ℂ𝕂𝕃!𝔾ℍ𝕋

25,068 views • 1 month ago

one of my favorite aspects of this new work is that it is generative, not based on an arbitrary random number, but based on the chaos of real life. the physical sculpture is constantly pulling in news and real-time data from all over the world and the NFT is updated daily as well with this hectic collage of information overload... i believe in the future more work will be dynamic like this allowing us to reimagine real-time data in new ways based on different events happening in the world...

one of my favorite aspects of this new work is that it is generative, not based on an arbitrary random number, but based on the chaos of real life. the physical sculpture is constantly pulling in news and real-time data from all over the world and the NFT is updated daily as well with this hectic collage of information overload... i believe in the future more work will be dynamic like this allowing us to reimagine real-time data in new ways based on different events happening in the world...

beeple

155,725 views • 1 year ago

Why is this video not trending? Anyone who is against the mandatory transmission polling units level results in real time is a thief. Thank you Peter.

Why is this video not trending? Anyone who is against the mandatory transmission polling units level results in real time is a thief. Thank you Peter.

Akwa Ibom 1st Son

145,099 views • 5 months ago