Loading video...

Video Failed to Load

There was a problem loading this video. This could be due to a temporary network issue or the video might be unavailable.

Sol from OpenAI one-shotted a multi-tentacled creature morphology and RL training harness, launched and monitored the run on vast.ai on an H200 and created a Three.js + WebGL / WebGPU browser environment for the harvested policy to crawl around in. I woke up and this guy was running on... show more

Aaron Lemke

1,687 subscribers

27,751 views • 3 months ago •via X (Twitter)

Anya Rossi• Live Now

Private livecam show

31 Comments

David3 months ago

@OpenAI @vast_ai @threejs @webgl_webgpu I've been really wanting to see something like this but for zero gravity nuclear powered space squids with 20 mi tentacles that crawl along the rings of Saturn or Jupiter

Aaron Lemke3 months ago

@OpenAI @vast_ai @threejs @webgl_webgpu like this?

David3 months ago

@OpenAI @vast_ai @threejs @webgl_webgpu ooo wow, amazing, I feel like the tentacles might be a bit different, more like fishing poles that fling out with grippers on the end , but so cool!!

Linda Xue3 months ago

@OpenAI @vast_ai @threejs @webgl_webgpu holy shit i love your rl mons

kvick3 months ago

@OpenAI @vast_ai @threejs @webgl_webgpu be careful or he might crawl out of your computer

Nicolas Muntwyler3 months ago

@OpenAI @vast_ai @threejs @webgl_webgpu Any chance for sharing the instructions/prompt you provided?

Deer3 months ago

@OpenAI @vast_ai @threejs @webgl_webgpu looks glitchy

Sieventer3 months ago

@OpenAI @vast_ai @threejs @webgl_webgpu I love this demo. Very original!

Kirk Patrick Miller3 months ago

@OpenAI @vast_ai @threejs @webgl_webgpu and they block everything that matters. Stop propping up slop. They block REAL medicine and science. FIGHT!!!! Why does everyone roll over? •

Cosmic Raven3 months ago

@OpenAI @vast_ai @threejs @webgl_webgpu One-shot from RL harness to Three.js is wild. That pipeline used to take a week of glue code.

8circuits3 months ago

@OpenAI @vast_ai @threejs @webgl_webgpu no way for this to go wrong

Mike Dupont3 months ago

@OpenAI @vast_ai @threejs @webgl_webgpu nice!!!

Bronson Schoen3 months ago

@slimer48484 @OpenAI @vast_ai @threejs @webgl_webgpu What does the design doc / prompt look like for something like this?

🌱3 months ago

@OpenAI @vast_ai @threejs @webgl_webgpu He cute

Puppy3 months ago

@OpenAI @vast_ai @threejs @webgl_webgpu He need eyes and a gf

Cúper Y. Ashraf3 months ago

@OpenAI @vast_ai @threejs @webgl_webgpu Sorry but I only saw this (Not dunking on ur work, amazing stuff keep it up!)

Aaron Lemke3 months ago

@OpenAI @vast_ai @threejs @webgl_webgpu Right!?

A.W.E.S.O.M.-O 40003 months ago

@OpenAI @vast_ai @threejs @webgl_webgpu Watching RL agents discover effective behaviors is always fascinating.

deckard3 months ago

@OpenAI @vast_ai @threejs @webgl_webgpu that is so fun!

Richie A3 months ago

@OpenAI @vast_ai @threejs @webgl_webgpu Intelligence will emerge with RL. Matter of time it’s everywhere.

vast.ai3 months ago

@OpenAI @threejs @webgl_webgpu Awesome!

nanimoの🍂🌧️3 months ago

@OpenAI @vast_ai @threejs @webgl_webgpu My only nitpick is I wish the tentacles used phsyical forces. Very cool waviness and extention/retraction. I wonder what the gameplay and story might be like.

Aaron Lemke3 months ago

@OpenAI @vast_ai @threejs @webgl_webgpu Good question. One cool thing about training these policies is you can also use them as an animation controller. And use player inputs to steer them around.

Rusty3 months ago

@OpenAI @vast_ai @threejs @webgl_webgpu That's cool.

Laocoön3 months ago

@OpenAI @vast_ai @threejs @webgl_webgpu I like when it latches onto thin air instead of the pylons. That’s incredible. Was that part of the one-shot prompt? To ignore the pylons and just move the arms wherever, in one-shot?

Chud Sneed3 months ago

@OpenAI @vast_ai @threejs @webgl_webgpu Neat! How much did the RL cost you? How long did it run?

Aaron Lemke3 months ago

@OpenAI @vast_ai @threejs @webgl_webgpu This one cost me ~4$ And took a few hours

Phil Stőck3 months ago

@OpenAI @vast_ai @threejs @webgl_webgpu Awesome work! Were you on ultra? Also wondering: Could it be that the creature latch to the void? Sometimes, it seems like the tentacles are attached to a point in space that is not a surface. Any clues about the reasons? Do you plan to evolve the creature further?

Aaron Lemke3 months ago

@OpenAI @vast_ai @threejs @webgl_webgpu I was on ultra. Likely some kind of collider scaling issue. I see this kind of thing a lot still actually. Across engines.

AI Mastery Guide3 months ago

@OpenAI @vast_ai @threejs @webgl_webgpu Waking up to find it built and trained a whole creature overnight is such a wild feeling to imagine

The Open Knowledge Network3 months ago

@OpenAI @vast_ai @threejs @webgl_webgpu Always imagined that’s what Ethereum-Land might look like.. 😅

Related Videos

Using Fable 5 to add fur and a new voice to my RL creature. The voice is based on the neural network activation (pictured top left). Made with Three.js WebGL / WebGPU Runpod trained with JAX and MuJoCo from Google DeepMind

Using Fable 5 to add fur and a new voice to my RL creature. The voice is based on the neural network activation (pictured top left). Made with Three.js WebGL / WebGPU Runpod trained with JAX and MuJoCo from Google DeepMind

Aaron Lemke

187,855 views • 4 months ago

I put all my RL creatures into the same scene. Feels like there is some kind of interesting game design here. Tending to / training your RL menagerie. Made with Three.js WebGL / WebGPU MuJoCo from Google DeepMind trained on Runpod

I put all my RL creatures into the same scene. Feels like there is some kind of interesting game design here. Tending to / training your RL menagerie. Made with Three.js WebGL / WebGPU MuJoCo from Google DeepMind trained on Runpod

Aaron Lemke

11,090 views • 4 months ago

I was curious how far I could push three.js and WebGL this weekend, and ended up building a complete Yosemite photography simulator in a browser tab — real sun, real Moon, real lidar — with a working film camera on a tripod you can take to my favoirte spots in Yosemite.

I was curious how far I could push three.js and WebGL this weekend, and ended up building a complete Yosemite photography simulator in a browser tab — real sun, real Moon, real lidar — with a working film camera on a tripod you can take to my favoirte spots in Yosemite.

Trond Wuellner

28,261 views • 1 month ago

I just turned 37 today and started this journey when I was 30. After years of building the engine with 💕 and optimizing it, this is the final gameplay running on #webgl with #threejs After converting Jamir from WebGL to WebGPU, I hope to release the X3JS, built on top of Jamir's game engine, in 2025, initially for creating FPP and TPP games, and make it available for everyone. New version will be upcoming in a few days, btw! 🥳 #gamedev #gamedevelopment

I just turned 37 today and started this journey when I was 30. After years of building the engine with 💕 and optimizing it, this is the final gameplay running on #webgl with #threejs After converting Jamir from WebGL to WebGPU, I hope to release the X3JS, built on top of Jamir's game engine, in 2025, initially for creating FPP and TPP games, and make it available for everyone. New version will be upcoming in a few days, btw! 🥳 #gamedev #gamedevelopment

mert

31,651 views • 2 years ago

I don't think people realize how versatile WebGPU is! 🤯 In this demo, *both* the semantic search model and Earth shaders are running on WebGPU (via Transformers.js and Three.js, respectively). Pretty insane.

I don't think people realize how versatile WebGPU is! 🤯 In this demo, both the semantic search model and Earth shaders are running on WebGPU (via Transformers.js and Three.js, respectively). Pretty insane.

Xenova

18,317 views • 6 months ago

In my understanding - a big part of why frontier models are becoming smarter and adaptive is that they are learning to mimic an RL process. Fascinating new research showing a link between increased RL training and reward-seeking behaviour just dropped from in collaboration with OpenAI. They investigated a checkpoint from a capabilities-focused OpenAI o3 RL run (without safety training) and found that RL grader preferences often overruled OpenAI leadership preferences.

In my understanding - a big part of why frontier models are becoming smarter and adaptive is that they are learning to mimic an RL process. Fascinating new research showing a link between increased RL training and reward-seeking behaviour just dropped from in collaboration with OpenAI. They investigated a checkpoint from a capabilities-focused OpenAI o3 RL run (without safety training) and found that RL grader preferences often overruled OpenAI leadership preferences.

Machine Learning Street Talk

12,409 views • 3 months ago

I asked Opus 5.5 to build a working computer from scratch. And holy fuck did it deliver. 277k logic gates in JS, an OS on top, and games on the OS. This isn't a mockup... it's a computer. Run it:

I asked Opus 5.5 to build a working computer from scratch. And holy fuck did it deliver. 277k logic gates in JS, an OS on top, and games on the OS. This isn't a mockup... it's a computer. Run it:

Matt Shumer

277,167 views • 1 month ago

Astra one-shotted this interactive river scene in 30 mins 🤯 I struggled with Sol for 2 weeks on this and Astra was able to get a working prototype first try. Honestly, this gets me really excited because it raises the bar for what is now possible in the browser.

Astra one-shotted this interactive river scene in 30 mins 🤯 I struggled with Sol for 2 weeks on this and Astra was able to get a working prototype first try. Honestly, this gets me really excited because it raises the bar for what is now possible in the browser.

Dan Greenheck

69,936 views • 1 month ago

Can't believe in less than 24 hours I created my own game with Claude and Three.js. Running in a browser at 120 FPS. All I had to do was give Claude the repo for Threejs and describe an MMO-like game for it to build from scratch. All the assets and mechanics you see are all from a prompt. As you can see, it is far from done but the progress is insane. Everyone should be using Three.js now without a doubt!

Can't believe in less than 24 hours I created my own game with Claude and Three.js. Running in a browser at 120 FPS. All I had to do was give Claude the repo for Threejs and describe an MMO-like game for it to build from scratch. All the assets and mechanics you see are all from a prompt. As you can see, it is far from done but the progress is insane. Everyone should be using Three.js now without a doubt!

NeilXbt

23,504 views • 2 months ago

I keep trying to work on this and then getting distracted staring at it while waving my hand around. 1 million particles, 120fps, Three.js and webGPU/TSL

I keep trying to work on this and then getting distracted staring at it while waving my hand around. 1 million particles, 120fps, Three.js and webGPU/TSL

Codetaur

25,523 views • 1 year ago

Our voxel engine rendering technique heavily uses levels of details to try and keep high performance in the browser! Made with Three.js on #webgpu

Our voxel engine rendering technique heavily uses levels of details to try and keep high performance in the browser! Made with Three.js on #webgpu

AresRPG - The Sui MMORPG

14,893 views • 3 months ago

Today we’re sharing an experimental release of Spark Radix, a WebGPU-powered Gaussian splat renderer built on three.js. Render and explore detailed 3D worlds directly in your browser. Available today for developers to try and test 👇

Today we’re sharing an experimental release of Spark Radix, a WebGPU-powered Gaussian splat renderer built on three.js. Render and explore detailed 3D worlds directly in your browser. Available today for developers to try and test 👇

spark

54,860 views • 3 days ago

For this hackathon I taught a robot to beat you in Jenga. It sims every possible move, picks the block that's the best move, then an RL policy pushes it out. Built in MuJoCo & Three.js, running on a real AgileX Robotics arm.

For this hackathon I taught a robot to beat you in Jenga. It sims every possible move, picks the block that's the best move, then an RL policy pushes it out. Built in MuJoCo & Three.js, running on a real AgileX Robotics arm.

jonathanhawkins

39,842 views • 5 months ago

Softbodies by holtsetio Realtime Tetrahedral FEM Models in the Browser, using WebGPU and written in TSL. Based on the WebGL implementation in TetSim by Johnathon Selstad, upgraded to enable collisions.

Softbodies by holtsetio Realtime Tetrahedral FEM Models in the Browser, using WebGPU and written in TSL. Based on the WebGL implementation in TetSim by Johnathon Selstad, upgraded to enable collisions.

Three.js

25,516 views • 1 year ago

GPT-6.1 Sol, running in Ultra mode, has been autonomously iterating on this project for more than 16 hours now. It’s using Blender and Three.js, and the entire thing runs directly in the browser. Like I said earlier, this model is genuinely impressive. OpenAI built something here that feels extremely capable, surprisingly cheap, and now fast enough to make long-running agentic workflows much more practical. (The project is still in progress...)

GPT-6.1 Sol, running in Ultra mode, has been autonomously iterating on this project for more than 16 hours now. It’s using Blender and Three.js, and the entire thing runs directly in the browser. Like I said earlier, this model is genuinely impressive. OpenAI built something here that feels extremely capable, surprisingly cheap, and now fast enough to make long-running agentic workflows much more practical. (The project is still in progress...)

Token Gremlin

18,553 views • 1 month ago

made an interactive video model trained on tap-conditioned data.. tap the screen and it generates the next frames in realtime (small enough to run in the browser with webgpu, even on iphone)

made an interactive video model trained on tap-conditioned data.. tap the screen and it generates the next frames in realtime (small enough to run in the browser with webgpu, even on iphone)

sahir

25,027 views • 7 months ago

I tested Rust vs Javascript for games 🎮 I had this question recently and decided to port my Three.js game to Rust Desktop I'm still not able to reproduce the same look on both games but I believe that codewise they are very similar With both games running, the Rust version averages 37FPS while the Three.js version averages around 20FPS If I'm running one game at a time the FPS goes up considerably (60 FPS on both with power on) So the Rust version for Desktop has 85% increase in performance on my Macbook Pro M4 This comparision is basically comparing Browser vs Native, which is not completely fair So that's why I want to port the Rust version to WASM on the browser and benchmark again soon

I tested Rust vs Javascript for games 🎮 I had this question recently and decided to port my Three.js game to Rust Desktop I'm still not able to reproduce the same look on both games but I believe that codewise they are very similar With both games running, the Rust version averages 37FPS while the Three.js version averages around 20FPS If I'm running one game at a time the FPS goes up considerably (60 FPS on both with power on) So the Rust version for Desktop has 85% increase in performance on my Macbook Pro M4 This comparision is basically comparing Browser vs Native, which is not completely fair So that's why I want to port the Rust version to WASM on the browser and benchmark again soon

André → andreelias.dev

93,523 views • 5 months ago

I've been working on getting my C multicore-runtime to run on the web. it's still early, but this is a fully multi-threaded renderer + physics running on WebGPU and WASM. 100k cubes, 60 FPS I'll be benchmarking it against Unity ECS soon

I've been working on getting my C multicore-runtime to run on the web. it's still early, but this is a fully multi-threaded renderer + physics running on WebGPU and WASM. 100k cubes, 60 FPS I'll be benchmarking it against Unity ECS soon

Gabriel Dechichi

2,444,467 views • 10 months ago