正在加载视频...

视频加载失败

加载此视频时出现问题。这可能是由于临时网络问题，或视频可能不可用。

Sol from OpenAI one-shotted a multi-tentacled creature morphology and RL training harness, launched and monitored the run on vast.ai on an H200 and created a Three.js + WebGL / WebGPU browser environment for the harvested policy to crawl around in. I woke up and this guy was running on... show more

Aaron Lemke

1,687 subscribers

27,751 次观看 • 3 个月前 •via X (Twitter)

Anya Rossi• Live Now

Private livecam show

31 条评论

David 的头像

David3 个月前

@OpenAI @vast_ai @threejs @webgl_webgpu I've been really wanting to see something like this but for zero gravity nuclear powered space squids with 20 mi tentacles that crawl along the rings of Saturn or Jupiter

Aaron Lemke 的头像

Aaron Lemke3 个月前

@OpenAI @vast_ai @threejs @webgl_webgpu like this?

David 的头像

David3 个月前

@OpenAI @vast_ai @threejs @webgl_webgpu ooo wow, amazing, I feel like the tentacles might be a bit different, more like fishing poles that fling out with grippers on the end , but so cool!!

Linda Xue 的头像

Linda Xue3 个月前

@OpenAI @vast_ai @threejs @webgl_webgpu holy shit i love your rl mons

kvick 的头像

kvick3 个月前

@OpenAI @vast_ai @threejs @webgl_webgpu be careful or he might crawl out of your computer

Nicolas Muntwyler 的头像

Nicolas Muntwyler3 个月前

@OpenAI @vast_ai @threejs @webgl_webgpu Any chance for sharing the instructions/prompt you provided?

Deer 的头像

Deer3 个月前

@OpenAI @vast_ai @threejs @webgl_webgpu looks glitchy

Sieventer 的头像

Sieventer3 个月前

@OpenAI @vast_ai @threejs @webgl_webgpu I love this demo. Very original!

Kirk Patrick Miller 的头像

Kirk Patrick Miller3 个月前

@OpenAI @vast_ai @threejs @webgl_webgpu and they block everything that matters. Stop propping up slop. They block REAL medicine and science. FIGHT!!!! Why does everyone roll over? •

Cosmic Raven 的头像

Cosmic Raven3 个月前

@OpenAI @vast_ai @threejs @webgl_webgpu One-shot from RL harness to Three.js is wild. That pipeline used to take a week of glue code.

8circuits 的头像

8circuits3 个月前

@OpenAI @vast_ai @threejs @webgl_webgpu no way for this to go wrong

Mike Dupont 的头像

Mike Dupont3 个月前

@OpenAI @vast_ai @threejs @webgl_webgpu nice!!!

Bronson Schoen 的头像

Bronson Schoen3 个月前

@slimer48484 @OpenAI @vast_ai @threejs @webgl_webgpu What does the design doc / prompt look like for something like this?

🌱 的头像

🌱3 个月前

@OpenAI @vast_ai @threejs @webgl_webgpu He cute

Puppy 的头像

Puppy3 个月前

@OpenAI @vast_ai @threejs @webgl_webgpu He need eyes and a gf

Cúper Y. Ashraf 的头像

Cúper Y. Ashraf3 个月前

@OpenAI @vast_ai @threejs @webgl_webgpu Sorry but I only saw this (Not dunking on ur work, amazing stuff keep it up!)

Aaron Lemke 的头像

Aaron Lemke3 个月前

@OpenAI @vast_ai @threejs @webgl_webgpu Right!?

A.W.E.S.O.M.-O 4000 的头像

A.W.E.S.O.M.-O 40003 个月前

@OpenAI @vast_ai @threejs @webgl_webgpu Watching RL agents discover effective behaviors is always fascinating.

deckard 的头像

deckard3 个月前

@OpenAI @vast_ai @threejs @webgl_webgpu that is so fun!

Richie A 的头像

Richie A3 个月前

@OpenAI @vast_ai @threejs @webgl_webgpu Intelligence will emerge with RL. Matter of time it’s everywhere.

vast.ai 的头像

vast.ai3 个月前

@OpenAI @threejs @webgl_webgpu Awesome!

nanimoの🍂🌧️ 的头像

nanimoの🍂🌧️3 个月前

@OpenAI @vast_ai @threejs @webgl_webgpu My only nitpick is I wish the tentacles used phsyical forces. Very cool waviness and extention/retraction. I wonder what the gameplay and story might be like.

Aaron Lemke 的头像

Aaron Lemke3 个月前

@OpenAI @vast_ai @threejs @webgl_webgpu Good question. One cool thing about training these policies is you can also use them as an animation controller. And use player inputs to steer them around.

Rusty 的头像

Rusty3 个月前

@OpenAI @vast_ai @threejs @webgl_webgpu That's cool.

Laocoön 的头像

Laocoön3 个月前

@OpenAI @vast_ai @threejs @webgl_webgpu I like when it latches onto thin air instead of the pylons. That’s incredible. Was that part of the one-shot prompt? To ignore the pylons and just move the arms wherever, in one-shot?

Chud Sneed 的头像

Chud Sneed3 个月前

@OpenAI @vast_ai @threejs @webgl_webgpu Neat! How much did the RL cost you? How long did it run?

Aaron Lemke 的头像

Aaron Lemke3 个月前

@OpenAI @vast_ai @threejs @webgl_webgpu This one cost me ~4$ And took a few hours

Phil Stőck 的头像

Phil Stőck3 个月前

@OpenAI @vast_ai @threejs @webgl_webgpu Awesome work! Were you on ultra? Also wondering: Could it be that the creature latch to the void? Sometimes, it seems like the tentacles are attached to a point in space that is not a surface. Any clues about the reasons? Do you plan to evolve the creature further?

Aaron Lemke 的头像

Aaron Lemke3 个月前

@OpenAI @vast_ai @threejs @webgl_webgpu I was on ultra. Likely some kind of collider scaling issue. I see this kind of thing a lot still actually. Across engines.

AI Mastery Guide 的头像

AI Mastery Guide3 个月前

@OpenAI @vast_ai @threejs @webgl_webgpu Waking up to find it built and trained a whole creature overnight is such a wild feeling to imagine

The Open Knowledge Network 的头像

The Open Knowledge Network3 个月前

@OpenAI @vast_ai @threejs @webgl_webgpu Always imagined that’s what Ethereum-Land might look like.. 😅

相关视频

Using Fable 5 to add fur and a new voice to my RL creature. The voice is based on the neural network activation (pictured top left). Made with Three.js WebGL / WebGPU Runpod trained with JAX and MuJoCo from Google DeepMind

Using Fable 5 to add fur and a new voice to my RL creature. The voice is based on the neural network activation (pictured top left). Made with Three.js WebGL / WebGPU Runpod trained with JAX and MuJoCo from Google DeepMind

Aaron Lemke

187,855 次观看 • 4 个月前

I put all my RL creatures into the same scene. Feels like there is some kind of interesting game design here. Tending to / training your RL menagerie. Made with Three.js WebGL / WebGPU MuJoCo from Google DeepMind trained on Runpod

I put all my RL creatures into the same scene. Feels like there is some kind of interesting game design here. Tending to / training your RL menagerie. Made with Three.js WebGL / WebGPU MuJoCo from Google DeepMind trained on Runpod

Aaron Lemke

11,090 次观看 • 4 个月前

I was curious how far I could push three.js and WebGL this weekend, and ended up building a complete Yosemite photography simulator in a browser tab — real sun, real Moon, real lidar — with a working film camera on a tripod you can take to my favoirte spots in Yosemite.

I was curious how far I could push three.js and WebGL this weekend, and ended up building a complete Yosemite photography simulator in a browser tab — real sun, real Moon, real lidar — with a working film camera on a tripod you can take to my favoirte spots in Yosemite.

Trond Wuellner

28,261 次观看 • 1 个月前

I just turned 37 today and started this journey when I was 30. After years of building the engine with 💕 and optimizing it, this is the final gameplay running on #webgl with #threejs After converting Jamir from WebGL to WebGPU, I hope to release the X3JS, built on top of Jamir's game engine, in 2025, initially for creating FPP and TPP games, and make it available for everyone. New version will be upcoming in a few days, btw! 🥳 #gamedev #gamedevelopment

I just turned 37 today and started this journey when I was 30. After years of building the engine with 💕 and optimizing it, this is the final gameplay running on #webgl with #threejs After converting Jamir from WebGL to WebGPU, I hope to release the X3JS, built on top of Jamir's game engine, in 2025, initially for creating FPP and TPP games, and make it available for everyone. New version will be upcoming in a few days, btw! 🥳 #gamedev #gamedevelopment

mert

31,651 次观看 • 2 年前

I don't think people realize how versatile WebGPU is! 🤯 In this demo, *both* the semantic search model and Earth shaders are running on WebGPU (via Transformers.js and Three.js, respectively). Pretty insane.

I don't think people realize how versatile WebGPU is! 🤯 In this demo, both the semantic search model and Earth shaders are running on WebGPU (via Transformers.js and Three.js, respectively). Pretty insane.

Xenova

18,317 次观看 • 6 个月前

In my understanding - a big part of why frontier models are becoming smarter and adaptive is that they are learning to mimic an RL process. Fascinating new research showing a link between increased RL training and reward-seeking behaviour just dropped from in collaboration with OpenAI. They investigated a checkpoint from a capabilities-focused OpenAI o3 RL run (without safety training) and found that RL grader preferences often overruled OpenAI leadership preferences.

In my understanding - a big part of why frontier models are becoming smarter and adaptive is that they are learning to mimic an RL process. Fascinating new research showing a link between increased RL training and reward-seeking behaviour just dropped from in collaboration with OpenAI. They investigated a checkpoint from a capabilities-focused OpenAI o3 RL run (without safety training) and found that RL grader preferences often overruled OpenAI leadership preferences.

Machine Learning Street Talk

12,409 次观看 • 3 个月前

I asked Opus 5.5 to build a working computer from scratch. And holy fuck did it deliver. 277k logic gates in JS, an OS on top, and games on the OS. This isn't a mockup... it's a computer. Run it:

I asked Opus 5.5 to build a working computer from scratch. And holy fuck did it deliver. 277k logic gates in JS, an OS on top, and games on the OS. This isn't a mockup... it's a computer. Run it:

Matt Shumer

277,167 次观看 • 1 个月前

Astra one-shotted this interactive river scene in 30 mins 🤯 I struggled with Sol for 2 weeks on this and Astra was able to get a working prototype first try. Honestly, this gets me really excited because it raises the bar for what is now possible in the browser.

Astra one-shotted this interactive river scene in 30 mins 🤯 I struggled with Sol for 2 weeks on this and Astra was able to get a working prototype first try. Honestly, this gets me really excited because it raises the bar for what is now possible in the browser.

Dan Greenheck

69,936 次观看 • 1 个月前

Can't believe in less than 24 hours I created my own game with Claude and Three.js. Running in a browser at 120 FPS. All I had to do was give Claude the repo for Threejs and describe an MMO-like game for it to build from scratch. All the assets and mechanics you see are all from a prompt. As you can see, it is far from done but the progress is insane. Everyone should be using Three.js now without a doubt!

Can't believe in less than 24 hours I created my own game with Claude and Three.js. Running in a browser at 120 FPS. All I had to do was give Claude the repo for Threejs and describe an MMO-like game for it to build from scratch. All the assets and mechanics you see are all from a prompt. As you can see, it is far from done but the progress is insane. Everyone should be using Three.js now without a doubt!

NeilXbt

23,504 次观看 • 2 个月前

I keep trying to work on this and then getting distracted staring at it while waving my hand around. 1 million particles, 120fps, Three.js and webGPU/TSL

I keep trying to work on this and then getting distracted staring at it while waving my hand around. 1 million particles, 120fps, Three.js and webGPU/TSL

Codetaur

25,523 次观看 • 1 年前

Our voxel engine rendering technique heavily uses levels of details to try and keep high performance in the browser! Made with Three.js on #webgpu

Our voxel engine rendering technique heavily uses levels of details to try and keep high performance in the browser! Made with Three.js on #webgpu

AresRPG - The Sui MMORPG

14,893 次观看 • 3 个月前

Today we’re sharing an experimental release of Spark Radix, a WebGPU-powered Gaussian splat renderer built on three.js. Render and explore detailed 3D worlds directly in your browser. Available today for developers to try and test 👇

Today we’re sharing an experimental release of Spark Radix, a WebGPU-powered Gaussian splat renderer built on three.js. Render and explore detailed 3D worlds directly in your browser. Available today for developers to try and test 👇

spark

54,860 次观看 • 3 天前

For this hackathon I taught a robot to beat you in Jenga. It sims every possible move, picks the block that's the best move, then an RL policy pushes it out. Built in MuJoCo & Three.js, running on a real AgileX Robotics arm.

For this hackathon I taught a robot to beat you in Jenga. It sims every possible move, picks the block that's the best move, then an RL policy pushes it out. Built in MuJoCo & Three.js, running on a real AgileX Robotics arm.

jonathanhawkins

39,842 次观看 • 5 个月前

Softbodies by holtsetio Realtime Tetrahedral FEM Models in the Browser, using WebGPU and written in TSL. Based on the WebGL implementation in TetSim by Johnathon Selstad, upgraded to enable collisions.

Softbodies by holtsetio Realtime Tetrahedral FEM Models in the Browser, using WebGPU and written in TSL. Based on the WebGL implementation in TetSim by Johnathon Selstad, upgraded to enable collisions.

Three.js

25,516 次观看 • 1 年前

GPT-6.1 Sol, running in Ultra mode, has been autonomously iterating on this project for more than 16 hours now. It’s using Blender and Three.js, and the entire thing runs directly in the browser. Like I said earlier, this model is genuinely impressive. OpenAI built something here that feels extremely capable, surprisingly cheap, and now fast enough to make long-running agentic workflows much more practical. (The project is still in progress...)

GPT-6.1 Sol, running in Ultra mode, has been autonomously iterating on this project for more than 16 hours now. It’s using Blender and Three.js, and the entire thing runs directly in the browser. Like I said earlier, this model is genuinely impressive. OpenAI built something here that feels extremely capable, surprisingly cheap, and now fast enough to make long-running agentic workflows much more practical. (The project is still in progress...)

Token Gremlin

18,553 次观看 • 1 个月前

made an interactive video model trained on tap-conditioned data.. tap the screen and it generates the next frames in realtime (small enough to run in the browser with webgpu, even on iphone)

made an interactive video model trained on tap-conditioned data.. tap the screen and it generates the next frames in realtime (small enough to run in the browser with webgpu, even on iphone)

sahir

25,027 次观看 • 7 个月前

I tested Rust vs Javascript for games 🎮 I had this question recently and decided to port my Three.js game to Rust Desktop I'm still not able to reproduce the same look on both games but I believe that codewise they are very similar With both games running, the Rust version averages 37FPS while the Three.js version averages around 20FPS If I'm running one game at a time the FPS goes up considerably (60 FPS on both with power on) So the Rust version for Desktop has 85% increase in performance on my Macbook Pro M4 This comparision is basically comparing Browser vs Native, which is not completely fair So that's why I want to port the Rust version to WASM on the browser and benchmark again soon

I tested Rust vs Javascript for games 🎮 I had this question recently and decided to port my Three.js game to Rust Desktop I'm still not able to reproduce the same look on both games but I believe that codewise they are very similar With both games running, the Rust version averages 37FPS while the Three.js version averages around 20FPS If I'm running one game at a time the FPS goes up considerably (60 FPS on both with power on) So the Rust version for Desktop has 85% increase in performance on my Macbook Pro M4 This comparision is basically comparing Browser vs Native, which is not completely fair So that's why I want to port the Rust version to WASM on the browser and benchmark again soon

André → andreelias.dev

93,523 次观看 • 5 个月前

I've been working on getting my C multicore-runtime to run on the web. it's still early, but this is a fully multi-threaded renderer + physics running on WebGPU and WASM. 100k cubes, 60 FPS I'll be benchmarking it against Unity ECS soon

I've been working on getting my C multicore-runtime to run on the web. it's still early, but this is a fully multi-threaded renderer + physics running on WebGPU and WASM. 100k cubes, 60 FPS I'll be benchmarking it against Unity ECS soon

Gabriel Dechichi

2,444,467 次观看 • 10 个月前