Loading video...

Video Failed to Load

Go Home

~~RL project progress~~ wrote a FAST (88M steps/s) parallelized env in jax from scratch. here's its renderer:

14,149 views • 1 year ago •via X (Twitter)

7 Comments

danb's profile picture
danb1 year ago

i used LLMs to write the renderer btw. im learning RL not openGL the core jax env under the hood is what matters. its steps/s == how fast I can train a model on it SoA and jax.jit do the heavy lifting here. future optimizations: replace loops with scans, run on a cloud gpu

kunal's profile picture
kunal1 year ago

very cool who is the agent and whats its learning objective in this sim?

danb's profile picture
danb1 year ago

right now there is no agent, just the parallelizable env and renderer the agent will be a planet whose objective is a bit complex. but essentially its goal is to guarantee survival

attentionmech's profile picture
attentionmech1 year ago

looks so coooool !!

kache's profile picture
kache1 year ago

very cool

_doola's profile picture
_doola1 year ago

88 million steps/s?? holy shit

Keith Tsang's profile picture
Keith Tsang1 year ago

@yacineMTB Impressive work! Building a FAST parallelized env from scratch is no small feat. What's next on your agenda? 🚀 #Innovation

Related Videos