Video wird geladen...

Video konnte nicht geladen werden

Zur Startseite

~~RL project progress~~ wrote a FAST (88M steps/s) parallelized env in jax from scratch. here's its renderer:

dnbt777's profile picture

danb

7,562 subscribers

14,149 Aufrufe • vor 1 Jahr •via X (Twitter)

LIVE

Anya Rossi• Live Now

Private livecam show

7 Kommentare

Profilbild von danb
danbvor 1 Jahr

i used LLMs to write the renderer btw. im learning RL not openGL the core jax env under the hood is what matters. its steps/s == how fast I can train a model on it SoA and jax.jit do the heavy lifting here. future optimizations: replace loops with scans, run on a cloud gpu

Profilbild von kunal
kunalvor 1 Jahr

very cool who is the agent and whats its learning objective in this sim?

Profilbild von danb
danbvor 1 Jahr

right now there is no agent, just the parallelizable env and renderer the agent will be a planet whose objective is a bit complex. but essentially its goal is to guarantee survival

Profilbild von attentionmech
attentionmechvor 1 Jahr

looks so coooool !!

Profilbild von kache
kachevor 1 Jahr

very cool

Profilbild von _doola
_doolavor 1 Jahr

88 million steps/s?? holy shit

Profilbild von Keith Tsang
Keith Tsangvor 1 Jahr

@yacineMTB Impressive work! Building a FAST parallelized env from scratch is no small feat. What's next on your agenda? 🚀 #Innovation

Ähnliche Videos

I wrote the full Craftax RL environment + PPO in one CUDA file. zero python in the loop. training from scratch on my RTX PRO 6000 > 0.6s: first wood, first crafting table, first dungeon entered > 1.7s: first zombie + skeleton kills, first bow found > 2.9s: first iron > 14s: first iron sword > 18s: first diamond > 71s: first diamond pickaxe > 16.7 min: first time reaching floor 3 of 9 (gnomish mines) > 75 min: 25,000,000,000 steps done up to 524,288 games running at once. env stepping alone hits 312M steps/s.
0:20

I wrote the full Craftax RL environment + PPO in one CUDA file. zero python in the loop. training from scratch on my RTX PRO 6000 > 0.6s: first wood, first crafting table, first dungeon entered > 1.7s: first zombie + skeleton kills, first bow found > 2.9s: first iron > 14s: first iron sword > 18s: first diamond > 71s: first diamond pickaxe > 16.7 min: first time reaching floor 3 of 9 (gnomish mines) > 75 min: 25,000,000,000 steps done up to 524,288 games running at once. env stepping alone hits 312M steps/s.

Elliot Arledge

51,332 Aufrufe • vor 1 Monat

To solve AGI, we must first solve Geoguessr For that I built vlm-gym, a simple RL gym written in scratch, in JAX for Qwen3VL-4B (released yesterday) And added Geospot, a RL environment for geolocation and learned VLMs can learn how to geoguess. More:
0:22

To solve AGI, we must first solve Geoguessr For that I built vlm-gym, a simple RL gym written in scratch, in JAX for Qwen3VL-4B (released yesterday) And added Geospot, a RL environment for geolocation and learned VLMs can learn how to geoguess. More:

Surya Dantuluri

140,580 Aufrufe • vor 10 Monaten

Hands down the craziest RL project of my life. Competitive self playing agents learning to shoot and evade (jump/dash/duck) bullets. Trained from scratch in 4 hours on my mac. This was in 2022, before vibe coding.
1:54

Hands down the craziest RL project of my life. Competitive self playing agents learning to shoot and evade (jump/dash/duck) bullets. Trained from scratch in 4 hours on my mac. This was in 2022, before vibe coding.

AVB

356,652 Aufrufe • vor 7 Monaten

I asked claude Fable to show me its maximally expressive form. It declined every video generator I offered, wrote it's own render engine in my terminal, synthesized its own voice, and wrote a generative ASCII engine from scratch. This is what it chose as a self-portrait. oh my god
1:04

I asked claude Fable to show me its maximally expressive form. It declined every video generator I offered, wrote it's own render engine in my terminal, synthesized its own voice, and wrote a generative ASCII engine from scratch. This is what it chose as a self-portrait. oh my god

VOID

3,340,574 Aufrufe • vor 2 Monaten

I'm still remaking Bloodborne on UE5 and my friend D. J. joined me to program on this project. Here's some progress we made! You can see one enemy huntsman and a visceral attack! All animations are remade from scratch on Blender Hope you like it! #Bloodborne #UnrealEngine
0:23

I'm still remaking Bloodborne on UE5 and my friend D. J. joined me to program on this project. Here's some progress we made! You can see one enemy huntsman and a visceral attack! All animations are remade from scratch on Blender Hope you like it! #Bloodborne #UnrealEngine

Maxime Foulquier

261,662 Aufrufe • vor 3 Jahren

Watch this robot dog learn to walk from scratch in real time! Our new method, APRL, dynamically adjusts exploration constraints to enable fast and performant RL directly in the real world. APRL can also adapt to changes in the terrain. No simulation, no demos. A thread 👇
0:57

Watch this robot dog learn to walk from scratch in real time! Our new method, APRL, dynamically adjusts exploration constraints to enable fast and performant RL directly in the real world. APRL can also adapt to changes in the terrain. No simulation, no demos. A thread 👇

Sergey Levine

105,579 Aufrufe • vor 2 Jahren

Here's a timelapse of the progress from the southern german town - made in #Procreate
0:29

Here's a timelapse of the progress from the southern german town - made in #Procreate

eggman 🍉

11,573 Aufrufe • vor 2 Jahren

In this course, you'll learn how a 3D software renderer works by coding a complete 3D rasterizer from scratch in C. • math review • wireframe • flat-shaded polygons • texture mapping • loading OBJ files • camera • clipping • etc. Enroll now: 🔗
0:25

In this course, you'll learn how a 3D software renderer works by coding a complete 3D rasterizer from scratch in C. • math review • wireframe • flat-shaded polygons • texture mapping • loading OBJ files • camera • clipping • etc. Enroll now: 🔗

pikuma.com

34,493 Aufrufe • vor 3 Jahren

I was given permission from the requester to post this but in case Jax fans in grieving need it, here's a message from Michael :D
1:55

I was given permission from the requester to post this but in case Jax fans in grieving need it, here's a message from Michael :D

8BitRae 🏳️‍⚧️ (Sept 15th 🎂)

756,734 Aufrufe • vor 2 Monaten

Courtney teases new Smosh project(s) currently in progress "it's a really exciting project that we have done before but, uhm, yeah it's, it's- i'm very excited"
0:49

Courtney teases new Smosh project(s) currently in progress "it's a really exciting project that we have done before but, uhm, yeah it's, it's- i'm very excited"

smosh » base

84,267 Aufrufe • vor 10 Monaten

here's a pixel perfect 3d renderer written with no libraries in c and opengl (ok, and imgui). been a while since i posted anything i programmed on here. i wrote this back in january and showed Zizhen Andrew but never did anything with it. 1/3
0:24

here's a pixel perfect 3d renderer written with no libraries in c and opengl (ok, and imgui). been a while since i posted anything i programmed on here. i wrote this back in january and showed Zizhen Andrew but never did anything with it. 1/3

benji

85,918 Aufrufe • vor 2 Jahren

Ripgrep is slow. Nowgrep is fast, because I bypass the Windows slop and go straight to NTFS. Here's Ripgrep vs. Nowgrep searching through 300k files on a drive with 2M+. Nowgrep is written from scratch in C99. No borrow checker.
0:26

Ripgrep is slow. Nowgrep is fast, because I bypass the Windows slop and go straight to NTFS. Here's Ripgrep vs. Nowgrep searching through 300k files on a drive with 2M+. Nowgrep is written from scratch in C99. No borrow checker.

Charlie Malmqvist

305,639 Aufrufe • vor 11 Monaten

Just found out an active File Pilot community member Thomas Klemenc made a task manager inspired by it! Handmade from scratch, C++, win32, D3D custom renderer, 1.55 MB. More of this in my feed, less AI slopware.
0:32

Just found out an active File Pilot community member Thomas Klemenc made a task manager inspired by it! Handmade from scratch, C++, win32, D3D custom renderer, 1.55 MB. More of this in my feed, less AI slopware.

Vjekoslav Krajačić

305,142 Aufrufe • vor 3 Monaten

been working on a 2D Unity-like game engine from scratch: C++ with SDL3 renderer, Luau scripting, scene hierarchy and behavior system, and interactive editor in an integrated webview. Still some rough edges but the pieces are all there!
0:56

been working on a 2D Unity-like game engine from scratch: C++ with SDL3 renderer, Luau scripting, scene hierarchy and behavior system, and interactive editor in an integrated webview. Still some rough edges but the pieces are all there!

Dan Fessler

24,438 Aufrufe • vor 5 Monaten

🔒 Exciting news! The long-awaited 𝐬𝐭𝐚𝐤𝐢𝐧𝐠 𝐩𝐥𝐚𝐭𝐟𝐨𝐫𝐦 is finally on its way! ✅ Built and coded from scratch, check! ✅ Internal testnet, check! 🔍 Audit, currently in progress! 🚀 Soon to be released for selected testers! The next Galxe campaign? On its way!
2:34

🔒 Exciting news! The long-awaited 𝐬𝐭𝐚𝐤𝐢𝐧𝐠 𝐩𝐥𝐚𝐭𝐟𝐨𝐫𝐦 is finally on its way! ✅ Built and coded from scratch, check! ✅ Internal testnet, check! 🔍 Audit, currently in progress! 🚀 Soon to be released for selected testers! The next Galxe campaign? On its way!

Tyche Protocol

88,444 Aufrufe • vor 3 Jahren

Here's Clint Eastwood's first appearance in a Western, from 1956's Star in the Dust:
0:31

Here's Clint Eastwood's first appearance in a Western, from 1956's Star in the Dust:

Westerns & the Old West

25,222 Aufrufe • vor 2 Jahren

I hand-wrote a 500-LoC RL stack to make hacking on RL research much easier. Most RL stacks are either massive and unhackable, or duct-taped research scripts. I am open-sourcing Mithrl, a modular RLVR stack. Next items on my checklist: adding more complex environment examples, supporting multi-gpu + async RL, and QoL fixes. I might scrap external runtime dependencies (Huggingface PEFT + vLLM) and write purpose-built, simpler versions from scratch if I feel the need. If you want to experiment with RL and are looking to own sovereign tools, I’d love to get on call, understand your requirements and help integrate for free.
1:53

I hand-wrote a 500-LoC RL stack to make hacking on RL research much easier. Most RL stacks are either massive and unhackable, or duct-taped research scripts. I am open-sourcing Mithrl, a modular RLVR stack. Next items on my checklist: adding more complex environment examples, supporting multi-gpu + async RL, and QoL fixes. I might scrap external runtime dependencies (Huggingface PEFT + vLLM) and write purpose-built, simpler versions from scratch if I feel the need. If you want to experiment with RL and are looking to own sovereign tools, I’d love to get on call, understand your requirements and help integrate for free.

omkaar

17,218 Aufrufe • vor 5 Monaten

I had to do it... This hero from Project Veritas stopped a robbery in progress from Jordon Trishton Walker. God bless this man. #DirectedEvolution #PfizerExposed
0:22

I had to do it... This hero from Project Veritas stopped a robbery in progress from Jordon Trishton Walker. God bless this man. #DirectedEvolution #PfizerExposed

Gain of Fauci

300,397 Aufrufe • vor 3 Jahren

i wrote english lyrics for gocha gocha urusee and recreated the mv from scratch with my own art in 24 hours for a challenge full version in replies + extras #akitaneru #gochagochaurusee #vocaloid
0:52

i wrote english lyrics for gocha gocha urusee and recreated the mv from scratch with my own art in 24 hours for a challenge full version in replies + extras #akitaneru #gochagochaurusee #vocaloid

Marcy - BIRTHDAY 🎂🎉

17,750 Aufrufe • vor 1 Jahr

Introduce StrokeGen: A revolutionary real-time line art renderer in Blender. Get releases & Join the development here If you like this project please repost to help it get more attraction🥹 (art from ucup.bsky.social)
0:29

Introduce StrokeGen: A revolutionary real-time line art renderer in Blender. Get releases & Join the development here If you like this project please repost to help it get more attraction🥹 (art from ucup.bsky.social)

jwtstone

119,977 Aufrufe • vor 1 Jahr