Loading video...

Video Failed to Load

There was a problem loading this video. This could be due to a temporary network issue or the video might be unavailable.

Introducing RL Visualizer See PPO and GRPO mentioned everywhere but don't know what actually makes them different? Visualize and compare these algorithms in a simple online maze environment! 🚀

alphaXiv

41,033 subscribers

78,947 views • 7 months ago •via X (Twitter)

Education Science & Technology

Anya Rossi• Live Now

Private livecam show

0 Comments

No comments available

Comments from the original post will appear here

Related Videos

Want to scale RL with your shiny new GPU? 🚀 In our ICML24 Oral we find that RL algorithms hit a barrier when data is scaled up. Our new algorithm, SAPG, proposes a simple fix. It scales to 25k envs and solves hard tasks where PPO makes no progress. 1/n

Want to scale RL with your shiny new GPU? 🚀 In our ICML24 Oral we find that RL algorithms hit a barrier when data is scaled up. Our new algorithm, SAPG, proposes a simple fix. It scales to 25k envs and solves hard tasks where PPO makes no progress. 1/n

Ananye Agarwal

64,403 views • 1 year ago

Let’s talk about our new orthodontic pacifiers and what makes them different! In this video I wanted to highlight all the features of our new design and what makes these unique~

Let’s talk about our new orthodontic pacifiers and what makes them different! In this video I wanted to highlight all the features of our new design and what makes these unique~

Lil Comforts

46,987 views • 5 months ago

bro casually explains RL tuning for LLMs and the three critical components: training, inference, and environments. basically any RLVR algorithm such as GRPO comes down to this super simple concept.

bro casually explains RL tuning for LLMs and the three critical components: training, inference, and environments. basically any RLVR algorithm such as GRPO comes down to this super simple concept.

ℏεsam

102,344 views • 5 months ago

I don't know but all in all we now understand what and why all these happened .

I don't know but all in all we now understand what and why all these happened .

𝗩𝗶𝗴𝗶𝗹𝗮𝗻𝘁𝗲 𝗩𝗮𝗻𝗴𝘂𝗮𝗿𝗱

164,825 views • 1 year ago

When I say Ødegaard lacks conviction in his actions, this is what I mean. Do you see the urgency, creativity, and spontaneity here? That’s what makes a big mover. Now compare that to Ødegaard it's a different level of intent and directness.

When I say Ødegaard lacks conviction in his actions, this is what I mean. Do you see the urgency, creativity, and spontaneity here? That’s what makes a big mover. Now compare that to Ødegaard it's a different level of intent and directness.

Arsenal X-tra

473,389 views • 6 months ago

Okay okay, spent my weekend gooning around learning GRPO math. Here's some takes. Essentially, this is me yapping through a recap of smaller details on how GRPO is implemented, what Dr. GRPO changes, why, DAPO, connections to PPO, aggregating batches... Reading list below.

Okay okay, spent my weekend gooning around learning GRPO math. Here's some takes. Essentially, this is me yapping through a recap of smaller details on how GRPO is implemented, what Dr. GRPO changes, why, DAPO, connections to PPO, aggregating batches... Reading list below.

Nathan Lambert

123,052 views • 1 year ago

I love how these were never officially released by ariana and her team but still see them everywhere

I love how these were never officially released by ariana and her team but still see them everywhere

444

144,065 views • 3 months ago

What did Peter Obi say that was different from what's coming from the mouth of these Pastors? We a know the truth and the simple message PO was trying to pass, but let's keep pretending and forming religious voltrons in a dying economy.

What did Peter Obi say that was different from what's coming from the mouth of these Pastors? We a know the truth and the simple message PO was trying to pass, but let's keep pretending and forming religious voltrons in a dying economy.

WiII E. 🏝️

341,439 views • 1 year ago

They know they’re doing fraud but you will see them floating luxury cars and money online. When will these boys learn sense? Arrangement and Lanchester paaa 💔💔💔💔

They know they’re doing fraud but you will see them floating luxury cars and money online. When will these boys learn sense? Arrangement and Lanchester paaa 💔💔💔💔

Gh Durk 🇬🇭🌎

43,152 views • 2 months ago

To solve AGI, we must first solve Geoguessr For that I built vlm-gym, a simple RL gym written in scratch, in JAX for Qwen3VL-4B (released yesterday) And added Geospot, a RL environment for geolocation and learned VLMs can learn how to geoguess. More:

To solve AGI, we must first solve Geoguessr For that I built vlm-gym, a simple RL gym written in scratch, in JAX for Qwen3VL-4B (released yesterday) And added Geospot, a RL environment for geolocation and learned VLMs can learn how to geoguess. More:

Surya

140,348 views • 8 months ago

They’re calling it a “dragon”… but nobody can prove what it actually is. That hasn’t stopped it from spreading everywhere online. In Romania, a man claims to have found and excavated this large skull, which some are claiming is a dragon. What do you see, discovery or deception? 🐉

They’re calling it a “dragon”… but nobody can prove what it actually is. That hasn’t stopped it from spreading everywhere online. In Romania, a man claims to have found and excavated this large skull, which some are claiming is a dragon. What do you see, discovery or deception? 🐉

𝙲𝚘𝚗𝚜𝚎𝚛𝚟𝚊𝚝𝚒𝚟𝚎 👑 𝙳𝚒𝚟𝚊™

25,683 views • 1 month ago

They put these same lessons over and over everywhere under the cover of entertainment, but really it's a school. Run by who I really don't know.

They put these same lessons over and over everywhere under the cover of entertainment, but really it's a school. Run by who I really don't know.

Invisidon

54,063 views • 1 year ago

I'm a curator of a museum of art. I think these watches tell a story in every case, and they're all different. You know, they're striking enough that you see something different in every dial, and that's exactly what I'm trying to achieve.

I'm a curator of a museum of art. I think these watches tell a story in every case, and they're all different. You know, they're striking enough that you see something different in every dial, and that's exactly what I'm trying to achieve.

Kevin O'Leary aka Mr. Wonderful

25,767 views • 1 year ago

Sungjae was mentioned in Han Chaeah's latest content HCA is trying to get these high school students to know her. They know YSJ and The Golden Spoon, but they don't believe HCA plays his mother there. Well her style as a poor mother is so different from her style irl😂

Sungjae was mentioned in Han Chaeah's latest content HCA is trying to get these high school students to know her. They know YSJ and The Golden Spoon, but they don't believe HCA plays his mother there. Well her style as a poor mother is so different from her style irl😂

fy🍀🎶

15,774 views • 1 month ago

But what they really want is a forever family ❤️ Meet these perfect dogs and see what makes each of them unforgettable! To learn more about these precious pups, check out Franklin County Dog Shelter & Adoption Center on Instagram:

But what they really want is a forever family ❤️ Meet these perfect dogs and see what makes each of them unforgettable! To learn more about these precious pups, check out Franklin County Dog Shelter & Adoption Center on Instagram:

The Dodo

46,936 views • 6 months ago

The co-founders of Flapping Airplanes call the current RL paradigm for model training "environment slop." They explain: "The reinforcement paradigms of today are shockingly inefficient. You don't really get much generalization across tasks, you teach a model through one kind of learning and then you teach it the next one. It's kind of like whack-a-mole. We look at this and think it's kind of crazy. The next paradigm of AI will not be environment slop." "Human level intelligence is not the ceiling, it is merely the floor on what is possible. If you can train models with vastly less data and possibly more compute in very different ways, what is going to happen? We actually don't know. But I do think they'll be different and weird and they'll have interesting capabilities that we'll find really valuable ways to use."

The co-founders of Flapping Airplanes call the current RL paradigm for model training "environment slop." They explain: "The reinforcement paradigms of today are shockingly inefficient. You don't really get much generalization across tasks, you teach a model through one kind of learning and then you teach it the next one. It's kind of like whack-a-mole. We look at this and think it's kind of crazy. The next paradigm of AI will not be environment slop." "Human level intelligence is not the ceiling, it is merely the floor on what is possible. If you can train models with vastly less data and possibly more compute in very different ways, what is going to happen? We actually don't know. But I do think they'll be different and weird and they'll have interesting capabilities that we'll find really valuable ways to use."

TBPN

85,358 views • 5 months ago

I don't even know where we begin fixing society. Send them back and see what happens is a start I guess.

I don't even know where we begin fixing society. Send them back and see what happens is a start I guess.

Russian Garbage Human

101,650 views • 3 months ago

further reward crafting for hand-centric (tm) PPO model. Closing in on what I want. need to slow down max velocities and I want more stepping/stride + less tip toe on left foot ideally. almost cant believe this is actually just RL!

further reward crafting for hand-centric (tm) PPO model. Closing in on what I want. need to slow down max velocities and I want more stepping/stride + less tip toe on left foot ideally. almost cant believe this is actually just RL!

Harrison Kinsley

15,973 views • 6 months ago

Vision-based(Colapli) RAG is becoming popular, so we built a platform to compare: - Simple OCR RAG - VisionRAG - Colpali - Hybrid Colpali 🚀 Introducing VARAG – the Vision-First RAG Engine (Vision Augmented Retrieval and Generation).

Vision-based(Colapli) RAG is becoming popular, so we built a platform to compare: - Simple OCR RAG - VisionRAG - Colpali - Hybrid Colpali 🚀 Introducing VARAG – the Vision-First RAG Engine (Vision Augmented Retrieval and Generation).

Adithya S K

95,370 views • 1 year ago

🚨 🇺🇸 SEN. FETTERMAN: DON’T EVER COMPARE ANYONE TO HITLER. IT INCITES VIOLENCE "Do not ever, ever, ever compare anyone to Hitler. If not, go online and read up on exactly what he's responsible for. You know, 75 to 80 million lives were lost in World War II, and you don't compare him to anyone." Source: Bret Baier

🚨 🇺🇸 SEN. FETTERMAN: DON’T EVER COMPARE ANYONE TO HITLER. IT INCITES VIOLENCE "Do not ever, ever, ever compare anyone to Hitler. If not, go online and read up on exactly what he's responsible for. You know, 75 to 80 million lives were lost in World War II, and you don't compare him to anyone." Source: Bret Baier

Mario Nawfal

149,031 views • 9 months ago