Video yükleniyor...

Video Yüklenemedi

Ana Sayfaya Dön

Introducing RL Visualizer See PPO and GRPO mentioned everywhere but don't know what actually makes them different? Visualize and compare these algorithms in a simple online maze environment! 🚀

askalphaxiv's profile picture

alphaXiv

41,033 subscribers

78,947 görüntüleme • 6 ay önce •via X (Twitter)

EğitimBilim & Teknoloji
LIVE

Anya Rossi• Live Now

Private livecam show

0 Yorum

Yorum bulunmuyor

Orijinal gönderinin yorumları burada görünecek

Benzer Videolar

Want to scale RL with your shiny new GPU? 🚀 In our ICML24 Oral we find that RL algorithms hit a barrier when data is scaled up. Our new algorithm, SAPG, proposes a simple fix. It scales to 25k envs and solves hard tasks where PPO makes no progress. 1/n
1:24

Want to scale RL with your shiny new GPU? 🚀 In our ICML24 Oral we find that RL algorithms hit a barrier when data is scaled up. Our new algorithm, SAPG, proposes a simple fix. It scales to 25k envs and solves hard tasks where PPO makes no progress. 1/n

Ananye Agarwal

64,403 görüntüleme • 1 yıl önce

Let’s talk about our new orthodontic pacifiers and what makes them different! In this video I wanted to highlight all the features of our new design and what makes these unique~
1:27

Let’s talk about our new orthodontic pacifiers and what makes them different! In this video I wanted to highlight all the features of our new design and what makes these unique~

Lil Comforts

46,987 görüntüleme • 5 ay önce

bro casually explains RL tuning for LLMs and the three critical components: training, inference, and environments. basically any RLVR algorithm such as GRPO comes down to this super simple concept.
1:42

bro casually explains RL tuning for LLMs and the three critical components: training, inference, and environments. basically any RLVR algorithm such as GRPO comes down to this super simple concept.

ℏεsam

102,344 görüntüleme • 5 ay önce

I don't know but all in all we now understand what and why all these happened .
6:44

I don't know but all in all we now understand what and why all these happened .

𝗩𝗶𝗴𝗶𝗹𝗮𝗻𝘁𝗲 𝗩𝗮𝗻𝗴𝘂𝗮𝗿𝗱

164,825 görüntüleme • 1 yıl önce

When I say Ødegaard lacks conviction in his actions, this is what I mean. Do you see the urgency, creativity, and spontaneity here? That’s what makes a big mover. Now compare that to Ødegaard it's a different level of intent and directness.
1:56

When I say Ødegaard lacks conviction in his actions, this is what I mean. Do you see the urgency, creativity, and spontaneity here? That’s what makes a big mover. Now compare that to Ødegaard it's a different level of intent and directness.

Arsenal X-tra

473,389 görüntüleme • 6 ay önce

Okay okay, spent my weekend gooning around learning GRPO math. Here's some takes. Essentially, this is me yapping through a recap of smaller details on how GRPO is implemented, what Dr. GRPO changes, why, DAPO, connections to PPO, aggregating batches... Reading list below.
22:22

Okay okay, spent my weekend gooning around learning GRPO math. Here's some takes. Essentially, this is me yapping through a recap of smaller details on how GRPO is implemented, what Dr. GRPO changes, why, DAPO, connections to PPO, aggregating batches... Reading list below.

Nathan Lambert

123,052 görüntüleme • 1 yıl önce

I love how these were never officially released by ariana and her team but still see them everywhere
2:41

I love how these were never officially released by ariana and her team but still see them everywhere

444

144,065 görüntüleme • 3 ay önce

They know they’re doing fraud but you will see them floating luxury cars and money online. When will these boys learn sense? Arrangement and Lanchester paaa 💔💔💔💔
0:32

They know they’re doing fraud but you will see them floating luxury cars and money online. When will these boys learn sense? Arrangement and Lanchester paaa 💔💔💔💔

Gh Durk 🇬🇭🌎

43,152 görüntüleme • 1 ay önce

What did Peter Obi say that was different from what's coming from the mouth of these Pastors? We a know the truth and the simple message PO was trying to pass, but let's keep pretending and forming religious voltrons in a dying economy.
1:52

What did Peter Obi say that was different from what's coming from the mouth of these Pastors? We a know the truth and the simple message PO was trying to pass, but let's keep pretending and forming religious voltrons in a dying economy.

WiII 🏝️

341,412 görüntüleme • 1 yıl önce

To solve AGI, we must first solve Geoguessr For that I built vlm-gym, a simple RL gym written in scratch, in JAX for Qwen3VL-4B (released yesterday) And added Geospot, a RL environment for geolocation and learned VLMs can learn how to geoguess. More:
0:22

To solve AGI, we must first solve Geoguessr For that I built vlm-gym, a simple RL gym written in scratch, in JAX for Qwen3VL-4B (released yesterday) And added Geospot, a RL environment for geolocation and learned VLMs can learn how to geoguess. More:

Surya

140,348 görüntüleme • 8 ay önce

They’re calling it a “dragon”… but nobody can prove what it actually is. That hasn’t stopped it from spreading everywhere online. In Romania, a man claims to have found and excavated this large skull, which some are claiming is a dragon. What do you see, discovery or deception? 🐉
1:04

They’re calling it a “dragon”… but nobody can prove what it actually is. That hasn’t stopped it from spreading everywhere online. In Romania, a man claims to have found and excavated this large skull, which some are claiming is a dragon. What do you see, discovery or deception? 🐉

𝙲𝚘𝚗𝚜𝚎𝚛𝚟𝚊𝚝𝚒𝚟𝚎 👑 𝙳𝚒𝚟𝚊™

25,683 görüntüleme • 1 ay önce

They put these same lessons over and over everywhere under the cover of entertainment, but really it's a school. Run by who I really don't know.
4:39

They put these same lessons over and over everywhere under the cover of entertainment, but really it's a school. Run by who I really don't know.

Invisidon

54,063 görüntüleme • 1 yıl önce

I'm a curator of a museum of art. I think these watches tell a story in every case, and they're all different. You know, they're striking enough that you see something different in every dial, and that's exactly what I'm trying to achieve.
0:35

I'm a curator of a museum of art. I think these watches tell a story in every case, and they're all different. You know, they're striking enough that you see something different in every dial, and that's exactly what I'm trying to achieve.

Kevin O'Leary aka Mr. Wonderful

25,767 görüntüleme • 1 yıl önce

Sungjae was mentioned in Han Chaeah's latest content HCA is trying to get these high school students to know her. They know YSJ and The Golden Spoon, but they don't believe HCA plays his mother there. Well her style as a poor mother is so different from her style irl😂
0:29

Sungjae was mentioned in Han Chaeah's latest content HCA is trying to get these high school students to know her. They know YSJ and The Golden Spoon, but they don't believe HCA plays his mother there. Well her style as a poor mother is so different from her style irl😂

fy🍀🎶

15,774 görüntüleme • 1 ay önce

But what they really want is a forever family ❤️ Meet these perfect dogs and see what makes each of them unforgettable! To learn more about these precious pups, check out Franklin County Dog Shelter & Adoption Center on Instagram:
1:33

But what they really want is a forever family ❤️ Meet these perfect dogs and see what makes each of them unforgettable! To learn more about these precious pups, check out Franklin County Dog Shelter & Adoption Center on Instagram:

The Dodo

46,936 görüntüleme • 6 ay önce

further reward crafting for hand-centric (tm) PPO model. Closing in on what I want. need to slow down max velocities and I want more stepping/stride + less tip toe on left foot ideally. almost cant believe this is actually just RL!
2:40

further reward crafting for hand-centric (tm) PPO model. Closing in on what I want. need to slow down max velocities and I want more stepping/stride + less tip toe on left foot ideally. almost cant believe this is actually just RL!

Harrison Kinsley

15,973 görüntüleme • 6 ay önce

The co-founders of Flapping Airplanes call the current RL paradigm for model training "environment slop." They explain: "The reinforcement paradigms of today are shockingly inefficient. You don't really get much generalization across tasks, you teach a model through one kind of learning and then you teach it the next one. It's kind of like whack-a-mole. We look at this and think it's kind of crazy. The next paradigm of AI will not be environment slop." "Human level intelligence is not the ceiling, it is merely the floor on what is possible. If you can train models with vastly less data and possibly more compute in very different ways, what is going to happen? We actually don't know. But I do think they'll be different and weird and they'll have interesting capabilities that we'll find really valuable ways to use."
2:40

The co-founders of Flapping Airplanes call the current RL paradigm for model training "environment slop." They explain: "The reinforcement paradigms of today are shockingly inefficient. You don't really get much generalization across tasks, you teach a model through one kind of learning and then you teach it the next one. It's kind of like whack-a-mole. We look at this and think it's kind of crazy. The next paradigm of AI will not be environment slop." "Human level intelligence is not the ceiling, it is merely the floor on what is possible. If you can train models with vastly less data and possibly more compute in very different ways, what is going to happen? We actually don't know. But I do think they'll be different and weird and they'll have interesting capabilities that we'll find really valuable ways to use."

TBPN

85,358 görüntüleme • 5 ay önce

I don't even know where we begin fixing society. Send them back and see what happens is a start I guess.
1:03

I don't even know where we begin fixing society. Send them back and see what happens is a start I guess.

Russian Garbage Human

101,650 görüntüleme • 2 ay önce

Vision-based(Colapli) RAG is becoming popular, so we built a platform to compare: - Simple OCR RAG - VisionRAG - Colpali - Hybrid Colpali 🚀 Introducing VARAG – the Vision-First RAG Engine (Vision Augmented Retrieval and Generation).
2:19

Vision-based(Colapli) RAG is becoming popular, so we built a platform to compare: - Simple OCR RAG - VisionRAG - Colpali - Hybrid Colpali 🚀 Introducing VARAG – the Vision-First RAG Engine (Vision Augmented Retrieval and Generation).

Adithya S K

95,370 görüntüleme • 1 yıl önce

🚨 🇺🇸 SEN. FETTERMAN: DON’T EVER COMPARE ANYONE TO HITLER. IT INCITES VIOLENCE "Do not ever, ever, ever compare anyone to Hitler. If not, go online and read up on exactly what he's responsible for. You know, 75 to 80 million lives were lost in World War II, and you don't compare him to anyone." Source: Bret Baier
1:04

🚨 🇺🇸 SEN. FETTERMAN: DON’T EVER COMPARE ANYONE TO HITLER. IT INCITES VIOLENCE "Do not ever, ever, ever compare anyone to Hitler. If not, go online and read up on exactly what he's responsible for. You know, 75 to 80 million lives were lost in World War II, and you don't compare him to anyone." Source: Bret Baier

Mario Nawfal

149,031 görüntüleme • 9 ay önce