Загрузка видео...

Не удалось загрузить видео

На главную

Introducing RL Visualizer See PPO and GRPO mentioned everywhere but don't know what actually makes them different? Visualize and compare these algorithms in a simple online maze environment! 🚀

askalphaxiv's profile picture

alphaXiv

41,033 subscribers

78,947 просмотров • 6 месяцев назад •via X (Twitter)

ОбразованиеНаука и технологии
LIVE

Anya Rossi• Live Now

Private livecam show

Комментарии: 0

Нет доступных комментариев

Здесь появятся комментарии из оригинального поста

Похожие видео

Want to scale RL with your shiny new GPU? 🚀 In our ICML24 Oral we find that RL algorithms hit a barrier when data is scaled up. Our new algorithm, SAPG, proposes a simple fix. It scales to 25k envs and solves hard tasks where PPO makes no progress. 1/n
1:24

Want to scale RL with your shiny new GPU? 🚀 In our ICML24 Oral we find that RL algorithms hit a barrier when data is scaled up. Our new algorithm, SAPG, proposes a simple fix. It scales to 25k envs and solves hard tasks where PPO makes no progress. 1/n

Ananye Agarwal

64,403 просмотров • 1 год назад

Let’s talk about our new orthodontic pacifiers and what makes them different! In this video I wanted to highlight all the features of our new design and what makes these unique~
1:27

Let’s talk about our new orthodontic pacifiers and what makes them different! In this video I wanted to highlight all the features of our new design and what makes these unique~

Lil Comforts

46,509 просмотров • 4 месяцев назад

bro casually explains RL tuning for LLMs and the three critical components: training, inference, and environments. basically any RLVR algorithm such as GRPO comes down to this super simple concept.
1:42

bro casually explains RL tuning for LLMs and the three critical components: training, inference, and environments. basically any RLVR algorithm such as GRPO comes down to this super simple concept.

ℏεsam

102,303 просмотров • 4 месяцев назад

I don't know but all in all we now understand what and why all these happened .
6:44

I don't know but all in all we now understand what and why all these happened .

𝗩𝗶𝗴𝗶𝗹𝗮𝗻𝘁𝗲 𝗩𝗮𝗻𝗴𝘂𝗮𝗿𝗱

164,633 просмотров • 1 год назад

When I say Ødegaard lacks conviction in his actions, this is what I mean. Do you see the urgency, creativity, and spontaneity here? That’s what makes a big mover. Now compare that to Ødegaard it's a different level of intent and directness.
1:56

When I say Ødegaard lacks conviction in his actions, this is what I mean. Do you see the urgency, creativity, and spontaneity here? That’s what makes a big mover. Now compare that to Ødegaard it's a different level of intent and directness.

Arsenal X-tra

473,389 просмотров • 5 месяцев назад

Okay okay, spent my weekend gooning around learning GRPO math. Here's some takes. Essentially, this is me yapping through a recap of smaller details on how GRPO is implemented, what Dr. GRPO changes, why, DAPO, connections to PPO, aggregating batches... Reading list below.
22:22

Okay okay, spent my weekend gooning around learning GRPO math. Here's some takes. Essentially, this is me yapping through a recap of smaller details on how GRPO is implemented, what Dr. GRPO changes, why, DAPO, connections to PPO, aggregating batches... Reading list below.

Nathan Lambert

123,030 просмотров • 1 год назад

I love how these were never officially released by ariana and her team but still see them everywhere
2:41

I love how these were never officially released by ariana and her team but still see them everywhere

444

144,065 просмотров • 2 месяцев назад

To solve AGI, we must first solve Geoguessr For that I built vlm-gym, a simple RL gym written in scratch, in JAX for Qwen3VL-4B (released yesterday) And added Geospot, a RL environment for geolocation and learned VLMs can learn how to geoguess. More:
0:22

To solve AGI, we must first solve Geoguessr For that I built vlm-gym, a simple RL gym written in scratch, in JAX for Qwen3VL-4B (released yesterday) And added Geospot, a RL environment for geolocation and learned VLMs can learn how to geoguess. More:

Surya

140,283 просмотров • 7 месяцев назад

What did Peter Obi say that was different from what's coming from the mouth of these Pastors? We a know the truth and the simple message PO was trying to pass, but let's keep pretending and forming religious voltrons in a dying economy.
1:52

What did Peter Obi say that was different from what's coming from the mouth of these Pastors? We a know the truth and the simple message PO was trying to pass, but let's keep pretending and forming religious voltrons in a dying economy.

WiII 🏝️

341,412 просмотров • 1 год назад

They know they’re doing fraud but you will see them floating luxury cars and money online. When will these boys learn sense? Arrangement and Lanchester paaa 💔💔💔💔
0:32

They know they’re doing fraud but you will see them floating luxury cars and money online. When will these boys learn sense? Arrangement and Lanchester paaa 💔💔💔💔

Gh Durk 🇬🇭🌎

43,152 просмотров • 1 месяц назад

They’re calling it a “dragon”… but nobody can prove what it actually is. That hasn’t stopped it from spreading everywhere online. In Romania, a man claims to have found and excavated this large skull, which some are claiming is a dragon. What do you see, discovery or deception? 🐉
1:04

They’re calling it a “dragon”… but nobody can prove what it actually is. That hasn’t stopped it from spreading everywhere online. In Romania, a man claims to have found and excavated this large skull, which some are claiming is a dragon. What do you see, discovery or deception? 🐉

𝙲𝚘𝚗𝚜𝚎𝚛𝚟𝚊𝚝𝚒𝚟𝚎 👑 𝙳𝚒𝚟𝚊™

25,544 просмотров • 29 дней назад

They put these same lessons over and over everywhere under the cover of entertainment, but really it's a school. Run by who I really don't know.
4:39

They put these same lessons over and over everywhere under the cover of entertainment, but really it's a school. Run by who I really don't know.

Invisidon

53,765 просмотров • 1 год назад

I'm a curator of a museum of art. I think these watches tell a story in every case, and they're all different. You know, they're striking enough that you see something different in every dial, and that's exactly what I'm trying to achieve.
0:35

I'm a curator of a museum of art. I think these watches tell a story in every case, and they're all different. You know, they're striking enough that you see something different in every dial, and that's exactly what I'm trying to achieve.

Kevin O'Leary aka Mr. Wonderful

25,767 просмотров • 11 месяцев назад

Sungjae was mentioned in Han Chaeah's latest content HCA is trying to get these high school students to know her. They know YSJ and The Golden Spoon, but they don't believe HCA plays his mother there. Well her style as a poor mother is so different from her style irl😂
0:29

Sungjae was mentioned in Han Chaeah's latest content HCA is trying to get these high school students to know her. They know YSJ and The Golden Spoon, but they don't believe HCA plays his mother there. Well her style as a poor mother is so different from her style irl😂

fy🍀🎶

15,567 просмотров • 16 дней назад

But what they really want is a forever family ❤️ Meet these perfect dogs and see what makes each of them unforgettable! To learn more about these precious pups, check out Franklin County Dog Shelter & Adoption Center on Instagram:
1:33

But what they really want is a forever family ❤️ Meet these perfect dogs and see what makes each of them unforgettable! To learn more about these precious pups, check out Franklin County Dog Shelter & Adoption Center on Instagram:

The Dodo

46,927 просмотров • 5 месяцев назад

further reward crafting for hand-centric (tm) PPO model. Closing in on what I want. need to slow down max velocities and I want more stepping/stride + less tip toe on left foot ideally. almost cant believe this is actually just RL!
2:40

further reward crafting for hand-centric (tm) PPO model. Closing in on what I want. need to slow down max velocities and I want more stepping/stride + less tip toe on left foot ideally. almost cant believe this is actually just RL!

Harrison Kinsley

15,971 просмотров • 5 месяцев назад

I don't even know where we begin fixing society. Send them back and see what happens is a start I guess.
1:03

I don't even know where we begin fixing society. Send them back and see what happens is a start I guess.

Russian Garbage Human

101,604 просмотров • 2 месяцев назад

The co-founders of Flapping Airplanes call the current RL paradigm for model training "environment slop." They explain: "The reinforcement paradigms of today are shockingly inefficient. You don't really get much generalization across tasks, you teach a model through one kind of learning and then you teach it the next one. It's kind of like whack-a-mole. We look at this and think it's kind of crazy. The next paradigm of AI will not be environment slop." "Human level intelligence is not the ceiling, it is merely the floor on what is possible. If you can train models with vastly less data and possibly more compute in very different ways, what is going to happen? We actually don't know. But I do think they'll be different and weird and they'll have interesting capabilities that we'll find really valuable ways to use."
2:40

The co-founders of Flapping Airplanes call the current RL paradigm for model training "environment slop." They explain: "The reinforcement paradigms of today are shockingly inefficient. You don't really get much generalization across tasks, you teach a model through one kind of learning and then you teach it the next one. It's kind of like whack-a-mole. We look at this and think it's kind of crazy. The next paradigm of AI will not be environment slop." "Human level intelligence is not the ceiling, it is merely the floor on what is possible. If you can train models with vastly less data and possibly more compute in very different ways, what is going to happen? We actually don't know. But I do think they'll be different and weird and they'll have interesting capabilities that we'll find really valuable ways to use."

TBPN

85,358 просмотров • 4 месяцев назад

Vision-based(Colapli) RAG is becoming popular, so we built a platform to compare: - Simple OCR RAG - VisionRAG - Colpali - Hybrid Colpali 🚀 Introducing VARAG – the Vision-First RAG Engine (Vision Augmented Retrieval and Generation).
2:19

Vision-based(Colapli) RAG is becoming popular, so we built a platform to compare: - Simple OCR RAG - VisionRAG - Colpali - Hybrid Colpali 🚀 Introducing VARAG – the Vision-First RAG Engine (Vision Augmented Retrieval and Generation).

Adithya S K

95,370 просмотров • 1 год назад

Diddy : I don't know why these celebrities TAT certain things on them and they don't know what the true meaning of it is. thoughts 💭 ⁉️
2:26

Diddy : I don't know why these celebrities TAT certain things on them and they don't know what the true meaning of it is. thoughts 💭 ⁉️

BLACK FLAG 💨🏴🇺🇸

21,198 просмотров • 6 месяцев назад