Video wird geladen...

Video konnte nicht geladen werden

Beim Laden dieses Videos ist ein Problem aufgetreten. Dies könnte an einem vorübergehenden Netzwerkproblem liegen oder das Video ist möglicherweise nicht verfügbar.

Introducing RL Visualizer See PPO and GRPO mentioned everywhere but don't know what actually makes them different? Visualize and compare these algorithms in a simple online maze environment! 🚀

alphaXiv

41,033 subscribers

78,947 Aufrufe • vor 6 Monaten •via X (Twitter)

Bildung Wissenschaft & Technologie

Anya Rossi• Live Now

Private livecam show

0 Kommentare

Keine Kommentare verfügbar

Kommentare vom Original-Post werden hier angezeigt

Ähnliche Videos

Want to scale RL with your shiny new GPU? 🚀 In our ICML24 Oral we find that RL algorithms hit a barrier when data is scaled up. Our new algorithm, SAPG, proposes a simple fix. It scales to 25k envs and solves hard tasks where PPO makes no progress. 1/n

Want to scale RL with your shiny new GPU? 🚀 In our ICML24 Oral we find that RL algorithms hit a barrier when data is scaled up. Our new algorithm, SAPG, proposes a simple fix. It scales to 25k envs and solves hard tasks where PPO makes no progress. 1/n

Ananye Agarwal

64,403 Aufrufe • vor 1 Jahr

Let’s talk about our new orthodontic pacifiers and what makes them different! In this video I wanted to highlight all the features of our new design and what makes these unique~

Let’s talk about our new orthodontic pacifiers and what makes them different! In this video I wanted to highlight all the features of our new design and what makes these unique~

Lil Comforts

46,955 Aufrufe • vor 5 Monaten

bro casually explains RL tuning for LLMs and the three critical components: training, inference, and environments. basically any RLVR algorithm such as GRPO comes down to this super simple concept.

bro casually explains RL tuning for LLMs and the three critical components: training, inference, and environments. basically any RLVR algorithm such as GRPO comes down to this super simple concept.

ℏεsam

102,344 Aufrufe • vor 5 Monaten

I don't know but all in all we now understand what and why all these happened .

I don't know but all in all we now understand what and why all these happened .

𝗩𝗶𝗴𝗶𝗹𝗮𝗻𝘁𝗲 𝗩𝗮𝗻𝗴𝘂𝗮𝗿𝗱

164,822 Aufrufe • vor 1 Jahr

When I say Ødegaard lacks conviction in his actions, this is what I mean. Do you see the urgency, creativity, and spontaneity here? That’s what makes a big mover. Now compare that to Ødegaard it's a different level of intent and directness.

When I say Ødegaard lacks conviction in his actions, this is what I mean. Do you see the urgency, creativity, and spontaneity here? That’s what makes a big mover. Now compare that to Ødegaard it's a different level of intent and directness.

Arsenal X-tra

473,389 Aufrufe • vor 6 Monaten

I love how these were never officially released by ariana and her team but still see them everywhere

I love how these were never officially released by ariana and her team but still see them everywhere

444

144,065 Aufrufe • vor 3 Monaten

Okay okay, spent my weekend gooning around learning GRPO math. Here's some takes. Essentially, this is me yapping through a recap of smaller details on how GRPO is implemented, what Dr. GRPO changes, why, DAPO, connections to PPO, aggregating batches... Reading list below.

Okay okay, spent my weekend gooning around learning GRPO math. Here's some takes. Essentially, this is me yapping through a recap of smaller details on how GRPO is implemented, what Dr. GRPO changes, why, DAPO, connections to PPO, aggregating batches... Reading list below.

Nathan Lambert

123,052 Aufrufe • vor 1 Jahr

What did Peter Obi say that was different from what's coming from the mouth of these Pastors? We a know the truth and the simple message PO was trying to pass, but let's keep pretending and forming religious voltrons in a dying economy.

What did Peter Obi say that was different from what's coming from the mouth of these Pastors? We a know the truth and the simple message PO was trying to pass, but let's keep pretending and forming religious voltrons in a dying economy.

WiII 🏝️

341,412 Aufrufe • vor 1 Jahr

To solve AGI, we must first solve Geoguessr For that I built vlm-gym, a simple RL gym written in scratch, in JAX for Qwen3VL-4B (released yesterday) And added Geospot, a RL environment for geolocation and learned VLMs can learn how to geoguess. More:

To solve AGI, we must first solve Geoguessr For that I built vlm-gym, a simple RL gym written in scratch, in JAX for Qwen3VL-4B (released yesterday) And added Geospot, a RL environment for geolocation and learned VLMs can learn how to geoguess. More:

Surya

140,348 Aufrufe • vor 8 Monaten

They know they’re doing fraud but you will see them floating luxury cars and money online. When will these boys learn sense? Arrangement and Lanchester paaa 💔💔💔💔

They know they’re doing fraud but you will see them floating luxury cars and money online. When will these boys learn sense? Arrangement and Lanchester paaa 💔💔💔💔

Gh Durk 🇬🇭🌎

43,152 Aufrufe • vor 1 Monat

They’re calling it a “dragon”… but nobody can prove what it actually is. That hasn’t stopped it from spreading everywhere online. In Romania, a man claims to have found and excavated this large skull, which some are claiming is a dragon. What do you see, discovery or deception? 🐉

They’re calling it a “dragon”… but nobody can prove what it actually is. That hasn’t stopped it from spreading everywhere online. In Romania, a man claims to have found and excavated this large skull, which some are claiming is a dragon. What do you see, discovery or deception? 🐉

𝙲𝚘𝚗𝚜𝚎𝚛𝚟𝚊𝚝𝚒𝚟𝚎 👑 𝙳𝚒𝚟𝚊™

25,683 Aufrufe • vor 1 Monat

They put these same lessons over and over everywhere under the cover of entertainment, but really it's a school. Run by who I really don't know.

They put these same lessons over and over everywhere under the cover of entertainment, but really it's a school. Run by who I really don't know.

Invisidon

54,063 Aufrufe • vor 1 Jahr

I'm a curator of a museum of art. I think these watches tell a story in every case, and they're all different. You know, they're striking enough that you see something different in every dial, and that's exactly what I'm trying to achieve.

I'm a curator of a museum of art. I think these watches tell a story in every case, and they're all different. You know, they're striking enough that you see something different in every dial, and that's exactly what I'm trying to achieve.

Kevin O'Leary aka Mr. Wonderful

25,767 Aufrufe • vor 1 Jahr

Sungjae was mentioned in Han Chaeah's latest content HCA is trying to get these high school students to know her. They know YSJ and The Golden Spoon, but they don't believe HCA plays his mother there. Well her style as a poor mother is so different from her style irl😂

Sungjae was mentioned in Han Chaeah's latest content HCA is trying to get these high school students to know her. They know YSJ and The Golden Spoon, but they don't believe HCA plays his mother there. Well her style as a poor mother is so different from her style irl😂

fy🍀🎶

15,774 Aufrufe • vor 1 Monat

But what they really want is a forever family ❤️ Meet these perfect dogs and see what makes each of them unforgettable! To learn more about these precious pups, check out Franklin County Dog Shelter & Adoption Center on Instagram:

But what they really want is a forever family ❤️ Meet these perfect dogs and see what makes each of them unforgettable! To learn more about these precious pups, check out Franklin County Dog Shelter & Adoption Center on Instagram:

The Dodo

46,936 Aufrufe • vor 6 Monaten

further reward crafting for hand-centric (tm) PPO model. Closing in on what I want. need to slow down max velocities and I want more stepping/stride + less tip toe on left foot ideally. almost cant believe this is actually just RL!

further reward crafting for hand-centric (tm) PPO model. Closing in on what I want. need to slow down max velocities and I want more stepping/stride + less tip toe on left foot ideally. almost cant believe this is actually just RL!

Harrison Kinsley

15,973 Aufrufe • vor 6 Monaten

I don't even know where we begin fixing society. Send them back and see what happens is a start I guess.

I don't even know where we begin fixing society. Send them back and see what happens is a start I guess.

Russian Garbage Human

101,650 Aufrufe • vor 2 Monaten

The co-founders of Flapping Airplanes call the current RL paradigm for model training "environment slop." They explain: "The reinforcement paradigms of today are shockingly inefficient. You don't really get much generalization across tasks, you teach a model through one kind of learning and then you teach it the next one. It's kind of like whack-a-mole. We look at this and think it's kind of crazy. The next paradigm of AI will not be environment slop." "Human level intelligence is not the ceiling, it is merely the floor on what is possible. If you can train models with vastly less data and possibly more compute in very different ways, what is going to happen? We actually don't know. But I do think they'll be different and weird and they'll have interesting capabilities that we'll find really valuable ways to use."

The co-founders of Flapping Airplanes call the current RL paradigm for model training "environment slop." They explain: "The reinforcement paradigms of today are shockingly inefficient. You don't really get much generalization across tasks, you teach a model through one kind of learning and then you teach it the next one. It's kind of like whack-a-mole. We look at this and think it's kind of crazy. The next paradigm of AI will not be environment slop." "Human level intelligence is not the ceiling, it is merely the floor on what is possible. If you can train models with vastly less data and possibly more compute in very different ways, what is going to happen? We actually don't know. But I do think they'll be different and weird and they'll have interesting capabilities that we'll find really valuable ways to use."

TBPN

85,358 Aufrufe • vor 4 Monaten

Diddy : I don't know why these celebrities TAT certain things on them and they don't know what the true meaning of it is. thoughts 💭 ⁉️

Diddy : I don't know why these celebrities TAT certain things on them and they don't know what the true meaning of it is. thoughts 💭 ⁉️

BLACK FLAG 💨🏴🇺🇸

21,198 Aufrufe • vor 6 Monaten

Vision-based(Colapli) RAG is becoming popular, so we built a platform to compare: - Simple OCR RAG - VisionRAG - Colpali - Hybrid Colpali 🚀 Introducing VARAG – the Vision-First RAG Engine (Vision Augmented Retrieval and Generation).

Vision-based(Colapli) RAG is becoming popular, so we built a platform to compare: - Simple OCR RAG - VisionRAG - Colpali - Hybrid Colpali 🚀 Introducing VARAG – the Vision-First RAG Engine (Vision Augmented Retrieval and Generation).

Adithya S K

95,370 Aufrufe • vor 1 Jahr