Loading video...

Video Failed to Load

Go Home

New work: The Value Axis 🎯 How do LLMs choose which path to take mid-task? We find they internally track the chance of reaching their goal along a linear axis, akin to a value function in RL. We show it modulates confidence in math & coding and can be...

28,365 views • 2 months ago •via X (Twitter)

0 Comments

No comments available

Comments from the original post will appear here

Related Videos

AI has had exactly two scaling axes that worked so far, and the second one is starting to look finite too the first one was pretraining: with scaling parameters and data, we got world knowledge (i.e. ChatGPT had read enough to know things), but it started saturating a while ago the second one was RL, and people had been doing RL the whole time before that: RLHF is RL but it never scaled far because it was trying to control the exact output, which tokens come out, how the text reads, but you can only push that so far before you’re just polishing RLVR dropped that constraint: giving the model a task, then checking whether the final answer is right, and ignoring everything in between -- so the model does whatever it wants in the middle and only the endpoint gets graded, and that’s much closer to actual RL and it’s what bought us planning and reasoning (arguably, tool use sits around 2.5 on this list -- while useful, it's not a different kind of thing) so one axis gave knowledge, the other gave reasoning, and both of them are one model working alone the next axis is how many models you can get working on the same problem, which is a different kind of axis than the previous two we know that multi-agent RL has always been the harder problem: I spent years in that literature and the gap between single-agent and multi-agent is definitely not incremental -- it’s a whole different class of difficulty! which is also why the derivatives are steep at the start, nobody has picked the easy wins yet... and the thing that gates this multi-agent coordination is communication: models can only coordinate as well as they can exchange information, and right now they do that by writing sentences to each other imagine what could we possibly achieve if we properly open that third axis development by letting models to exchange information in their native "language" without loosing any computational data that they produce during inference

Sasha Malysheva

11,393 views • 11 days ago

Dear Pioneers 🌏 We are living in a decisive moment! Pi Network has the potential to become a true revolution in the global financial landscape, but for that to happen, we must act wisely and united. We are millions of Pioneers around the world, driven by the same purpose: to create a decentralized, accessible, and fair financial system for all. The real value of Pi is not determined by the traditional market but by our confidence and engagement. The GCV of $314,159 represents much more than just a number – it symbolizes our conviction about Pi's potential. Our Strength Lies in the Community For Pi to reach its true value, we need to act strategically and with commitment. No great project can sustain itself without the support of its participants. If we want to see Pi shine, we must: ✅ Avoid having our Pi traded on exchanges prematurely, creating scarcity and strengthening its value ✅ Not accept selling it for prices lower than it truly deserves ✅ Acquire and withdraw Pi from exchanges, consolidating its strength in the market ✅ Use it in real transactions, promoting its growth as a global digital currency ✅ Spread awareness and encourage its daily use, expanding its acceptance Each Pioneer plays a crucial role in this process. The more we use and value Pi within the ecosystem, the more it will establish itself as an asset of great global impact. The Future Is in Our Hands We can allow speculators to dictate the value of Pi, or we can take control of our own destiny and ensure that it reaches its true potential. The decision is ours! If we act together, with strategy and determination, nothing can stop us from making Pi Network a milestone in cryptocurrency history. The time is now, and each of us is a fundamental part of this revolution. Let's strengthen Pi together and make the GCV of $314,159 an undeniable reality! Sérgio Cruz, Portugal GCV Ambassador 🇵🇹

Doris Yin 东方紫莲🪷

25,065 views • 1 year ago