New work: The Value Axis 🎯
Nick Jiang
Visit on X@nickhjiang1.2K followers
30,285 views
New work: The Value Axis 🎯
How do LLMs choose which path to take mid-task? We find they internally track the chance of reaching their goal along a linear axis, akin to a value function in RL. We show it modulates confidence in math & coding and can be reshaped with DPO and SFT.
Comments
Comments from the original post on X (Twitter)
No comments yet
