Loading video...
Video Failed to Load
RL is painfully slow 😭 — bottlenecked by super-long CoT rollout. 🔭 Sparse attention should help, but naive sparse rollout hits a brutal efficiency–stability tradeoff: A tedious trial-and-error sparsity sweep for each dense policy is required before an actual RL run. 🐤Sparrow chirps no more pain! Introduce Sparrow: Sparse... show more
78,717 views • 2 months ago •via X (Twitter)
0 Comments
No comments available
Comments from the original post will appear here
