Aviral Kumar's banner
Aviral Kumar's profile picture

Aviral Kumar

@aviral_kumar2 • 5,816 subscribers

Assistant Professor of CS & ML at @CarnegieMellon. PhD from UC Berkeley.

Shorts

🚨Current scalable RL algos train a policy w/o value func, which is limiting with learning in open-ended, non-stationary, dynamic environments. But, how to scale value-based RL with more data/compute is unclear... Not anymore: presenting scaling laws for value-based RL 🧵⬇️

🚨Current scalable RL algos train a policy w/o value func, which is limiting with learning in open-ended, non-stationary, dynamic environments. But, how to scale value-based RL with more data/compute is unclear... Not anymore: presenting scaling laws for value-based RL 🧵⬇️

37,266 görüntüleme

Videos

LIVE
1.2k

Anya Rossi

sweetdream.ai

SweetDream.aiSponsored•Livecam
Streaming Now

Watch Anya Live

Anya is streaming live right now! Join her private show and enjoy exclusive content.

HD live stream
Exclusive private shows
1.2k viewers online

Free preview available • Premium content

🚨🚨New paper: if you want robots to do bimanual long-horizon tasks well, try RaC: a human in-the-loop data collection protocol that naturally amplifies Recovery & Correction behaviors + trains on them. 📈 data efficiency 10x vs prior results (+many nice properties). 🧵⬇️
0:50
aviral_kumar2's profile picture

🚨🚨New paper: if you want robots to do bimanual long-horizon tasks well, try RaC: a human in-the-loop data collection protocol that naturally amplifies Recovery & Correction behaviors + trains on them. 📈 data efficiency 10x vs prior results (+many nice properties). 🧵⬇️

Aviral Kumar

25,771 görüntüleme • 8 ay önce

Daha fazla içerik yok.