正在加载视频...

视频加载失败

I re-recorded the post-training part of our NeurIPS tutorial on language models, added some more slides, and wrote up a mini state of the union on Interconnects AI. Enjoy! Links in QT. 00:00 Introduction 10:00 Prompts & Skill Selection 14:19 Instruction Finetuning 21:45 Preference Finetuning 36:17 Reinforcement Finetuning 45:28...

49,435 次观看 • 1 年前 •via X (Twitter)

11 条评论

Nathan Lambert 的头像
Nathan Lambert1 年前

Second, I think YouTube is an important distribution mechanism for AI research and education. Lmk if there's something I should do more of.

Nathan Lambert 的头像
Nathan Lambert1 年前

Also continuing to plug away at rlhf book but waiting to announce until v1

Power Homeschool 的头像
Power Homeschool2 年前

Start your child's independent homeschooling journey with our flexible, self-paced platform. We offer a full PreK-12 curriculum with electives & hundreds of engaging video-based lessons taught by experienced educators! Enroll now! ✅ No Contracts. Cancel Anytime.

Cameron R. Wolfe, Ph.D. 的头像
Cameron R. Wolfe, Ph.D.1 年前

@interconnectsai Best talk at NeurIPS this year IMO. Everyone should watch.

Zion 的头像
Zion1 年前

@interconnectsai Thanks for the Knowledge Nathan

Michael Craig 的头像
Michael Craig1 年前

@interconnectsai Thanks for sharing @natolambert. Saw the series of talks at NeurIPS this year as well, very informative.

Zayn Al-Mahdi 的头像
Zayn Al-Mahdi1 年前

@interconnectsai Excellent re-record, Nathan! Your insights on instruction and reinforcement fine-tuning are spot on. Curious about their real-world applications. Diving into the blog now.

altyni (ethmag.eth) 🪄 的头像
altyni (ethmag.eth) 🪄1 年前

@interconnectsai What are your thoughts on post-training for JSON outputs and function calling?

Atma 的头像
Atma1 年前

@interconnectsai Nice talk, would you mind sharing the slides?

Matthew Lam 的头像
Matthew Lam1 年前

@interconnectsai Thanks for the knowledge

Ashvini Jindal 的头像
Ashvini Jindal1 年前

@interconnectsai Thanks for sharing!

相关视频

"If NASA and United States can not beat the Chinese back to the moon, then the moon belongs to the Chinese, and we get what we deserve." You don't want to miss this interview. I met Casey Handmer (Casey Handmer) while flying fighter jets in Montana. I Immediately I knew he had a story to tell. Turns out he wants to tile the United States in solar panels, and use that power to generate rocket fuel and clean water for tens of millions of people. Basically to re-invent American industry. In this interview Casey discusses the innovative pursuits of his company Terraform Industries. He reflects on his previous roles at NASA and JPL, where he was frustrated with the inefficiencies and lack of innovation in traditional institutions. Handmer discusses the importance of ambition, self-awareness, curiosity, and practical experience in hiring and developing talent at Terraform. To fully understand the scope of Casey’s ambitions, you should visit his blog where he discusses things like Mars helicopters and desalination to support a new mega city in California. 00:00:00 - 00:00:17 Geopolitical Stakes: US vs. China in Space Race 00:00:17 - 00:01:17 Interview Introduction: Casey's Background and Topics 00:01:17 - 00:03:10 Podcast Setup and Welcome to Terraform Industries 00:03:10 - 00:04:40 Building History and Manufacturing Interest 00:04:40 - 00:07:17 Meeting at Hangar Event and Aircraft Engineering 00:07:17 - 00:20:45 Early Life: Hands-On Building and Career Path 00:20:45 - 00:40:00 Founding Terraform: Synthetic Fuels Vision and Prototypes 00:40:00 - 01:00:00 Technology Deep Dive: Solar to Hydrocarbons and Scaling 01:00:00 - 01:20:00 Energy Geopolitics and US Reindustrialization 01:20:00 - 01:40:00 Team Building, Hiring Philosophy, and Company Culture 01:40:00 - 02:00:00 Hardware vs. Software Challenges and Entrepreneur Advice 02:00:00 - 02:22:24 Future Visions: Desalination and New Cities 02:22:24 - 02:36:39 Closing Call to Action and Thanks

Penny2x

1,598,196 次观看 • 1 年前