Загрузка видео...

Не удалось загрузить видео

На главную

I re-recorded the post-training part of our NeurIPS tutorial on language models, added some more slides, and wrote up a mini state of the union on Interconnects. Enjoy! Links in QT. 00:00 Introduction 10:00 Prompts & Skill Selection 14:19 Instruction Finetuning 21:45 Preference Finetuning 36:17 Reinforcement Finetuning 45:28 Open...

49,310 просмотров • 1 год назад •via X (Twitter)

Комментарии: 11

Фото профиля Nathan Lambert
Nathan Lambert1 год назад

Second, I think YouTube is an important distribution mechanism for AI research and education. Lmk if there's something I should do more of.

Фото профиля Nathan Lambert
Nathan Lambert1 год назад

Also continuing to plug away at rlhf book but waiting to announce until v1

Фото профиля Power Homeschool
Power Homeschool1 год назад

Start your child's independent homeschooling journey with our flexible, self-paced platform. We offer a full PreK-12 curriculum with electives & hundreds of engaging video-based lessons taught by experienced educators! Enroll now! ✅ No Contracts. Cancel Anytime.

Фото профиля Cameron R. Wolfe, Ph.D.
Cameron R. Wolfe, Ph.D.1 год назад

@interconnectsai Best talk at NeurIPS this year IMO. Everyone should watch.

Фото профиля Zion
Zion1 год назад

@interconnectsai Thanks for the Knowledge Nathan

Фото профиля Michael Craig
Michael Craig1 год назад

@interconnectsai Thanks for sharing @natolambert. Saw the series of talks at NeurIPS this year as well, very informative.

Фото профиля Zayn Al-Mahdi
Zayn Al-Mahdi1 год назад

@interconnectsai Excellent re-record, Nathan! Your insights on instruction and reinforcement fine-tuning are spot on. Curious about their real-world applications. Diving into the blog now.

Фото профиля altyni (ethmag.eth) 🪄
altyni (ethmag.eth) 🪄1 год назад

@interconnectsai What are your thoughts on post-training for JSON outputs and function calling?

Фото профиля Atma
Atma1 год назад

@interconnectsai Nice talk, would you mind sharing the slides?

Фото профиля Matthew Lam
Matthew Lam1 год назад

@interconnectsai Thanks for the knowledge

Фото профиля Ashvini Jindal
Ashvini Jindal1 год назад

@interconnectsai Thanks for sharing!

Похожие видео

"If NASA and United States can not beat the Chinese back to the moon, then the moon belongs to the Chinese, and we get what we deserve." You don't want to miss this interview. I met Casey Handmer (Casey Handmer) while flying fighter jets in Montana. I Immediately I knew he had a story to tell. Turns out he wants to tile the United States in solar panels, and use that power to generate rocket fuel and clean water for tens of millions of people. Basically to re-invent American industry. In this interview Casey discusses the innovative pursuits of his company Terraform Industries. He reflects on his previous roles at NASA and JPL, where he was frustrated with the inefficiencies and lack of innovation in traditional institutions. Handmer discusses the importance of ambition, self-awareness, curiosity, and practical experience in hiring and developing talent at Terraform. To fully understand the scope of Casey’s ambitions, you should visit his blog where he discusses things like Mars helicopters and desalination to support a new mega city in California. 00:00:00 - 00:00:17 Geopolitical Stakes: US vs. China in Space Race 00:00:17 - 00:01:17 Interview Introduction: Casey's Background and Topics 00:01:17 - 00:03:10 Podcast Setup and Welcome to Terraform Industries 00:03:10 - 00:04:40 Building History and Manufacturing Interest 00:04:40 - 00:07:17 Meeting at Hangar Event and Aircraft Engineering 00:07:17 - 00:20:45 Early Life: Hands-On Building and Career Path 00:20:45 - 00:40:00 Founding Terraform: Synthetic Fuels Vision and Prototypes 00:40:00 - 01:00:00 Technology Deep Dive: Solar to Hydrocarbons and Scaling 01:00:00 - 01:20:00 Energy Geopolitics and US Reindustrialization 01:20:00 - 01:40:00 Team Building, Hiring Philosophy, and Company Culture 01:40:00 - 02:00:00 Hardware vs. Software Challenges and Entrepreneur Advice 02:00:00 - 02:22:24 Future Visions: Desalination and New Cities 02:22:24 - 02:36:39 Closing Call to Action and Thanks

Penny2x

1,598,196 просмотров • 8 месяцев назад

We don't know what most microbial genes do. Can genomic language models help? there's only one way to find out! this is a 1 hour and 42 minute interview with an MIT professor (the famous Yunha Hwang) chatting about these questions, her work in solving them at Tatta Bio, and more. zoomer captions are back too Links in reply! Timestamps: 00:00:00 - Clips + sponsor roll from the wonderful LatchBio 00:02:07 – Introduction 00:02:23 – Why do microbial genomes matter 00:04:07 – Deep learning acceptance in metagenomics 00:05:25 – The case for genomic “context” over sequence matching 00:06:43 – OMG: the only ML-ready metagenomic dataset 00:09:27 – gLM2: A multimodal genomic language model 00:11:06 – What do you do with the output of genomic language models? 00:17:41 – How will OMG evolve? 00:20:26 – Why train on only microbial genomes, as opposed to all genomes? 00:22:58 – Do we need more sequences or more annotations? 00:23:54 – Is there a conserved microbial genome ‘language’? 00:28:11 – What non-obvious things can this genomic language model tell you? 00:33:08 – Semantic deduplication and evaluation 00:37:33 – How does benchmarking work for these types of models? 00:41:31 – Gaia: A genomic search engine 00:44:18 – Even ‘well-studied’ genomes are mostly unannotated 00:50:51 – Using agents on Gaia 00:54:53 – Will genomic language models reshape the tree of life? 00:59:18 – Current limitations of genomic language models 01:08:54 – Directed evolution as training data 01:12:35 – What is Tatta Bio? 01:19:02 – Building Google for genomic sequences (SeqHub) 01:25:46 – How to create communities around scientific OSS 01:29:06 – What’s the purpose in the centralization of the software? 01:35:37 – How will the way science is done change in 10 years?

owl

44,279 просмотров • 6 месяцев назад