Video yükleniyor...

Video Yüklenemedi

Ana Sayfaya Dön

Introducing DoctorGPT! After applying fine-tuning, reinforcement learning, & compilation techniques to Meta's Llama2 model, I got amazing results: - Passes the US Medical Licensing Exam - Offline - iOS & Android - Open Source Code: Full video tutorial:

450,230 görüntüleme • 2 yıl önce •via X (Twitter)

9 Yorum

Rowan Cheung profil fotoğrafı
Rowan Cheung2 yıl önce

Great work

Dwayne profil fotoğrafı
Dwayne2 yıl önce

Finally, I can achieve my dreams of becoming a doctor and charging $300 for a band aid.

biccs👨🏽‍💻{3.LAND} profil fotoğrafı
biccs👨🏽‍💻{3.LAND}2 yıl önce

Me: my head hurts DoctorGPT: you have cancer 💀

Abhinav Das profil fotoğrafı
Abhinav Das2 yıl önce

A Doctor in my pocket!

Manish Patel profil fotoğrafı
Manish Patel2 yıl önce

Can't wait for @DrHughHarvey to see this 😬😱

Linus Ekenstam – eu/acc profil fotoğrafı
Linus Ekenstam – eu/acc2 yıl önce

This is amazing work Siraj!!!

Lachlan Phillips exo/acc 👾 profil fotoğrafı
Lachlan Phillips exo/acc 👾2 yıl önce

.@elonmusk @lindayaX @X The features that make YouTube the best are: 1. Full screen button makes the video horizontal mode. 2. Video plays as audio in the background so you can do other things and listen. Please implement these! Xx

Izzy Brooks profil fotoğrafı
Izzy Brooks2 yıl önce

@wagieeacc 👀

AJ Keller profil fotoğrafı
AJ Keller2 yıl önce

Giving me so many thoughts!

Benzer Videolar

New Course: Reinforcement Fine-Tuning LLMs with GRPO! Learn to use reinforcement learning to improve your LLM performance in this short course, built in collaboration with Predibase by Rubrik, and taught by Travis Addair, its Co-Founder and CTO, and Arnav Garg, its Senior Engineer and Machine Learning Lead. Reasoning models have been one of the most important developments in LLMs. Reinforcement Fine-Tuning (RFT) uses rewards to encourage LLMs to find solutions to multi-step reasoning tasks such as solving math problems and debugging code - without needing pre-existing training examples like in traditional supervised fine-tuning. Group Relative Policy Optimization (GRPO) is a reinforcement fine-tuning algorithm gaining rapid adoption. Developed by the DeepSeek team and used to train the R1 reasoning model, GRPO uses reward functions that you can write in Python to assign rewards to model responses. It’s beneficial for tasks with verifiable outcomes and can work well even with fewer than 100 training examples. It can also significantly improve the reasoning ability of smaller LLMs, making applications faster and more cost effective. In this course, you’ll take a technical deep dive into RFT with GRPO. You’ll learn to build reward functions that you can use in the GRPO training process to guide an LLM toward better performance on multi-step reasoning tasks. In detail, you’ll: - Learn when reinforcement fine-tuning is a better fit than supervised fine-tuning, especially for tasks involving multi-step reasoning or limited labeled data. - Understand how GRPO uses programmable reward functions as a more scalable alternative to the human feedback required for other reinforcement learning algorithms, such as RLHF and DPO. - Frame the Wordle game as a reinforcement fine-tuning problem and see how an LLM can learn to plan, analyze feedback, and improve its strategy over time. - Design reward functions that power the reinforcement fine-tuning process. - Learn techniques for evaluating more subjective tasks, such as rating the quality of a text summary, using an LLM as a judge. - Understand why reward hacking happens and how to avoid it by adding penalty functions to discourage undesirable behaviors. - Learn the four key components of the loss calculation in the GRPO algorithm: token probability distribution ratios, advantages, clipping, and KL-divergence. - Launch reinforcement fine-tuning jobs using Predibase’s hosted training services. By the end of this course, you’ll be able to build and fine-tune LLMs using reinforcement learning to improve reasoning without relying on large labeled datasets or subjective human feedback. Please sign up here:

Andrew Ng

86,381 görüntüleme • 1 yıl önce