Video wird geladen...

Video konnte nicht geladen werden

Zur Startseite

Introducing DoctorGPT! After applying fine-tuning, reinforcement learning, & compilation techniques to Meta's Llama2 model, I got amazing results: - Passes the US Medical Licensing Exam - Offline - iOS & Android - Open Source Code: Full video tutorial:

450,245 Aufrufe • vor 2 Jahren •via X (Twitter)

9 Kommentare

Profilbild von Rowan Cheung
Rowan Cheungvor 2 Jahren

Great work

Profilbild von Dwayne
Dwaynevor 2 Jahren

Finally, I can achieve my dreams of becoming a doctor and charging $300 for a band aid.

Profilbild von biccs👨🏽‍💻{3.LAND}
biccs👨🏽‍💻{3.LAND}vor 2 Jahren

Me: my head hurts DoctorGPT: you have cancer 💀

Profilbild von Abhinav Das
Abhinav Dasvor 2 Jahren

A Doctor in my pocket!

Profilbild von Manish Patel
Manish Patelvor 2 Jahren

Can't wait for @DrHughHarvey to see this 😬😱

Profilbild von Linus Ekenstam – eu/acc
Linus Ekenstam – eu/accvor 2 Jahren

This is amazing work Siraj!!!

Profilbild von Lachlan Phillips exo/acc 👾
Lachlan Phillips exo/acc 👾vor 2 Jahren

.@elonmusk @lindayaX @X The features that make YouTube the best are: 1. Full screen button makes the video horizontal mode. 2. Video plays as audio in the background so you can do other things and listen. Please implement these! Xx

Profilbild von Izzy Brooks
Izzy Brooksvor 2 Jahren

@wagieeacc 👀

Profilbild von AJ Keller
AJ Kellervor 2 Jahren

Giving me so many thoughts!

Ähnliche Videos

New Course: Reinforcement Fine-Tuning LLMs with GRPO! Learn to use reinforcement learning to improve your LLM performance in this short course, built in collaboration with Predibase by Rubrik, and taught by Travis Addair, its Co-Founder and CTO, and Arnav Garg, its Senior Engineer and Machine Learning Lead. Reasoning models have been one of the most important developments in LLMs. Reinforcement Fine-Tuning (RFT) uses rewards to encourage LLMs to find solutions to multi-step reasoning tasks such as solving math problems and debugging code - without needing pre-existing training examples like in traditional supervised fine-tuning. Group Relative Policy Optimization (GRPO) is a reinforcement fine-tuning algorithm gaining rapid adoption. Developed by the DeepSeek team and used to train the R1 reasoning model, GRPO uses reward functions that you can write in Python to assign rewards to model responses. It’s beneficial for tasks with verifiable outcomes and can work well even with fewer than 100 training examples. It can also significantly improve the reasoning ability of smaller LLMs, making applications faster and more cost effective. In this course, you’ll take a technical deep dive into RFT with GRPO. You’ll learn to build reward functions that you can use in the GRPO training process to guide an LLM toward better performance on multi-step reasoning tasks. In detail, you’ll: - Learn when reinforcement fine-tuning is a better fit than supervised fine-tuning, especially for tasks involving multi-step reasoning or limited labeled data. - Understand how GRPO uses programmable reward functions as a more scalable alternative to the human feedback required for other reinforcement learning algorithms, such as RLHF and DPO. - Frame the Wordle game as a reinforcement fine-tuning problem and see how an LLM can learn to plan, analyze feedback, and improve its strategy over time. - Design reward functions that power the reinforcement fine-tuning process. - Learn techniques for evaluating more subjective tasks, such as rating the quality of a text summary, using an LLM as a judge. - Understand why reward hacking happens and how to avoid it by adding penalty functions to discourage undesirable behaviors. - Learn the four key components of the loss calculation in the GRPO algorithm: token probability distribution ratios, advantages, clipping, and KL-divergence. - Launch reinforcement fine-tuning jobs using Predibase’s hosted training services. By the end of this course, you’ll be able to build and fine-tune LLMs using reinforcement learning to improve reasoning without relying on large labeled datasets or subjective human feedback. Please sign up here:

Andrew Ng

86,457 Aufrufe • vor 1 Jahr