Загрузка видео...

Не удалось загрузить видео

На главную

Introducing `claude-llm-trainer` ✍️ The world's simplest way to train a task-specific LLM. Just write a sentence describing the model you want. A chain of AI systems will generate a dataset and train a model for you. And it's open-source.

383,194 просмотров • 2 лет назад •via X (Twitter)

Комментарии: 9

Фото профиля Matt Shumer
Matt Shumer2 лет назад

How it works: - The user describes the model they want Ex: "A model that writes Python functions" - claude-llm-trainer leverages a chain of Claude 3 calls to create a great dataset for your task. - We process the dataset, and train a LLaMA model!

Фото профиля Matt Shumer
Matt Shumer2 лет назад

This was based off of an older project I did, so the model we train is LLaMA 2 7B. If you want, you can easily use a newer + better model like Mistral 7B.

Фото профиля Matt Shumer
Matt Shumer2 лет назад

You can go from an idea to a fully trained model in a matter of minutes. And the resulting models are really capable!

Фото профиля Matt Shumer
Matt Shumer2 лет назад

If you'd like to try it or contribute, check out the Github repo:

Фото профиля Matt Shumer
Matt Shumer2 лет назад

Incredible haha

Фото профиля mAI
mAI2 лет назад

Man, do you ever sleep?

Фото профиля Matt Shumer
Matt Shumer2 лет назад

Haha yeah, been getting this question a lot lately though lol

Фото профиля AI Adventurer
AI Adventurer2 лет назад

Well, that sir is excellent stuff!

Фото профиля al𝕏
al𝕏2 лет назад

LLM recursion 😂 that's awesome

Похожие видео

Small Language Models (SML) are the future of AI. "Small" (SML) instead of "Large" (LLM). These small models are highly specialized models with superhuman abilities on specific tasks. Here are two techniques to build these models: • Spectrum • Model Merging I give you a short introduction in the attached video, but here is a quick summary: Spectrum helps us identify the most relevant layers to solve one specific task. We can ignore everything else and focus on fine-tuning these layers. Using Spectrum, we can fine-tune models in a heartbeat. Model Merging combines multiple models into a unique, much better model than any of the individual input models. You can also combine models specialized in different tasks and get a model with multiple abilities. This is the state of the art of productizing models. It's what Arcee.ai's platform does behind the scenes. Arcee collaborated with me on this post and is sponsoring it. There are three main steps to produce a model for your particular use case: 1. You create a dataset by uploading your data. 2. You train a model. At this step, Arcee uses Spectrum and Model Merging to produce a highly specialized model for your task. 3. You can deploy that model to any environment you want. Three important notes: • Training process is 2x faster and 2x cheaper than regular fine-tuning. • Resultant models are smaller and have higher accuracy. • They create these specialized models from open-source models. Check this site so you can fully appreciate how this works: If you want to fine-tune an open-source model, consider Arcee's platform. This is the state of the art.

Santiago

164,162 просмотров • 2 лет назад