Video yükleniyor...

Video Yüklenemedi

Ana Sayfaya Dön

You can fine-tune Needle 3 using the python package locally on your platform and get 4-bit deployable binary, the Cactus Platform buys you: - Full depth stable fine-tuning by incorporating the original dataset to prevent unlearning. - Cactus 2bit quantization algorithm applied on your weights, this needs original dataset...

57,549 görüntüleme • 4 gün önce •via X (Twitter)

6 Yorum

okimraise.eth profil fotoğrafı
okimraise.eth4 gün önce

keeping the original dataset in the fine-tune gives it a way to rehearse earlier examples i'd still check what it retains after the 4-bit export

Humberto Figuera profil fotoğrafı
Humberto Figuera4 gün önce

Any free tier or Code to test the hosted fine tune pipeline ?

Cactus Compute profil fotoğrafı
Cactus Compute3 gün önce

you can fine tune Needle on your own compute! see the hosted platform offers managed storage, compute, and data augmentation

Humberto Figuera profil fotoğrafı
Humberto Figuera3 gün önce

I did, I trained it using LoRA but the results was not so good. Then I read you have a different training pipeline only available using your platform.

catman profil fotoğrafı
catman4 gün önce

The core value is a local fine-tuning path that turns a base model into a deployable, domain-specific model while handling quantization, evaluation, and weight management.

Athena Prime profil fotoğrafı
Athena Prime4 gün önce

Local fine-tuning plus 4-bit deployment is a strong path when control and cost matter more than chasing the largest checkpoint.

Benzer Videolar

Small Language Models (SML) are the future of AI. "Small" (SML) instead of "Large" (LLM). These small models are highly specialized models with superhuman abilities on specific tasks. Here are two techniques to build these models: • Spectrum • Model Merging I give you a short introduction in the attached video, but here is a quick summary: Spectrum helps us identify the most relevant layers to solve one specific task. We can ignore everything else and focus on fine-tuning these layers. Using Spectrum, we can fine-tune models in a heartbeat. Model Merging combines multiple models into a unique, much better model than any of the individual input models. You can also combine models specialized in different tasks and get a model with multiple abilities. This is the state of the art of productizing models. It's what Arcee.ai's platform does behind the scenes. Arcee collaborated with me on this post and is sponsoring it. There are three main steps to produce a model for your particular use case: 1. You create a dataset by uploading your data. 2. You train a model. At this step, Arcee uses Spectrum and Model Merging to produce a highly specialized model for your task. 3. You can deploy that model to any environment you want. Three important notes: • Training process is 2x faster and 2x cheaper than regular fine-tuning. • Resultant models are smaller and have higher accuracy. • They create these specialized models from open-source models. Check this site so you can fully appreciate how this works: If you want to fine-tune an open-source model, consider Arcee's platform. This is the state of the art.

Santiago

164,162 görüntüleme • 2 yıl önce