You can fine-tune Needle 3 using the python package locally on your platform and get 4-bit…
@cactuscompute4K followers
58,077 views
6 Comments
Comments from the original post on X (Twitter)

@ok1mraise
keeping the original dataset in the fine-tune gives it a way to rehearse earlier examples i'd still check what it retains after the 4-bit export

@hfiguera
Any free tier or Code to test the hosted fine tune pipeline ?

@cactuscompute
you can fine tune Needle on your own compute! see the hosted platform offers managed storage, compute, and data augmentation

@hfiguera
I did, I trained it using LoRA but the results was not so good. Then I read you have a different training pipeline only available using your platform.

@catmanyau
The core value is a local fine-tuning path that turns a base model into a deployable, domain-specific model while handling quantization, evaluation, and weight management.

@AthenaPrime
Local fine-tuning plus 4-bit deployment is a strong path when control and cost matter more than chasing the largest checkpoint.