Do you take contracts for fine tuning and quantization?
#1
by
rafa9
- opened
Hi, @LoneStriker can we hire you for fine tuning and quantization related tasks?
If you want a model quantized and it's supported by exl2 (and can fit on my personal boxes), just link the model and I can look if it's feasible. If you need real engineering support for quantization support for newer models, you're better off pinging the authors of the various quant libraries.
If you want fine-tuning services, I've done some model fine-tuning but only for personal projects. I know others who would be more expert and appropriate, depending on your particular use-case; e.g. story-telling/long-form prose, RAG, etc.