exl2 quant (measurement.json in main branch)
check revisions for quants
SFT on 1/4th the data. More converstional and usable even in SFT stage.
It uses chatML format and must use "<|im_start|>user", "<|im_start|>assistant", and "<|im_start|>system"
No further support will be provided for the use of this model, your milage may vary.
Inference Providers
NEW
This model is not currently available via any of the supported third-party Inference Providers, and
HF Inference API was unable to determine this model's library.