LeroyDyer/Mixtral_AI_MiniTron_Chat AWQ

Model Summary

these little one are easy to train for task !!! ::

They already have some training (not great) But they can take more and more

(and being MISTRAL they can takes lora modules!)

Rememeber to add training on to the lora you merge withit : ie load the lora and train a few cycle on the same data that was applied in the p=lora (ie 20 Steps ) and

See it it took hold then merge IT!

  • Developed by: LeroyDyer
  • License: apache-2.0
  • Finetuned from model : LeroyDyer/Mixtral_AI_MiniTron
Downloads last month
18
Safetensors
Model size
729M params
Tensor type
I32
·
FP16
·
Inference Examples
Inference API (serverless) has been turned off for this model.