exl2 quantized 5.0 bpw from https://huggingface.co/cognitivecomputations/dolphin-2.6-mistral-7b-dpo/tree/main