Uploaded model

  • Developed by: BarraHome
  • License: apache-2.0
  • Finetuned from model : unsloth/zephyr-sft

This mistral model was trained 2x faster with Unsloth and Huggingface's TRL library.

Downloads last month
5
Safetensors
Model size
3.86B params
Tensor type
F32
BF16
U8
Inference Providers NEW
This model is not currently available via any of the supported Inference Providers.

Model tree for BarraHome/zephyr-dpo-4bit

Base model

unsloth/zephyr-sft
Quantized
(4)
this model
Finetunes
1 model