Llama-3-8B ORPOtuned on Intel/orca_dpo_pairs dataset

Brain

Further Testing Needed

  • Developed by: cookinai
  • License: apache-2.0
  • Finetuned from model : unsloth/llama-3-8b-bnb-4bit

This llama model was trained 2x faster with Unsloth and Huggingface's TRL library.

Downloads last month
3
Inference Providers NEW
This model isn't deployed by any Inference Provider. ๐Ÿ™‹ Ask for provider support

Model tree for cookinai/NeuralLlama-3-ORPO

Finetuned
(2698)
this model
Quantizations
2 models