metadata
base_model: huihui-ai/Falcon3-10B-Instruct-abliterated
tags:
- text-generation-inference
- transformers
- unsloth
- llama
- trl
license: apache-2.0
language:
- en
datasets:
- mlabonne/orpo-dpo-mix-40k
This is huihui-ai/Falcon3-10B-Instruct-abliterated finetuned w/ unsloth ORPO on mlabonne/orpo-dpo-mix-40k for one epoch.
The results are a very good Uncensored model for its size (10B). When prompted correctly, this model shows no refusals. The model scores 33.44% on Open LLM Leaderboard. With GGUF(Q4KM) coming in around 6.4GB this model will be usable on most devices even without a GPU.
Run GGUF with LMStudio.ai
[Open LLM Leaderboard Evaluation Results]
| Metric | Value (%) |
|---|---|
| Average | 33.44 |
| IFEval (0-Shot) | 77.31 |
| BBH (3-Shot) | 43.57 |
| MATH Lvl 5 (4-Shot) | 22.89 |
| GPQA (0-shot) | 10.40 |
| MuSR (0-shot) | 9.39 |
| MMLU-PRO (5-shot) | 37.07 |