brittlewis12 commited on
Commit
bb97c46
·
verified ·
1 Parent(s): 64480dc

Create README.md

Browse files
Files changed (1) hide show
  1. README.md +66 -0
README.md ADDED
@@ -0,0 +1,66 @@
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
+ ---
2
+ base_model: argilla/distilabeled-Marcoro14-7B-slerp-full
3
+ inference: false
4
+ license: apache-2.0
5
+ language:
6
+ - en
7
+ datasets:
8
+ - argilla/distilabel-intel-orca-dpo-pairs
9
+ tags:
10
+ - distilabel
11
+ - dpo
12
+ - rlaif
13
+ - rlhf
14
+ - merge
15
+ - mergekit
16
+ model_creator: argilla
17
+ model_name: distilabeled-Marcoro14-7B-slerp-full
18
+ model_type: mistral
19
+ pipeline_tag: text-generation
20
+ quantized_by: brittlewis12
21
+ ---
22
+
23
+ # distilabeled-Marcoro14-7B-slerp-full GGUF
24
+
25
+ Original model: [distilabeled-Marcoro14-7B-slerp-full](https://huggingface.co/argilla/distilabeled-Marcoro14-7B-slerp-full)
26
+ Model creator: [Argilla](https://huggingface.co/argilla)
27
+
28
+ This repo contains GGUF format model files for Argilla’s distilabeled-Marcoro14-7B-slerp-full.
29
+
30
+ As described on the original model card:
31
+ > This model is a new DPO fine-tune of our new open dataset argilla/distilabel-intel-orca-dpo-pairs, on the mlabonne/Marcoro14-7B-slerp model. You can find more information of the "distilabeled" dataset used at this repo argilla/distilabeled-Hermes-2.5-Mistral-7B, and visit distilabel.
32
+ >
33
+ > The difference between this model and argilla/distilabeled-Marcoro14-7B-slerp is that this model has been fine-tuned for a whole epoch instead instead of 200 steps, so it has seen the whole dataset.
34
+
35
+
36
+
37
+ ### What is GGUF?
38
+
39
+ GGUF is a file format for representing AI models. It is the third version of the format, introduced by the llama.cpp team on August 21st 2023. It is a replacement for GGML, which is no longer supported by llama.cpp.
40
+ Converted using llama.cpp build 1879 (revision [3e5ca79](https://github.com/ggerganov/llama.cpp/commit/3e5ca7931c68152e4ec18d126e9c832dd84914c8))
41
+
42
+ ### Prompt template: Unknown
43
+
44
+ `{{prompt}}`
45
+
46
+ ---
47
+
48
+ ## Download & run with [cnvrs](https://testflight.apple.com/join/sFWReS7K) on iPhone, iPad, and Mac!
49
+
50
+ [cnvrs](https://testflight.apple.com/join/sFWReS7K) is the best app for private, local AI on your device:
51
+ - create & save **Characters** with custom system prompts & temperature settings
52
+ - download and experiment with any **GGUF model** you can [find on HuggingFace](https://huggingface.co/models?library=gguf)!
53
+ - make it your own with custom **Theme colors**
54
+ - powered by Metal ⚡️ & [Llama.cpp](https://github.com/ggerganov/llama.cpp), with **haptics** during response streaming!
55
+ - **try it out** yourself today, on [Testflight](https://testflight.apple.com/join/sFWReS7K)!
56
+
57
+ ---
58
+
59
+ ## Original Model Evaluations:
60
+
61
+ | Model |AGIEval|GPT4ALL|TruthfulQA|Bigbench|Average|
62
+ |-------------------------|------:|------:|---------:|-------:|------:|
63
+ |[argilla/distilabeled-Marcoro14-7B-slerp-full](https://huggingface.co/argilla/distilabeled-Marcoro14-7B-slerp-full)| 45.17| **76.59**| 64.68| **48.15**| **58.65**|
64
+ |[argilla/distilabeled-Marcoro14-7B-slerp](https://huggingface.co/argilla/distilabeled-Marcoro14-7B-slerp)| **45.4**| 76.47| **65.46**| 47.19| 58.63|
65
+ |[Marcoro14-7B-slerp](https://huggingface.co/mlabonne/Marcoro14-7B-slerp) | 44.66| 76.24| 64.15| 45.64| 57.67|
66
+ |[argilla/distilabeled-Hermes-2.5-Mistral-7B](https://huggingface.co/argilla/distilabeled-Hermes-2.5-Mistral-7B) | 44.64 | 73.35 | 55.96 | 42.21 | 54.04 |