aashish1904 commited on
Commit
b756422
·
verified ·
1 Parent(s): 2a6af41

Upload README.md with huggingface_hub

Browse files
Files changed (1) hide show
  1. README.md +199 -0
README.md ADDED
@@ -0,0 +1,199 @@
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
+
2
+ ---
3
+
4
+ language:
5
+ - en
6
+ license: cc-by-4.0
7
+ library_name: transformers
8
+ tags:
9
+ - mergekit
10
+ - merge
11
+ - mistral
12
+ - text-generation
13
+ - roleplay
14
+ base_model:
15
+ - SanjiWatsuki/Kunoichi-7B
16
+ - SanjiWatsuki/Silicon-Maid-7B
17
+ - KatyTheCutie/LemonadeRP-4.5.3
18
+ - Sao10K/Fimbulvetr-11B-v2
19
+ model-index:
20
+ - name: Chewy-Lemon-Cookie-11B
21
+ results:
22
+ - task:
23
+ type: text-generation
24
+ name: Text Generation
25
+ dataset:
26
+ name: IFEval (0-Shot)
27
+ type: HuggingFaceH4/ifeval
28
+ args:
29
+ num_few_shot: 0
30
+ metrics:
31
+ - type: inst_level_strict_acc and prompt_level_strict_acc
32
+ value: 48.75
33
+ name: strict accuracy
34
+ source:
35
+ url: https://huggingface.co/spaces/open-llm-leaderboard/open_llm_leaderboard?query=FallenMerick/Chewy-Lemon-Cookie-11B
36
+ name: Open LLM Leaderboard
37
+ - task:
38
+ type: text-generation
39
+ name: Text Generation
40
+ dataset:
41
+ name: BBH (3-Shot)
42
+ type: BBH
43
+ args:
44
+ num_few_shot: 3
45
+ metrics:
46
+ - type: acc_norm
47
+ value: 33.01
48
+ name: normalized accuracy
49
+ source:
50
+ url: https://huggingface.co/spaces/open-llm-leaderboard/open_llm_leaderboard?query=FallenMerick/Chewy-Lemon-Cookie-11B
51
+ name: Open LLM Leaderboard
52
+ - task:
53
+ type: text-generation
54
+ name: Text Generation
55
+ dataset:
56
+ name: MATH Lvl 5 (4-Shot)
57
+ type: hendrycks/competition_math
58
+ args:
59
+ num_few_shot: 4
60
+ metrics:
61
+ - type: exact_match
62
+ value: 4.61
63
+ name: exact match
64
+ source:
65
+ url: https://huggingface.co/spaces/open-llm-leaderboard/open_llm_leaderboard?query=FallenMerick/Chewy-Lemon-Cookie-11B
66
+ name: Open LLM Leaderboard
67
+ - task:
68
+ type: text-generation
69
+ name: Text Generation
70
+ dataset:
71
+ name: GPQA (0-shot)
72
+ type: Idavidrein/gpqa
73
+ args:
74
+ num_few_shot: 0
75
+ metrics:
76
+ - type: acc_norm
77
+ value: 3.91
78
+ name: acc_norm
79
+ source:
80
+ url: https://huggingface.co/spaces/open-llm-leaderboard/open_llm_leaderboard?query=FallenMerick/Chewy-Lemon-Cookie-11B
81
+ name: Open LLM Leaderboard
82
+ - task:
83
+ type: text-generation
84
+ name: Text Generation
85
+ dataset:
86
+ name: MuSR (0-shot)
87
+ type: TAUR-Lab/MuSR
88
+ args:
89
+ num_few_shot: 0
90
+ metrics:
91
+ - type: acc_norm
92
+ value: 15.95
93
+ name: acc_norm
94
+ source:
95
+ url: https://huggingface.co/spaces/open-llm-leaderboard/open_llm_leaderboard?query=FallenMerick/Chewy-Lemon-Cookie-11B
96
+ name: Open LLM Leaderboard
97
+ - task:
98
+ type: text-generation
99
+ name: Text Generation
100
+ dataset:
101
+ name: MMLU-PRO (5-shot)
102
+ type: TIGER-Lab/MMLU-Pro
103
+ config: main
104
+ split: test
105
+ args:
106
+ num_few_shot: 5
107
+ metrics:
108
+ - type: acc
109
+ value: 25.19
110
+ name: accuracy
111
+ source:
112
+ url: https://huggingface.co/spaces/open-llm-leaderboard/open_llm_leaderboard?query=FallenMerick/Chewy-Lemon-Cookie-11B
113
+ name: Open LLM Leaderboard
114
+
115
+ ---
116
+
117
+ [![QuantFactory Banner](https://lh7-rt.googleusercontent.com/docsz/AD_4nXeiuCm7c8lEwEJuRey9kiVZsRn2W-b4pWlu3-X534V3YmVuVc2ZL-NXg2RkzSOOS2JXGHutDuyyNAUtdJI65jGTo8jT9Y99tMi4H4MqL44Uc5QKG77B0d6-JfIkZHFaUA71-RtjyYZWVIhqsNZcx8-OMaA?key=xt3VSDoCbmTY7o-cwwOFwQ)](https://hf.co/QuantFactory)
118
+
119
+
120
+ # QuantFactory/Chewy-Lemon-Cookie-11B-GGUF
121
+ This is quantized version of [FallenMerick/Chewy-Lemon-Cookie-11B](https://huggingface.co/FallenMerick/Chewy-Lemon-Cookie-11B) created using llama.cpp
122
+
123
+ # Original Model Card
124
+
125
+
126
+ ![cute](https://huggingface.co/FallenMerick/Chewy-Lemon-Cookie-11B/resolve/main/Chewy-Lemon-Cookie.png)
127
+
128
+ # Chewy-Lemon-Cookie-11B
129
+
130
+ This is a merge of pre-trained language models created using [mergekit](https://github.com/cg123/mergekit).
131
+
132
+ GGUF quants:
133
+ * https://huggingface.co/backyardai/Chewy-Lemon-Cookie-11B-GGUF
134
+ * https://huggingface.co/mradermacher/Chewy-Lemon-Cookie-11B-GGUF
135
+ * https://huggingface.co/mradermacher/Chewy-Lemon-Cookie-11B-i1-GGUF
136
+
137
+ ## Merge Details
138
+ ### Merge Method
139
+
140
+ This model was merged using the following methods:
141
+ * passthrough
142
+ * [task arithmetic](https://arxiv.org/abs/2212.04089)
143
+
144
+ ### Models Merged
145
+
146
+ The following models were included in the merge:
147
+ * [SanjiWatsuki/Kunoichi-7B](https://huggingface.co/SanjiWatsuki/Kunoichi-7B)
148
+ * [SanjiWatsuki/Silicon-Maid-7B](https://huggingface.co/SanjiWatsuki/Silicon-Maid-7B)
149
+ * [KatyTheCutie/LemonadeRP-4.5.3](https://huggingface.co/KatyTheCutie/LemonadeRP-4.5.3)
150
+ * [Sao10K/Fimbulvetr-11B-v2](https://huggingface.co/Sao10K/Fimbulvetr-11B-v2)
151
+
152
+ ### Configuration
153
+
154
+ The following YAML configurations were used to produce this model:
155
+
156
+ ```yaml
157
+ slices:
158
+ - sources:
159
+ - model: SanjiWatsuki/Kunoichi-7B
160
+ layer_range: [0, 24]
161
+ - sources:
162
+ - model: SanjiWatsuki/Silicon-Maid-7B
163
+ layer_range: [8, 24]
164
+ - sources:
165
+ - model: KatyTheCutie/LemonadeRP-4.5.3
166
+ layer_range: [24, 32]
167
+ merge_method: passthrough
168
+ dtype: bfloat16
169
+ name: Big-Lemon-Cookie-11B-BF16
170
+
171
+ ---
172
+
173
+ models:
174
+ - model: Big-Lemon-Cookie-11B-BF16
175
+ parameters:
176
+ weight: 0.85
177
+ - model: Sao10K/Fimbulvetr-11B-v2
178
+ parameters:
179
+ weight: 0.15
180
+ merge_method: task_arithmetic
181
+ base_model: Big-Lemon-Cookie-11B-BF16
182
+ dtype: bfloat16
183
+ name: Chewy-Lemon-Cookie-11B
184
+ ```
185
+
186
+ # [Open LLM Leaderboard Evaluation Results](https://huggingface.co/spaces/open-llm-leaderboard/open_llm_leaderboard)
187
+ Detailed results can be found [here](https://huggingface.co/datasets/open-llm-leaderboard/details_FallenMerick__Chewy-Lemon-Cookie-11B)
188
+
189
+ | Metric |Value|
190
+ |-------------------|----:|
191
+ |Avg. |21.91|
192
+ |IFEval (0-Shot) |48.75|
193
+ |BBH (3-Shot) |33.01|
194
+ |MATH Lvl 5 (4-Shot)| 4.61|
195
+ |GPQA (0-shot) | 3.91|
196
+ |MuSR (0-shot) |15.95|
197
+ |MMLU-PRO (5-shot) |25.19|
198
+
199
+