munish0838 commited on
Commit
28e2033
·
verified ·
1 Parent(s): 54ba72c

Upload README.md with huggingface_hub

Browse files
Files changed (1) hide show
  1. README.md +169 -0
README.md ADDED
@@ -0,0 +1,169 @@
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
+
2
+ ---
3
+
4
+ license: apache-2.0
5
+ library_name: transformers
6
+ tags:
7
+ - mergekit
8
+ - merge
9
+ base_model:
10
+ - DreadPoor/Heart_Stolen-8B-Model_Stock
11
+ - DreadPoor/WIP-TEST_PENDING_4
12
+ - DreadPoor/Aspire-8B-model_stock
13
+ model-index:
14
+ - name: Aurora_faustus-8B-LINEAR
15
+ results:
16
+ - task:
17
+ type: text-generation
18
+ name: Text Generation
19
+ dataset:
20
+ name: IFEval (0-Shot)
21
+ type: HuggingFaceH4/ifeval
22
+ args:
23
+ num_few_shot: 0
24
+ metrics:
25
+ - type: inst_level_strict_acc and prompt_level_strict_acc
26
+ value: 72.81
27
+ name: strict accuracy
28
+ source:
29
+ url: https://huggingface.co/spaces/open-llm-leaderboard/open_llm_leaderboard?query=DreadPoor/Aurora_faustus-8B-LINEAR
30
+ name: Open LLM Leaderboard
31
+ - task:
32
+ type: text-generation
33
+ name: Text Generation
34
+ dataset:
35
+ name: BBH (3-Shot)
36
+ type: BBH
37
+ args:
38
+ num_few_shot: 3
39
+ metrics:
40
+ - type: acc_norm
41
+ value: 36.26
42
+ name: normalized accuracy
43
+ source:
44
+ url: https://huggingface.co/spaces/open-llm-leaderboard/open_llm_leaderboard?query=DreadPoor/Aurora_faustus-8B-LINEAR
45
+ name: Open LLM Leaderboard
46
+ - task:
47
+ type: text-generation
48
+ name: Text Generation
49
+ dataset:
50
+ name: MATH Lvl 5 (4-Shot)
51
+ type: hendrycks/competition_math
52
+ args:
53
+ num_few_shot: 4
54
+ metrics:
55
+ - type: exact_match
56
+ value: 15.18
57
+ name: exact match
58
+ source:
59
+ url: https://huggingface.co/spaces/open-llm-leaderboard/open_llm_leaderboard?query=DreadPoor/Aurora_faustus-8B-LINEAR
60
+ name: Open LLM Leaderboard
61
+ - task:
62
+ type: text-generation
63
+ name: Text Generation
64
+ dataset:
65
+ name: GPQA (0-shot)
66
+ type: Idavidrein/gpqa
67
+ args:
68
+ num_few_shot: 0
69
+ metrics:
70
+ - type: acc_norm
71
+ value: 7.61
72
+ name: acc_norm
73
+ source:
74
+ url: https://huggingface.co/spaces/open-llm-leaderboard/open_llm_leaderboard?query=DreadPoor/Aurora_faustus-8B-LINEAR
75
+ name: Open LLM Leaderboard
76
+ - task:
77
+ type: text-generation
78
+ name: Text Generation
79
+ dataset:
80
+ name: MuSR (0-shot)
81
+ type: TAUR-Lab/MuSR
82
+ args:
83
+ num_few_shot: 0
84
+ metrics:
85
+ - type: acc_norm
86
+ value: 12.39
87
+ name: acc_norm
88
+ source:
89
+ url: https://huggingface.co/spaces/open-llm-leaderboard/open_llm_leaderboard?query=DreadPoor/Aurora_faustus-8B-LINEAR
90
+ name: Open LLM Leaderboard
91
+ - task:
92
+ type: text-generation
93
+ name: Text Generation
94
+ dataset:
95
+ name: MMLU-PRO (5-shot)
96
+ type: TIGER-Lab/MMLU-Pro
97
+ config: main
98
+ split: test
99
+ args:
100
+ num_few_shot: 5
101
+ metrics:
102
+ - type: acc
103
+ value: 31.58
104
+ name: accuracy
105
+ source:
106
+ url: https://huggingface.co/spaces/open-llm-leaderboard/open_llm_leaderboard?query=DreadPoor/Aurora_faustus-8B-LINEAR
107
+ name: Open LLM Leaderboard
108
+
109
+ ---
110
+
111
+ [![QuantFactory Banner](https://lh7-rt.googleusercontent.com/docsz/AD_4nXeiuCm7c8lEwEJuRey9kiVZsRn2W-b4pWlu3-X534V3YmVuVc2ZL-NXg2RkzSOOS2JXGHutDuyyNAUtdJI65jGTo8jT9Y99tMi4H4MqL44Uc5QKG77B0d6-JfIkZHFaUA71-RtjyYZWVIhqsNZcx8-OMaA?key=xt3VSDoCbmTY7o-cwwOFwQ)](https://hf.co/QuantFactory)
112
+
113
+
114
+ # QuantFactory/Aurora_faustus-8B-LINEAR-GGUF
115
+ This is quantized version of [DreadPoor/Aurora_faustus-8B-LINEAR](https://huggingface.co/DreadPoor/Aurora_faustus-8B-LINEAR) created using llama.cpp
116
+
117
+ # Original Model Card
118
+
119
+ # merge
120
+
121
+ This is a merge of pre-trained language models created using [mergekit](https://github.com/cg123/mergekit).
122
+
123
+ ## Merge Details
124
+ ### Merge Method
125
+
126
+ This model was merged using the [linear](https://arxiv.org/abs/2203.05482) merge method.
127
+
128
+ ### Models Merged
129
+
130
+ The following models were included in the merge:
131
+ * [DreadPoor/Heart_Stolen-8B-Model_Stock](https://huggingface.co/DreadPoor/Heart_Stolen-8B-Model_Stock)
132
+ * [DreadPoor/WIP-TEST_PENDING_4](https://huggingface.co/DreadPoor/WIP-TEST_PENDING_4)
133
+ * [DreadPoor/Aspire-8B-model_stock](https://huggingface.co/DreadPoor/Aspire-8B-model_stock)
134
+
135
+ ### Configuration
136
+
137
+ The following YAML configuration was used to produce this model:
138
+
139
+ ```yaml
140
+ models:
141
+ - model: DreadPoor/Aspire-8B-model_stock
142
+ parameters:
143
+ weight: 1.0
144
+ - model: DreadPoor/WIP-TEST_PENDING_4
145
+ parameters:
146
+ weight: 1.0
147
+ - model: DreadPoor/Heart_Stolen-8B-Model_Stock
148
+ parameters:
149
+ weight: 1.0
150
+ merge_method: linear
151
+ normalize: false
152
+ int8_mask: true
153
+ dtype: bfloat16
154
+
155
+ ```
156
+ # [Open LLM Leaderboard Evaluation Results](https://huggingface.co/spaces/open-llm-leaderboard/open_llm_leaderboard)
157
+ Detailed results can be found [here](https://huggingface.co/datasets/open-llm-leaderboard/details_DreadPoor__Aurora_faustus-8B-LINEAR)
158
+
159
+ | Metric |Value|
160
+ |-------------------|----:|
161
+ |Avg. |29.31|
162
+ |IFEval (0-Shot) |72.81|
163
+ |BBH (3-Shot) |36.26|
164
+ |MATH Lvl 5 (4-Shot)|15.18|
165
+ |GPQA (0-shot) | 7.61|
166
+ |MuSR (0-shot) |12.39|
167
+ |MMLU-PRO (5-shot) |31.58|
168
+
169
+