Statuo commited on
Commit
17677e2
·
verified ·
1 Parent(s): 9213ba3

Update README.md

Browse files
Files changed (1) hide show
  1. README.md +36 -0
README.md CHANGED
@@ -1,4 +1,5 @@
1
  ---
 
2
  library_name: transformers
3
  license: other
4
  license_name: qwen
@@ -11,6 +12,41 @@ model-index:
11
  results: []
12
  ---
13
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
14
  ![Kunou](https://huggingface.co/Sao10K/72B-Qwen2.5-Kunou-v1/resolve/main/knn.png)
15
 
16
  **Elder Sister Versions for Heavier Use!**
 
1
  ---
2
+ ---
3
  library_name: transformers
4
  license: other
5
  license_name: qwen
 
12
  results: []
13
  ---
14
 
15
+ Blessed be Sao who came down from the heavens to give us another 14b model. There's a 32b link but it's not up yet unfortunately. I'm sure when I post this it'll be up as a gotcha to me personally by God.
16
+
17
+ <br>
18
+
19
+ Anyway, before I get into the links you should know the following:
20
+ <br>
21
+ ChatML format seems to be the best fit here.
22
+ <br>
23
+ I disagree with Sao's sampler settings because the provided settings seem to have the settle into a kind of word-salad-y prose after a few messages. Try instead one of the following settings, or drop your Min P LOW. Like 0.02.
24
+ <br>
25
+ Min P: 0.02
26
+ <br>
27
+ Rep Penalty: 1.08
28
+ <br>
29
+ Presence Penalty: 1.1-1.11
30
+ <br>
31
+ OR
32
+ <br>
33
+ Min P: 0.02
34
+ <br>
35
+ XTC: 0.15, 0.3
36
+ <br>
37
+ DRY: 0.3, 1.75, 2
38
+
39
+ <br>
40
+ Raise the Min P slowly until you hit your sweet spot. Good luck, Tarnished.
41
+ <br>
42
+
43
+ [This is the EXL2 6bpw version of this model. You can find the original model here.](https://huggingface.co/Sao10K/14B-Qwen2.5-Kunou-v1)
44
+ <br>
45
+ [For the 8bpw version, go here.](https://huggingface.co/Statuo/Qwen-2.5-14b-Kunou-EXL2-8bpw)
46
+ <br>
47
+ [For the 4bpw version, go here.](https://huggingface.co/Statuo/Qwen-2.5-14b-Kunou-EXL2-4bpw)
48
+ ---
49
+
50
  ![Kunou](https://huggingface.co/Sao10K/72B-Qwen2.5-Kunou-v1/resolve/main/knn.png)
51
 
52
  **Elder Sister Versions for Heavier Use!**