DavidAU commited on
Commit
e0513fa
·
verified ·
1 Parent(s): 637c9bc

Update README.md

Browse files
Files changed (1) hide show
  1. README.md +5 -0
README.md CHANGED
@@ -116,6 +116,11 @@ Alpaca generates longer text / story, whereas Instruct are shorter and "to the p
116
 
117
  CRANK UP to "TEMP" ... to get stronger, better results.
118
 
 
 
 
 
 
119
  <B>Model "DNA":</B>
120
 
121
  Special thanks to the incredible work of the model makers "TheDrummer", "anthracite-org", and "nothingiisreal".
 
116
 
117
  CRANK UP to "TEMP" ... to get stronger, better results.
118
 
119
+ Q2k/Q3 quants:
120
+
121
+ You may need to use temp 2 or lower with these quants (1 or lower for q2k). Just too much compression at this level, damaging the model. I will see if Imatrix versions
122
+ of these quants will function better.
123
+
124
  <B>Model "DNA":</B>
125
 
126
  Special thanks to the incredible work of the model makers "TheDrummer", "anthracite-org", and "nothingiisreal".