Text Generation
GGUF
English
creative
creative writing
fiction writing
plot generation
sub-plot generation
story generation
scene continue
storytelling
fiction story
science fiction
romance
all genres
story
writing
vivid prosing
vivid writing
fiction
roleplaying
bfloat16
swearing
rp
horror
mistral nemo
mergekit
Inference Endpoints
Update README.md
Browse files
README.md
CHANGED
@@ -116,6 +116,11 @@ Alpaca generates longer text / story, whereas Instruct are shorter and "to the p
|
|
116 |
|
117 |
CRANK UP to "TEMP" ... to get stronger, better results.
|
118 |
|
|
|
|
|
|
|
|
|
|
|
119 |
<B>Model "DNA":</B>
|
120 |
|
121 |
Special thanks to the incredible work of the model makers "TheDrummer", "anthracite-org", and "nothingiisreal".
|
|
|
116 |
|
117 |
CRANK UP to "TEMP" ... to get stronger, better results.
|
118 |
|
119 |
+
Q2k/Q3 quants:
|
120 |
+
|
121 |
+
You may need to use temp 2 or lower with these quants (1 or lower for q2k). Just too much compression at this level, damaging the model. I will see if Imatrix versions
|
122 |
+
of these quants will function better.
|
123 |
+
|
124 |
<B>Model "DNA":</B>
|
125 |
|
126 |
Special thanks to the incredible work of the model makers "TheDrummer", "anthracite-org", and "nothingiisreal".
|