erdiari commited on
Commit
1f74d2b
·
verified ·
1 Parent(s): 0031d50

Create README.md

Browse files
Files changed (1) hide show
  1. README.md +21 -0
README.md ADDED
@@ -0,0 +1,21 @@
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
+ ---
2
+ license: apache-2.0
3
+ library_name: transformers
4
+ ---
5
+
6
+ # Mistral Scary Story Finetune
7
+
8
+ This model is a finetune of mistralai/Mistral-7B-v0.1 using r/nosleep subreddit as data. This is not an instruction fine tuned model and only fine tuned
9
+ on stories. To generate a story, give a title to model like:
10
+ ```
11
+ # On a dark and spooky night
12
+ ```
13
+ You can even write some of the story get a better result.
14
+
15
+
16
+ # Training Procedure
17
+
18
+ This is a lora fine-tune with following parameters:
19
+ - r=8,
20
+ - lora_alpha=16,
21
+ - lora_dropout=0.05