PyTorch
English
llama
Sao10K commited on
Commit
7879806
1 Parent(s): 0d4b318

Update README.md

Browse files
Files changed (1) hide show
  1. README.md +10 -8
README.md CHANGED
@@ -12,7 +12,7 @@ language:
12
  ---
13
 
14
  Thanks to Gargamel for the compute, to train this!
15
- <br>It took ~120 Hours on Several A100s.
16
 
17
  ---
18
 
@@ -25,6 +25,15 @@ This model has went through a single stage finetuning process, over 2 epochs. Da
25
  - - Dataset consists of a mixture of Human and Claude Data.
26
  ```
27
 
 
 
 
 
 
 
 
 
 
28
  Prompting Format:
29
  ```
30
  - Use the L3 Instruct Formatting - Euryale 2.1 Preset Works Well
@@ -44,13 +53,6 @@ Changes since Euryale v2.1 \[Same Dataset as Stheno 3.4\]
44
  - Filtered for the usual errors, slop and stuff at the end. Some may have slipped through, but I removed nearly all of it.
45
  ```
46
 
47
- Personal Opinions:
48
- ```
49
- - Llama 3.1 is... meh. I'm sure you guys in the community have debated over this.
50
- - Whatever they did to their Instruct overcooked the model. Base is weird.
51
- - Still, the 70B is pretty nice, though sometimes it bugs out? A swipe / regen always fixes it.
52
- - May be less 'uncensored' zero-shot due to removal of c2 samples, but it is perfectly fine for roleplaying purposes.
53
- ```
54
 
55
  Below are some graphs and all for you to observe.
56
 
 
12
  ---
13
 
14
  Thanks to Gargamel for the compute, to train this!
15
+ <br>It took ~120 Hours on 8x A100s.
16
 
17
  ---
18
 
 
25
  - - Dataset consists of a mixture of Human and Claude Data.
26
  ```
27
 
28
+ Personal Opinions:
29
+ ```
30
+ - Llama 3.1 is... meh. I'm sure you guys in the community have debated over this.
31
+ - Whatever they did to their Instruct overcooked the model. Base is weird compared to Llama 3.
32
+ - Still, the 70B is pretty nice to use, though sometimes it bugs out? A swipe / regen always fixes it.
33
+ - May be less 'uncensored' zero-shot due to removal of c2 samples, but it is perfectly fine for roleplaying purposes.
34
+ - I never got the feeling Euryale was ever too horny, even with v2.1 ymmv.
35
+ ```
36
+
37
  Prompting Format:
38
  ```
39
  - Use the L3 Instruct Formatting - Euryale 2.1 Preset Works Well
 
53
  - Filtered for the usual errors, slop and stuff at the end. Some may have slipped through, but I removed nearly all of it.
54
  ```
55
 
 
 
 
 
 
 
 
56
 
57
  Below are some graphs and all for you to observe.
58