Update README.md
Browse files
README.md
CHANGED
@@ -12,7 +12,7 @@ language:
|
|
12 |
---
|
13 |
|
14 |
Thanks to Gargamel for the compute, to train this!
|
15 |
-
<br>It took ~120 Hours on
|
16 |
|
17 |
---
|
18 |
|
@@ -25,6 +25,15 @@ This model has went through a single stage finetuning process, over 2 epochs. Da
|
|
25 |
- - Dataset consists of a mixture of Human and Claude Data.
|
26 |
```
|
27 |
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
28 |
Prompting Format:
|
29 |
```
|
30 |
- Use the L3 Instruct Formatting - Euryale 2.1 Preset Works Well
|
@@ -44,13 +53,6 @@ Changes since Euryale v2.1 \[Same Dataset as Stheno 3.4\]
|
|
44 |
- Filtered for the usual errors, slop and stuff at the end. Some may have slipped through, but I removed nearly all of it.
|
45 |
```
|
46 |
|
47 |
-
Personal Opinions:
|
48 |
-
```
|
49 |
-
- Llama 3.1 is... meh. I'm sure you guys in the community have debated over this.
|
50 |
-
- Whatever they did to their Instruct overcooked the model. Base is weird.
|
51 |
-
- Still, the 70B is pretty nice, though sometimes it bugs out? A swipe / regen always fixes it.
|
52 |
-
- May be less 'uncensored' zero-shot due to removal of c2 samples, but it is perfectly fine for roleplaying purposes.
|
53 |
-
```
|
54 |
|
55 |
Below are some graphs and all for you to observe.
|
56 |
|
|
|
12 |
---
|
13 |
|
14 |
Thanks to Gargamel for the compute, to train this!
|
15 |
+
<br>It took ~120 Hours on 8x A100s.
|
16 |
|
17 |
---
|
18 |
|
|
|
25 |
- - Dataset consists of a mixture of Human and Claude Data.
|
26 |
```
|
27 |
|
28 |
+
Personal Opinions:
|
29 |
+
```
|
30 |
+
- Llama 3.1 is... meh. I'm sure you guys in the community have debated over this.
|
31 |
+
- Whatever they did to their Instruct overcooked the model. Base is weird compared to Llama 3.
|
32 |
+
- Still, the 70B is pretty nice to use, though sometimes it bugs out? A swipe / regen always fixes it.
|
33 |
+
- May be less 'uncensored' zero-shot due to removal of c2 samples, but it is perfectly fine for roleplaying purposes.
|
34 |
+
- I never got the feeling Euryale was ever too horny, even with v2.1 ymmv.
|
35 |
+
```
|
36 |
+
|
37 |
Prompting Format:
|
38 |
```
|
39 |
- Use the L3 Instruct Formatting - Euryale 2.1 Preset Works Well
|
|
|
53 |
- Filtered for the usual errors, slop and stuff at the end. Some may have slipped through, but I removed nearly all of it.
|
54 |
```
|
55 |
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
56 |
|
57 |
Below are some graphs and all for you to observe.
|
58 |
|