Hastagaras
commited on
Update README.md
Browse files
README.md
CHANGED
@@ -15,7 +15,7 @@ I just realized that abusing free services isn't cool, so I set myself a challen
|
|
15 |
|
16 |
Base model: [mergekit-community/mergekit-ties-svidyqt](https://huggingface.co/mergekit-community/mergekit-ties-svidyqt)
|
17 |
|
18 |
-
The dataset is already listed, with just a small addition of persona-like data generated with Gemma, and some instruction following data, probably less than 1000 examples
|
19 |
```
|
20 |
#TRAINING: STAGE ONE
|
21 |
layers = [
|
|
|
15 |
|
16 |
Base model: [mergekit-community/mergekit-ties-svidyqt](https://huggingface.co/mergekit-community/mergekit-ties-svidyqt)
|
17 |
|
18 |
+
The dataset is already listed, with just a small addition of persona-like data generated with Gemma, and some instruction following data, probably less than 1000 examples, added for better generalization, since the two don’t have system turns (honestly, I just wanted to round it up from 24K to 25K, it looks nicer when tokenizing)
|
19 |
```
|
20 |
#TRAINING: STAGE ONE
|
21 |
layers = [
|