Update README.md
Browse files
README.md
CHANGED
|
@@ -22,14 +22,6 @@ datasets:
|
|
| 22 |
|
| 23 |
Another experimental model, using mostly sythetic data generated by [airoboros](https://github.com/jondurbin/airoboros)
|
| 24 |
|
| 25 |
-
#### IMPORTANT NOTE - llama-2 chat format!!!
|
| 26 |
-
|
| 27 |
-
This models uses llama-2 chat format, rather than vicuna style user/assistant!
|
| 28 |
-
|
| 29 |
-
This is a breaking change, although most inference systems support llama-2 chat templating.
|
| 30 |
-
|
| 31 |
-
See prompt format below for all of the details.
|
| 32 |
-
|
| 33 |
#### Highlights
|
| 34 |
|
| 35 |
This is using yi-34b-200k as the base model. While the base model supports 200k context size, this model was fine-tuned with a ctx size of 8k tokens, so anything beyond that will likely have questionable results.
|
|
|
|
| 22 |
|
| 23 |
Another experimental model, using mostly sythetic data generated by [airoboros](https://github.com/jondurbin/airoboros)
|
| 24 |
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| 25 |
#### Highlights
|
| 26 |
|
| 27 |
This is using yi-34b-200k as the base model. While the base model supports 200k context size, this model was fine-tuned with a ctx size of 8k tokens, so anything beyond that will likely have questionable results.
|