Upload folder using huggingface_hub
Browse files- .gitattributes +1 -0
- README.md +51 -0
- chronos-70b-v2.Q4_0.gguf +3 -0
.gitattributes
CHANGED
@@ -33,3 +33,4 @@ saved_model/**/* filter=lfs diff=lfs merge=lfs -text
|
|
33 |
*.zip filter=lfs diff=lfs merge=lfs -text
|
34 |
*.zst filter=lfs diff=lfs merge=lfs -text
|
35 |
*tfevents* filter=lfs diff=lfs merge=lfs -text
|
|
|
|
33 |
*.zip filter=lfs diff=lfs merge=lfs -text
|
34 |
*.zst filter=lfs diff=lfs merge=lfs -text
|
35 |
*tfevents* filter=lfs diff=lfs merge=lfs -text
|
36 |
+
chronos-70b-v2.Q4_0.gguf filter=lfs diff=lfs merge=lfs -text
|
README.md
ADDED
@@ -0,0 +1,51 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
1 |
+
---
|
2 |
+
license: cc-by-nc-4.0
|
3 |
+
tags:
|
4 |
+
- chat
|
5 |
+
- roleplay
|
6 |
+
- storywriting
|
7 |
+
---
|
8 |
+
|
9 |
+
# chronos-70b-v2
|
10 |
+
|
11 |
+
This is the FP16 PyTorch / HF version of **chronos-70b-v2** based on the **Llama v2 Base** model. This version will **not fit on a consumer GPU**, use a quantized type of model from those linked below!
|
12 |
+
|
13 |
+
Big thank you to the Pygmalion team for providing compute. Reach out to me if you would like individual credit.
|
14 |
+
|
15 |
+
This model is primarily focused on chat, roleplay, storywriting, with significantly improved reasoning and logic. It does not have any form of censorship, please use responsibly.
|
16 |
+
|
17 |
+
Chronos can generate very long outputs with coherent text, largely due to the human inputs it was trained on, and it supports context length up to 4096 tokens.
|
18 |
+
|
19 |
+
## License
|
20 |
+
|
21 |
+
This model is strictly [*non-commercial*](https://creativecommons.org/licenses/by-nc/4.0/) (**cc-by-nc-4.0**) use only which takes priority over the **LLAMA 2 COMMUNITY LICENSE AGREEMENT**. If you'd like to discuss using it for your business, contact Elinas through Discord **elinas**, or X (Twitter) **@officialelinas**.
|
22 |
+
|
23 |
+
The "Model" is completely free (ie. base model, derivates, merges/mixes) to use for non-commercial purposes as long as the the included **cc-by-nc-4.0** license in any parent repository, and the non-commercial use statute remains, regardless of other models' licences.
|
24 |
+
At the moment, only 70b models released will be under this license and the terms may change at any time (ie. a more permissive license allowing commercial use).
|
25 |
+
|
26 |
+
## Model Usage
|
27 |
+
|
28 |
+
This model uses Alpaca formatting, so for optimal model performance, use it to start the dialogue or story, and if you use a frontend like SillyTavern ENABLE Alpaca instruction mode:
|
29 |
+
|
30 |
+
```
|
31 |
+
### Instruction:
|
32 |
+
Your instruction or question here.
|
33 |
+
### Response:
|
34 |
+
```
|
35 |
+
Not using the format will make the model perform significantly worse than intended.
|
36 |
+
|
37 |
+
## Tips
|
38 |
+
|
39 |
+
Sampling and settings can make a significant difference for this model, so play around with them. I was also informed by a user that if you are using **KoboldCPP** that using the flag
|
40 |
+
`--unbantokens` may improve model performance **significantly**. This has not been tested by myself, but that is something to keep in mind.
|
41 |
+
|
42 |
+
## Quantized Versions for Consumer GPU Usage
|
43 |
+
|
44 |
+
[LlamaCPP Versions provided by @TheBloke](https://huggingface.co/TheBloke/Chronos-70B-v2-GGUF)
|
45 |
+
|
46 |
+
[GPTQ Quantized Versions provided by @TheBloke](https://huggingface.co/TheBloke/Chronos-70B-v2-GPTQ)
|
47 |
+
|
48 |
+
|
49 |
+
**Support Development of New Models**
|
50 |
+
<a href='https://ko-fi.com/Q5Q6MB734' target='_blank'><img height='36' style='border:0px;height:36px;'
|
51 |
+
src='https://storage.ko-fi.com/cdn/kofi1.png?v=3' border='0' alt='Support Development' /></a>
|
chronos-70b-v2.Q4_0.gguf
ADDED
@@ -0,0 +1,3 @@
|
|
|
|
|
|
|
|
|
1 |
+
version https://git-lfs.github.com/spec/v1
|
2 |
+
oid sha256:d29effca2faa03c95c31934940e75805bb362f4e703aa2d03e6605f60fca5f4a
|
3 |
+
size 38872249696
|