Update elx2 quants
Browse files
README.md
CHANGED
|
@@ -59,8 +59,10 @@ TBD
|
|
| 59 |
#### Exllama2
|
| 60 |
[@elinas - 8.0bpw](https://huggingface.co/ZeusLabs/Chronos-Divergence-33B-8.0bpw)
|
| 61 |
|
| 62 |
-
|
| 63 |
-
|
|
|
|
|
|
|
| 64 |
|
| 65 |
## Sampling Settings
|
| 66 |
Here are some settings that work well with this model:
|
|
|
|
| 59 |
#### Exllama2
|
| 60 |
[@elinas - 8.0bpw](https://huggingface.co/ZeusLabs/Chronos-Divergence-33B-8.0bpw)
|
| 61 |
|
| 62 |
+
[@SicariusSicariiStuff - 6.0bpw](https://huggingface.co/SicariusSicariiStuff/ZeusLabs_Chronos-Divergence-33B-EXL2-6.0bpw)
|
| 63 |
+
|
| 64 |
+
[@SicariusSicariiStuff - 4.0bpw](https://huggingface.co/SicariusSicariiStuff/ZeusLabs_Chronos-Divergence-33B-EXL2-4.0bpw)
|
| 65 |
+
|
| 66 |
|
| 67 |
## Sampling Settings
|
| 68 |
Here are some settings that work well with this model:
|