Adding AWQ Quant
Browse filesThank-you for another great model. We have made an AWQ quant for it.
README.md
CHANGED
@@ -42,6 +42,8 @@ ExLlamaV2: https://huggingface.co/bartowski/Hyperion-2.0-Mistral-7B-exl2
|
|
42 |
|
43 |
GGUF: https://huggingface.co/bartowski/Hyperion-2.0-Mistral-7B-GGUF
|
44 |
|
|
|
|
|
45 |
## Evaluation Results
|
46 |
0-shot AGIEval
|
47 |
| Tasks |Version|Filter|n-shot| Metric |Value | |Stderr|
|
|
|
42 |
|
43 |
GGUF: https://huggingface.co/bartowski/Hyperion-2.0-Mistral-7B-GGUF
|
44 |
|
45 |
+
AWQ: https://huggingface.co/solidrust/Hyperion-2.0-Mistral-7B-AWQ
|
46 |
+
|
47 |
## Evaluation Results
|
48 |
0-shot AGIEval
|
49 |
| Tasks |Version|Filter|n-shot| Metric |Value | |Stderr|
|