Update README.md
Browse files
README.md
CHANGED
@@ -6,6 +6,6 @@ EXL2 Quantizations of Qwen2.5-3B-Instruct
|
|
6 |
|
7 |
Using exllamav2 release 0.2.6 for quantization.
|
8 |
|
9 |
-
Original model: https://huggingface.co/Qwen/Qwen2-
|
10 |
|
11 |
Bits 8.0, lm_head 8.0
|
|
|
6 |
|
7 |
Using exllamav2 release 0.2.6 for quantization.
|
8 |
|
9 |
+
Original model: https://huggingface.co/Qwen/Qwen2.5-3B-Instruct
|
10 |
|
11 |
Bits 8.0, lm_head 8.0
|