Update README.md
Browse files
README.md
CHANGED
@@ -15,7 +15,7 @@ pipeline_tag: text-generation
|
|
15 |
**This is an early preview release of ExLlamaV3.**
|
16 |
|
17 |
|
18 |
-
| | Quant type | File Size |
|
19 |
| -------- | ---------- | --------- | -------- |
|
20 |
| [phi-4_3bpw](https://huggingface.co/cmh/phi-4_exl3/tree/3bpw) | 3 bits per weight | 6.08 GB | **9.4 GB** |
|
21 |
| [phi-4_4bpw](https://huggingface.co/cmh/phi-4_exl3/tree/4bpw) | 4 bits per weight | 7.67 GB | **11.0 GB** |
|
|
|
15 |
**This is an early preview release of ExLlamaV3.**
|
16 |
|
17 |
|
18 |
+
| | Quant type | File Size | Vram*|
|
19 |
| -------- | ---------- | --------- | -------- |
|
20 |
| [phi-4_3bpw](https://huggingface.co/cmh/phi-4_exl3/tree/3bpw) | 3 bits per weight | 6.08 GB | **9.4 GB** |
|
21 |
| [phi-4_4bpw](https://huggingface.co/cmh/phi-4_exl3/tree/4bpw) | 4 bits per weight | 7.67 GB | **11.0 GB** |
|