Update README.md
Browse files
README.md
CHANGED
@@ -8,6 +8,20 @@ tags:
|
|
8 |
language:
|
9 |
- en
|
10 |
---
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
11 |
# Qwen 2.5 32b RP Ink
|
12 |
![image/png](https://cdn-uploads.huggingface.co/production/uploads/634262af8d8089ebaefd410e/1_Zt_OvEW183lmrgidQw8.png)
|
13 |
|
|
|
8 |
language:
|
9 |
- en
|
10 |
---
|
11 |
+
|
12 |
+
Ah shit, here I go quanting Qwen 2.5 models again.
|
13 |
+
|
14 |
+
[This is the EXL2 3.5bpw version of this model. For the original model, go here](https://huggingface.co/allura-org/Qwen2.5-32b-RP-Ink)
|
15 |
+
<br>
|
16 |
+
[For the 8bpw version, go here](https://huggingface.co/Statuo/Allura-Qwen2.5-32b-RP-Ink-EXL2-8bpw)
|
17 |
+
<br>
|
18 |
+
[For the 6bpw version, go here](https://huggingface.co/Statuo/Allura-Qwen2.5-32b-RP-Ink-EXL2-6bpw)
|
19 |
+
<br>
|
20 |
+
[For the 4bpw version, go here](https://huggingface.co/Statuo/Allura-Qwen2.5-32b-RP-Ink-EXL2-4bpw)
|
21 |
+
<br>
|
22 |
+
[For the 3bpw version, go here](https://huggingface.co/Statuo/Allura-Qwen2.5-32b-RP-Ink-EXL2-3bpw)
|
23 |
+
<br>
|
24 |
+
|
25 |
# Qwen 2.5 32b RP Ink
|
26 |
![image/png](https://cdn-uploads.huggingface.co/production/uploads/634262af8d8089ebaefd410e/1_Zt_OvEW183lmrgidQw8.png)
|
27 |
|