Updated the current KoboldCpp RAM requirements
Browse files
README.md
CHANGED
@@ -20,18 +20,18 @@ This is [BlinkDL/rwkv-4-pileplus](https://huggingface.co/BlinkDL/rwkv-4-pileplus
|
|
20 |
Model | RAM usage (with OpenBLAS)
|
21 |
:--:|:--:
|
22 |
Unloaded | 41.3 MiB
|
23 |
-
169M q4_0 |
|
24 |
-
169M q5_0 |
|
25 |
-
169M q5_1 |
|
26 |
-
430M q4_0 |
|
27 |
-
430M q5_0 |
|
28 |
-
430M q5_1 |
|
29 |
-
1.5B q4_0 | 1.
|
30 |
1.5B q5_0 | 1.3 GiB
|
31 |
-
1.5B q5_1 | 1.
|
32 |
-
3B q4_0 | 2.
|
33 |
3B q5_0 | 2.3 GiB
|
34 |
-
3B q5_1 | 2.
|
35 |
|
36 |
Original model card by BlinkDL is below.
|
37 |
|
|
|
20 |
Model | RAM usage (with OpenBLAS)
|
21 |
:--:|:--:
|
22 |
Unloaded | 41.3 MiB
|
23 |
+
169M q4_0 | 232.2 MiB
|
24 |
+
169M q5_0 | 243.3 MiB
|
25 |
+
169M q5_1 | 249.2 MiB
|
26 |
+
430M q4_0 | 413.2 MiB
|
27 |
+
430M q5_0 | 454.4 MiB
|
28 |
+
430M q5_1 | 471.8 MiB
|
29 |
+
1.5B q4_0 | 1.1 GiB
|
30 |
1.5B q5_0 | 1.3 GiB
|
31 |
+
1.5B q5_1 | 1.3 GiB
|
32 |
+
3B q4_0 | 2.0 GiB
|
33 |
3B q5_0 | 2.3 GiB
|
34 |
+
3B q5_1 | 2.4 GiB
|
35 |
|
36 |
Original model card by BlinkDL is below.
|
37 |
|