Merry commited on
Commit
fd373a3
1 Parent(s): b903210

Updated the current KoboldCpp RAM requirements

Browse files
Files changed (1) hide show
  1. README.md +10 -10
README.md CHANGED
@@ -20,18 +20,18 @@ This is [BlinkDL/rwkv-4-pileplus](https://huggingface.co/BlinkDL/rwkv-4-pileplus
20
  Model | RAM usage (with OpenBLAS)
21
  :--:|:--:
22
  Unloaded | 41.3 MiB
23
- 169M q4_0 | 249.0 MiB
24
- 169M q5_0 | 254.2 MiB
25
- 169M q5_1 | 259.6 MiB
26
- 430M q4_0 | 443.7 MiB
27
- 430M q5_0 | 463.2 MiB
28
- 430M q5_1 | 482.8 MiB
29
- 1.5B q4_0 | 1.2 GiB
30
  1.5B q5_0 | 1.3 GiB
31
- 1.5B q5_1 | 1.4 GiB
32
- 3B q4_0 | 2.1 GiB
33
  3B q5_0 | 2.3 GiB
34
- 3B q5_1 | 2.5 GiB
35
 
36
  Original model card by BlinkDL is below.
37
 
 
20
  Model | RAM usage (with OpenBLAS)
21
  :--:|:--:
22
  Unloaded | 41.3 MiB
23
+ 169M q4_0 | 232.2 MiB
24
+ 169M q5_0 | 243.3 MiB
25
+ 169M q5_1 | 249.2 MiB
26
+ 430M q4_0 | 413.2 MiB
27
+ 430M q5_0 | 454.4 MiB
28
+ 430M q5_1 | 471.8 MiB
29
+ 1.5B q4_0 | 1.1 GiB
30
  1.5B q5_0 | 1.3 GiB
31
+ 1.5B q5_1 | 1.3 GiB
32
+ 3B q4_0 | 2.0 GiB
33
  3B q5_0 | 2.3 GiB
34
+ 3B q5_1 | 2.4 GiB
35
 
36
  Original model card by BlinkDL is below.
37