shuyuej commited on
Commit
29ffb2e
·
verified ·
1 Parent(s): c0d0d29

Update README.md

Browse files
Files changed (1) hide show
  1. README.md +37 -3
README.md CHANGED
@@ -1,3 +1,37 @@
1
- ---
2
- license: apache-2.0
3
- ---
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
+ ---
2
+ license: apache-2.0
3
+ ---
4
+
5
+ # The Quantized CohereForAI/c4ai-command-r-v01 Model
6
+
7
+ Original Base Model: `CohereForAI/c4ai-command-r-v01`.<br>
8
+ Link: [https://huggingface.co/CohereForAI/c4ai-command-r-v01](https://huggingface.co/CohereForAI/c4ai-command-r-v01)
9
+
10
+ ## Quantization Configurations
11
+
12
+ ```text
13
+ "quantization_config": {
14
+ "bits": 4,
15
+ "checkpoint_format": "gptq",
16
+ "desc_act": true,
17
+ "dynamic": null,
18
+ "group_size": 128,
19
+ "lm_head": false,
20
+ "meta": {
21
+ "damp_auto_increment": 0.0025,
22
+ "damp_percent": 0.01,
23
+ "mse": 0.0,
24
+ "quantizer": [
25
+ "gptqmodel:1.4.5"
26
+ ],
27
+ "static_groups": false,
28
+ "true_sequential": true,
29
+ "uri": "https://github.com/modelcloud/gptqmodel"
30
+ },
31
+ "quant_method": "gptq",
32
+ "sym": true
33
+ },
34
+ ```
35
+
36
+ ## Source Codes
37
+ Source Codes: [https://github.com/vkola-lab/medpodgpt/tree/main/quantization](https://github.com/vkola-lab/medpodgpt/tree/main/quantization).