ModelCloud
/

gemma-2-9b-gptq-4bit

Text Generation

text-generation-inference

4-bit precision

Model card Files Files and versions

lrl-modelcloud commited on Jul 2, 2024

Commit

b479648

·

verified ·

1 Parent(s): 1d82a4a

Update config.json

Files changed (1) hide show

config.json +1 -1

config.json CHANGED Viewed

@@ -30,7 +30,7 @@
     "group_size": 128,
     "lm_head": false,
     "meta": {
-      "quantizer": "gptqmodel:0.9.1"
     },
     "model_file_base_name": null,
     "model_name_or_path": null,

     "group_size": 128,
     "lm_head": false,
     "meta": {
+      "quantizer": "gptqmodel:0.9.2"
     },
     "model_file_base_name": null,
     "model_name_or_path": null,