Hugging Face's logo

hivata
/
functionary-small-v3.1-AWQ

Safetensors
llama
custom_code
4-bit precision
awq
Model card Files
xet
Community
LHC88 commited on
Commit
5745fb0
·
verified ·
1 Parent(s): bb3286a

Create README.md

Browse files
Files changed (1) hide show
  1. README.md +1 -0
README.md ADDED
@@ -0,0 +1 @@
 
 
1
+ quant_config = {"zero_point": True, "q_group_size": 128, "w_bit": 4, "version":"GEMM"}