aixsatoshi
/

c4ai-command-r-plus-08-2024-awq

4-bit precision

Model card Files Files and versions Community

c4ai-command-r-plus-08-2024-awq / README.md

aixsatoshi's picture

Update README.md

6f91c0e verified 5 months ago

|

history blame contribute delete

252 Bytes

metadata

license: cc-by-nc-4.0
base_model: CohereForAI/c4ai-command-r-plus-08-2024

https://huggingface.co/CohereForAI/c4ai-command-r-plus-08-2024

quant_config = { "zero_point": True, "q_group_size": 128, "w_bit": 4, "version": "GEMM" }