Granther
/

Gemma-2-9B-Instruct-4Bit-GPTQ

Text Generation

text-generation-inference

4-bit precision

Model card Files Files and versions Community

Gemma-2-9B-Instruct-4Bit-GPTQ

Commit History

Upload gemma_quantize.ipynb with huggingface_hub

41dacb0
verified

Granther commited on Jul 2, 2024

Upload gemma_2_9b_4bit_gptq.ipynb with huggingface_hub

0e55ffe
verified

Granther commited on Jul 2, 2024

initial commit

a9f9c86
verified

Granther commited on Jul 1, 2024