kaitchup
/

Falcon3-7B-Base-AutoRound-GPTQ-4bit

Text Generation

text-generation-inference

Inference Endpoints

4-bit precision

Model card Files Files and versions Community

Falcon3-7B-Base-AutoRound-GPTQ-4bit / model-00001-of-00002.safetensors

Commit History

Upload LlamaForCausalLM

3e2d076
verified

bnjmnmarie commited on 28 days ago