QuantFactory
/

llm-compiler-7b-GGUF

Text Generation

Inference Endpoints

Model card Files Files and versions Community

llm-compiler-7b-GGUF

Commit History

Upload llm-compiler-7b.Q3_K_L.gguf with huggingface_hub

2de69d4
verified

munish0838 commited on Jun 28

Upload llm-compiler-7b.Q2_K.gguf with huggingface_hub

30ae640
verified

munish0838 commited on Jun 28

Upload llm-compiler-7b.Q5_1.gguf with huggingface_hub

bab9ae3
verified

munish0838 commited on Jun 28

Upload llm-compiler-7b.Q5_0.gguf with huggingface_hub

6a54918
verified

munish0838 commited on Jun 28

Upload llm-compiler-7b.Q5_K_S.gguf with huggingface_hub

a6a2198
verified

munish0838 commited on Jun 28

Upload llm-compiler-7b.Q5_K_M.gguf with huggingface_hub

2e7b91b
verified

munish0838 commited on Jun 28

Upload llm-compiler-7b.Q6_K.gguf with huggingface_hub

eed53e8
verified

munish0838 commited on Jun 28

Upload llm-compiler-7b.Q8_0.gguf with huggingface_hub

21cb6ee
verified

munish0838 commited on Jun 28

Upload llm-compiler-7b.Q4_0.gguf with huggingface_hub

8de0160
verified

munish0838 commited on Jun 28

Upload llm-compiler-7b.Q4_1.gguf with huggingface_hub

83999aa
verified

munish0838 commited on Jun 28

Upload llm-compiler-7b.Q4_K_M.gguf with huggingface_hub

418d43f
verified

munish0838 commited on Jun 28

initial commit

41c809f
verified

munish0838 commited on Jun 28