MCZK
/

Qwen2-1.5B-Instruct-GGUF

Text Generation

Inference Endpoints

Model card Files Files and versions Community

Qwen2-1.5B-Instruct-GGUF

1 contributor

History: 11 commits

MCZK's picture

Upload Qwen2-1.5B-Instruct.Q3_K_M.iMatrix.gguf with huggingface_hub

4089aea verified 7 months ago

.gitattributes

2.18 kB

Upload Qwen2-1.5B-Instruct.Q3_K_M.iMatrix.gguf with huggingface_hub 7 months ago
Qwen2-1.5B-Instruct.Q3_K_M.iMatrix.gguf

824 MB
LFS

Upload Qwen2-1.5B-Instruct.Q3_K_M.iMatrix.gguf with huggingface_hub 7 months ago
Qwen2-1.5B-Instruct.Q4_K_M.iMatrix.gguf

986 MB
LFS

Upload Qwen2-1.5B-Instruct.Q4_K_M.iMatrix.gguf with huggingface_hub 7 months ago
Qwen2-1.5B-Instruct.Q4_K_S.iMatrix.gguf

940 MB
LFS

Upload Qwen2-1.5B-Instruct.Q4_K_S.iMatrix.gguf with huggingface_hub 7 months ago
Qwen2-1.5B-Instruct.Q5_K_M.iMatrix.gguf

1.13 GB
LFS

Upload Qwen2-1.5B-Instruct.Q5_K_M.iMatrix.gguf with huggingface_hub 7 months ago
Qwen2-1.5B-Instruct.Q5_K_S.iMatrix.gguf

1.1 GB
LFS

Upload Qwen2-1.5B-Instruct.Q5_K_S.iMatrix.gguf with huggingface_hub 7 months ago
Qwen2-1.5B-Instruct.Q6_K.iMatrix.gguf

1.27 GB
LFS

Upload Qwen2-1.5B-Instruct.Q6_K.iMatrix.gguf with huggingface_hub 7 months ago
Qwen2-1.5B-Instruct.Q8_0.gguf

1.65 GB
LFS

Upload Qwen2-1.5B-Instruct.Q8_0.gguf with huggingface_hub 7 months ago
Qwen2-1.5B-Instruct.iQ3_XXS.gguf

669 MB
LFS

Upload Qwen2-1.5B-Instruct.iQ3_XXS.gguf with huggingface_hub 7 months ago
Qwen2-1.5B-Instruct.iQ4_XS.gguf

896 MB
LFS

Upload Qwen2-1.5B-Instruct.iQ4_XS.gguf with huggingface_hub 7 months ago
README.md

435 Bytes

Create README.md 7 months ago