thesven
/

Qwen2-0.5B-Instruct-GGUF

Text Generation

Inference Endpoints

Model card Files Files and versions Community

Qwen2-0.5B-Instruct-GGUF

1 contributor

History: 4 commits

thesven's picture

Update README.md

e92a7d7 verified 9 months ago

.gitattributes

2.17 kB

Upload folder using huggingface_hub 9 months ago
Qwen2-0.5B-Instruct-GGUF-IQ1_S.gguf

316 MB
LFS

Upload folder using huggingface_hub 9 months ago
Qwen2-0.5B-Instruct-GGUF-IQ2_S.gguf

326 MB
LFS

Upload folder using huggingface_hub 9 months ago
Qwen2-0.5B-Instruct-GGUF-IQ2_XS.gguf

324 MB
LFS

Upload folder using huggingface_hub 9 months ago
Qwen2-0.5B-Instruct-GGUF-IQ3_S.gguf

339 MB
LFS

Upload folder using huggingface_hub 9 months ago
Qwen2-0.5B-Instruct-GGUF-IQ3_XXS.gguf

334 MB
LFS

Upload folder using huggingface_hub 9 months ago
Qwen2-0.5B-Instruct-GGUF-IQ4_NL.gguf

353 MB
LFS

Upload folder using huggingface_hub 9 months ago
Qwen2-0.5B-Instruct-GGUF-IQ4_XS.gguf

349 MB
LFS

Upload folder using huggingface_hub 9 months ago
Qwen2-0.5B-Instruct-GGUF-Q4_K_M.gguf

398 MB
LFS

Upload folder using huggingface_hub 9 months ago
Qwen2-0.5B-Instruct-GGUF-bf16.gguf

994 MB
LFS

Upload folder using huggingface_hub 9 months ago
README.md

4.06 kB

Update README.md 9 months ago
imatrix_Qwen2-0.5B-Instruct.dat

989 kB

Upload folder using huggingface_hub 9 months ago