Hugging Face
Models
Datasets
Spaces
Posts
Docs
Enterprise
Pricing
Log In
Sign Up
player1537
/
Bloom-560M-GGUF
like
0
GGUF
Inference Endpoints
Model card
Files
Files and versions
Community
Deploy
Use this model
main
Bloom-560M-GGUF
2 contributors
History:
2 commits
Tanner Hobson
GGUF model commit (made with llama.cpp commit fe680e3)
2d82e17
about 1 year ago
.gitattributes
Safe
1.56 kB
GGUF model commit (made with llama.cpp commit fe680e3)
about 1 year ago
Bloom-560M.Q2_K.gguf
Safe
431 MB
LFS
GGUF model commit (made with llama.cpp commit fe680e3)
about 1 year ago
Bloom-560M.Q3_K.gguf
Safe
493 MB
LFS
GGUF model commit (made with llama.cpp commit fe680e3)
about 1 year ago
Bloom-560M.Q3_K_L.gguf
Safe
507 MB
LFS
GGUF model commit (made with llama.cpp commit fe680e3)
about 1 year ago
Bloom-560M.Q3_K_M.gguf
Safe
493 MB
LFS
GGUF model commit (made with llama.cpp commit fe680e3)
about 1 year ago
Bloom-560M.Q3_K_S.gguf
Safe
465 MB
LFS
GGUF model commit (made with llama.cpp commit fe680e3)
about 1 year ago
Bloom-560M.Q4_0.gguf
Safe
539 MB
LFS
GGUF model commit (made with llama.cpp commit fe680e3)
about 1 year ago
Bloom-560M.Q4_K.gguf
Safe
561 MB
LFS
GGUF model commit (made with llama.cpp commit fe680e3)
about 1 year ago
Bloom-560M.Q4_K_M.gguf
Safe
561 MB
LFS
GGUF model commit (made with llama.cpp commit fe680e3)
about 1 year ago
Bloom-560M.Q4_K_S.gguf
Safe
541 MB
LFS
GGUF model commit (made with llama.cpp commit fe680e3)
about 1 year ago
Bloom-560M.Q5_1.gguf
Safe
644 MB
LFS
GGUF model commit (made with llama.cpp commit fe680e3)
about 1 year ago
Bloom-560M.Q5_K.gguf
Safe
626 MB
LFS
GGUF model commit (made with llama.cpp commit fe680e3)
about 1 year ago
Bloom-560M.Q5_K_M.gguf
Safe
626 MB
LFS
GGUF model commit (made with llama.cpp commit fe680e3)
about 1 year ago
Bloom-560M.Q5_K_S.gguf
Safe
609 MB
LFS
GGUF model commit (made with llama.cpp commit fe680e3)
about 1 year ago
Bloom-560M.Q6_K.gguf
Safe
683 MB
LFS
GGUF model commit (made with llama.cpp commit fe680e3)
about 1 year ago
Bloom-560M.Q8_0.gguf
Safe
881 MB
LFS
GGUF model commit (made with llama.cpp commit fe680e3)
about 1 year ago