Hugging Face
Models
Datasets
Spaces
Posts
Docs
Enterprise
Pricing
Log In
Sign Up
MaziyarPanahi
/
Calme-7B-Instruct-v0.5-GGUF
like
2
Text Generation
Transformers
GGUF
Safetensors
mistral
quantized
2-bit
3-bit
4-bit precision
5-bit
6-bit
8-bit precision
GGUF
Generated from Trainer
7b
calme
conversational
text-generation-inference
License:
apache-2.0
Model card
Files
Files and versions
Community
1
Train
Deploy
Use this model
c5f0300
Calme-7B-Instruct-v0.5-GGUF
1 contributor
History:
8 commits
MaziyarPanahi
e28bd234dbd9f4f998685b72cbd8cb46ab9cfdb0729c922f47deab41e0d7649d
c5f0300
verified
10 months ago
.gitattributes
2.01 kB
e28bd234dbd9f4f998685b72cbd8cb46ab9cfdb0729c922f47deab41e0d7649d
10 months ago
Calme-7B-Instruct-v0.5.IQ4_XS.gguf
3.94 GB
LFS
3d6c0d536a01e77744d7d6fb57bbfedef8521824439a4f04158c6e34df775ddf
10 months ago
Calme-7B-Instruct-v0.5.Q2_K.gguf
2.72 GB
LFS
5049c882f51e1aafdc2af8a54a06a6c5ab3cb6cb81559c7bc484fbaa0061ca7e
10 months ago
Calme-7B-Instruct-v0.5.Q3_K_L.gguf
3.82 GB
LFS
686a81b135720d7ac931167769c7da6f029ffc3452dc96e0821ebcb177fbb888
10 months ago
Calme-7B-Instruct-v0.5.Q3_K_M.gguf
3.52 GB
LFS
bc73b90f547e7def57523238cc4b45b911aec11bc9dc217e80fb21706b9a64e6
10 months ago
Calme-7B-Instruct-v0.5.Q3_K_S.gguf
3.16 GB
LFS
c1569134a09c418f5eff39ded704ce80c37407fb45ea22699b6fed4a42952dcf
10 months ago
Calme-7B-Instruct-v0.5.Q4_K_M.gguf
4.37 GB
LFS
a7c775ede0d5bb388989374ce09aa518f3ce7486603add3e210d84700ed5fc16
10 months ago
Calme-7B-Instruct-v0.5.Q4_K_S.gguf
4.14 GB
LFS
e28bd234dbd9f4f998685b72cbd8cb46ab9cfdb0729c922f47deab41e0d7649d
10 months ago