Hugging Face
Models
Datasets
Spaces
Posts
Docs
Solutions
Pricing
Log In
Sign Up
MaziyarPanahi
/
Experiment26Yamshadow-7B-GGUF
like
0
Text Generation
Transformers
GGUF
Safetensors
mistral
quantized
2-bit
3-bit
4-bit precision
5-bit
6-bit
8-bit precision
GGUF
Merge
mergekit
lazymergekit
automerger
Inference Endpoints
text-generation-inference
License:
apache-2.0
Model card
Files
Files and versions
Community
1
Train
Deploy
Use this model
16c6179
Experiment26Yamshadow-7B-GGUF
1 contributor
History:
12 commits
MaziyarPanahi
dc76105736e116901ffbf1ca975d5352f9c916655835e466e570dab0d9a7bd67
16c6179
verified
7 months ago
.gitattributes
2.32 kB
dc76105736e116901ffbf1ca975d5352f9c916655835e466e570dab0d9a7bd67
7 months ago
Experiment26Yamshadow-7B.IQ3_XS.gguf
3.02 GB
LFS
39f0672f05ad12547b372c94e0e3ea046a7b429750f141923785af3a1b57c709
7 months ago
Experiment26Yamshadow-7B.IQ4_XS.gguf
3.94 GB
LFS
cf35bc3d7dba974e0aa9027af09e00b299c5b76ed1d78c6d19ebb7ea61b53ca5
7 months ago
Experiment26Yamshadow-7B.Q2_K.gguf
2.72 GB
LFS
d357ef9c0512046229456d5232b0d5f56aed021406ca4a57fc0a99cda1ba35c6
7 months ago
Experiment26Yamshadow-7B.Q3_K_L.gguf
3.82 GB
LFS
80f447b760d878ae4dcacdfd12041eace5878b00ffde0a468218b7e03ff9bd2b
7 months ago
Experiment26Yamshadow-7B.Q3_K_M.gguf
3.52 GB
LFS
35624dafc91040570d60f4bff8b00283bee8fb322c9f3a2da01c393ba8081b7d
7 months ago
Experiment26Yamshadow-7B.Q3_K_S.gguf
3.16 GB
LFS
95e64ab43d875f9be70d26b0791c0cbb7dba10036b08c9227c3227cf58c237d9
7 months ago
Experiment26Yamshadow-7B.Q4_K_M.gguf
4.37 GB
LFS
e2f4d369059eee8d3c7fdc2b1bff0d3d9869e8d0cf7114a9c74c661177f29583
7 months ago
Experiment26Yamshadow-7B.Q4_K_S.gguf
4.14 GB
LFS
ff686df4c6ee2e68a66fa7a314214655bd64dd0a56f8f1d4cc44ec63e9fb3e1e
7 months ago
Experiment26Yamshadow-7B.Q5_K_M.gguf
5.13 GB
LFS
ff3c6f44befa3c66a3a43566726d74679d2fbd5e307bb733395dee105bac8caf
7 months ago
Experiment26Yamshadow-7B.Q5_K_S.gguf
5 GB
LFS
f598744679c5e498783b273a51ee71195743023ef66e630dabc6157437342d8f
7 months ago
Experiment26Yamshadow-7B.Q6_K.gguf
5.94 GB
LFS
dc76105736e116901ffbf1ca975d5352f9c916655835e466e570dab0d9a7bd67
7 months ago