Hugging Face
Models
Datasets
Spaces
Posts
Docs
Enterprise
Pricing
Log In
Sign Up
MaziyarPanahi
/
OgnoExperiment27-7B-GGUF
like
0
Text Generation
Transformers
GGUF
Safetensors
mistral
quantized
2-bit
3-bit
4-bit precision
5-bit
6-bit
8-bit precision
GGUF
mergekit
Merge
Inference Endpoints
text-generation-inference
License:
apache-2.0
Model card
Files
Files and versions
Community
1
Train
Deploy
Use this model
1bdc2d8
OgnoExperiment27-7B-GGUF
1 contributor
History:
11 commits
MaziyarPanahi
26752b9e0f7f0026089ebb740b0e8a07f3cc0fee55b329410bb979f27e8f5bf4
1bdc2d8
verified
10 months ago
.gitattributes
2.2 kB
26752b9e0f7f0026089ebb740b0e8a07f3cc0fee55b329410bb979f27e8f5bf4
10 months ago
OgnoExperiment27-7B.IQ3_XS.gguf
3.02 GB
LFS
b2708293b8229bb6e9f1d442689322e7bfa6f582e1fceb6ab299c4812fee5988
10 months ago
OgnoExperiment27-7B.IQ4_XS.gguf
3.94 GB
LFS
259aebe224fcf080dff54a1a18a7006e94ffdf4f2d0a3eb92ed670f3bb054ca7
10 months ago
OgnoExperiment27-7B.Q2_K.gguf
2.72 GB
LFS
bfbdda58e85accc04681a3f364daf80a438819f253b72bfd45d6d6e759ebdb91
10 months ago
OgnoExperiment27-7B.Q3_K_L.gguf
3.82 GB
LFS
db7737a03b0460da0e12cd6d645eb41a2b939663ee95d029f0b42b1ccf925e75
10 months ago
OgnoExperiment27-7B.Q3_K_M.gguf
3.52 GB
LFS
44ed26447a2411214f0c2ee8ee0d453a31b677ca746c57c4ce57e7fd5345a9da
10 months ago
OgnoExperiment27-7B.Q3_K_S.gguf
3.16 GB
LFS
830cb308998af1039aeb54790d6f63b658c2745c44cdc92bbd06e90925092b9b
10 months ago
OgnoExperiment27-7B.Q4_K_M.gguf
4.37 GB
LFS
ac65a86c90b69cc98005b24264d035132b8ae854f3242a4e1ce7324e285703bf
10 months ago
OgnoExperiment27-7B.Q4_K_S.gguf
4.14 GB
LFS
28fa70a7f91aef669270a83b38fa87f23e9f3385de1104879cf18767e1bfb9e7
10 months ago
OgnoExperiment27-7B.Q5_K_M.gguf
5.13 GB
LFS
2074cd6846398370d896886dfafc4ce13134f198ce3017b6600a0e47f8e002f9
10 months ago
OgnoExperiment27-7B.Q5_K_S.gguf
5 GB
LFS
26752b9e0f7f0026089ebb740b0e8a07f3cc0fee55b329410bb979f27e8f5bf4
10 months ago
