Hugging Face's logo

MaziyarPanahi
/
calme-3.2-instruct-3b-GGUF

Text Generation
GGUF
mistral
quantized
2-bit
3-bit
4-bit precision
5-bit
6-bit
8-bit precision
GGUF
conversational
Model card Files Community
3

Upload folder using huggingface_hub

#2
by MaziyarPanahi - opened
base: refs/heads/main
←
from: refs/pr/2
Discussion Files changed
+14
-15
Files changed (5) hide show
  1. README.md +6 -7
  2. calme-3.2-instruct-3b.Q5_K_M.gguf +2 -2
  3. calme-3.2-instruct-3b.Q6_K.gguf +2 -2
  4. calme-3.2-instruct-3b.Q8_0.gguf +2 -2
  5. calme-3.2-instruct-3b.fp16.gguf +2 -2
README.md CHANGED
@@ -1,4 +1,10 @@
1
  ---
 
 
 
 
 
 
2
  tags:
3
  - quantized
4
  - 2-bit
@@ -9,13 +15,6 @@ tags:
9
  - 8-bit
10
  - GGUF
11
  - text-generation
12
- - text-generation
13
- model_name: calme-3.2-instruct-3b-GGUF
14
- base_model: MaziyarPanahi/calme-3.2-instruct-3b
15
- inference: false
16
- model_creator: MaziyarPanahi
17
- pipeline_tag: text-generation
18
- quantized_by: MaziyarPanahi
19
  ---
20
  # [MaziyarPanahi/calme-3.2-instruct-3b-GGUF](https://huggingface.co/MaziyarPanahi/calme-3.2-instruct-3b-GGUF)
21
  - Model creator: [MaziyarPanahi](https://huggingface.co/MaziyarPanahi)
 
1
  ---
2
+ base_model: MaziyarPanahi/calme-3.2-instruct-3b
3
+ inference: false
4
+ model_creator: MaziyarPanahi
5
+ model_name: calme-3.2-instruct-3b-GGUF
6
+ pipeline_tag: text-generation
7
+ quantized_by: MaziyarPanahi
8
  tags:
9
  - quantized
10
  - 2-bit
 
15
  - 8-bit
16
  - GGUF
17
  - text-generation
 
 
 
 
 
 
 
18
  ---
19
  # [MaziyarPanahi/calme-3.2-instruct-3b-GGUF](https://huggingface.co/MaziyarPanahi/calme-3.2-instruct-3b-GGUF)
20
  - Model creator: [MaziyarPanahi](https://huggingface.co/MaziyarPanahi)
calme-3.2-instruct-3b.Q5_K_M.gguf CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:0d50102755dbd14f2cfd668601d2c209fa1fbfa489b57ac733041c81874ebc25
3
- size 2225423520
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:86da249bfbd8bce5423c42ce81e55f938be9344593ecc3fbf96363f46703f049
3
+ size 2224815264
calme-3.2-instruct-3b.Q6_K.gguf CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:61025a7ef7c47aa50df08330cdaf59b30d671ef39ad6170419c2e2dd75eeb4dc
3
- size 2538767520
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:bd3ceb7a1eea4323bad00ff71ab07144d8c25c3120905629def5eada606b28e5
3
+ size 2538159264
calme-3.2-instruct-3b.Q8_0.gguf CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:0ade8cff2368882624e0563da866b16207f0c100a57e146ce999f6e376986ac3
3
- size 3286084768
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:764958c2be4316cba02cc1322a8b183b28d40f202c0784d3d10613c7d203bc97
3
+ size 3285476512
calme-3.2-instruct-3b.fp16.gguf CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:ce57babecfb1b14c8f8094bcf5a7aa9efe5717e169ea70ea65c2d79c82016c54
3
- size 6178925472
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:1d7c6593cfe4260732b6a5c77b85539758fc4bc70790d3344e362969061ef3ac
3
+ size 6178317472