Hugging Face's logo

legraphista
/
Qwen2.5-32B-Instruct-IMat-GGUF

Text Generation
GGUF
English
chat
quantized
GGUF
quantization
imat
imatrix
static
16bit
8bit
6bit
5bit
4bit
3bit
2bit
1bit
conversational
Model card Files Community
Qwen2.5-32B-Instruct-IMat-GGUF
File size: 3,717 Bytes 
87a7e54
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
195f9be
b66ed5b
0f40c42
badbe63
78d3414
6105a1c
5a54687
f3ad9df
e2df34a
8e3d76a
657b27e
4d09636
3b44128
9d16155
6d77593
98b2f6f
a222e47
a8c803d
c3484c0
d39e39c
3feedd0
2e1b3a5
d79268c
77abdb0
9d52a98
2e7af69
708c338
dbc0de1
dea848d
 
1
2
3
4
5
6
7
8
9
10
11
12
13
14
15
16
17
18
19
20
21
22
23
24
25
26
27
28
29
30
31
32
33
34
35
36
37
38
39
40
41
42
43
44
45
46
47
48
49
50
51
52
53
54
55
56
57
58
59
60
61
62
63
64
65
 
*.7z filter=lfs diff=lfs merge=lfs -text
*.arrow filter=lfs diff=lfs merge=lfs -text
*.bin filter=lfs diff=lfs merge=lfs -text
*.bz2 filter=lfs diff=lfs merge=lfs -text
*.ckpt filter=lfs diff=lfs merge=lfs -text
*.ftz filter=lfs diff=lfs merge=lfs -text
*.gz filter=lfs diff=lfs merge=lfs -text
*.h5 filter=lfs diff=lfs merge=lfs -text
*.joblib filter=lfs diff=lfs merge=lfs -text
*.lfs.* filter=lfs diff=lfs merge=lfs -text
*.mlmodel filter=lfs diff=lfs merge=lfs -text
*.model filter=lfs diff=lfs merge=lfs -text
*.msgpack filter=lfs diff=lfs merge=lfs -text
*.npy filter=lfs diff=lfs merge=lfs -text
*.npz filter=lfs diff=lfs merge=lfs -text
*.onnx filter=lfs diff=lfs merge=lfs -text
*.ot filter=lfs diff=lfs merge=lfs -text
*.parquet filter=lfs diff=lfs merge=lfs -text
*.pb filter=lfs diff=lfs merge=lfs -text
*.pickle filter=lfs diff=lfs merge=lfs -text
*.pkl filter=lfs diff=lfs merge=lfs -text
*.pt filter=lfs diff=lfs merge=lfs -text
*.pth filter=lfs diff=lfs merge=lfs -text
*.rar filter=lfs diff=lfs merge=lfs -text
*.safetensors filter=lfs diff=lfs merge=lfs -text
saved_model/**/* filter=lfs diff=lfs merge=lfs -text
*.tar.* filter=lfs diff=lfs merge=lfs -text
*.tar filter=lfs diff=lfs merge=lfs -text
*.tflite filter=lfs diff=lfs merge=lfs -text
*.tgz filter=lfs diff=lfs merge=lfs -text
*.wasm filter=lfs diff=lfs merge=lfs -text
*.xz filter=lfs diff=lfs merge=lfs -text
*.zip filter=lfs diff=lfs merge=lfs -text
*.zst filter=lfs diff=lfs merge=lfs -text
*tfevents* filter=lfs diff=lfs merge=lfs -text
Qwen2.5-32B-Instruct.Q8_0.gguf filter=lfs diff=lfs merge=lfs -text
Qwen2.5-32B-Instruct.Q6_K.gguf filter=lfs diff=lfs merge=lfs -text
Qwen2.5-32B-Instruct.Q5_K.gguf filter=lfs diff=lfs merge=lfs -text
imatrix.dat filter=lfs diff=lfs merge=lfs -text
Qwen2.5-32B-Instruct.BF16/Qwen2.5-32B-Instruct.BF16-00003-of-00003.gguf filter=lfs diff=lfs merge=lfs -text
Qwen2.5-32B-Instruct.Q5_K_S.gguf filter=lfs diff=lfs merge=lfs -text
Qwen2.5-32B-Instruct.BF16/Qwen2.5-32B-Instruct.BF16-00002-of-00003.gguf filter=lfs diff=lfs merge=lfs -text
Qwen2.5-32B-Instruct.FP16/Qwen2.5-32B-Instruct.FP16-00002-of-00003.gguf filter=lfs diff=lfs merge=lfs -text
Qwen2.5-32B-Instruct.BF16/Qwen2.5-32B-Instruct.BF16-00001-of-00003.gguf filter=lfs diff=lfs merge=lfs -text
Qwen2.5-32B-Instruct.FP16/Qwen2.5-32B-Instruct.FP16-00003-of-00003.gguf filter=lfs diff=lfs merge=lfs -text
Qwen2.5-32B-Instruct.Q3_K.gguf filter=lfs diff=lfs merge=lfs -text
Qwen2.5-32B-Instruct.Q4_K.gguf filter=lfs diff=lfs merge=lfs -text
Qwen2.5-32B-Instruct.FP16/Qwen2.5-32B-Instruct.FP16-00001-of-00003.gguf filter=lfs diff=lfs merge=lfs -text
Qwen2.5-32B-Instruct.Q2_K.gguf filter=lfs diff=lfs merge=lfs -text
Qwen2.5-32B-Instruct.Q3_K_S.gguf filter=lfs diff=lfs merge=lfs -text
Qwen2.5-32B-Instruct.Q4_K_S.gguf filter=lfs diff=lfs merge=lfs -text
Qwen2.5-32B-Instruct.Q3_K_L.gguf filter=lfs diff=lfs merge=lfs -text
Qwen2.5-32B-Instruct.Q2_K_S.gguf filter=lfs diff=lfs merge=lfs -text
Qwen2.5-32B-Instruct.IQ3_M.gguf filter=lfs diff=lfs merge=lfs -text
Qwen2.5-32B-Instruct.IQ4_XS.gguf filter=lfs diff=lfs merge=lfs -text
Qwen2.5-32B-Instruct.IQ3_XXS.gguf filter=lfs diff=lfs merge=lfs -text
Qwen2.5-32B-Instruct.IQ3_S.gguf filter=lfs diff=lfs merge=lfs -text
Qwen2.5-32B-Instruct.IQ3_XS.gguf filter=lfs diff=lfs merge=lfs -text
Qwen2.5-32B-Instruct.IQ2_S.gguf filter=lfs diff=lfs merge=lfs -text
Qwen2.5-32B-Instruct.IQ2_M.gguf filter=lfs diff=lfs merge=lfs -text
Qwen2.5-32B-Instruct.IQ2_XS.gguf filter=lfs diff=lfs merge=lfs -text
Qwen2.5-32B-Instruct.IQ2_XXS.gguf filter=lfs diff=lfs merge=lfs -text
Qwen2.5-32B-Instruct.IQ1_M.gguf filter=lfs diff=lfs merge=lfs -text
Qwen2.5-32B-Instruct.IQ1_S.gguf filter=lfs diff=lfs merge=lfs -text