Hugging Face
Models
Datasets
Spaces
Posts
Docs
Enterprise
Pricing
Log In
Sign Up
RefalMachine
/
RuadaptQwen2.5-32B-QWQ-Beta-GGUF
like
3
GGUF
conversational
Model card
Files
Files and versions
Community
Deploy
Use this model
No model card
Downloads last month
321
GGUF
Model size
32.7B params
Architecture
qwen2
Chat template
Hardware compatibility
Log In
to view the estimation
2-bit
Q2_K
12.3 GB
3-bit
IQ3_S
14.4 GB
Q3_K_S
14.4 GB
Q3_K_M
15.9 GB
4-bit
IQ4_XS
17.8 GB
Q4_K_S
18.8 GB
IQ4_NL
18.8 GB
Q4_0
18.6 GB
Q4_K_M
19.8 GB
5-bit
Q5_K_S
22.6 GB
Q5_0
22.6 GB
Q5_K_M
23.2 GB
6-bit
Q6_K
26.8 GB
8-bit
Q8_0
34.8 GB
View +1 variant
Inference Providers
NEW
This model isn't deployed by any Inference Provider.
๐
Ask for provider support
HF Inference deployability: The model has no library tag.
Collection including
RefalMachine/RuadaptQwen2.5-32B-QWQ-Beta-GGUF
Ruadapt Reasoning
Collection
6 items
โข
Updated
Mar 10